JupyterHub

Jupyterhub cannot start server - 500 error

不问归期 提交于 2019-12-12 04:10:39
问题 I am trying to run jupyter hub for multiuser mode. I installed jupyterhub from PIP. [root@ip-of-machine hadoop]# echo $PATH /usr/local/bin/jupyterhub-singleuser:/usr/local/bin/jupyterhub:/sbin:/bin:/usr/sbin:/usr/bin:/opt/aws/bin When I tun jupyterhub I get an error saying 500 : Internal Server Error Failed to start your server. Please contact admin. I ran it as [root@ip-of-machine hadoop]# /usr/local/bin/jupyterhub -f ./jupyterhub/jupyterhub_config.py --no-ssl The logs contain [I 2016-05-03

How do I set parameters for each notebook on JuPyterHub running on K8s

倾然丶 夕夏残阳落幕 提交于 2019-12-11 15:57:43
问题 I want to set some parameters as defined here(https://github.com/nteract/papermill#python-version-support). The catch is, I want to be able to do this via UI. I have a JHub installed on my cluster and while opening it, I want certain parameters to be set by default. Also, when I pass the parameters via papermill(the above script gets saved somewhere and then I will run it via papermill), I want the latter to override the former. I tried looking into several topics in pure JuPyter notebooks

How to have file written automatically in the startup folder when a new user signs up/in on JuPyter hub?

时光怂恿深爱的人放手 提交于 2019-12-11 15:17:33
问题 I am using JuPyter hub on k8s. It has a persistent volume claim. I want to have my users use a variable run_id = "sample" every time they use jupyter notebook. Doing so requires making a file aviral.py in the path /home/jovyan/.ipython/profile_default/startup with the content run_id = "sample" . I have to do this manually and would want this to be done as soon as the new user's pod is created for the first time i.e. the file gets written there itself. Is there any way to automate this?

Set Volume Permissions in Multi-Tenant Kubernetes Cluster

流过昼夜 提交于 2019-12-11 04:14:15
问题 Situation: - users A, B, C, D - team 1: user A, user B - team 2: user C, user D Desired: - each user has private volume - each team has a shared volume --> users in team can see shared volume - some users, based on permission, can see both shared volumes Searched for quite some time now, do not see a solution in the Docs. Ideas: - Use Namespaces! problem --> can no longer see shared volume of other Namespace 回答1: This is an example of how you would do it. You can use namespaces for the

pandas.read_clipboard from cloud-hosted jupyter?

孤街浪徒 提交于 2019-12-10 15:38:41
问题 I am running a Data8 instance of JupyterHub running JupyterLab on a server, and pd.read_clipboard() does not seem to work. I see the same problem in google colab. import pandas as pd pd.read_clipboard() errors out like so: --------------------------------------------------------------------------- PyperclipException Traceback (most recent call last) <ipython-input-2-8cbad928c47b> in <module>() ----> 1 pd.read_clipboard() /opt/conda/lib/python3.6/site-packages/pandas/io/clipboards.py in read

two factor authentication with username and password for a Jupyter Notebook server

自闭症网瘾萝莉.ら 提交于 2019-12-08 21:57:29
I've setup a Jupyter Notebook server with appropriate password and SSL so it is accessed via HTTPS. However, I'm looking now for a way to enforce a two factor authentication with username and password for loging in. The current Jupyter Notebook server only asks for a password and I hence have to create a shared one (no username though). I know about JupyterHub, but at the moment I'm looking for a way to add a username (or multiple usernames) and correspond password (passwords), so that everyone can access the same work space without necessarily having credentials on the Linux server side. Is

Can't reach Jupyter Notebooks on Azure Deep Learning Virtual Machine

牧云@^-^@ 提交于 2019-12-08 08:05:51
问题 I followed the instructions here. I am on the Ubuntu VM via SSH. I tried to access IP:8000 but Chrome says the Site can't be reached. Port 8000 is indeed open by default as mentioned in the docs. Instructions don't mention if I have to start jupyterhub so I tried that and got this error - username@fastai:~ $ jupyterhub [I 2018-04-02 00:25:41.018 JupyterHub app:871] Writing cookie_secret to /home/username/jupyterhub_cookie_secret [I 2018-04-02 00:25:41.036 alembic.runtime.migration migration

two factor authentication with username and password for a Jupyter Notebook server

♀尐吖头ヾ 提交于 2019-12-08 06:09:27
问题 I've setup a Jupyter Notebook server with appropriate password and SSL so it is accessed via HTTPS. However, I'm looking now for a way to enforce a two factor authentication with username and password for loging in. The current Jupyter Notebook server only asks for a password and I hence have to create a shared one (no username though). I know about JupyterHub, but at the moment I'm looking for a way to add a username (or multiple usernames) and correspond password (passwords), so that

使用Kubeadm Upgrade更新Kubernetes集群的过程

冷暖自知 提交于 2019-12-06 05:50:04
操作系统用的Ubuntu18.04,装了JupyterHub,启动 Notebook镜像后自动退出。经过排查,发现是因为使用的Notebook镜像不对,后来更新了下,就可以用了。 不过,在此之前,怀疑是Kubernetes版本较低(另外一台Kubernetes1.11.2的机器没有这个问题),所以 就想把Kubernetes更新一下 。 Kubernetes项目有个Kubeadm工具,按其描述是支持直接更新的。不过,之前用过一次,总是报版本不对,这次就比较小心,最终升级成功。 步骤: 运行kubeadm upgrade plan看看是否可以升级。 把kubernetes 1.11.2的镜像提前下载好,可以使用 https://github.com/openthings/kubernetes-tools/kubeadm/allimages-pull-aliyun.sh 脚本从阿里云下载。 升级kubeadm到1.11.2版本,使用 sudo apt install kubeadm=v1.11.2-00 安装。 注意, 此后千万不要重启机器 ,否则再起来时因为kubelet被更新,集群无法访问,kubeadm upgrade运行也就失败了(这个设计应该是有问题的,如果不起动kubelet服务也可以更新就好了)。 运行 sudo kubeadm upgrade apply v1.11.2

Docker build-容器构建加速攻略

…衆ロ難τιáo~ 提交于 2019-12-05 23:05:53
容器构建时需要下载多种软件,往往这是非常耗时间的。hub.docker.com本来就慢,尤其是遇到存放在gcr.io/aws等上面的模块就挂了,pip安装python模块是也较慢,conda的下载更是如蜗牛。 加快容器构建时的下载速度,有多种方法: 1、放在“外面的服务器”构建,然后传送到aliyun等镜像,下载速度就会快很多很多。 步骤可以参考: 在阿里云创建Kubernetetes-1.11.0镜像服务(高速) 系统盘不够的话,参考: 如何给容器服务的Docker增加数据盘 2、添加proxy和pip、conda的镜像。如下是给jupyterhub环境下使用构建的一个singleuser镜像。 # Copyright (c) Jupyter Development Team. # Distributed under the terms of the Modified BSD License. FROM jupyter/all-spark-notebook:5811dcb711ba LABEL maintainer="Databook Project,https://github.com/databooks<openthings@163.com>" USER root # ======================================================