dsx

Is it possible for a spark job on bluemix to see a list of the other processes on the operating system?

由 旧城冷巷雨未停 提交于 2019-12-24 17:06:34
问题 A common approach for connecting to third party systems from spark is to provide the credentials for the systems as arguments to the spark script. However, this raises some questions about security. E.g. See this question Bluemix spark-submit -- How to secure credentials needed by my Scala jar Is it possible for a spark job running on bluemix to see a list of the other processes on the operating system? I.e. Can a job run the equivalent of ps -awx to inspect the processes running on the spark

matplotlib - ImportError: No module named _tkinter

由 我的未来我决定 提交于 2019-12-11 08:45:13
问题 I have a simple notebook with the following code: %matplotlib inline However, when running it I get the following error: ImportError: No module named _tkinter I have another notebook in the same project, and that one is able to run the statement without issue. The data science experience is a managed service so you don't have root access to install _tkinter. Full stacktrace: ImportErrorTraceback (most recent call last) <ipython-input-43-5f9c00ae8c2d> in <module>() ----> 1 get_ipython().magic

install.packages(“tm”) -> “dependency 'slam' is not available”

由 北城余情 提交于 2019-12-02 18:22:36
问题 I'm trying to install the tm package on IBM's Data Science Experience (DSX): install.packages("tm") However, I'm hitting this issue: "dependency 'slam' is not available" This post suggests that R version 3.3.1 will resolve the issue, however the R version on DSX is: R version 3.3.0 (2016-05-03) How can I resolve this issue on IBM DSX? Note that you don't have root access on DSX. I've seen similar questions on stackoverflow, but none are asking how to fix the issue on IBM DSX, e.g. dependency

install.packages(“tm”) -> “dependency 'slam' is not available”

由 岁酱吖の 提交于 2019-12-02 08:48:10
I'm trying to install the tm package on IBM's Data Science Experience (DSX): install.packages("tm") However, I'm hitting this issue: "dependency 'slam' is not available" This post suggests that R version 3.3.1 will resolve the issue, however the R version on DSX is: R version 3.3.0 (2016-05-03) How can I resolve this issue on IBM DSX? Note that you don't have root access on DSX. I've seen similar questions on stackoverflow, but none are asking how to fix the issue on IBM DSX, e.g. dependency ‘slam’ is not available when installing TM package Update: install.packages("slam") Returns: Installing

How to troubleshoot a DSX scheduled notebook?

由 社会主义新天地 提交于 2019-11-28 13:05:26
I have a DSX notebook that I can run manually usng the DSX user interface and it populates some data in a Cloudant database. I have scheduled the notebook to run hourly. Overnight I would have expected the job to have run many times, but the Cloudant database has not been updated. How can I debug the scheduled job? Are there any logs that I can check to verify that the notebook has actually been executed? Is the output from my notebook saved to log files? Where can I find these files? One possibility is to look into the kernel logs of your notebook kernel. For that you need to use a Python

How to troubleshoot a DSX scheduled notebook?

由 六眼飞鱼酱① 提交于 2019-11-27 07:25:00
问题 I have a DSX notebook that I can run manually usng the DSX user interface and it populates some data in a Cloudant database. I have scheduled the notebook to run hourly. Overnight I would have expected the job to have run many times, but the Cloudant database has not been updated. How can I debug the scheduled job? Are there any logs that I can check to verify that the notebook has actually been executed? Is the output from my notebook saved to log files? Where can I find these files? 回答1:
订阅 dsx