DevTech101

DevTech101

How to install iPython/Notebook on an Oracle BDA

Install the below packages

pip install 
ibackports.ssl_match_hostname-3.5.0.1.tar.gz
ipython-1.2.1.tar.gz
pyzmq-15.2.0.zip
tornado-3.2.1.tar.gz

add parcels in CDH GUI parcel address

Remote Parcel Repository URLs
https://repo.continuum.io/pkgs/misc/parcels/

donwload, distrubite, activate

System startup script

/usr/local/notebook/bin/start_notebook.sh
#!/bin/bash

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/rh/python27/root/usr/lib64
export PATH=/opt/rh/python27/root/usr/bin:$PATH

# Notebook
export PYSPARK_DRIVER_PYTHON=ipython
export PYSPARK_DRIVER_PYTHON_OPTS="notebook --NotebookApp.open_browser=False --NotebookApp.ip='*' --NotebookApp.port=8880"

# Jupyter
#export PYSPARK_DRIVER_PYTHON=/opt/cloudera/parcels/Anaconda/bin/jupyter
#export PYSPARK_PYTHON=/opt/cloudera/parcels/Anaconda/bin/python
#export PYSPARK_DRIVER_PYTHON_OPTS="notebook --NotebookApp.open_browser=False --NotebookApp.ip='*' --NotebookApp.port=8880"

cd /usr/local/notebook/notebook_data
nohup /usr/bin/pyspark &

source
http://www.cloudera.com/documentation/enterprise/latest/topics/spark_ipython.html

0 0 votes
Article Rating
Subscribe
Notify of
guest
2 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Meher Bezawada
Meher Bezawada
April 9, 2018 1:35 pm

BDA 4.11 currently uses Python2.6.6 and does PATH setting to use 2.7 cause any issues?

2
0
Would love your thoughts, please comment.x
()
x
%d bloggers like this: