Oracle BDA iPython, Notebook and Jupytar Configuration

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to install iPython/Notebook on an Oracle BDA

Install the below packages

pip install 
ibackports.ssl_match_hostname-3.5.0.1.tar.gz
ipython-1.2.1.tar.gz
pyzmq-15.2.0.zip
tornado-3.2.1.tar.gz

add parcels in CDH GUI parcel address

Remote Parcel Repository URLs
https://repo.continuum.io/pkgs/misc/parcels/

donwload, distrubite, activate

System startup script

/usr/local/notebook/bin/start_notebook.sh
#!/bin/bash

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/rh/python27/root/usr/lib64
export PATH=/opt/rh/python27/root/usr/bin:$PATH

# Notebook
export PYSPARK_DRIVER_PYTHON=ipython
export PYSPARK_DRIVER_PYTHON_OPTS="notebook --NotebookApp.open_browser=False --NotebookApp.ip='*' --NotebookApp.port=8880"

# Jupyter
#export PYSPARK_DRIVER_PYTHON=/opt/cloudera/parcels/Anaconda/bin/jupyter
#export PYSPARK_PYTHON=/opt/cloudera/parcels/Anaconda/bin/python
#export PYSPARK_DRIVER_PYTHON_OPTS="notebook --NotebookApp.open_browser=False --NotebookApp.ip='*' --NotebookApp.port=8880"

cd /usr/local/notebook/notebook_data
nohup /usr/bin/pyspark &

source
http://www.cloudera.com/documentation/enterprise/latest/topics/spark_ipython.html

2
Leave a Reply

avatar
3000
1 Comment threads
1 Thread replies
0 Followers
 
Most reacted comment
Hottest comment thread
2 Comment authors
Eli KleinmanMeher Bezawada Recent comment authors
  Subscribe  
newest oldest most voted
Notify of
Meher Bezawada
Guest
Meher Bezawada

BDA 4.11 currently uses Python2.6.6 and does PATH setting to use 2.7 cause any issues?