Oracle BDA iPython, Notebook and Jupytar Configuration

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to install iPython/Notebook on an Oracle BDA Install the below packages

add parcels in CDH GUI parcel address

donwload, distrubite, activate System startup script

source http://www.cloudera.com/documentation/enterprise/latest/topics/spark_ipython.html

Read More

To increase SPARK kyroserializer.buffer.max

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

To address error like the one below

In CDH under SPARK look for spark-defaults.conf, add the below

Deploy the config once done the modify Note: The file below gets modified /etc/spark/conf/spark-defaults.conf

Read More

ELK and Kafka Zookeeper Configuration on Oracle BDA

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

First lets configure Kafka Note: In Kafka 8.1 (and lower) you can not delete a topic, make sure to update to a latter version then 8.2+ Modify the below Kafka settings

To make kafka listing on all interfaces

First lets create a topic Note: The instructions below is missing initial zookeeper setup which […]

Read More

How to configure beeline for hive on remote client

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

http://www.oracle.com/technetwork/java/javase/downloads/jce-7-download-432124.html

Source https://docs.oracle.com/cd/E63064_01/doc.42/e63062/users.htm#BIGUG328

Read More

How to load/add a jar file in Hive – Installing JSONSerDe in a CDH environment

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to install, configure Json capability in CDH distribution The Cloudera(CDH) distribution is not coming with json capability, in order to use that you will need to add/install your own There are 3 options to add/load a jar file if you use the cloudera(CDH) distribution add yourjar.jar Create an .hiverc, an example in the link […]

Read More

Hadoop hdfs (BDA) setting extended ACL’s

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to set extended ACL’s

Check extended ACL’s

Set the mask to get the full default inherent access

Reference https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/FileSystemShell.html

Read More