Oracle BDA iPython, Notebook and Jupytar Configuration

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to install iPython/Notebook on an Oracle BDA Install the below packages

add parcels in CDH GUI parcel address

donwload, distrubite, activate System startup script

source http://www.cloudera.com/documentation/enterprise/latest/topics/spark_ipython.html

Read More

To increase SPARK kyroserializer.buffer.max

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

To address error like the one below

In CDH under SPARK look for spark-defaults.conf, add the below

Deploy the config once done the modify Note: The file below gets modified /etc/spark/conf/spark-defaults.conf

Read More

How to configure beeline for hive on remote client

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

http://www.oracle.com/technetwork/java/javase/downloads/jce-7-download-432124.html

Source https://docs.oracle.com/cd/E63064_01/doc.42/e63062/users.htm#BIGUG328

Read More

How to load/add a jar file in Hive – Installing JSONSerDe in a CDH environment

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to install, configure Json capability in CDH distribution The Cloudera(CDH) distribution is not coming with json capability, in order to use that you will need to add/install your own There are 3 options to add/load a jar file if you use the cloudera(CDH) distribution add yourjar.jar Create an .hiverc, an example in the link […]

Read More

Hadoop hdfs (BDA) setting extended ACL’s

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to set extended ACL’s

Check extended ACL’s

Set the mask to get the full default inherent access

Reference https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/FileSystemShell.html

Read More

How to configure LDAP on Oracle big data appliance(BDA)

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

First configure yum and install SSSD

Install SSSD

our SSSD config – /etc/sssd/sssd.conf

Reference https://docs.oracle.com/cd/E37670_01/E41138/html/ol_sssd_ldap.html Secure and start SSSD

Create LDAP configuration – /etc/ldap.conf

Note: Update also /etc/openldap/ldap.conf

Modify /etc/security/access.conf

Initialize LDAP and update OS files for first time

Note: You need to add users to the […]

Read More

How to manage users in Oracleto BDA using kerberos authentication

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

setup kerbros for a user Note: Make sure to run enable the service on Solaris client

Extend the time to 1460d (4 years)

Update on how to create a service or krb ticket

Modify to allow 7 day renew expire ticket

Manuel add crypt types to add a krb ticket

[…]

Read More