DevTech101

DevTech101

Hadoop

Testing HDFS Over WebHDFS By Using CURL

A quick update on hdfs put/get/etc… Simplest solution to upload/download/delete/etc… Use webhdfs. samples are below. ————— Simple Example in one step. Note: In this example, replace node name with any of the 6 nodes [n01-n06] curl -L -i -X PUT -T source_file_name.pdf “http://n03.domain.com:50075/webhdfs/v1/user/usera/dest_file_name.pdf?user.name=usera&op=CREATE&user.name=usera&namenoderpcaddress=bda-cluster1-ns&overwrite=false” # Example You have a source file: solaris_openstack.pdf user.name: usera file dest: …

Testing HDFS Over WebHDFS By Using CURL Read More »