Kafka To Flume PipeLing To HDFS And Elasticsearch

The below post describes how to configure Flum to grab data from a Kafaka topic as the source then send the data to an HDFS target. Pipeline flow Original source > Kafka topic > Flum from (Kafka topic) > HDFS Create a run file agent_name=flume1 flume-ng agent -n $agent_name -c conf -f conf/flume.conf # Debug …

Kafka To Flume PipeLing To HDFS And Elasticsearch Read More »