DevTech101

DevTech101

elk

Elasticserach templates – SSD Template

Dealing with SSDs in Elasticserach Upload a template for SSD(HOT) disk, so new index’s are placed on SSD. curl -XPUT http://elk1.domain.com:9200/_template/web-sql-log -d ‘ { “template”: “web-sql-log-*”, “settings”: { “index.refresh_interval”: “5s”, “index.routing.allocation.require.box_type”: “hot”, “number_of_shards” : 3 } }’ Verify new template curl -XGET ‘http://elk1.domain.com:9200/_template/web-sql-log?pretty’ { “web-sql-log” : { “order” : 0, “template” : “web-sql-log-*”, “settings” : …

Elasticserach templates – SSD Template Read More »

ELK and Kafka Zookeeper Configuration on Oracle BDA

First lets configure Kafka Note: In Kafka 8.1 (and lower) you can not delete a topic, make sure to update to a latter version then 8.2+ Modify the below Kafka settings message.max.bytes: 5000000 replica.fetch.max.bytes: 5 max.connections.per.ip: 500 To make kafka listing on all interfaces Added the following to the Advanced Snippet text field: listeners=PLAINTEXT://0.0.0.0:9092,SSL://127.0.0.1:9093 #Note: …

ELK and Kafka Zookeeper Configuration on Oracle BDA Read More »

How To Configure Elasticsearch(ELK) Hot And Warm Data

Configuring Elasticsearch(ELK) Hot And Warm Data movement Get the current node box status curl ‘elk1.domain.com:9200/web-sql-log-2016.02.29/_settings?pretty’ { “web-sql-log-2016.02.29” : { “settings” : { “index” : { “routing” : { “allocation” : { “require” : { “box_type” : “hot” } } }, “refresh_interval” : “5s”, “number_of_shards” : “3”, “creation_date” : “1456738651834”, “number_of_replicas” : “1”, “uuid” : “p67uw-XhQLe78sjEuDDbpg”, …

How To Configure Elasticsearch(ELK) Hot And Warm Data Read More »

Solaris Logstash Forwarder Configuration and Setup

Click here for the Full Install ELK and Configure Create elastic user and group groupadd elastic useradd -d /export/home/elastic -g elastic -m -s /bin/bash -c “Elastic Search” elastic Create elastic user home directory mkdir /export/home/elastic chown elastic:elastic /export/home/elastic Download logstash gz file and create directory cd /opt tar xf /var/tmp/logstash-2.2.2.tar.gz mv logstash-2.2.2 logstash Modify two …

Solaris Logstash Forwarder Configuration and Setup Read More »

Installing and Configuring ELK – Part six(6) – General platform tips & tricks

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part six(6) – …

Installing and Configuring ELK – Part six(6) – General platform tips & tricks Read More »

Installing and Configuring ELK – Part five(5) – Install Kibana, configuration

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning– Part two(2) – Configure KVM, Tuning– Part three(3) – install elasticsearch, configuration– Part four(4) – Install logstash, configuration– Part five(5) – Install Kibana, configuration– Part six(6) – General platform tips & tricks– Part six(7) Solaris logstash forwarder setup This is Part five(5) …

Installing and Configuring ELK – Part five(5) – Install Kibana, configuration Read More »

Installing and Configuring ELK – Part four(4) – Install logstash, configuration

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning– Part two(2) – Configure KVM, Tuning– Part three(3) – install elasticsearch, configuration– Part four(4) – Install logstash, configuration– Part five(5) – Install Kibana, configuration– Part six(6) – General platform tips & tricks This is Part four(4) – Install logstash, configuration Lets install …

Installing and Configuring ELK – Part four(4) – Install logstash, configuration Read More »

Installing and Configuring ELK – Part three(3) – install Elasticsearch, configuration

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning– Part two(2) – Configure KVM, Tuning– Part three(3) – install elasticsearch, configuration– Part four(4) – Install logstash, configuration– Part five(5) – Install Kibana, configuration– Part six(6) – General platform tips & tricks This is Part three(3) – install elasticsearch, configuration Configuring the …

Installing and Configuring ELK – Part three(3) – install Elasticsearch, configuration Read More »

Installing and Configuring ELK – Part two(2) – Configure KVM & Tuning

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part two(2) – …

Installing and Configuring ELK – Part two(2) – Configure KVM & Tuning Read More »

Installing and Configuring ELK – Part one(1) – Install OS and tuning

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning– Part two(2) – Configure KVM, Tuning– Part three(3) – install elasticsearch, configuration– Part four(4) – Install logstash, configuration– Part five(5) – Install Kibana, configuration– Part six(6) – General platform tips & tricks This is Part one(1) – Install OS (OEL 7.2), Tuning …

Installing and Configuring ELK – Part one(1) – Install OS and tuning Read More »