Collectd , logstash and Elasticsearch

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Install Collectd from opencsw

Modify collectd.conf vi /etc/opt/csw/collectd.conf

Restart or enable collectd

forward the logs to elasticsearch with logstash

Source Monitoring With Collectd And Kibana Collectd plugins https://collectd.org/wiki/index.php/Table_of_Plugins/

Read More

Configuring Elasticsearch betas/topbeats on linux

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

First, lets Download the beats template.

Upload to elastic template

Now, lets install topbeat, add elastic beat repo, and run

Modify /etc/topbeat/topbeat.yml, under elasticsearch add elastic (or logstash) hosts

Start the beat service

Install topbeats dashboards

Finally, create the kibana index, [topbeat]-YYY.MM.DD in the web UI To verify the […]

Read More

Upgrading Elasticsearch To A Newer Version

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to upgrading Elasticsearch To A Newer Version The key is exporting the instance. Disable shard movement

Migrate to new version (on linux)

Migrate to new version (on solaris)

Re-enable shared movement, once the cluster is back up

Read More

Solaris Elasticsearch Forwarder(Logstash) Setup

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Create elastic data pool

Add elastic user

Install elastic binary’s

Grant access for elastic user

Configre system limits for user elastic /etc/project

add to /opt/elasticsearch/bin/elasticsearch (top)

Configure startup script

Configure elasticsearch.yml for hot warm (SSD) Hot warm config Configure hot template

Add latter the mappings

To […]

Read More

Elasticserach templates – SSD Template

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Dealing with SSDs in Elasticserach Upload a template for SSD(HOT) disk, so new index’s are placed on SSD.

Verify new template

Read More

How To Configure Elasticsearch(ELK) Hot And Warm Data

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Configuring Elasticsearch(ELK) Hot And Warm Data movement Get the current node box status

Change the allocation to hot

To use curator install it with pip Note: Curator was not working for me, therefore I was using simple curl (above)

Get indices (index) space

Reference

Read More

Installing and Configuring ELK – Part six(6) – General platform tips & tricks

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part six(6) – […]

Read More

Installing and Configuring ELK – Part five(5) – Install Kibana, configuration

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks – Part six(7) Solaris logstash […]

Read More

Installing and Configuring ELK – Part four(4) – Install logstash, configuration

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part four(4) – […]

Read More

Installing and Configuring ELK – Part three(3) – install Elasticsearch, configuration

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part three(3) – […]

Read More