Nginx Logging Headers Body Millisecond Timing Using Nginx LUA Module
Configuring Nginx Logging – Headers, Body, And Millisecond Timing, Using Nginx LUA Module.
elasticsearch
Deploying Helm / Tiller, Prometheus, AlertManager, Grafana, Elasticsearch On Your kubernetes Cluster – Part 2
Installing, configuring Prometheus and Grafana Below I am continuing, with options on installing Prometheus and Grafana. This is Part 2. in Part 1 I am describing what it takes to install Helm, Tiller as well as SSL/TLS configuration. It has been a while, I didn’t had a chance to complete the Prometheus & Grafana installation …
Deploying Helm / Tiller, Prometheus, AlertManager, Grafana, Elasticsearch On Your kubernetes Cluster
Deploying Helm Charts / Tiller on your kubernetes cluster Below is a continuation to my previous post(S) part 1-7 on how to configure Kubernetes 3 Master Node cluster. In the post below I am going to show you. How to install / configure – Helm / Tiller on your kubernetes cluster. How to install / …
Collectd , logstash and Elasticsearch
Install Collectd from opencsw /opt/csw/bin/pkgutil -i collectd /opt/csw/bin/pkgutil -i collectd-utils Modify collectd.conf vi /etc/opt/csw/collectd.conf Hostname “yourhost” FQDNLookup false LoadPlugin syslog LoadPlugin cpu LoadPlugin df LoadPlugin disk LoadPlugin interface LoadPlugin load LoadPlugin memory LoadPlugin network LoadPlugin rrdtool LoadPlugin zfs_arc Server “10.10.10.11” “3333” Restart or enable collectd svcadm enable svc:/network/cswcollectd:default forward the logs to elasticsearch with logstash …
Configuring Elasticsearch betas/topbeats on linux
First, lets Download the beats template. curl -O https://raw.githubusercontent.com/elastic/topbeat/master/etc/topbeat.template.json Upload to elastic template curl -XPUT ‘http://elk3.domain.com:9200/_template/topbeat’ -d@topbeat.template.json Now, lets install topbeat, add elastic beat repo, and run yum -y install topbeat Modify /etc/topbeat/topbeat.yml, under elasticsearch add elastic (or logstash) hosts hosts: [“10.10.3.48:9204”, “10.10.3.48:9205”, “10.10.3.48:9206”] Start the beat service systemctl start topbeat Install topbeats dashboards curl …
Configuring Elasticsearch betas/topbeats on linux Read More »
Upgrading Elasticsearch To A Newer Version
How to upgrading Elasticsearch To A Newer Version The key is exporting the instance. Disable shard movement curl -XPUT http://elk2.domain.com:9200/_cluster/settings -d ‘ { “transient”: { “cluster.routing.allocation.enable”: “none” } }’ Migrate to new version (on linux) export INS=1 alias cp=cp cd /opt /opt/elasticsearch-ins${INS}/bin/start_elastic.sh stop unzip -qq /var/tmp/elasticsearch-2.3.0.zip mv elasticsearch-ins${INS} elasticsearch-ins${INS}-2.2 mv elasticsearch-2.3.0 elasticsearch-ins$INS cd elasticsearch-ins${INS} cp …
Solaris Elasticsearch Forwarder(Logstash) Setup
Create elastic data pool zpool create data1 c1d1 Add elastic user groupadd elastic useradd -d /export/home/elastic -g elastic -m -s /bin/bash -c “Elastic Search” elastic Install elastic binary’s cd /opt;unzip -qq /install/elasticsearch-2.2.0.zip;mv elasticsearch-2.2.0 elasticsearch mkdir /data1 /data1/data /data1/plugins /data1/log mkdir /opt/elasticsearch/current /opt/elasticsearch/current/logs /opt/elasticsearch/current/data /opt/elasticsearch/current/tmp chown -R elastic:elastic /opt/elasticsearch /data1 Grant access for elastic user echo …
Elasticserach templates – SSD Template
Dealing with SSDs in Elasticserach Upload a template for SSD(HOT) disk, so new index’s are placed on SSD. curl -XPUT http://elk1.domain.com:9200/_template/web-sql-log -d ‘ { “template”: “web-sql-log-*”, “settings”: { “index.refresh_interval”: “5s”, “index.routing.allocation.require.box_type”: “hot”, “number_of_shards” : 3 } }’ Verify new template curl -XGET ‘http://elk1.domain.com:9200/_template/web-sql-log?pretty’ { “web-sql-log” : { “order” : 0, “template” : “web-sql-log-*”, “settings” : …
How To Configure Elasticsearch(ELK) Hot And Warm Data
Configuring Elasticsearch(ELK) Hot And Warm Data movement Get the current node box status curl ‘elk1.domain.com:9200/web-sql-log-2016.02.29/_settings?pretty’ { “web-sql-log-2016.02.29” : { “settings” : { “index” : { “routing” : { “allocation” : { “require” : { “box_type” : “hot” } } }, “refresh_interval” : “5s”, “number_of_shards” : “3”, “creation_date” : “1456738651834”, “number_of_replicas” : “1”, “uuid” : “p67uw-XhQLe78sjEuDDbpg”, …
How To Configure Elasticsearch(ELK) Hot And Warm Data Read More »
Installing and Configuring ELK – Part six(6) – General platform tips & tricks
Installing and Configuring ELK – Part one(1) – Install OS (OEL 7.2), Tuning – Part two(2) – Configure KVM, Tuning – Part three(3) – install elasticsearch, configuration – Part four(4) – Install logstash, configuration – Part five(5) – Install Kibana, configuration – Part six(6) – General platform tips & tricks This is Part six(6) – …
Installing and Configuring ELK – Part six(6) – General platform tips & tricks Read More »