Logstash

Logstash is a light-weight, open-source, server-side data processing pipeline that allows you to collect data from a variety of sources, transform it on the fly, and send it to your desired destination. It is most often used as a data pipeline for Elasticsearch, an open-source analytics and search engine. Logstash integrates with Elasticsearch and has over 200 pre-built open-source plugins that can help to index your data.

Plugins: https://www.elastic.co/guide/en/logstash/current/output-plugins.html

• Kafka
• XMMP
• Zabbix

• MacOS installation:
  • brew install logstash
  • brew cask install homebrew/cask-versions/adoptopenjdk8

logstash (command)

Docker Logstash

Official Logstash docker image is around 800 MB size.

docker pull docker.elastic.co/logstash/logstash:7.8.0
docker run --rm -it -v ~/pipeline/:/usr/share/logstash/pipeline/ docker.elastic.co/logstash/logstash:7.8.0

• Docker Logstash configurations:
  • Config: /usr/share/logstash/config/logstash.yml
  • Pipeline configurations: /usr/share/logstash/pipeline/

Activities

• Review homepage: https://www.elastic.co/logstash
• Review Logstash logs

Related terms

• MetricBeat
• Lumberjack protocol
• Filebeat

See also

• Logstash, logstash (command), logstash.yml, Logstash: docker run, Logstash changelog
• Elastic: ELK, Elasticsearch, Logstash, Kibana, Installation, AWS Elasticsearch, Elastic SIEM, Elastic Beats, metricbeat, filebeat, journalbeat, Elastisearch Service , Search guard, Elasticsearch logs, curator, ILM, Lumberjack protocol, aws_elasticsearch_domain, KQL, elasticsearch.yml, elasticsearch-plugin, elasticsearch-certutil, Elasticsearch release notes/changelog