OSDC: Unifying logs and metrics data with Elastic Beats

Abstract

The Beats are a friendly army of lightweight agents that installed on your servers capture operational data and ship it to Elasticsearch for analysis. They are open source, written in Golang, and maintained by Elastic, the company behind Elasticsearch, Logstash, and Kibana.

This talk presents the Beats: Topbeat for system level metrics, Filebeat for log files, Packetbeat for wire data and Metricbeat (soon to come) for gathering metrics from external systems.

It also demonstrates how to combine the Beats with Logstash and Kibana in one advanced monitoring solution, unifying log management, metrics monitoring and system stats. Finally, you learn how to create a new Beat from scratch using Golang and the libbeat framework to capture any type of information and ship it to Elasticsearch.

Slides

Video