USING ELK TECHNOLOGY STACK TO PROCESS AND ANALYZE SYSTEM LOGS

Abstract

This paper describes and presents a system for parsing, processing and visualisation of system logs. This system receives logs from client applications, parses and structures them using Logstash, persists them in Elasticsearch and visualises them using the Kibana user interface. Client applications are systems that “subscribe” to this system to be able to use its functionalities. Along with the before mentioned functionality this system is able to provide client applications the possibility to upload and download their system logs to/from a system dedicated S3 bucket hosted on Amazon.