Help Kafka Logs

Kafka Logs

Site24x7 AppLogs makes Kafka log management simple as the log content is sliced into various appropriate fields such as date & time, log level, thread name, source file name, line number, and message. With this you can quickly pinpoint the required information over several lines of log data.  Learn more about log management with Site24x7.

Getting started 

  1. Log in to your Site24x7 account.
  2. Download and install the Site24x7 Server Monitoring agent (Windows | Linux). 
  3. Go to Admin > AppLogs > Log Profile and Add Log Profile.

Logs file path

Each application writes logs in different folders and files. By default, Kafka logs are sourced from the below-mentioned folder path for the respective Operating System. If you have logs in a different folder, you can mention it under the File Path to source them from that particular folder while creating a log profile.

Linux icon
:
/var/log/kafka*/*.log
Windows icon
:
C:\kafka*\kafka-logs\*.log", "C:\kafka*\logs\*.log
 
 
C:\Program Files\kafka*\kafka-logs\*.log" , "C:\Program Files\kafka*\logs\*.log

Log pattern

$DateTime:date$ - $LogLevel$ [$ThreadName$:$SourceFileName$@$LineNumber:number$] - $Message$

This is the default pattern defined by Site24x7 for parsing Kafka logs based on the sample mentioned below.

Sample log

2017-03-14 18:24:15,495] INFO [Controller 0]: List of topics to be deleted: 143 (kafka.controller.KafkaController)

The above sample log can be separated into 6 fields, each of which will take its respective value from here and will then be uploaded to Site24x7.

Field name Field value
Date Time 2017-03-14 18:24:15,495
Log Level INFO
Thread Name Controller 0
Source File Name List of topics to be deleted
Line Number 143
Message kafka.controller.KafkaController

Related log types

Was this document helpful?
Thanks for taking the time to share your feedback. We’ll use your feedback to improve our online help resources.

Help Kafka Logs