🔀
Kibana & the Elastic Stack

Logstash Basics

Input-Filter-Output Pipeline
💡 Logstash, EK, "FACTORY, ASSEMBLY, LINE", jaisi, hai — RAW, MATERIAL, (input) aata hai, PROCESS, hota hai, (filter), aur, FINISHED, PRODUCT, (output) doosri, taraf, nikalta hai.

Logstash, EK, DATA, PROCESSING, PIPELINE, hai, JISME, TEEN, STAGES, HOTE, HAIN: Input, (DATA, KAHAN, se, aa, RAHA, hai), Filter, (DATA, ko, TRANSFORM/PARSE, karna), aur, Output, (PROCESSED, DATA, KAHAN, jaayega — usually, Elasticsearch).

Grok, filter, UNSTRUCTURED, LOG, LINES, ko, STRUCTURED, FIELDS, mein, PARSE, karta hai, PREDEFINED, PATTERNS, ke, ZARIYE.

input { file { path => "/var/log/app.log" } }
filter { grok { match => { "message" => "%{COMBINEDAPACHELOG}" } } }
output { elasticsearch { hosts => ["localhost:9200"] } }
🔀
Logstash, EK, "FACTORY, ASSEMBLY, LINE", jaisi, hai — RAW, MATERIAL, (input) aata hai, PROCESS, hota hai, (filter), aur, FINISHED, PRODUCT, (output) doosri, taraf, nikalta hai.
1 / 2
⚡ Quick Recap
  • Logstash pipeline = input -> filter -> output
  • Grok filter unstructured logs ko structured fields mein parse karta hai
  • Logstash resource-intensive hai, lightweight ke liye Beats prefer kiye jaate hain
Is page mein (2 subtopics)

Logstash, EK, DATA, PROCESSING, PIPELINE, hai, JISME, TEEN, STAGES, HOTE, HAIN: Input, (DATA, KAHAN, se, aa, RAHA, hai, — jaise, files, ya, DATABASES, se), Filter, (DATA, ko, TRANSFORM/PARSE, karna), aur, Output, (PROCESSED, DATA, KAHAN, jaayega, — usually, Elasticsearch).

input { file { path => "/var/log/app.log" } }
filter { grok { match => { "message" => "%{COMBINEDAPACHELOG}" } } }
output { elasticsearch { hosts => ["localhost:9200"] } }

Grok, filter, UNSTRUCTURED, LOG, LINES, ko, STRUCTURED, FIELDS, mein, PARSE, karta hai, PREDEFINED, PATTERNS, (jaise, "%{IP}", "%{TIMESTAMP_ISO8601}") ke, ZARIYE — YE, RAW, TEXT, logs, ko, SEARCHABLE, structured, DATA, mein, CONVERT, karta hai.

💡Tip: Logstash, RESOURCE-INTENSIVE, ho, sakta hai, — LIGHTWEIGHT, use-cases, ke, liye, aksar, "Beats" (agla, TOPIC) PREFER, kiye, jaate, HAIN.