logging
Centralized logging with ELK Stack, Loki, Fluentd, and log analysis for distributed systems
When & Why to Use This Skill
This Claude skill provides comprehensive expertise in architecting and managing centralized logging systems for distributed environments. It enables users to implement robust observability pipelines using industry-standard tools like the ELK Stack, Loki, and Fluentd. By streamlining log collection, parsing, and advanced analytics, the skill helps teams reduce Mean Time to Recovery (MTTR), optimize infrastructure performance, and maintain high-volume data pipelines with efficient index management.
Use Cases
- Microservices Troubleshooting: Aggregating logs from diverse distributed services into a centralized dashboard to trace cross-service requests and identify root causes of failures.
- Real-time Incident Detection: Configuring log-based alerting and monitoring patterns to proactively identify system anomalies or security breaches before they escalate.
- Compliance and Audit Logging: Establishing structured logging practices and long-term retention policies to meet regulatory requirements and facilitate forensic investigations.
- Log Pipeline Optimization: Designing high-performance log collection architectures using Fluent Bit and Promtail to minimize resource overhead while processing massive data volumes.
| name | logging |
|---|---|
| description | Centralized logging with ELK Stack, Loki, Fluentd, and log analysis for distributed systems |
| sasmp_version | "1.3.0" |
| bonded_agent | 06-monitoring-observability |
| bond_type | PRIMARY_BOND |
Logging Skill
MANDATORY
- ELK Stack (Elasticsearch, Logstash, Kibana)
- Fluentd/Fluent Bit log collection
- Loki and Promtail
- Log formats and parsing
- Index management and retention
OPTIONAL
- Splunk fundamentals
- Graylog setup
- Log-based alerting
- Structured logging patterns
- Log correlation
ADVANCED
- Log analytics and ML
- Multi-cluster log aggregation
- Compliance and audit logging
- High-volume log processing
- Custom log pipelines
Assets
- See
assets/logging-stack.yamlfor configuration templates