jingshaoyi opened a new issue, #4090: URL: https://github.com/apache/hertzbeat/issues/4090
### Feature Request Support pulling logs from Grafana Loki as log source ### Is your feature request related to a problem? Please describe Currently, HertzBeat's log integration module supports receiving logs via OTLP protocol, but lacks native integration with Grafana Loki as a log source. Many users have deployed Loki for log storage and want HertzBeat to be able to pull logs from Loki for unified monitoring and analysis. ### Describe the solution you'd like Add native Loki log source integration to enable HertzBeat to pull logs from Loki: ### Describe alternatives you've considered 1. **Loki Log Pulling**: Configure Loki datasource URL and query parameters 2. **LogQL Support**: Support LogQL query language for filtering and querying logs 3. **Real-time Streaming**: Implement real-time log streaming from Loki using Loki's tail API 4. **Label Filtering**: Filter logs by Loki labels (app, env, namespace, etc.) 5. **Time Range Query**: Support configurable time range for log queries ### Additional context ### Benefits: - **Unified Observability**: Combine metrics from HertzBeat with logs from Loki - **Cost Effective**: Leverage existing Loki deployment - **Powerful Queries**: Use LogQL for precise log filtering - **Grafana Ecosystem**: Integrate with existing Grafana/Loki dashboards ### Technical References: - Loki HTTP API: https://grafana.com/docs/loki/latest/api/ - LogQL Documentation: https://grafana.com/docs/loki/latest/logql/ - Loki Tail API: https://grafana.com/docs/loki/latest/api/#tail-logs ### Implementation Suggestions: 1. Add Loki client library dependency (e.g., `com.grafana:loki-client`) 2. Create `LokiLogSource` class implementing the log source interface 3. Implement LogQL query parser and executor 4. Add periodic polling or WebSocket streaming support 5. Convert Loki log entries to HertzBeat's internal log format -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
