VictoriaLogs Practical Ingestion Guide for Message, Time and Streams
7 days ago
- #logging
- #VictoriaLogs
- #structured-logs
- VictoriaLogs can handle both structured and unstructured logs, converting unstructured logs into structured format with _msg and _time fields.
- Every log entry must include at least the _msg field for a human-readable description of the event.
- If the _time field is not specified, VictoriaLogs uses the log ingestion time as the timestamp.
- A stream in VictoriaLogs is a logical bucket for related logs, improving query efficiency by grouping logs.
- Choosing the right stream fields is crucial to avoid issues like 'fat stream' or 'high cardinality'.
- VictoriaLogs automatically assigns _stream_id and _stream fields to logs for efficient filtering and organization.
- Compression in VictoriaLogs reduces disk storage by efficiently handling fields with constant, numeric, or timestamp values.
- Nested fields in logs are flattened or converted to JSON strings to manage field name length limits.
- VictoriaLogs is part of VictoriaMetrics, offering scalable and cost-efficient solutions for monitoring, logging, and tracing.