Summarize logs and traces
Demo by @alex-fedotyevEvent deltas heatmap into chart builder
Demo by @alex-fedotyevBenchmarking for schema improvements
Demo by @knudttytimestamp_time column (a 32-bit Unix timestamp with second-level granularity) in favor of relying solely on timestamp, which provides nanosecond precision and removes one column from the schema. Across a broad set of query benchmarks, the updated schema performs as well or better than the old one in nearly every case.
The final schema also includes read order optimizations that show meaningful gains on selective queries. Searching for a relatively rare map value ran roughly twice as fast compared to the baseline, and high-frequency value lookups showed even greater improvement. Insert performance is marginally higher (more columns to maintain), but query performance across the board is on par or improved, making this a straightforward upgrade.
Related PRs: #2125 feat: optimized default otel-logs schema
Improvements to autocomplete
Demo by @knudttyAggregatingMergeTrees that pre-aggregates key-value pairs in 15-minute time buckets), so rather than querying raw data on every keystroke, the system reads from a much smaller pre-computed dataset. In a live demo against a 230 million row staging instance, autocomplete loaded values for high-cardinality fields like hostname quickly and without noticeable lag.
The system supports both a key-only rollup (returning all keys but no attached values, for lower cardinality overhead) and a full key-value rollup. If only a key rollup is present, the system falls back to the existing fetch-values strategy for the value lookup step. If no rollup table is detected at all, it falls back gracefully to the current behaviour. Aaron also notes that a future allow-list UI for controlling which keys get value rollups would be a useful addition for customers with especially high cardinality data.
Related PRs: #2128 feat: fast and full autocomplete, #2127 feat: better autocomplete