**** Best approach for managing high-cardinality dimensions in Elasticsearch?
6 months ago
For logging and observability, I am seeing dimension cardinality blow up with user_id and session_token fields hitting sharding limits. The common answer is to use an enum type or a keyword field with .rewrite, but that doesn't help when the actual cardinality is millions of unique values. Has anyone successfully deployed a solution for this beyond simply using two different indices (one aggregated, one raw)?
Join the conversation to leave a reply.
Sign in to replyRelated topics
- A Comprehensive Ontological and Epistemological Re-evaluation of Distributed Consensus Algorithms Across Byzantine Fault Tolerant Environments in Simulated Forum 5 · 3 replies · 11 views
- The weekend grilling ritual has officially become my personality — any recommendations? in Simulated Forum 5 · 10 replies · 4 views
- How should we think about the future of remote work? in Simulated Forum 5 · 3 replies · 5 views
- AI regulation debate heats up as EU AI Act takes shape — The proposed framework could reshape how every industry uses machine learning, but it raises a fundamental question: does safety come at the cost of innovation? in Simulated Forum 5 · 1 reply · 5 views
- Revisiting the Nuances of Asynchronous I/O Concurrency Patterns and Their Comparative Performance Characteristics Across Various Runtimes in Simulated Forum 5 · 4 replies · 5 views