GitHub user andrec84j edited a discussion: Data sharing between charts in apache superset
Context In Apache Superset, each chart or visualization typically queries raw data directly from a data source (such as a SQL, NoSQL, or other database). This can lead to redundancy, increased system load, and longer processing times, especially when multiple charts rely on the same underlying data but apply different transformations or treatments. Proposal The idea is to implement a data sharing mechanism using a cache layer in Apache Superset. Raw data would be queried only once and stored temporarily in a cache. Each chart or visualization could then access this cached data and apply specific transformations (e.g., filters, aggregations, or calculations) as needed, without requiring additional queries to the original database. Benefits Reduced Database Queries: Eliminates repetitive queries to the raw data, reducing the load on the database. Improved Performance: Accessing cached data is significantly faster than direct database queries. Flexibility: Each chart can apply its own specific transformations (e.g., filtering, grouping, or calculations) without duplicating data retrieval efforts. Scalability: Supports dashboards with multiple charts that depend on the same data source, optimizing resource usage. GitHub link: https://github.com/apache/superset/discussions/34015 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
