These may interest
https://www.spinellis.gr/blog/20241015/ Unix make vs Apache Airflow
... With /make/ approaching its 50th birthday, before writing the column
I looked for possible modern and better alternatives I might be ignoring.
... Another suggested tool that matched my requirements was Apache
Airflow <https://airflow.apache.org/>, which I decided to investigate
further.
I was disappointed by what I found. ...
D. Spinellis, "Modular Data Analytics," in IEEE Software, vol. 41, no.
5, pp. 20-23, Sept.-Oct. 2024, doi: 10.1109/MS.2024.3409988. keywords:
{Analytical models;Query processing;Online services;Data analysis},
A sophisticated analysis of data is often based on relational analytical
processing (ROLAP) methods. These involve using SQL queries on a
relational database system to perform on the data operations such as
slice and dice, drill down, and roll up. Such queries can be complex,
involving tens of tables and many intermediate steps. ...
Handling Dependencies
To facilitate the development of maintainable, time-efficient, and
testable ROLAP queries, I developed simple-rolap
(github.com/dspinellis/simple-rolap/), a small open source software
framework that automates the dependency analysis and orchestrates the
execution of multiple modular queries. ...
The frameworkâs design is based on convention over configuration
centered on two databases. A main database contains the primary queried
data, which are assumed to be infrequently modified. A secondary
database is used for caching derived intermediate ROLAP results.
_______________________________________________
luv-main mailing list -- luv-main@luv.asn.au
To unsubscribe send an email to luv-main-le...@luv.asn.au
