Re: Comparing Flink vs Materialize

2021-01-05 Thread Arvid Heise
Hi Dan, I have not touched Materialize yet, but the picture of them is too simplifying. When you run Flink in parallel, then each source shard is assigned to one Flink source operator. Similarly, filter and map would run in parallel. Flink chains simple operators that have the same degree of paral

Comparing Flink vs Materialize

2021-01-04 Thread Dan Hill
Has anyone compared Flink with Materialize? A friend recommended me switch to Materialize. In one of their blog posts, it says that Flink splits operators across CPUs (instead of splitting partitions across CPUs). Is this true? Is it configurable? https://materialize.com/blog-rocksdb/