Re: Updating multiple database tables

2020-02-04 Thread Dylan Adams
of saving updates to multiple RDBMS tables. > While I'm leaning towards using multiple JDBCOutputFormats to solve the > issue, I'm curious about which approach you ended up using. > > Thanks, > Jason > > On 2018/11/28 21:09:08, Dylan Adams wrote: > > Hello,>

Re: Flink on YARN: TaskManager heap auto-sizing?

2019-05-08 Thread Dylan Adams
> Cheers, > Till > > On Tue, May 7, 2019 at 3:29 PM Dylan Adams wrote: > >> In the Configuration section of the docs >> <https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/config.html#taskmanager>, >> the description for "taskmanager.heap.si

Flink on YARN: TaskManager heap auto-sizing?

2019-05-07 Thread Dylan Adams
In the Configuration section of the docs , the description for "taskmanager.heap.size" contains: "On YARN setups, this value is automatically configured to the size of the TaskManager's YARN container, minus a

Updating multiple database tables

2018-11-28 Thread Dylan Adams
Hello, I was hoping to get input from the Flink community about patterns for handling multiple dependent RDMS updates. A textbook example would be order & order_line_item tables. I've encountered a few approaches to this problem, and I'm curious to see if there are others, and the benefits & drawb

Filter-Join Ordering Issue

2018-08-07 Thread Dylan Adams
I'm trying to use the Flink DataSet API to validate some records and have run into an issue. My program uses joins to validate inputs against reference data. One of the attributes I'm validating is optional, and only needs to be validated when non-NULL. So I added a filter to prevent the null-keyed