Hi, I am new to Flink, and I'd like to firstly use it to perform some in memory aggregation in batch mode (in some months this will be migrated to permanent streaming, hence the choice of Flink).
For this, I can successfully create the complex key that I require using KeySelector & returning a hash of the set of fields to "groupBy". I can also get the data from file/db, but now I want to be able to perform many different reduce functions on different fields (not hardcoded, but read from configuration). What I'd like to know, is if this is possible out of the box? >From my research, it seems that only a single reduce function can be applied to a DataSet. The only way I found up to now, was to create a single reducer which is a container for all of the reduce functions I want to apply to my data record and simply loop through them to apply them to each record. Is this recommended? or am I missing some basics here? Many thanks for any advice, Osh
