Hi Guys, very new to flink so my apology for the newbie questions :) but I desperately looking for a good example for streaming to file using bucketingSink / StreamingFileSink . Unfortunately the examples in the documentation are not event compiling (at least not the ones in scala https://issues.apache.org/jira/browse/FLINK-11053 )
I tried using bucketing sink with streamingFileSink (or just streamingFileSink ) and finally tried to implement a writer but with no luck. BucketingSink seems to be a perfect fit because I can set the batch interval by time interval or size which is exactly what I need. This is my last attempt (sample project) <https://bitbucket.org/avilevi/kafka-flink-parquet/src/master/> which results a lot of "pending" files. *Any help would be appreciated* *Thanks* *Avi*