Get get file name when reading from files? Or assign timestamps from file creation time?

2018-04-06 Thread Josh Lemer
Hey there, is it possible to somehow read the filename of elements that are read from `env.readFile`? In our case, the date of creation is encoded in the file name. Otherwise, maybe it is possible to assign timestamps somehow by the file's creation time directly? Thanks!

Bucketing Sink does not complete files, when source is from a collection

2018-04-04 Thread Josh Lemer
Hello, I was wondering if I could get some pointers on what I'm doing wrong here. I posted this on stack overflow , but I thought I'd also ask here. I'm trying to generate s