Re: scala version of flink mongodb example

2017-02-07 Thread alex.decastro
Hi there, treading in the thread, do you know how to add authentication options to mongo here? I'm trying to do hdIf.getJobConf.set("user", s"$USER") hdIf.getJobConf.set("password", s"$PWD") but I can't find any documentation to support it. Any pointers? Many thanks, Alex -- View th

Re: scala version of flink mongodb example

2016-09-08 Thread Fabian Hueske
Hi Frank, I didn't tried to run the code, but this does not show a compiler error in IntelliJ: > input.map( mapfunc2 _ ) Decomposing the Tuple2 into two separate arguments does only work with Scala's pattern matching technique (this is the second approach I posted). The Java API is not capable o

Re: scala version of flink mongodb example

2016-09-08 Thread Frank Dekervel
Hello Fabian, Thanks, your solution works indeed. however, i don't understand why. When i replace the lambda by an explicit function def mapfunc2(pair: Tuple2[BSONWritable, BSONWritable]) : String = { return pair._1.toString } input.map mapfunc2 i get the error below, which seemingly indica

Re: scala version of flink mongodb example

2016-09-08 Thread Fabian Hueske
Hi Frank, input should be of DataSet[(BSONWritable, BSONWritable)], so a Tuple2[BSONWritable, BSONWritable], right? Something like this should work: input.map( pair => pair._1.toString ) Pair is a Tuple2[BSONWritable, BSONWritable], and pair._1 accesses the key of the pair. Alternatively you c