Problems with Kerberos Kafka connection in version 1.2.0

2017-04-11 Thread Diego Fustes Villadóniga
entry in `/tmp/jaas-522055201249067191.conf` Indeed, the JAAS file is empty. Do yon know what may be happening? Diego Fustes Villadóniga, Arquitecto Big Data, CCIM

RE: Calling external services/databases from DataStream API

2017-01-30 Thread Diego Fustes Villadóniga
Hi Stephan, Thanks a lot for your response. I’ll study the options that you mention, I’m not sure if the “chagelog stream” will be easy to implement since the lookup is based on matching IP ranges and not just keys. Regards, Diego De: Stephan Ewen [mailto:se...@apache.org] Enviado el: lunes,

Calling external services/databases from DataStream API

2017-01-30 Thread Diego Fustes Villadóniga
Hi all, I'm working on an application that enriches network connections with Geolocations, using the GeoIP database, which is stored as a file in HDFS. To do so, I map every connection in my stream, using this function: def enrichIp(ip: String): Location = { val location = service.getLocati

RE: Problems with RollingSink

2016-11-29 Thread Diego Fustes Villadóniga
1-29 15:50 GMT+01:00 Kostas Kloudas mailto:k.klou...@data-artisans.com>>: Hi Diego, You cannot prefix each stream with a different string so that the paths do not collide? If I understand your use-case correctly, this might work. Cheers, Kostas On Nov 29, 2016, at 10:04 AM, Diego Fustes Villadóni

RE: Problems with RollingSink

2016-11-29 Thread Diego Fustes Villadóniga
-archive.com/issues@flink.apache.org/msg73871.html Thanks, Kostas On Nov 28, 2016, at 5:37 PM, Diego Fustes Villadóniga mailto:dfus...@oesia.com>> wrote: Hi colleagues, I am experiencing problems when trying to write events from a stream to HDFS. I get the following exc

Problems with RollingSink

2016-11-28 Thread Diego Fustes Villadóniga
Hi colleagues, I am experiencing problems when trying to write events from a stream to HDFS. I get the following exception: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException): failed to create file /user/biguardian/events/2016-11-28--15/flinkpar