Re: Broadcasting sets in Flink Streaming

2015-08-25 Thread Tamara Mendt
once an example where he did something comparable. Maybe he >> can chime in here. >> >> Cheers, >> Till >> >> On Tue, Aug 25, 2015 at 11:15 AM, Tamara Mendt >> wrote: >> >>> Hello, >>> >>> I have been trying to use the funct

Broadcasting sets in Flink Streaming

2015-08-25 Thread Tamara Mendt
Hello, I have been trying to use the function withBroadcastSet on a SingleOutputStreamOperator (map) the same way I would on a MapOperator for a DataSet. From what I see, this cannot be done. I wonder if there is some way to broadcast a DataSet to the tasks that are performing transformations on a

Re: Read CSV Parse Quoted Strings Function

2015-08-24 Thread Tamara Mendt
osed. > > While your proposal is a very convenient feature, I think we should rather > implement explicit quoting for performance and clarity reasons. > > Cheers, > Max > > > > On Mon, Aug 24, 2015 at 10:40 AM, Tamara Mendt > wrote: > >> Hi all, >> >&g

Read CSV Parse Quoted Strings Function

2015-08-24 Thread Tamara Mendt
Hi all, When using the parseQuotedStrings function for the CsvReader class, I have noticed that if the caracter of the quotes is also inside of the string, the parsing fails. For example, if there is a field of this form: "RT @sportsguy33: New Time Warner slogan: "Time Warner, where we make you

Re: Using collect and accessing accumulator results

2015-06-18 Thread Tamara Mendt
nt trigger an execution of the > ExecutionEnvironment, you can get the result afterwards using > env.getLastExecutionResult(). > > > > Best, > > Max > > > > On Thu, Jun 18, 2015 at 3:57 PM, Tamara Mendt > wrote: > > Hey! > > > > I am currently runn

Using collect and accessing accumulator results

2015-06-18 Thread Tamara Mendt
Hey! I am currently running a job in which I wish to use collect to trigger my job execution, but I also need to have access to the final accumulator results. Up until now I have been accessing the accumulator results through the JobExecutionResult that the function execute() returns. Not surpris

Re: Monitoring memory usage of a Flink Job

2015-06-15 Thread Tamara Mendt
t that Flink monitors memory usage. >> >> Cheers, Fabian >> >> 2015-06-15 14:34 GMT+02:00 Tamara Mendt : >> >>> Hi, >>> >>> I am running some experiments on Flink and was wondering if there is >>> some way to monitor the memory

Monitoring memory usage of a Flink Job

2015-06-15 Thread Tamara Mendt
Hi, I am running some experiments on Flink and was wondering if there is some way to monitor the memory usage of a Flink Job (running locally and on a cluster). I need to run multiple jobs and compare their memory usage. Cheers, Tamara

Re: JSON data source for Flink Job

2015-05-28 Thread Tamara Mendt
on which you > can split? If yes, you can use theTextInputFormat (with a custom line break > character), take the strings and parse them to JSON with your favorite > library (like Jackson or so). > > Stephan > > > On Thu, May 28, 2015 at 12:24 PM, Tamara Mendt > wrote: &g

JSON data source for Flink Job

2015-05-28 Thread Tamara Mendt
Hello, I have a JSON file containing multiple JSON objects and wish to use this as a data source for a Flink Job. What is the best way to do this? Cheers, Tamara