Hey Rico!
Parts of the "global windows" are still not super stable, and we are
heavily reworking them for the 0.10 release.
What you can try is reversing the order of the "window" and "groupby"
statement. If you group before windowing, you get local windows, if you
window before grouping, you get
Maybe you could include some log statements in you user code to see
which parts of the program receive data and which not. To narrow down
the problematic part...
On 08/31/2015 06:03 PM, Rico Bergmann wrote:
> The part is exactly as I wrote. ds is assigned a data flow that computes some
> stuff. T
The part is exactly as I wrote. ds is assigned a data flow that computes some
stuff. Then the de duplication code as written in my first mail us assigned to
a new variable called output. Then output.addSink(.) is called.
> Am 31.08.2015 um 17:45 schrieb Matthias J. Sax
> :
>
> Can you post y
Can you post your whole program (both versions if possible)?
Otherwise I have only a wild guess: A common mistake is not to assign
the stream variable properly:
DataStream ds = ...
ds = ds.APPLY_FUNCTIONS
ds.APPLY_MORE_FUNCTIONS
In your code example, the assignment is missing -- but maybe it j
Hi,
For unknown reasons, the stdout/stderr output of my jobs wasn’t retrieved by
Yarn. Same thing for slf4j logger : outside local cluster mode, I could not see
any trace from the nodes. I’ve spent a few hours trying to find why, but I
gave up.
Since I need “real time” logging & monitoring in t
Hi!
I have a problem that I cannot really track down. I'll try to describe
the issue.
My streaming flink program computes something. At the end I'm doing the
follwing on my DataStream ds
ds.window(2, TimeUnit.SECONDS)
.groupBy(/*custom KeySelector converting input to a String representation*
We've finally merged the fix for the bug you've reported here (
https://issues.apache.org/jira/browse/FLINK-2543).
You should now be able to use the file-based state handle with user classes
as well.
Please let us know if you encounter more issues.
On Wed, Aug 19, 2015 at 10:20 AM, Rico Bergmann
@Arnaud
Are you looking for a separate user log file next to the system log file,
or would Robert's suggestion work?
On Fri, Aug 28, 2015 at 4:20 PM, Robert Metzger wrote:
> Hi,
>
> Creating a slf4j logger like this:
>
> private static final Logger LOG =
> LoggerFactory.getLogger(PimpedKafkaSi
