Re: Sending watermarks into Kafka

artition in a topic. Do you guys know of any article/blog/paper/mail discussion/... that describes/discusses this? Niels On Mon, Dec 20, 2021 at 4:35 PM Matthias J. Sax wrote: I think this problem should be tackled inside Kafka, not Flink. Kafka already has internal control messages to write

Re: Sending watermarks into Kafka

I think this problem should be tackled inside Kafka, not Flink. Kafka already has internal control messages to write transaction markers. Those could be extended to carry watermark information. It would be best to generalize those as "user control messages" and watermarks could just be one app

Re: [ANNOUNCE] New PMC member: Arvid Heise

Congrats! On 6/16/21 6:06 AM, Leonard Xu wrote: > Congratulations, Arvid! > > >> 在 2021年6月16日，20:08，Till Rohrmann 写道： >> >> Congratulations, Arvid! >> >> Cheers, >> Till >> >> On Wed, Jun 16, 2021 at 1:47 PM JING ZHANG wrote: >> >>> Congratulations, Arvid! >>> >>> Nicholas Jiang 于2021年6月16日周三

Re: [DISCUSS] Disable "Squash and merge" button for Flink repository on GitHub

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Seems, this will be fixed today: https://twitter.com/natfriedman/status/1235613840659767298?s=19 - -Matthias On 3/5/20 8:37 AM, Stephan Ewen wrote: > It looks like this feature still messes up email addresses, for > example if you do a "git log |

Re: [ANNOUNCE] New Flink PMC member Thomas Weise

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 2/12/19 3:26 AM, Dian Fu wrote: > Congrats Thomas! > > Regards, Dian >> 在 2019年2月12日，下午6:58，Hequn Cheng 写道： >> >> Congrats Thomas! >> >> Best, Hequn >> >> >> On Tue, Feb 12, 2019 at 6:53 PM Stefan Richter >> >

Re: [ANNOUNCE] New committer Gary Yao

Congrats! On 09/07/2018 08:15 AM, Timo Walther wrote: > Congratulations, Gary! > > Timo > > > Am 07.09.18 um 16:46 schrieb Ufuk Celebi: >> Great addition to the committers. Congrats, Gary! >> >> – Ufuk >> >> >> On Fri, Sep 7, 2018 at 4:45 PM, Kostas Kloudas >> wrote: >>> Congratulations Gary!

Re: [ANNOUNCE] New committer Piotr Nowojski

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 6/22/18 12:28 PM, Stefan Richter wrote: -BEGIN PGP SIGNATURE- Comment: GPGTools - https://gpgtools.org iQIzBAEBCgAdFiEEeiQdEa0SVXokodP3DccxaWtLg18FAlstTjMACgkQDccxaWtL g1+AgA/8DT/ZS8nUrE/DKWs5JPqEBTXvuR6f7/pfs12cJQ+vesbpIUxCB87

Re: [ANNOUNCE] New committer Piotr Nowojski

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 6/22/18 12:28 PM, Stefan Richter wrote: > Congrats Piotr! > >> Am 22.06.2018 um 21:26 schrieb Till Rohrmann >> : >> >> Hi everybody, >> >> On behalf of the PMC I am delighted to announce Piotr Nowojski as >> a new Flink committer! >

Re: [ANNOUNCE] New committer: Sihua Zhou

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 6/22/18 10:33 AM, shimin yang wrote: > Congrats! > > On Sat, Jun 23, 2018 at 1:13 AM Chen Qin > wrote: > >> Congrats! >> >>> On Jun 22, 2018, at 9:48 AM, Ted Yu >>> wrote: >>> >>> Congratulations Sihua! >>> On Fri, Jun 22,

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 5/8/18 12:28 PM, Shuyi Chen wrote: > Congratulations! > > On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz < > wysakowicz.da...@gmail.com> wrote: > >> Congratulations Nico and Xingcan! Well deserved! >> >> >> On 08.05.2018 20:52,

Re: [ANNOUNCE] New committer: Haohui Mai

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 11/1/17 9:40 PM, Dawid Wysakowicz wrote: > Congratulations! > > 01.11.2017 7:45 PM "Stephan Ewen" napisał(a): > >> Congrats and welcome! >> >> On Wed, Nov 1, 2017 at 6:47 PM, Chen Qin >> wrote: >> >>> Congratulations! >>> >>> On

Re: [ANNOUNCE] New Flink PMC member: Chesnay Schepler

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 7/28/17 4:40 PM, Fabian Hueske wrote: > Congrats and welcome Chesnay! > > 2017-07-28 16:34 GMT+02:00 Kostas Kloudas > : > >> Congratulations Chesnay! >> >>> On Jul 28, 2017, at 4:05 PM, Greg Hogan >>> wrote: >>> >>> Developers, >>>

Re: [ANNOUNCE] New Flink committer Jincheng Sun

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 7/10/17 6:42 AM, Ted Yu wrote: > Congratulations, Jincheng. > > On Mon, Jul 10, 2017 at 6:17 AM, Fabian Hueske > wrote: > >> Hi everybody, >> >> On behalf of the PMC, I'm very happy to announce that Jincheng >> Sun has accepted the

Re: [ANNOUNCE] New Flink PMC member: Tzu-Li (Gordon) Tai

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 7/10/17 8:03 AM, jincheng sun wrote: > Hi Gordon, Congratulations !!! > > Cheers, Jincheng > > 2017-07-10 22:44 GMT+08:00 Robert Metzger : > >> Hi Everybody, >> >> On behalf of the Flink PMC, I'm very excited to announce Gordon >> a

Re: [ANNOUNCE] New Flink committer Shaoxuan Wang

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! :) On 6/21/17 3:59 PM, Kostas Kloudas wrote: > Congratulations Shaoxuan! More hands are always welcomed! > > Kostas > > On Jun 21, 2017 22:45, "Greg Hogan" wrote: > >> Congrats and welcome, Shaoxuan! >> >> >>> On Jun 21, 2017, at 4:1

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! - -Matthias On 6/19/17 3:52 AM, Dawid Wysakowicz wrote: > Thank you all for the warm welcome. I will do my best to be as > helpful as possible. > -BEGIN PGP SIGNATURE- Comment: GPGTools - https://gpgtools.org iQIYBAEBCgAGBQJZSEP

Re: [ANNOUNCE] New committer: Theodore Vasiloudis

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 3/21/17 8:59 AM, Greg Hogan wrote: > Welcome, Theo, and great to have you onboard with Flink and ML! > > >> On Mar 21, 2017, at 4:35 AM, Robert Metzger >> wrote: >> >> Hi everybody, >> >> On behalf of the PMC I am delighted to anno

Re: [ANNOUNCE] Welcome Stefan Richter as a new committer

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 2/10/17 2:00 AM, Ufuk Celebi wrote: > Hey everyone, > > I'm very happy to announce that the Flink PMC has accepted Stefan > Richter to become a committer of the Apache Flink project. > > Stefan is part of the community for almost a y

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 2/7/17 12:55 PM, Haohui Mai wrote: > Congratulations! > > On Tue, Feb 7, 2017 at 12:17 PM Fabian Hueske > wrote: > >> Hi everybody, >> >> I'm very happy to announce that Jark Wu and Kostas Kloudas >> accepted the invitation of the F

Re: [DISCUSS] Storm 1.x.x support in the compatibility layer

One thing to consider: there are still many people using Storm 0.9 or Storm 0.10. There was a recent "Survey" on Storm user list: https://mail-archives.apache.org/mod_mbox/storm-user/201608.mbox/%3C5DCE24EC-0E48-4AA1-A700-F2AB48248304%40gmail.com%3E Just want to point out, the we might "cut off"

Re: Some thoughts about the lower-level Flink APIs

It really depends on the skill level of the developer. Using low-level API requires to think about many details (eg. state handling etc.) that could be done wrong. As Flink gets a broader community, more people will use it who might not have the required skill level to deal with low-level API. For

Re: [ANNOUNCE] Flink 1.1.0 Released

Congrats! On 08/09/2016 09:26 AM, Fabian Hueske wrote: > Thanks Ufuk and everybody who contributed to the release! > > Cheers, Fabian > > 2016-08-08 20:41 GMT+02:00 Henry Saputra : > >> Great work all. Great Thanks to Ufuk as RE :) >> >> On Monday, August 8, 2016, Stephan Ewen wrote: >> >>> Gr

Re: Contribute to Flink

Hi Kevin, welcome to the Flink community! Did you have a look into the web-page: https://flink.apache.org/how-to-contribute.html If you have follow-up question, just go for it -Matthias On 07/08/2016 09:12 AM, Kevin wrote: > Hi, > > I am relatively new to the development process of Apache Fli

Re: [DISCUSS] FLIP 1 - Flink Improvement Proposal

". >>> >>> On Thu, 7 Jul 2016 at 11:28 Robert Metzger wrote: >>> >>>> I also like the proposal. I think its an issue that Google Docs comments >>>> are not reflected within ASF infra. Therefore, I'm +1 on discussing the >>>> prop

Re: Contributing

K/FLIP+Template -Matthias On 07/08/2016 11:17 AM, Matthias J. Sax wrote: > Hi Kevin, > > welcome to the Flink community! > > Did you have a look into the web-page: > https://flink.apache.org/how-to-contribute.html > > If you have follow-up question, just go for it :) >

Re: Contributing

Hi Kevin, welcome to the Flink community! Did you have a look into the web-page: https://flink.apache.org/how-to-contribute.html If you have follow-up question, just go for it :) -Matthias On 07/08/2016 10:02 AM, Kevin Jacobs wrote: > Hi, > > I am relatively new to the development process of

Re: [DISCUSS] FLIP 1 - Flink Improvement Proposal

t;> would not expect any problems with this, but we can post a quick note >>> to their ML. >>> >>> @Matthias: The name works for me. ;-) >>> >>> – Ufuk >>> >>> On Tue, Jun 28, 2016 at 10:19 PM, Matthias J. Sax >>> wrote: >

Re: [DISCUSS] FLIP 1 - Flink Improvement Proposal

FLIP ?? Really? :D http://www.maya.tv/en/character/flip -Matthias On 06/28/2016 06:26 PM, Aljoscha Krettek wrote: > I'm proposing to add a formal process for how we deal with (major) > improvements to Flink and design docs. This has been mentioned several > times recently but we never took any

Re: [Discussion] Query regarding Join

You need to do an outer-join. However, there is no build-in support for outer-joins yet. You can use Window-CoGroup to implement the outer-join as an own operator. -Matthias On 06/13/2016 06:53 PM, Vinay Patil wrote: > Hi, > > I have a question regarding the join operation, consider the follow

Re: Blogpost on Flink's SQL support

Will be a nice post! On 05/21/2016 10:40 PM, Henry Saputra wrote: > I agree with Ufuk, that this is more internal posts which perfect for blog. > > For high level and use cases I think would be better to be added to Apache > Flink release docs bc that is where most users will try to find info on

Re: [PROPOSAL] Structure the Flink Open Source Development

Sounds like a good idea to me. We could include Wikipedia article as well. As was thinking about extending the article anyway (no time so far...), as of Flink 1.x the system is stable in large parts and it might be nice to have a high level system description on Wikipedia, too. -Matthias On 05/

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 from my side. Happy to be the maintainer for Storm-Compatibiltiy (at least I guess it's me, even the correct spelling would be with two 't' :P) -Matthias On 05/12/2016 12:56 PM, Till Rohrmann wrote: > +1 for the proposal > On May 12, 2016 12:13 PM, "Stephan Ewen" wrote: > >> Yes, Gabor Geva

Re: Eclipse Problems

ents(OUT...) returns DataStreamSource > and will bind to the nearest common superclass? The new > .fromElements(Class, OUT...) does give the user the choice of common > superclass. > > Greg > > > On Wed, Apr 27, 2016 at 10:25 AM, Matthias J. Sax wrote: > >> I gues

Re: Eclipse Problems

ify class objects even > though he's providing only a set of strings, for example. > > On Wed, Apr 27, 2016 at 4:25 PM, Matthias J. Sax wrote: > >> I guess, removing .fromElements(Object..) would fix the problem. Not >> sure so, if we can remove the method due to API s

Re: Eclipse Problems

u remove the fromElementsWithBaseType2 > test case. > > Cheers, > Till > ​ > > On Wed, Apr 27, 2016 at 1:22 PM, Matthias J. Sax wrote: > >> Hi Till, >> >> but StreamExecutionEnvironmentTest.fromElementWithBaseTypeTest2 does not >> test was you describ

Re: Eclipse Problems

d another way to > make it work with Eclipse. > > Cheers, > Till > > On Tue, Apr 26, 2016 at 9:41 PM, Matthias J. Sax wrote: > >> Even if the fix works, I still have two issues in my Eclipse build... >> >> In >> >> >> flink-scala/src/test/s

Re: Eclipse Problems

this does not happen and .fromElemenst(Object[]) is called. Even if there is still an exception, I got the impression that this test does not what the intention was. If might be good to change fromElementsWithBaseTypeTest2 to > env.fromElements(new SubClass(1, "Java"), new ParentClass(1, &q

Re: Eclipse Problems

t;> On Mon, Apr 25, 2016 at 12:14 AM, Matthias J. Sax >> wrote: >>> What do you think about this? >> >> Hey Matthias! >> >> Thanks for bringing this up. >> >> I think it is very desirable to keep support for Eclipse. It's quite a >> h

Eclipse Problems

Hi, someone put this question on SO: https://stackoverflow.com/questions/36824684/eclipse-imported-maven-project-cannot-resolve-symbols-in-other-imported-maven-pr I can only confirm that Eclipse does not build Flink anymore. It shows "103 Errors" in my case. Not sure how many Eclipse users are st

Re: Problem with flink while development

If you work on plain Integer (or other non-POJO types) you need to provide a KeySelector to make it work. For you case something like this: .keyBy(new KeySelector() { @Override public Integer getKey(Integer value) throws Exception { return value; } }) As S

Re: Flink optimizer optimizations

Sure. WITHOUT. Thanks. Good catch :) On 04/16/2016 01:18 PM, Ufuk Celebi wrote: > On Sat, Apr 16, 2016 at 1:05 PM, Matthias J. Sax wrote: >> (with the need to sort the data, because both >> datasets will be sorted on A already). Thus, the overhead of sorting in >> the grou

Re: Flink optimizer optimizations

Assume you have a groupBy followed by a join. DataSet1 (nor sorted) -> groupBy(A) --> join(1.A == 2.A) ^ DataSet2 (sorted on A) -+ For groupBy(A) of DataSet1 the optimizer can pick hash-grouping or the more expensive sort-based-grouping. If

Re: Issue deploying a topology to flink with a java api

tter > > Btw, the dependency > org.apache.flink > flink-storm-examples_2.11 > 1.1-SNAPSHOT > > Could not be satisfy, but this one could be > org.apache.flink > flink-storm_2.10 1.1-SNAPSHOT > > > Le Jeudi 14 avril 2016 13h05, Matthias J. Sax a écrit : &

Re: Issue deploying a topology to flink with a java api

complains that > it could not satisfy the given dependency. > > Le Jeudi 14 avril 2016 10h45, star jlong a > écrit : > > > Yes it is. > > Le Jeudi 14 avril 2016 10h39, Matthias J. Sax a écrit : > > > For the fix, you need to use the curre

Re: Issue deploying a topology to flink with a java api

tTopology(topologyId, > uploadedJarLocation, getFlinkTopogy(String.format("file://%s", > jarPath),properties.getProperty("topologyMainClass"), > properties.getProperty("methodName"))); > Where getFlinkTopology() return the contains actually topology > >

Re: Issue deploying a topology to flink with a java api

t from the jar > to submit it to flink. > > I know that is possible because I have used the same procedure with a storm > topology that it works perfectly well. > What I'm missing please? > jstar > > Le Mercredi 13 avril 2016 19h23, Matthias J. Sax a > écrit :

Re: Issue deploying a topology to flink with a java api

Hi jstar, I need to have a close look. But I am wondering why you use reflection in the first place? Is there any specific reason for that? Furthermore, the example provided in project maven-example also covers the case to submit a topology to Flink via Java. Have a look at org.apache.flink.storm

Re: Broken links after doc resturcturing

p Compatibility in Flink) > > - Links that point to a changing URL (docs-master or Github master > branch) to point to the release around that time. > > - Links from news that have no match any more should probably be > dropped... > > Stephan > > > > On Th

Re: Broken links after doc resturcturing

Anyone? On 04/04/2016 05:06 PM, Matthias J. Sax wrote: > Hi, > > I just stepped through the whole blog. Some stuff can get fixed easily, > more links should just be removed, and for some I am not sure what to do > about (quite old stuff). > > I put my though about each br

Re: Failing Test

s, >>> >>> the test has been only recently added with the resource management >>> refactoring. It's probably just a too aggressive timeout for Travis. >>> >>> @Max: Did you ever see this fail? >>> >

Re: Broken links after doc resturcturing

> > We can also provide redirects for the broken links. With 1.0, we now > should be more careful to not break/redirect links... > > > On Mon, Apr 4, 2016 at 2:53 PM, Matthias J. Sax wrote: >> Hi, >> >> I just realized, that the restructuring of the pro

Broken links after doc resturcturing

Hi, I just realized, that the restructuring of the programming guide in our documentation https://github.com/apache/flink/commit/ad267a4b199979536dd8a5572628eefc77d7e0f4) broke a couple of links from the Flink blog. Should we update those older blog post? JIRA for it? For the future: would it be

Re: Failing Test

ecently added with the resource management >>> refactoring. It's probably just a too aggressive timeout for Travis. >>> >>> @Max: Did you ever see this fail? >>> >>> – Ufuk >>> >>> On Fri, Apr 1, 2016 at 9:24 AM, Matthias

Failing Test

Anyone seen this before? One-time thing or test instability? > ClusterShutdownITCase.testClusterShutdown:71 assertion failed: timeout > (29848225634 nanoseconds) during expectMsgClass waiting for class > org.apache.flink.runtime.clusterframework.messages.StopClusterSuccessful -Matthias sign

Re: Submission Problem

that the JobManager tries to load that class directly from > the actor message. > All user code should be deserialized lazily. > > How is that class passed? Implicitly through some config? > > On Thu, Mar 31, 2016 at 4:51 PM, Matthias J. Sax wrote: > >> Here we go... >>

Re: Submission Problem

ava:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > ] On 03/31/2016 04:31 PM, Till Rohrmann wrote: > Could you please rerun the whole job with debug log level and logging of > Akka's lifecycle events turned on? > &g

Re: Submission Problem

enclosed the logs.. maybe you can make some sense out if them. On 03/31/2016 02:52 PM, Till Rohrmann wrote: > I would assume that something went wrong on the JobManager side. Could you > check the logs if they contain something suspicious? Additionally you could > turn on lifecycle event logging​

Submission Problem

Hi, I just tried to submit Flink's Storm-Topology example via command line: bin/flink run ~/workspace_flink/flink/flink-contrib/flink-storm-examples/target/WordCount-StormTopology.jar However, I get a timeout and the program is not submitted. I tracked the problem down to the following statemen

Re: Guarantees for object reuse modes and documentation

Hi, I like Fabian's proposal. The idea of object reuse is performance gain, and we should not sacrifice this. Even more important is that the rules are easy to understand! -Matthias On 02/17/2016 06:17 PM, Fabian Hueske wrote: > Hi, > > > > Flink's DataSet API features a configuration parame

Re: StateBackend

gt; directory, and such). Then, however, care needs to be taken to make sure >> that the state inside the one redis instance does not clash. >> >> Cheers, >> Aljoscha >>> On 15 Feb 2016, at 14:53, Matthias J. Sax wrote: >>> >>> Anyone? >>> >>

[jira] [Created] (FLINK-3409) Integrate STOP with Savepoints

Matthias J. Sax created FLINK-3409: -- Summary: Integrate STOP with Savepoints Key: FLINK-3409 URL: https://issues.apache.org/jira/browse/FLINK-3409 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3408) Make STOP signal reliable

Matthias J. Sax created FLINK-3408: -- Summary: Make STOP signal reliable Key: FLINK-3408 URL: https://issues.apache.org/jira/browse/FLINK-3408 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3407) Extend TwitterSource with interface StoppableFunction

Matthias J. Sax created FLINK-3407: -- Summary: Extend TwitterSource with interface StoppableFunction Key: FLINK-3407 URL: https://issues.apache.org/jira/browse/FLINK-3407 Project: Flink

[jira] [Created] (FLINK-3406) Extend RabbitMQ source with interface StoppableFunction

Matthias J. Sax created FLINK-3406: -- Summary: Extend RabbitMQ source with interface StoppableFunction Key: FLINK-3406 URL: https://issues.apache.org/jira/browse/FLINK-3406 Project: Flink

[jira] [Created] (FLINK-3405) Extend NiFiSource with interface StoppableFunction

Matthias J. Sax created FLINK-3405: -- Summary: Extend NiFiSource with interface StoppableFunction Key: FLINK-3405 URL: https://issues.apache.org/jira/browse/FLINK-3405 Project: Flink Issue

[jira] [Created] (FLINK-3404) Extend Kafka consumers with interface StoppableFunction

Matthias J. Sax created FLINK-3404: -- Summary: Extend Kafka consumers with interface StoppableFunction Key: FLINK-3404 URL: https://issues.apache.org/jira/browse/FLINK-3404 Project: Flink

Re: StateBackend

Anyone? Otherwise, I will suggest to move forward with the PR using the assumption that Redis must be started manually. -Matthias On 02/11/2016 08:28 PM, Matthias J. Sax wrote: > Hi, > > In Flink it is possible to have different backends for operator state. I > am wondering w

StateBackend

Hi, In Flink it is possible to have different backends for operator state. I am wondering what the best approach for different state backends would be. Let's assume the backend is a database server. The following questions arise: - Should the database server be started manually by the user or c

[jira] [Created] (FLINK-3356) JobClientActorRecoveryITCase.testJobClientRecovery

Matthias J. Sax created FLINK-3356: -- Summary: JobClientActorRecoveryITCase.testJobClientRecovery Key: FLINK-3356 URL: https://issues.apache.org/jira/browse/FLINK-3356 Project: Flink Issue

Re: Want Flink startup issues :-)

For the road map ideas, there are often no JIRAs created yet. Mostly, road map ideas are more complex things to get done, requiring design documents and discussions before the actual coding can be done. Usually, we create the JIRA (or multiple JIRAs) during the design phase. So just watch the mail

Re: Want Flink startup issues :-)

Hi Dongwon, very cool that you decided to join the community. Btw: very nice talk at Flink Forward! Fabian pointed out the most important things already. On more thing I wanted to add (just in case you are not aware of it already). There is a "How to contribute" section on the Flink web page: ht

[jira] [Created] (FLINK-3344) EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow

Matthias J. Sax created FLINK-3344: -- Summary: EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow Key: FLINK-3344 URL: https://issues.apache.org/jira/browse/FLINK-3344 Project

Re: New instable test?

And another one: https://travis-ci.org/mjsax/flink/jobs/107198383 This time it's EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow -Matthias On 02/05/2016 11:06 AM, Matthias J. Sax wrote: > Hi, > > I had a failing build last night: > https://travis-ci

New instable test?

Hi, I had a failing build last night: https://travis-ci.org/apache/flink/jobs/107116079 > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 21.782 sec > <<< FAILURE! - in org.apache.flink.runtime.client.JobClientActorRecoveryITCase > testJobClientRecovery(org.apache.flink.runtime.c

[jira] [Created] (FLINK-3323) Nifi connector not documented

Matthias J. Sax created FLINK-3323: -- Summary: Nifi connector not documented Key: FLINK-3323 URL: https://issues.apache.org/jira/browse/FLINK-3323 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3324) Flume connector not documented

Matthias J. Sax created FLINK-3324: -- Summary: Flume connector not documented Key: FLINK-3324 URL: https://issues.apache.org/jira/browse/FLINK-3324 Project: Flink Issue Type: Improvement

Re: Connector Documentation missing

Thanks for clarification! What about the missing documentation? On 02/03/2016 03:18 PM, Maximilian Michels wrote: > There is currently only a FlumeSink. The FlumeSource is a dummy file > (copied from the AvroSource) and needs to be removed. > > On Wed, Feb 3, 2016 at 3:11 PM, Mat

Re: Connector Documentation missing

t from my iPhone > >> On Feb 3, 2016, at 8:24 AM, Matthias J. Sax wrote: >> >> Hi, >> >> I just observed that there are 7 flink-streaming-connectors available >> but only 5 are documented on the web page. >> >> Flume and Nifi are not documented

Connector Documentation missing

Hi, I just observed that there are 7 flink-streaming-connectors available but only 5 are documented on the web page. Flume and Nifi are not documented. Did we miss to extend the documentation for both (which should have been part of the commit of the code) or was this left out on purpose? -Matth

Re: Release Flink 1.0.0

Hi, I also would like to get the STOP signal in. But I do not have time to work in it this week... According to Till's comments, this will be the last round of reviewing required. So I should be able to finish it till 3rd Feb, but not sure. What do you think about it? -Matthias On 01/25/2016 04

Re: Emitting to non-declared output stream

Please ignore. Wrong list. Sorry! On 01/19/2016 03:25 PM, Matthias J. Sax wrote: > Hi, > > currently, I am using Storm 0.9.3. For first tests on a new topology, I > use LocalCluster. It happened to me, that I emitted tuples to an output > stream, that I did never declare (and thus

Emitting to non-declared output stream

Hi, currently, I am using Storm 0.9.3. For first tests on a new topology, I use LocalCluster. It happened to me, that I emitted tuples to an output stream, that I did never declare (and thus not connect to). For this, I would expect an error message in the log. However, I don't get anything which

Re: [ANNOUNCE] Chengxiang Li added as committer

Congrats and welcome Chengxiang!! :) On 01/19/2016 12:56 PM, Kostas Tzoumas wrote: > Welcome Chengxiang!! > > On Tue, Jan 19, 2016 at 12:31 PM, Stephan Ewen wrote: > >> Good to have you on board! >> >> On Tue, Jan 19, 2016 at 11:29 AM, Maximilian Michels >> wrote: >> >>> Pleased to have you wi

[jira] [Created] (FLINK-3238) EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow()

Matthias J. Sax created FLINK-3238: -- Summary: EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow() Key: FLINK-3238 URL: https://issues.apache.org/jira/browse/FLINK-3238 Project: Flink

Re: [DISCUSS] Git force pushing and deletion of branchs

+1 On 01/13/2016 11:51 AM, Fabian Hueske wrote: > @Stephan: You mean all tags should be protected, not only those under rel? > > 2016-01-13 11:43 GMT+01:00 Till Rohrmann : > >> +1 for protecting the master branch. >> >> On Wed, Jan 13, 2016 at 11:42 AM, Li, Chengxiang >> wrote: >> >>> +1 on the

[jira] [Created] (FLINK-3214) WindowCheckpointingITCase

Matthias J. Sax created FLINK-3214: -- Summary: WindowCheckpointingITCase Key: FLINK-3214 URL: https://issues.apache.org/jira/browse/FLINK-3214 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-3212) JobManagerCheckpointRecoveryITCase

Matthias J. Sax created FLINK-3212: -- Summary: JobManagerCheckpointRecoveryITCase Key: FLINK-3212 URL: https://issues.apache.org/jira/browse/FLINK-3212 Project: Flink Issue Type: Bug

Empty test-jar

Hi, I want to use HttpTestClient from flink-runtime-web in flink-tests module. However, the test-jar file flink-runtime-web-1.0-SNAPSHOT-tests.jar is empty... Any ideas how to fix this? -Matthias signature.asc Description: OpenPGP digital signature

Serialization Bug ?

Hi, today, the following question appeared on SO: https://stackoverflow.com/questions/34596005/how-to-make-a-variable-available-to-all-of-the-taskmanagers-in-apache-flink This sounds like a bug to me... MyPartitioner seems not to get serialized and deserialized correctly, resulting in an empty li

[jira] [Created] (FLINK-3199) KafkaITCase.testOneToOneSources

Matthias J. Sax created FLINK-3199: -- Summary: KafkaITCase.testOneToOneSources Key: FLINK-3199 URL: https://issues.apache.org/jira/browse/FLINK-3199 Project: Flink Issue Type: Bug

Streaming Iterations, no headOperator ?

Hi, I am working on FLINK-1870 and my changes break some unit tests. The problem is in streaming.api.IterateTest. I tracked the problem down to StreamTask.registerInputOutput(). It calls headOperator.setup(...). My changes depend on this call, however, there is no head operator (ie, ==null), and

[jira] [Created] (FLINK-3175) KafkaITCase.testOffsetAutocommitTest

Matthias J. Sax created FLINK-3175: -- Summary: KafkaITCase.testOffsetAutocommitTest Key: FLINK-3175 URL: https://issues.apache.org/jira/browse/FLINK-3175 Project: Flink Issue Type: Bug

Re: Flink and Clojure

sspath. >> >> >> >> On Fri, Dec 11, 2015 at 1:31 AM, Nick Dimiduk wrote: >> >>> As far as the jvm is concerned, clojure is just another library. You >> should >>> be able to package it up like any other dependency and submit the job. >

Re: New Blog Post Draft

19,949 > Apache Storm 955 > Apache Flink 205 > > > Slim > > On Dec 11, 2015, at 4:10 AM, Matthias J. Sax wrote: > >> Just published it. Spread the word :) >> >> Thanks for all your valuable feedback! >> >

Re: New Blog Post Draft

Just published it. Spread the word :) Thanks for all your valuable feedback! On 12/10/2015 01:17 PM, Matthias J. Sax wrote: > Thanks for all your feedback! I updated the PR. > > I would like to publish the post today. Please let me know if you have > any more comments

Re: Flink and Clojure

>> dynamically loading classes. We can check and make sure that one is >> set, >>>> but if Closure does not respect that, we have a problem. >>>> Then Closure is not built for dynamic class loading. >>>> >>>> >>>> >>>>

Re: Flink and Clojure

am that is written in Clojure right now... On 12/10/2015 05:09 PM, Aljoscha Krettek wrote: > Clojure is not considering the user-jar when trying to load the class. > >> On 10 Dec 2015, at 17:05, Matthias J. Sax wrote: >> >> Hi Squirrels, >> >> I was playing with a F

Flink and Clojure

Hi Squirrels, I was playing with a Flink Clojure WordCount example today. https://github.com/mjsax/flink-external/tree/master/flink-clojure After building the project with "mvn package" I tried to submit it to a local cluster. Before I started the cluster, I manually copied "clojure-1.5.1.jar" in

Re: New Blog Post Draft

;>> Thank you for the blog post. You had already shared a first draft with >>> me. This one looks even better! >>> >>> I've made some minor comments. +1 to merge if these are addressed. >>> >>> Cheers, >>> Max >>> >&g

Re: New Blog Post Draft

; Can you open a pull request against the "flink-web" repo to make reviewing >> it easier? >> >> On Wed, Dec 9, 2015 at 11:32 AM, Matthias J. Sax wrote: >> >>> Hi, >>> >>> after talking to several people and getting some feedback already, I

  1   2   3   4   5   >