Re: [DISCUSS] Disable "Squash and merge" button for Flink repository on GitHub

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Seems, this will be fixed today: https://twitter.com/natfriedman/status/1235613840659767298?s=19 - -Matthias On 3/5/20 8:37 AM, Stephan Ewen wrote: > It looks like this feature still messes up email addresses, for > example if you do a "git log |

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 5/8/18 12:28 PM, Shuyi Chen wrote: > Congratulations! > > On Tue, May 8, 2018 at 12:18 PM, Dawid Wysakowicz < > wysakowicz.da...@gmail.com> wrote: > >> Congratulations Nico and Xingcan! Well deserved! >> >> >> On 08.05.2018 20:52,

Re: [ANNOUNCE] New committer: Sihua Zhou

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 6/22/18 10:33 AM, shimin yang wrote: > Congrats! > > On Sat, Jun 23, 2018 at 1:13 AM Chen Qin > wrote: > >> Congrats! >> >>> On Jun 22, 2018, at 9:48 AM, Ted Yu >>> wrote: >>> >>> Congratulations Sihua! >>> On Fri, Jun 22,

Re: [ANNOUNCE] New committer Piotr Nowojski

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 6/22/18 12:28 PM, Stefan Richter wrote: > Congrats Piotr! > >> Am 22.06.2018 um 21:26 schrieb Till Rohrmann >> : >> >> Hi everybody, >> >> On behalf of the PMC I am delighted to announce Piotr Nowojski as >> a new Flink committer! >

Re: [ANNOUNCE] New committer Piotr Nowojski

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 6/22/18 12:28 PM, Stefan Richter wrote: -BEGIN PGP SIGNATURE- Comment: GPGTools - https://gpgtools.org iQIzBAEBCgAdFiEEeiQdEa0SVXokodP3DccxaWtLg18FAlstTjMACgkQDccxaWtL g1+AgA/8DT/ZS8nUrE/DKWs5JPqEBTXvuR6f7/pfs12cJQ+vesbpIUxCB87

Re: [ANNOUNCE] New committer Gary Yao

Congrats! On 09/07/2018 08:15 AM, Timo Walther wrote: > Congratulations, Gary! > > Timo > > > Am 07.09.18 um 16:46 schrieb Ufuk Celebi: >> Great addition to the committers. Congrats, Gary! >> >> – Ufuk >> >> >> On Fri, Sep 7, 2018 at 4:45 PM, Kostas Kloudas >> wrote: >>> Congratulations Gary!

Re: [ANNOUNCE] New Flink PMC member Thomas Weise

-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 2/12/19 3:26 AM, Dian Fu wrote: > Congrats Thomas! > > Regards, Dian >> 在 2019年2月12日，下午6:58，Hequn Cheng 写道： >> >> Congrats Thomas! >> >> Best, Hequn >> >> >> On Tue, Feb 12, 2019 at 6:53 PM Stefan Richter >> >

Re: [DISCUSS] Java code style

gt;> the >>>> rules >>>>>>> pass. >>>>>>> >>>>>>> On Thu, Oct 22, 2015 at 3:29 PM, Fabian Hueske >>>> wrote: >>>>>>> >>>>>>>> Sure, I don't expect it to be free. >&g

Re: From 0.10 to 1.0

+1 for 1.0 it's time to "grow up" :) On 10/23/2015 12:52 PM, Kostas Tzoumas wrote: > +1 for 1.0, it's the right time if not a bit overdue in my opinion > > On Fri, Oct 23, 2015 at 12:06 PM, Fabian Hueske wrote: > >> Yes, let's do it >> +1 >> >> 2015-10-23 12:00 GMT+02:00 Stephan Ewen : >> >>> +

Re: [DISCUSS] Java code style

On 10/23/2015 01:59 PM, Fabian Hueske wrote: > And who should be "forced" to write the docs before the deadline passes? > That's not going to work either, IMO. > > 2015-10-23 13:13 GMT+02:00 Matthias J. Sax : > >> I don't care about line length. >

Re: [DISCUSS] Java code style

efaults back to lazily adding JavaDocs (with some > bookkeeping). > > I'd be +1 for that. > > 2015-10-23 14:09 GMT+02:00 Matthias J. Sax : > >> A "deadline" is not really forcible. >> >> However, if we have a JIRA for each module, we can enabl

Re: [DISCUSS] Introducing a review process for pull requests

me way to integrate this into JIRA, so we can easily see (and >>>>>>> filter/sort) lingering PRs? >>>>>>> >>>>>>> Cheers, >>>>>>> Theo >>>>>>> >>>>>>> On Wed, Oct 7, 2015 at

Web Page Issue

Hi, I am not sure, but I guess there is something wrong on the web page. If you click on "Overview" in the menu bar at the start page (https://flink.apache.org/), it links to https://flink.apache.org/index.html This seems to be wrong to me. I guess it should link to https://ci.apache.org/projects

Re: Web Page Issue

Makes sense. Besides the color scheme, we might also want to use different menu structure and avoid to link "forth-and-back" to make the distinction clearer. On 10/26/2015 10:35 AM, Ufuk Celebi wrote: > >> On 26 Oct 2015, at 10:27, Fabian Hueske wrote: >> >> The website consists of two parts wh

Re: [DISCUSS] Introducing a review process for pull requests

eve he/ she needs review,especially with large >> patch, then he/ she should send PR for review. >> >> >> - Henry >> >> On Sat, Oct 24, 2015 at 3:53 AM, Matthias J. Sax wrote: >>> Great work! >>> >>> What puzzles me a little bit, is

Re: [DISCUSS] flink-external

place for this. >> I would actually put it under "Community", with a header "External >> Contributions" or something like this, but I'm not feeling strong about >> this :) >> >> -Vasia. >> >> >> On 9 October 2015 at 15:29, Matthias

Re: Web Page Issue

I started to work on this. Please see here: https://github.com/mjsax/flink/tree/flink-2752-webpage Basically, I just changed the color schema of the menu. I also remove "How to Contribute" and "Coding Guidelines" from "Internals". To get an even better separation, I would like to change the menu

Re: Web Page Issue

e: > Hi Matthias, > > thanks for taking care of this issue. > How about we change the menu completely, i.e., have menue entries for: > > - Project Website > - Setup > - Local > - Cluster > - Yarn > - DataSet API > - Programming guide > - transformations > -

Flink "Material"

Hi, I just "discovered" that on the Flink "Material" page, a couple of slide decks are listed (https://flink.apache.org/material.html). I guess, this list is far from complete. Should we try to extend it? -Matthias signature.asc Description: OpenPGP digital signature

Re: [DISCUSS] flink-external

Just updated this. Improved the layout and added FastR project. https://github.com/mjsax/flink-web/tree/flink-external-page -Matthias On 10/27/2015 03:25 AM, Matthias J. Sax wrote: > Hi, > > I updated the flink-external section on the Flink Web-Page: > https://github.com/mjsax/fl

Re: Web Page Issue

pache.org/index.html. Hence, it can > stay in the menu and should not be moved under Documentation. > > I would also add a dedicated "Project Website" link to the Documentation > menu in addition to the link on the logo. > > 2015-10-27 20:39 GMT+01:00 Matthias J. Sax : &

Re: Web Page Issue

e about the Logo issue. IMO, there should be always a text >>> link. The logo link should only be an addition. >>> >>> Maybe we should wait for more opinions, before we continue. >>> The website has been changed a couple of times, so it would be good to >> get &

Re: Web Page Issue

ckstarts should be very easy to discover, so we should keep > them on the main page. If you just browse to flink.apache.org you would not > be aware that they exist. >> On 28 Oct 2015, at 13:37, Matthias J. Sax wrote: >> >> What about "Quickstart" menu point... I

New JobManager web frontend

Hi, I was just playing with the new JobManager web frontend and missing a button to cancel a running job. It there no such button, or is it hidden somewhere? -Matthias signature.asc Description: OpenPGP digital signature

Re: Flink "Material"

2015 10:53: >> >>> Yes, you can find lots of Flink slides on the Slideshare. >>> >>> On Tue, Oct 27, 2015 at 9:46 PM, Matthias J. Sax >> wrote: >>> >>>> Hi, >>>> >>>> I just "discovered" that on the Flink "Ma

Re: [DISCUSS] Java code style

effort gives us >> good >>>>>>>> comments, actually. It just gives us checkmark comments that make >> the >>>>> rules >>>>>>>> pass. >>>>>>>> >>>>>>>&

Re: [DISCUSS] flink-external

What is the status here: https://github.com/apache/flink-web/pull/12 Please give feedback. On 10/28/2015 11:02 AM, Maximilian Michels wrote: > Thanks Matthias! I made a comment. Please open a pull request. > > On Tue, Oct 27, 2015 at 10:37 PM, Matthias J. Sax wrote: >> Ju

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc4)

You added Storm dependency? Why? Which version? How does it affect storm-compatibility? We decided to not include Storm as dependency to Flink when I started with it. Thus, fat-jars must include Storm classes if storm-compat is use. On 11/02/2015 03:07 PM, Maximilian Michels wrote: > Alright. Goo

[Webpage update] New Slides

Hi, I just opened a PR that updates the list of slide in the "Materials" page. I browsed slideshare profiles I am aware of and added everything I thought it might be interesting, while not being too repetitive. Additionally, I linked dataArtisan's slideshare profile and Flink training material, F

Re: Flink "Material"

keep up to date anyways... > > On Mon, Nov 2, 2015 at 5:26 AM, Matthias J. Sax wrote: > >> Will do. >> >> -Matthias >> >> On 11/02/2015 11:34 AM, Robert Metzger wrote: >>> I would really love to see it extended. >>> Do you have time for opening

[Summary] Homepage and Docu

Hi, according to the feedback I got so far, I have three open PRs for the webpage and docu now. I summarize this, because I want to merge all of them at once (to avoid rebuilding the webpage multiple times). Additionally, I want to apply one more change (see below). 1) adding third-party (externa

Re: Web interface to submit jobs

I like the idea in general! Not sure if integrating it into JobMangaer Webinterface is good or not... What would be the pros/cons for standalone vs. integrated? -Matthias On 11/05/2015 05:23 AM, Sachin Goel wrote: > Hi all > Are there any plans to upgrade the webclient interface? It could certain

Re: Web interface to submit jobs

ace a lot. In particular for users new to the system, its >> a >>>> very >>>>>>>> convenient feature. >>>>>>>> We would also get rid of this ugly, old web client :) >>>>>>>> >>>>>>>&

Re: Flink deployment fabric script

Hi Do, thanks for you interest in Flink. It is great that you want to contribute to the system. Right now, I am not sure how your script could be integrated into Flink. As a reference, please read the following guidelines: https://flink.apache.org/how-to-contribute.html https://flink.apache.org/

Python Examples

Hi, Slim recently twittered about Will McGinnis Python examples on Flink. https://github.com/wdm0006/flink-python-examples I think it would be nice to add it to the third party section on the web page. Does anyone have any objections about it? If not, I will add it the next days. -Matthias

Re: [DISCUSSION] Consistent shutdown of streaming jobs

I was thinking about this issue too and wanted to include it in my current PR (I just about to rebase it to the current master... https://github.com/apache/flink/pull/750). Or should be open a new JIRA for it and address it after Stop signal is available? -Matthias On 11/12/2015 11:47 AM, Maxim

Fwd: Re: Storm Compatibility

you change the dop from 4 to 1 WordCountTopology ? We should test in parallel fashion... * Too many reformatting changes ;) You though many classes without any actual code changes. Forwarded Message Subject: Re: Storm Compatibility Date: Fri, 13 Nov 2015 12:15:19 +0100 From:

Re: Fwd: Re: Storm Compatibility

About DataStream extension and setting storm dependency to provided. If this works, a big +1 from my side. -Matthias On 11/14/2015 05:13 PM, Matthias J. Sax wrote: > I just had a look at your proposal. It makes a lot of sense. I still > believe that it is a matter of taste if one prefer

Redis connector for Flink

Hi, I was just wondering if we should put a Redis connector for Flink on the agenda. Or do we have a JIRA for this already? If not, just having a JIRA might trigger some external contribution for it :) -Matthias signature.asc Description: OpenPGP digital signature

Re: Redis connector for Flink

I was thinking about source, sink. But why not as a state backend, too. On 11/17/2015 12:08 PM, Stephan Ewen wrote: > Nice idea! > > Do you mean Redis as a state backend, a source, or a sink? > > On Tue, Nov 17, 2015 at 11:41 AM, Matthias J. Sax wrote: > >> Hi, >&

Re: [DISCUSS] Release Flink 0.10.1 soon

If we find more bugs later on, we could have a 0.10.2, too. +1 for quick bug fix release. Question: should bug fix releases contain fixes for core components only? I would have a fix for a bug in Storm compatibility -- not sure if it should be included or not -Matthias On 11/20/2015 12:35 PM, T

Re: [DISCUSS] Release Flink 0.10.1 soon

no 0.10.1 branch yet, right?) -Matthias On 11/20/2015 01:54 PM, Till Rohrmann wrote: > If it' not API breaking, then it can be included imo. > > On Fri, Nov 20, 2015 at 1:44 PM, Matthias J. Sax wrote: > >> If we find more bugs later on, we could have a 0.10.2, too. &

Re: Storm Compatibility

>> >> Absolutely. Already reverted this locally. >> >>> * Too many reformatting changes ;) You though many classes without any >>> actual code changes. >> >> Yes, I ran "Optimize Imports" in IntelliJ. Sorry for that but this >> only affects

Re: how to write dataset in a file?

I would not set > ExecutionEnvironment env = > ExecutionEnvironment.createLocalEnvironment().setParallelism(1); because this changes the default parallelism of *all* operator to one. Instead, only set the parallelism of the **sink** to one (as described here: https://stackoverflow.com/questions/

Re: Storm Compatibility

lFlinkMiniCluster.scala > > > Not sure if this is an issue but after including scala dependencies > everything worked well. ;) > > > On Fri, Nov 20, 2015 at 4:12 PM, Matthias J. Sax wrote: > >> Multiple inputs per bolt is currently not supported. :( >> Fli

Slinding Window Join (without duplicates)

Hi, it seems that a join on the data streams with an overlapping sliding window produces duplicates in the output. The default implementation internally just use two nested-loops over both windows to compute the result. How can duplicates be avoided? Is there any way after all right now? If not,

Re: Slinding Window Join (without duplicates)

s a problem. If a user specifies sliding windows then >> one element can (and will) end up in several windows. If these are joined >> then there will be multiple results. If the user does not want multiple >> windows then tumbling windows should be used. >> >> IMHO, this

Re: withParameters() for Streaming API

We had this discussion a while ago. If I recall correctly, "withParameters()" is not encourage to be used in DataSet either. This is the thread: https://mail-archives.apache.org/mod_mbox/flink-dev/201509.mbox/%3C55EC69CD.1070003%40apache.org%3E -Matthias On 11/24/2015 02:14 PM, Timo Walther wro

Flink Master on Travis

Hi, I just observed that a couple of builds failed recently due to timeout... Is there anything we can do about this? Two recent build passed but took 1:56:25, 1:50:47 what is close to the 2h time limit, too. Just increasing the timeout seems no a good idea I guess. -Matthias signature.asc

JobManagerCheckpointRecoveryITCase

Hi, I had a failing build due to "Maven produced no output for 300 seconds." It seems that > JobManagerCheckpointRecoveryITCase.testCheckpointedStreamingSumProgram() got stuck. Did anyone see this before? Should I open an "instable-test" JIRA? https://travis-ci.org/mjsax/flink/jobs/95439206 -M

New Blog Post Draft

Hi, after talking to several people and getting some feedback already, I would like to suggest a new blog post for the project web site about the Storm compatibility layer. You can find the draft here: https://github.com/mjsax/flink-web/blob/stormCompatibilityBlogPost/_posts/2015-12-07-storm-comp

Re: New Blog Post Draft

; Can you open a pull request against the "flink-web" repo to make reviewing >> it easier? >> >> On Wed, Dec 9, 2015 at 11:32 AM, Matthias J. Sax wrote: >> >>> Hi, >>> >>> after talking to several people and getting some feedback already, I

Re: New Blog Post Draft

;>> Thank you for the blog post. You had already shared a first draft with >>> me. This one looks even better! >>> >>> I've made some minor comments. +1 to merge if these are addressed. >>> >>> Cheers, >>> Max >>> >&g

Flink and Clojure

Hi Squirrels, I was playing with a Flink Clojure WordCount example today. https://github.com/mjsax/flink-external/tree/master/flink-clojure After building the project with "mvn package" I tried to submit it to a local cluster. Before I started the cluster, I manually copied "clojure-1.5.1.jar" in

Re: Flink and Clojure

am that is written in Clojure right now... On 12/10/2015 05:09 PM, Aljoscha Krettek wrote: > Clojure is not considering the user-jar when trying to load the class. > >> On 10 Dec 2015, at 17:05, Matthias J. Sax wrote: >> >> Hi Squirrels, >> >> I was playing with a F

Re: Flink and Clojure

>> dynamically loading classes. We can check and make sure that one is >> set, >>>> but if Closure does not respect that, we have a problem. >>>> Then Closure is not built for dynamic class loading. >>>> >>>> >>>> >>>>

Re: New Blog Post Draft

Just published it. Spread the word :) Thanks for all your valuable feedback! On 12/10/2015 01:17 PM, Matthias J. Sax wrote: > Thanks for all your feedback! I updated the PR. > > I would like to publish the post today. Please let me know if you have > any more comments

Re: New Blog Post Draft

19,949 > Apache Storm 955 > Apache Flink 205 > > > Slim > > On Dec 11, 2015, at 4:10 AM, Matthias J. Sax wrote: > >> Just published it. Spread the word :) >> >> Thanks for all your valuable feedback! >> >

Re: Flink and Clojure

sspath. >> >> >> >> On Fri, Dec 11, 2015 at 1:31 AM, Nick Dimiduk wrote: >> >>> As far as the jvm is concerned, clojure is just another library. You >> should >>> be able to package it up like any other dependency and submit the job. >

Streaming Iterations, no headOperator ?

Hi, I am working on FLINK-1870 and my changes break some unit tests. The problem is in streaming.api.IterateTest. I tracked the problem down to StreamTask.registerInputOutput(). It calls headOperator.setup(...). My changes depend on this call, however, there is no head operator (ie, ==null), and

Serialization Bug ?

Hi, today, the following question appeared on SO: https://stackoverflow.com/questions/34596005/how-to-make-a-variable-available-to-all-of-the-taskmanagers-in-apache-flink This sounds like a bug to me... MyPartitioner seems not to get serialized and deserialized correctly, resulting in an empty li

Empty test-jar

Hi, I want to use HttpTestClient from flink-runtime-web in flink-tests module. However, the test-jar file flink-runtime-web-1.0-SNAPSHOT-tests.jar is empty... Any ideas how to fix this? -Matthias signature.asc Description: OpenPGP digital signature

Re: [DISCUSS] Git force pushing and deletion of branchs

+1 On 01/13/2016 11:51 AM, Fabian Hueske wrote: > @Stephan: You mean all tags should be protected, not only those under rel? > > 2016-01-13 11:43 GMT+01:00 Till Rohrmann : > >> +1 for protecting the master branch. >> >> On Wed, Jan 13, 2016 at 11:42 AM, Li, Chengxiang >> wrote: >> >>> +1 on the

Re: [ANNOUNCE] Chengxiang Li added as committer

Congrats and welcome Chengxiang!! :) On 01/19/2016 12:56 PM, Kostas Tzoumas wrote: > Welcome Chengxiang!! > > On Tue, Jan 19, 2016 at 12:31 PM, Stephan Ewen wrote: > >> Good to have you on board! >> >> On Tue, Jan 19, 2016 at 11:29 AM, Maximilian Michels >> wrote: >> >>> Pleased to have you wi

Emitting to non-declared output stream

Hi, currently, I am using Storm 0.9.3. For first tests on a new topology, I use LocalCluster. It happened to me, that I emitted tuples to an output stream, that I did never declare (and thus not connect to). For this, I would expect an error message in the log. However, I don't get anything which

Re: Emitting to non-declared output stream

Please ignore. Wrong list. Sorry! On 01/19/2016 03:25 PM, Matthias J. Sax wrote: > Hi, > > currently, I am using Storm 0.9.3. For first tests on a new topology, I > use LocalCluster. It happened to me, that I emitted tuples to an output > stream, that I did never declare (and thus

Re: Release Flink 1.0.0

Hi, I also would like to get the STOP signal in. But I do not have time to work in it this week... According to Till's comments, this will be the last round of reviewing required. So I should be able to finish it till 3rd Feb, but not sure. What do you think about it? -Matthias On 01/25/2016 04

Connector Documentation missing

Hi, I just observed that there are 7 flink-streaming-connectors available but only 5 are documented on the web page. Flume and Nifi are not documented. Did we miss to extend the documentation for both (which should have been part of the commit of the code) or was this left out on purpose? -Matth

Re: Connector Documentation missing

t from my iPhone > >> On Feb 3, 2016, at 8:24 AM, Matthias J. Sax wrote: >> >> Hi, >> >> I just observed that there are 7 flink-streaming-connectors available >> but only 5 are documented on the web page. >> >> Flume and Nifi are not documented

Re: Connector Documentation missing

Thanks for clarification! What about the missing documentation? On 02/03/2016 03:18 PM, Maximilian Michels wrote: > There is currently only a FlumeSink. The FlumeSource is a dummy file > (copied from the AvroSource) and needs to be removed. > > On Wed, Feb 3, 2016 at 3:11 PM, Mat

New instable test?

Hi, I had a failing build last night: https://travis-ci.org/apache/flink/jobs/107116079 > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 21.782 sec > <<< FAILURE! - in org.apache.flink.runtime.client.JobClientActorRecoveryITCase > testJobClientRecovery(org.apache.flink.runtime.c

Re: New instable test?

And another one: https://travis-ci.org/mjsax/flink/jobs/107198383 This time it's EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow -Matthias On 02/05/2016 11:06 AM, Matthias J. Sax wrote: > Hi, > > I had a failing build last night: > https://travis-ci

Re: Want Flink startup issues :-)

Hi Dongwon, very cool that you decided to join the community. Btw: very nice talk at Flink Forward! Fabian pointed out the most important things already. On more thing I wanted to add (just in case you are not aware of it already). There is a "How to contribute" section on the Flink web page: ht

Re: Want Flink startup issues :-)

For the road map ideas, there are often no JIRAs created yet. Mostly, road map ideas are more complex things to get done, requiring design documents and discussions before the actual coding can be done. Usually, we create the JIRA (or multiple JIRAs) during the design phase. So just watch the mail

StateBackend

Hi, In Flink it is possible to have different backends for operator state. I am wondering what the best approach for different state backends would be. Let's assume the backend is a database server. The following questions arise: - Should the database server be started manually by the user or c

Re: StateBackend

Anyone? Otherwise, I will suggest to move forward with the PR using the assumption that Redis must be started manually. -Matthias On 02/11/2016 08:28 PM, Matthias J. Sax wrote: > Hi, > > In Flink it is possible to have different backends for operator state. I > am wondering w

Re: StateBackend

gt; directory, and such). Then, however, care needs to be taken to make sure >> that the state inside the one redis instance does not clash. >> >> Cheers, >> Aljoscha >>> On 15 Feb 2016, at 14:53, Matthias J. Sax wrote: >>> >>> Anyone? >>> >>

Re: Guarantees for object reuse modes and documentation

Hi, I like Fabian's proposal. The idea of object reuse is performance gain, and we should not sacrifice this. Even more important is that the rules are easy to understand! -Matthias On 02/17/2016 06:17 PM, Fabian Hueske wrote: > Hi, > > > > Flink's DataSet API features a configuration parame

Submission Problem

Hi, I just tried to submit Flink's Storm-Topology example via command line: bin/flink run ~/workspace_flink/flink/flink-contrib/flink-storm-examples/target/WordCount-StormTopology.jar However, I get a timeout and the program is not submitted. I tracked the problem down to the following statemen

Re: Submission Problem

enclosed the logs.. maybe you can make some sense out if them. On 03/31/2016 02:52 PM, Till Rohrmann wrote: > I would assume that something went wrong on the JobManager side. Could you > check the logs if they contain something suspicious? Additionally you could > turn on lifecycle event logging​

Re: Submission Problem

ava:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > ] On 03/31/2016 04:31 PM, Till Rohrmann wrote: > Could you please rerun the whole job with debug log level and logging of > Akka's lifecycle events turned on? > &g

Re: Submission Problem

that the JobManager tries to load that class directly from > the actor message. > All user code should be deserialized lazily. > > How is that class passed? Implicitly through some config? > > On Thu, Mar 31, 2016 at 4:51 PM, Matthias J. Sax wrote: > >> Here we go... >>

Failing Test

Anyone seen this before? One-time thing or test instability? > ClusterShutdownITCase.testClusterShutdown:71 assertion failed: timeout > (29848225634 nanoseconds) during expectMsgClass waiting for class > org.apache.flink.runtime.clusterframework.messages.StopClusterSuccessful -Matthias sign

Re: Failing Test

ecently added with the resource management >>> refactoring. It's probably just a too aggressive timeout for Travis. >>> >>> @Max: Did you ever see this fail? >>> >>> – Ufuk >>> >>> On Fri, Apr 1, 2016 at 9:24 AM, Matthias

Broken links after doc resturcturing

Hi, I just realized, that the restructuring of the programming guide in our documentation https://github.com/apache/flink/commit/ad267a4b199979536dd8a5572628eefc77d7e0f4) broke a couple of links from the Flink blog. Should we update those older blog post? JIRA for it? For the future: would it be

Re: Broken links after doc resturcturing

> > We can also provide redirects for the broken links. With 1.0, we now > should be more careful to not break/redirect links... > > > On Mon, Apr 4, 2016 at 2:53 PM, Matthias J. Sax wrote: >> Hi, >> >> I just realized, that the restructuring of the pro

Re: Failing Test

s, >>> >>> the test has been only recently added with the resource management >>> refactoring. It's probably just a too aggressive timeout for Travis. >>> >>> @Max: Did you ever see this fail? >>> >

Re: Broken links after doc resturcturing

Anyone? On 04/04/2016 05:06 PM, Matthias J. Sax wrote: > Hi, > > I just stepped through the whole blog. Some stuff can get fixed easily, > more links should just be removed, and for some I am not sure what to do > about (quite old stuff). > > I put my though about each br

Re: Broken links after doc resturcturing

p Compatibility in Flink) > > - Links that point to a changing URL (docs-master or Github master > branch) to point to the release around that time. > > - Links from news that have no match any more should probably be > dropped... > > Stephan > > > > On Th

Re: Issue deploying a topology to flink with a java api

Hi jstar, I need to have a close look. But I am wondering why you use reflection in the first place? Is there any specific reason for that? Furthermore, the example provided in project maven-example also covers the case to submit a topology to Flink via Java. Have a look at org.apache.flink.storm

Re: Issue deploying a topology to flink with a java api

t from the jar > to submit it to flink. > > I know that is possible because I have used the same procedure with a storm > topology that it works perfectly well. > What I'm missing please? > jstar > > Le Mercredi 13 avril 2016 19h23, Matthias J. Sax a > écrit :

Re: Issue deploying a topology to flink with a java api

tTopology(topologyId, > uploadedJarLocation, getFlinkTopogy(String.format("file://%s", > jarPath),properties.getProperty("topologyMainClass"), > properties.getProperty("methodName"))); > Where getFlinkTopology() return the contains actually topology > >

Re: Issue deploying a topology to flink with a java api

complains that > it could not satisfy the given dependency. > > Le Jeudi 14 avril 2016 10h45, star jlong a > écrit : > > > Yes it is. > > Le Jeudi 14 avril 2016 10h39, Matthias J. Sax a écrit : > > > For the fix, you need to use the curre

Re: Issue deploying a topology to flink with a java api

tter > > Btw, the dependency > org.apache.flink > flink-storm-examples_2.11 > 1.1-SNAPSHOT > > Could not be satisfy, but this one could be > org.apache.flink > flink-storm_2.10 1.1-SNAPSHOT > > > Le Jeudi 14 avril 2016 13h05, Matthias J. Sax a écrit : &

Re: Flink optimizer optimizations

Assume you have a groupBy followed by a join. DataSet1 (nor sorted) -> groupBy(A) --> join(1.A == 2.A) ^ DataSet2 (sorted on A) -+ For groupBy(A) of DataSet1 the optimizer can pick hash-grouping or the more expensive sort-based-grouping. If

Re: Flink optimizer optimizations

Sure. WITHOUT. Thanks. Good catch :) On 04/16/2016 01:18 PM, Ufuk Celebi wrote: > On Sat, Apr 16, 2016 at 1:05 PM, Matthias J. Sax wrote: >> (with the need to sort the data, because both >> datasets will be sorted on A already). Thus, the overhead of sorting in >> the grou

Re: Problem with flink while development

If you work on plain Integer (or other non-POJO types) you need to provide a KeySelector to make it work. For you case something like this: .keyBy(new KeySelector() { @Override public Integer getKey(Integer value) throws Exception { return value; } }) As S

Eclipse Problems

Hi, someone put this question on SO: https://stackoverflow.com/questions/36824684/eclipse-imported-maven-project-cannot-resolve-symbols-in-other-imported-maven-pr I can only confirm that Eclipse does not build Flink anymore. It shows "103 Errors" in my case. Not sure how many Eclipse users are st

Re: Eclipse Problems

t;> On Mon, Apr 25, 2016 at 12:14 AM, Matthias J. Sax >> wrote: >>> What do you think about this? >> >> Hey Matthias! >> >> Thanks for bringing this up. >> >> I think it is very desirable to keep support for Eclipse. It's quite a >> h

Re: Eclipse Problems

this does not happen and .fromElemenst(Object[]) is called. Even if there is still an exception, I got the impression that this test does not what the intention was. If might be good to change fromElementsWithBaseTypeTest2 to > env.fromElements(new SubClass(1, "Java"), new ParentClass(1, &q

  1   2   3   4   5   >