Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Ted Yu
Congratulations, Xingcan and Nico ! On Tue, May 8, 2018 at 11:52 AM, Fabian Hueske wrote: > Hi everyone, > > I'm happy to announce that two members of the Flink community accepted the > offer of the PMC to become committers. > > * Xingcan Cui has been contributing to Flink for about a year, focu

Re: [VOTE] Release 1.5.0, release candidate #2

2018-05-10 Thread Ted Yu
I ran the test suite twice and both failed with: Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 9.784 sec <<< FAILURE! - in org.apache.flink.runtime.jobmanager.scheduler.ScheduleOrUpdateConsumersTest org.apache.flink.runtime.jobmanager.scheduler.ScheduleOrUpdateConsumersTest Time

Re: Snapshots and RC-candidate maven artifacts

2018-05-14 Thread Ted Yu
Flavio: Can you use the snapshot for 1.5 RC ? https://repository.apache.org/content/repositories/orgapacheflink-1154/ It was uploaded on Apr 2nd. FYI On Mon, May 14, 2018 at 7:54 AM, Fabian Hueske wrote: > Hi, > > I'd assume that we stopped updating 1.5-SNAPSHOT jars when we forked off > the r

Re: [VOTE] Release 1.5.0, release candidate #2

2018-05-14 Thread Ted Yu
Can you try out mvn 3.5.2 ? I don't get the error when running the command line you gave. BTW 2.7.3.2.6.2.0-205 was quite old release. Cheers On Mon, May 14, 2018 at 7:15 AM, shashank734 wrote: > While building from source failing with following error : > > Failed to execute goal > org.apache

Re: Closing (automatically?) inactive pull requests

2018-05-14 Thread Ted Yu
bq. this pull request requires a review, please simply write any comment. Shouldn't the wording of such comment be known before hand ? Otherwise pull request waiting for committers' review may be mis-classified. Cheers On Mon, May 14, 2018 at 7:59 PM, blues zheng wrote: > +1 for the proposal.

Re: Closing (automatically?) inactive pull requests

2018-05-15 Thread Ted Yu
t;> a > >>> chance for getting merged. > >>> > >>> Best, Fabian > >>> > >>> > >>> - > >>> > >>> 2018-05-15 9:13 GMT+02:00 Chesnay Schepler : > >>> > >>> -1 > >>&g

Re: [DISCUSS] Adding new interfaces in [Stream]ExecutionEnvironment

2018-05-16 Thread Ted Yu
bq. In a design document, Timo mentioned that we can ship multiple JAR files Mind telling us where the design doc can be retrieved ? Thanks On Wed, May 16, 2018 at 1:29 AM, Fabian Hueske wrote: > Hi, > > I'm not sure if we need to modify the existing method. > What we need is a bit different f

Re: [DISCUSS] Drop "canEqual" from TypeInformation, TypeSerializer, etc.

2018-05-16 Thread Ted Yu
+1 from me as well. I checked a few serializer classes. The `equals` method on serializers contains the logic of `canEqual` method whose existence seems redundant. On Wed, May 16, 2018 at 1:49 AM, Tzu-Li (Gordon) Tai wrote: > +1. > > Looking at the implementations of the `canEqual` method in se

Re: [DISCUSS] GitBox

2018-05-16 Thread Ted Yu
+1 Original message From: Shuyi Chen Date: 5/16/18 1:12 PM (GMT-08:00) To: dev@flink.apache.org Subject: Re: [DISCUSS] GitBox +1 :) A lot of projects are already using it. On Wed, May 16, 2018 at 3:40 AM, Chesnay Schepler wrote: > Hell

Re: [VOTE] Release 1.5.0, release candidate #4

2018-05-18 Thread Ted Yu
When I ran tests, I hit FLINK-9091 . It seems Timo already has a fix. It would be nice to include the fix since flink-json module is new in 1.5 release. On Fri, May 18, 2018 at 9:26 AM, Till Rohrmann wrote: > Hi everyone, > > since the effective voting period for the RC4 was quite short and it

Re: [VOTE] Release 1.5.0, release candidate #4

2018-05-18 Thread Ted Yu
elease it. > > Since it's hard to reproduce, we cannot be sure that Timo's fix actually > solves the problem. > We can merge the fix to the master and see if the problem goes away. > > Best, Fabian > > 2018-05-18 18:31 GMT+02:00 Ted Yu : > > > When I ran tests, I

Re: [VOTE] Enable GitBox integration (#2)

2018-05-22 Thread Ted Yu
+1 Original message From: Chesnay Schepler Date: 5/22/18 1:12 AM (GMT-08:00) To: dev@flink.apache.org Subject: [VOTE] Enable GitBox integration (#2) Hello, since no concerns have been raised in the discussion about enabling GitBox [1] I'm opening this vote to make things of

Re: [VOTE] Release 1.5.0, release candidate #5

2018-05-23 Thread Ted Yu
+1 Checked signatures Ran test suite Due to FLINK-9340 and FLINK-9091, I had to run tests in multiple rounds. Cheers On Wed, May 23, 2018 at 7:39 AM, Fabian Hueske wrote: > +1 (binding) > > - checked hashes and signatures > - checked source archive and didn't find unexpected binary files > -

Re: [PROPOSAL] Improving Flink’s timer management for large state

2018-05-27 Thread Ted Yu
+1 Original message From: Bowen Li Date: 5/27/18 12:31 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: [PROPOSAL] Improving Flink’s timer management for large state +1 LGTM. RocksDB timer service is one of the most highly anticipated features from Flink users, and it's f

Re: [WEBSITE] Proposal to rework the Flink website

2018-06-05 Thread Ted Yu
+1 On Tue, Jun 5, 2018 at 9:46 AM, Stephan Ewen wrote: > Big +1 to this! > > I would like to contribute to this effort and help strengthen the way Flink > presents itself. > > > On Tue, Jun 5, 2018 at 11:56 AM, Fabian Hueske wrote: > > > Hi everybody, > > > > I've opened a PR [1] that reworks p

Re: Static code analysis for Flink project

2018-06-12 Thread Ted Yu
I took a look at some of the blocker defects. e.g. https://sonarcloud.io/project/issues?id=org.apache.flink%3Aflink-parent&open=AWPxETxA3e-qcckj1Sl1&resolved=false&severities=BLOCKER&types=BUG For ./flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/s

Re: how to build the connectors and examples from the source

2018-06-12 Thread Ted Yu
Which connector from the following list are you trying to build ? https://flink.apache.org/ecosystem.html#connectors The available connectors from 1.5.0 are quite recent. Is there any functionality missing in the 1.5.0 release ? Thanks On Tue, Jun 12, 2018 at 5:17 PM, Chris Kellogg wrote: > H

Re: Please review FLINK-9610 Add Kafka partitioner that uses the key to partition by

2018-06-19 Thread Ted Yu
Interesting enhancement. I left a minor comment on the PR. Cheers On Tue, Jun 19, 2018 at 12:26 AM, Niels Basjes wrote: > Hi, > > Yesterday we ran into problems regarding the distribution of records across > Kafka where Flink was used as the producer. So we fixed this and realized > that the c

Re: [ANNOUNCE] New committer: Sihua Zhou

2018-06-22 Thread Ted Yu
Congratulations Sihua! On Fri, Jun 22, 2018 at 6:42 AM, zhangminglei <18717838...@163.com> wrote: > Congrats! Sihua > > Cheers > Minglei. > > > 在 2018年6月22日,下午9:17,Till Rohrmann 写道: > > > > Hi everybody, > > > > On behalf of the PMC I am delighted to announce Sihua Zhou as a new Flink > > commit

Re: [ANNOUNCE] New committer Piotr Nowojski

2018-06-22 Thread Ted Yu
Congratulations, Piotr! On Fri, Jun 22, 2018 at 12:26 PM, Till Rohrmann wrote: > Hi everybody, > > On behalf of the PMC I am delighted to announce Piotr Nowojski as a new > Flink > committer! > > Piotr has been an active member of our community for more than a year. > Among other things, he cont

Re: [Flink-9407] Question about proposed ORC Sink !

2018-06-22 Thread Ted Yu
For #1, the word exist should be exit, right ?Thanks Original message From: zhangminglei <18717838...@163.com> Date: 6/23/18 10:12 AM (GMT+08:00) To: sagar loke Cc: dev , user Subject: Re: [Flink-9407] Question about proposed ORC Sink ! Hi, Sagar. 1. It solves the issue par

Re: Job jumbo jar can't be extracted on Windows

2018-07-03 Thread Ted Yu
Looking at javadoc of separatorChar : * The system-dependent default name-separator character. This field is * initialized to contain the first character of the value of the system * property file.separator. On UNIX systems the value of this * field is '/'; on Microsoft Wi

Re: Flink Kafka TimeoutException

2018-07-05 Thread Ted Yu
Have you tried increasing the request.timeout.ms parameter (Kafka) ? Which Flink / Kafka release are you using ? Cheers On Thu, Jul 5, 2018 at 5:39 AM Amol S - iProgrammer wrote: > Hello, > > I am using flink with kafka and getting below exception. > > org.apache.kafka.common.errors.TimeoutExc

Re: [VOTE] Release 1.5.1, release candidate #2

2018-07-06 Thread Ted Yu
+1 Checked signatures of artifacts Ran test suite On Fri, Jul 6, 2018 at 11:42 AM Yaz Sh wrote: > +1 > > Tests have been done on OS X > > - Ran in cluster mode ./bin/start-cluster.sh > - Checked that *.out files are empty > - Stopped cluster ./bin/stop-cluster.sh > - Checked for No Exceptions

Re: [ANNOUNCE] New committer: Theodore Vasiloudis

2017-03-21 Thread Ted Yu
Congratulations ! On Tue, Mar 21, 2017 at 11:00 AM, Matthias J. Sax wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > Congrats! > > On 3/21/17 8:59 AM, Greg Hogan wrote: > > Welcome, Theo, and great to have you onboard with Flink and ML! > > > > > >> On Mar 21, 2017, at 4:35 AM, Ro

Re: [DISCUSS] TravisCI auto cancellation

2017-03-26 Thread Ted Yu
+1 to Greg's suggestion. On Sun, Mar 26, 2017 at 2:22 PM, Greg Hogan wrote: > Hi, > > Just saw this TravisCI beta feature. I think this would be worthwhile to > enable on pull request builds. We could leave branch builds unchanged since > there are fewer builds of this type and skipping builds w

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-03 Thread Ted Yu
Looks like #1 is better - 1.2.1 would be at least as stable as 1.2.0 Cheers On Mon, Apr 3, 2017 at 7:39 AM, Aljoscha Krettek wrote: > Just so we’re all on the same page. ;-) > > There was https://issues.apache.org/jira/browse/FLINK-5808 which was a > bug that we initially discovered in Flink 1.

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-04 Thread Ted Yu
9:10 AM, Kostas Kloudas < > >>> k.klou...@data-artisans.com> > >>>> wrote: > >>>> > >>>>> +1 for 1 > >>>>> > >>>>>> On Apr 3, 2017, at 5:52 PM, Till Rohrmann > >>> wrote: > >

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-12 Thread Ted Yu
I ran test suite where the following failed: Failed tests: StreamExecutionEnvironmentTest.testDefaultParallelismIsDefault:143 expected:<-1> but was:<24> StreamExecutionEnvironmentTest.testMaxParallelismMustBeBiggerEqualParallelism Expected test to throw an instance of java.lang.IllegalArgumentE

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-19 Thread Ted Yu
ndor: Oracle Corporation > > > > Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_ > > > > 121.jdk/Contents/Home/jre > > > > Default locale: en_US, platform encoding: UTF-8 > > > > OS name: "mac os x", version: "10.12.3", arch: &

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-20 Thread Ted Yu
om/aljoscha/FliRTT > > > > On Wed, Apr 19, 2017 at 7:48 AM, Ted Yu wrote: > > > >> Till: > >> A bit curious: where can I find the Flirrt tool ? > >> > >> Thanks > >> > >> On Wed, Apr 19, 2017 at 5:24 AM, Till Rohrmann >

Re: [RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Ted Yu
Should FLINK-6353 be mentioned in the announcement ? Cheers On Tue, Apr 25, 2017 at 2:09 AM, Robert Metzger wrote: > I've uploaded the artifacts to the apache mirrors and released the maven > stuff to central. > > While the artifacts are syncin

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Ted Yu
Flavio: Have you seen this (w.r.t. 1.2.1) ? http://search-hadoop.com/m/Flink/VkLeQejxLg24Lk0D1?subj=+RESULT+VOTE+Release+Apache+Flink+1+2+1+RC2+ On Fri, Apr 28, 2017 at 5:07 AM, Flavio Pompermaier wrote: > Any chance to cherry-pick this also into 1.2.1? We're usign Flink 1.2.0 in > production a

Re: Supported Hadoop versions

2017-04-30 Thread Ted Yu
For #1, +1 on dropping hadoop 1. For #2, we can reference Hadoop 2.7 BTW I think we can bump to 2.7.3 as dependency. For #3, Hadoop 2.8.0 was marked not production ready. Junping is in the process of releasing 2.8.1 It would be good idea to start testing against 2.8.0 now Cheers On Sun, Apr 30,

Re: Examples of Flink windowing unit tests, and option to bring in flink-spector to Flink

2017-05-03 Thread Ted Yu
See this related thread: http://search-hadoop.com/m/Flink/VkLeQcgMO91NWi982?subj=flink+1+2+and+unit+testing+flinkspector On Wed, May 3, 2017 at 3:20 AM, Aljoscha Krettek wrote: > Hi, > Yes, unfortunately there are no good unit test examples for testing Flink > jobs (with windowing or without).

Re: [DISCUSS] What is a "Blocker" in our JIRA?

2017-05-04 Thread Ted Yu
I agree with Kostas. Considering 1.3 has many new features which need non-trivial effort for testing, maybe the work on documentation can be done in parallel to testing RC0. Cheers On Thu, May 4, 2017 at 10:54 AM, Kostas Kloudas wrote: > Hi Robert, > > Thanks for clarifying this so that we all

Re: [DISCUSS] Backwards compatibility policy.

2017-05-22 Thread Ted Yu
For #2, it is difficult to achieve: a. maintaining savepoint migration is non-trivial and should be reviewed by domain experts b. how to certify such third-party tool Cheers On Mon, May 22, 2017 at 3:04 AM, 施晓罡 wrote: > Hi all, > > Currently, we work a lot in the maintenance of compatibility.

Re: [DISCUSS] Backwards compatibility policy.

2017-05-24 Thread Ted Yu
an > correctly, this would mean that the community will have to maintain > 2 or 3 LTS versions and the last two major ones, right? > > > On May 22, 2017, at 7:31 PM, Ted Yu wrote: > > > > For #2, it is difficult to achieve: > > > > a. maintaining savepoint migr

Re: Flink-JPMML - Streaming Machine Learning Model Serving on Flink

2017-05-26 Thread Ted Yu
Roberto: I enjoyed reading part 1 of the blog. Any plan on publishing the part 2 of the blog ? Cheers On Fri, May 26, 2017 at 3:11 PM, Fabian Hueske wrote: > Hi Roberto, > > thanks for sharing Flink-JPMML! > IMO, model serving is a very important use case that many users will have > to deal wit

Re: Building only flink-java8 module

2017-06-01 Thread Ted Yu
When I used the command given by Aljoscha, I got: https://pastebin.com/8WTGvdFQ FYI On Thu, Jun 1, 2017 at 8:17 AM, Aljoscha Krettek wrote: > Hi, > > I think you can use something like > > mvn verify -am -pl flink-java8 > > (From the base directory) > > The -pl flag will tell maven to only do

Re: Building only flink-java8 module

2017-06-01 Thread Ted Yu
the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced -> [Help 1] Looks like ${scala.binary.version} was not substituted for correctly. On Thu, Jun 1, 2017 at 8:24 AM, Ted Yu wrote: > When I used the command g

Re: Building only flink-java8 module

2017-06-01 Thread Ted Yu
On 1. Jun 2017, at 17:42, Ted Yu wrote: > > > > When using the second approach (install followed by 'mvn verify'), I got > > the following: > > > > [ERROR] Failed to execute goal on project flink-java8_2.10: Could not > > resolve dependencies for projec

Re: [ANNOUNCE] Apache Flink 1.3.0 released

2017-06-01 Thread Ted Yu
Robert: Do you know when maven artifacts would be populated ? Currently I don't see 1.3.0 here: https://mvnrepository.com/artifact/org.apache.flink/flink-core Thanks On Thu, Jun 1, 2017 at 7:48 AM, Robert Metzger wrote: > The Apache Flink community is pleased to announce the release of Apache

Re: [RESULT][VOTE] Release Apache Flink 1.3.0 (RC3)

2017-06-06 Thread Ted Yu
+1 bq. we can collect this list on the wiki Or utilize the Release Note field of JIRA for each such change. On Tue, Jun 6, 2017 at 5:45 AM, Till Rohrmann wrote: > +1 for your suggestions Tzu-Li. > > On Tue, Jun 6, 2017 at 9:47 AM, Tzu-Li (Gordon) Tai > wrote: > > > One suggestion for future m

Re: About flink 1.3.0 release packages.

2017-06-07 Thread Ted Yu
Did you embed images ? The images didn't come thru. Consider use third party site for images. Thanks On Wed, Jun 7, 2017 at 8:05 PM, Zhangrucong wrote: > Hi: > >We want to download the binaries and source code of flink 1.3.0 release > from https://flink.apache.org/downloads.html. I use th

Re: About flink 1.3.0 release packages.

2017-06-07 Thread Ted Yu
nload_link.png > But the package size of binary and source code are all not correct. Please > see the flink-1.3.0-binar.png and flink-1.3.0-source.png > > Thanks! > > -邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2017年6月8日 11:17 > 收件人: dev@flink.apache.o

Re: About flink 1.3.0 release packages.

2017-06-07 Thread Ted Yu
only 5kB. > > I am in china, Thanks! > > -邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2017年6月8日 11:38 > 收件人: dev@flink.apache.org > 主题: Re: About flink 1.3.0 release packages. > > The images didn't go thru. > > Which

Re: About flink 1.3.0 release packages.

2017-06-08 Thread Ted Yu
ink-1.2.1/. It is ok. >The Flink 1.3.0 now is different from other versions. How to choose > the mirror? > Thanks! > > -----邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2017年6月8日 12:12 > 收件人: Zhangrucong > 抄送: dev@flink.apache.org > 主题:

Re: FlinkML on slack

2017-06-08 Thread Ted Yu
Hi Stavros, Can you add me as well ? Thanks On Wed, Jun 7, 2017 at 12:56 PM, Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > Hi all, > > We took the initiative to create the organization for FlinkML on slack > (thnx Eron). > There is now a channel for model-serving >

Re: [DISCUSS] GitBox

2017-06-09 Thread Ted Yu
bq. better track the oft-neglected contributions Do you have estimate on how many contributions were not paid attention in the current infrastructure. Looking at #2, it seems Accumulo community hasn't reached consensus yet. Cheers On Fri, Jun 9, 2017 at 7:54 AM, Greg Hogan wrote: > All, > > A

Re: [QUESTION] OutOfMemoryError when writing into HDFS

2017-06-11 Thread Ted Yu
Can you see if the following post helps in troubleshooting ? https://blog.fastthread.io/2016/07/06/troubleshoot-outofmemoryerror-unable-to-create-new-native-thread/ Thanks On Sun, Jun 11, 2017 at 6:01 PM, Mu Kong wrote: > Hi all, > > Thanks a lot for your work for the community! > > This quest

Re: [VOTE] Release Apache Flink 1.3.1

2017-06-18 Thread Ted Yu
+1 Ran unit test suite which passed. On Wed, Jun 14, 2017 at 7:14 AM, Robert Metzger wrote: > Dear Flink community, > > Please vote on releasing the following candidate as Apache Flink version > 1.3.1. > > The commit to be voted on: > http://git-wip-us.apache.org/repos/asf/flink/commit/7cfe62b9

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Ted Yu
Here is the dependency in the flink-connector-kinesis module: [INFO] +- com.amazonaws:aws-java-sdk-kinesis:jar:1.10.71:compile [INFO] | \- com.amazonaws:aws-java-sdk-core:jar:1.10.71:compile [INFO] | +- org.apache.httpcomponents:httpclient:jar:4.3.6:compile [INFO] | +- org.apache.httpcomp

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Ted Yu
or shall > we upgrade httpcomponents version in Flink? > > Bowen > > > On Mon, Jun 19, 2017 at 7:02 PM, Ted Yu wrote: > > > Here is the dependency in the flink-connector-kinesis module: > > > > [INFO] +- com.amazonaws:aws-java-sdk-kinesis:jar:1.10.71:compile > >

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-20 Thread Ted Yu
under flink/, make sure >> to go >> > to flink-dist/ and build a second time for the dependencies to be >> properly >> > shaded. >> > Alternatively, Maven 3.0.x+ is the recommended version, as 3.3.x has >> > dependency shading issues. >> > >

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-20 Thread Ted Yu
build under flink/, make sure >> to go >> > to flink-dist/ and build a second time for the dependencies to be >> properly >> > shaded. >> > Alternatively, Maven 3.0.x+ is the recommended version, as 3.3.x has >> > dependency shading issues. >> &

Re: [VOTE] Release Apache Flink 1.3.1 (RC2)

2017-06-21 Thread Ted Yu
+1 Ran unit test suite which passed. On Wed, Jun 21, 2017 at 8:27 AM, Robert Metzger wrote: > +1 (binding) > > - Checked staging repository: ES5 connector is present > - quickstart-java points to 1.3.1 > - yarn session starts > - per-job YARN submission works / log files look good. > - Executed

Re: [ANNOUNCE] New Flink committer Shaoxuan Wang

2017-06-21 Thread Ted Yu
Congratulations, Shaoxuan On Wed, Jun 21, 2017 at 1:19 PM, Fabian Hueske wrote: > Hi everybody, > > On behalf of the PMC, I'm very happy to announce that Shaoxuan Wang has > accepted the invitation of the PMC to become a Flink committer. > > Shaoxuan has contributed several major features to the

Re: [DISCUSS] Changing Flink's shading model

2017-06-26 Thread Ted Yu
+1 on including dependency version.  Original message From: Stephan Ewen Date: 6/26/17 5:01 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: [DISCUSS] Changing Flink's shading model Looks good, thanks Chesnay!. How about including the dependency version names in the modu

Re: Switch to Scala 2.11 as a default build profile

2017-06-28 Thread Ted Yu
+1 on using Scale 2.11 as default.  Original message From: Piotr Nowojski Date: 6/28/17 5:36 AM (GMT-08:00) To: dev@flink.apache.org Subject: Switch to Scala 2.11 as a default build profile Hi, I propose to switch to Scala 2.11 as a default and to have a Scala 2.10 build pr

Re: Switch to Scala 2.11 as a default build profile

2017-06-28 Thread Ted Yu
Here is the KIP that drops support for Scala 2.10 in Kafka 0.11 : https://cwiki.apache.org/confluence/display/KAFKA/KIP-119%3A+Drop+Support+for+Scala+2.10+in+Kafka+0.11 FYI On Wed, Jun 28, 2017 at 7:23 AM, Piotr Nowojski wrote: > Yes, I know and I’m proposing to change this in parent pom by de

Re: [DISCUSS] Long-term plan for build times

2017-07-03 Thread Ted Yu
Have we considered using tool(s) such as nailgun ? https://www.lightbend.com/blog/zinc-and-incremental-compilation Cheers On Mon, Jul 3, 2017 at 7:42 AM, Chesnay Schepler wrote: > Hello, > > I want to start a discussion on how we plan to deal with ever-increasing > build times in the long term

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Ted Yu
Currently StreamExecutionEnvironment exposes Kryo thru the following: import com.esotericsoftware.kryo.Serializer; I think shading is possible since we can declare the Serializer class to come from shaded Kryo namespace. On Mon, Jul 3, 2017 at 9:25 AM, Aljoscha Krettek wrote: > Is it even poss

Re: Tips to fix IDEA strange problem after updating master code

2017-07-03 Thread Ted Yu
Looks like the picture didn't go thru. Mind using third party site ? Thanks On Mon, Jul 3, 2017 at 8:56 PM, Jark Wu wrote: > Hi devs, > > Yesterday, I updated the master code which include [FLINK-7030]: Build > with scala-2.11 by default. After that, I entered a strange problem with > IDEA tha

Re: Problem to deploy of flink program in cluster

2017-07-04 Thread Ted Yu
I only see pom.xml in the attachment.  Consider using pastebin for the other files.  Original message From: simone sguazza Date: 7/4/17 12:34 AM (GMT-08:00) To: dev@flink.apache.org Subject: Problem to deploy of flink program in cluster Hi, below you can find my mail and my

Re: refactor StreamConfig (Appending a picture)

2017-07-04 Thread Ted Yu
The picture didn't go thru. Please use third party site. On Tue, Jul 4, 2017 at 7:09 AM, xu wrote: > I All: > I am sorry about working with StreamConfig(https://github. > com/apache/flink/pull/4241) which may conflicts with others' work before > discussing. > > Motivation: >

Re: Make SubmittedJobGraphStore configurable

2017-07-06 Thread Ted Yu
The sample config entries are broken into multiple lines. Can you send the config again with one config on one line ? Cheers On Wed, Jul 5, 2017 at 10:19 PM, Chen Qin wrote: > ​Hi there, > > ​I would like to propose/discuss median level refactor work to make > submittedJobGraphStore configurab

Re: [DISCUSS] Managing announcements of breaking API / state compatibility changes in major releases

2017-07-06 Thread Ted Yu
Thru INFRA-14519, Release Note field has been added to JIRA.  We can use this field to record API/ compatibility changes.  Original message From: Aljoscha Krettek Date: 7/6/17 2:01 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: [DISCUSS] Managing announcements of breakin

Re: [ANNOUNCE] New Flink committer Jincheng Sun

2017-07-10 Thread Ted Yu
Congratulations, Jincheng. On Mon, Jul 10, 2017 at 6:17 AM, Fabian Hueske wrote: > Hi everybody, > > On behalf of the PMC, I'm very happy to announce that Jincheng Sun has > accepted the invitation of the PMC to become a Flink committer. > > Since more than nine month, Jincheng is one of the mos

Re: [ANNOUNCE] New Flink PMC member: Tzu-Li (Gordon) Tai

2017-07-10 Thread Ted Yu
Congratulations, Gordon. On Mon, Jul 10, 2017 at 7:44 AM, Robert Metzger wrote: > Hi Everybody, > > On behalf of the Flink PMC, I'm very excited to announce Gordon as the > latest addition to the Flink PMC. > > Gordon is a very active community member, helping with a lot of the release > tasks,

Re: [POLL] Who still uses Java 7 with Flink ?

2017-07-12 Thread Ted Yu
+1 on dropping support for Java 1.7 Original message From: Robert Metzger Date: 7/12/17 8:36 AM (GMT-08:00) To: dev@flink.apache.org Cc: user Subject: Re: [POLL] Who still uses Java 7 with Flink ? +1 to drop Java 7 support I believe that we can move to Java 8 for the argumen

Re: [ANNOUNCE] New Flink PMC member: Chesnay Schepler

2017-07-28 Thread Ted Yu
Congratulations, Chesnay.  Original message From: Fabian Hueske Date: 7/28/17 10:40 AM (GMT-05:00) To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Flink PMC member: Chesnay Schepler Congrats and welcome Chesnay! 2017-07-28 16:34 GMT+02:00 Kostas Kloudas : > Congratulat

Re: [VOTE] Release 1.3.2, release candidate #2

2017-08-04 Thread Ted Yu
When I ran integration tests, I bumped into: FLINK-7352 Should this be resolved for 1.3.2 ? Thanks On Sun, Jul 30, 2017 at 12:07 AM, Aljoscha Krettek wrote: > Hi everyone, > > Please review and vote on the release candidate #2 for the version 1.3.2, > as follows: > [ ] +1, Approve the release

Re: Which branch should I build for Flink 1.3.2

2017-08-11 Thread Ted Yu
From http://search-hadoop.com/m/Flink/VkLeQ4jYZR3pCAq1?subj=+ANNOUNCE+Apache+Flink+1+3+2+released , you can find this link: https://flink.apache.org/downloads.html#source On Fri, Aug 11, 2017 at 2:53 PM, Bowen Li wrote: > Hi guys, > I'm trying to build Flink 1.3.2 myself from source code, a

Re: How to build flink-dist.jar from source code

2017-08-11 Thread Ted Yu
**Maven 3.3.x** The build has to be done in two steps: First in the base directory, then in the distribution project: ~~~bash mvn clean install -DskipTests cd flink-dist mvn clean install On Fri, Aug 11, 2017 at 6:19 PM, Michael Fong wrote: > Hi, > > I am new to Flink. I would like to know how

Re: [DISCUSS] Stop serving docs for Flink version prior to 1.0

2017-08-16 Thread Ted Yu
Without any upgrade path, the old versions are not useful. +1 on redirecting doc to stable release(s). On Wed, Aug 16, 2017 at 9:46 AM, Kostas Kloudas wrote: > Hi Ufuk, > > +1 > > I think that this is a nice change! > Thanks Ufuk for opening the discussion. > > I think that broken/redirect link

Re: Support for multiple HDFS

2017-08-23 Thread Ted Yu
Would HDFS-6584 help with your use case ? On Wed, Aug 23, 2017 at 11:00 AM, Vijay Srinivasaraghavan < vijikar...@yahoo.com.invalid> wrote: > Hello, > Is it possible for a Flink cluster to use multiple HDFS repository (HDFS-1 > for managing Flink state backend, HDFS-2 for syncing results from user

Re: Using Maven Archetype Plugin 3.0+ to create flink-quickstart-java project

2017-09-10 Thread Ted Yu
The error was in an image which didn't come thru. Please use pastebin to convey the error. Cheers On Sun, Sep 10, 2017 at 6:57 AM, Michael Fong wrote: > Hi, all, > > While trying out the examples from here >

Re: Problem with basic example

2017-09-10 Thread Ted Yu
Is there extra '=' before the windowAll() call ? On Sun, Sep 10, 2017 at 1:01 AM, philippe wrote: > > Hi all, > > I am trying to run a simple example in the Scala shell: > > > case class MonEntier(classe: Int, valeur: Int) > val stream =3D senv.socketTextStream("localhost", 9000, '\n') > val w =

Re: Problem with basic example

2017-09-10 Thread Ted Yu
> > > // Exiting paste mode, now interpreting. > > :68: error: not found: value TumblingProcessingTimeWindows > .windowAll(TumblingProcessingTimeWindows. > of(Time.seconds(5))) > > > > > > Le 10 sept. 2017 à 18:14, Ted Yu a écrit : > > > >

Re: Problem with basic example

2017-09-10 Thread Ted Yu
> org.apache.flink >import org.apache.flink.table.plan.nodes.datastream. > DataStreamGroupWindowAggregate._ >^ > > > > > > Le 10 sept. 2017 à 18:31, Ted Yu a écrit : > > > > What if you add the following at the beginning: >

Re: Problem with basic example

2017-09-10 Thread Ted Yu
Ma gestion de fenêtres ") > > > // Exiting paste mode, now interpreting. > > :68: error: not found: value TumblingProcessingTimeWindows > .windowAll(TumblingProcessingTimeWindows. > of(Time.seconds(5))) > > > > > > Le 10 sept

Re: [DISCUSS] Dropping Scala 2.10

2017-09-20 Thread Ted Yu
+1 Original message From: Hai Zhou Date: 9/20/17 12:44 AM (GMT-08:00) To: Aljoscha Krettek , dev@flink.apache.org, user Subject: Re: [DISCUSS] Dropping Scala 2.10 +1 > 在 2017年9月19日,17:56,Aljoscha Krettek 写道: > > Hi, > > Talking to some people I get the impression that S

Re: Zookeeper failure handling

2017-09-22 Thread Ted Yu
Which release are you using ? Flink 1.3.2 uses Curator 2.12.0 which solves some leader election issues. Mind giving 1.3.2 a try ? On Fri, Sep 22, 2017 at 4:54 AM, Gyula Fóra wrote: > Hi all, > > We have observed that in case some nodes of the ZK cluster are restarted > (for a rolling restart)

Re: Adding a blog post about the 1.4/1.5 timeline and features

2017-11-21 Thread Ted Yu
+1 Looking forward to the new releases.

Re: [VOTE] Release 1.4.0, release candidate #1

2017-11-24 Thread Ted Yu
Aljoscha: Thanks for spinning RC. bq. The vote will be open for at least 72 hours As you are aware, it is long weekend in US. Is it possible to extend by 24 hours so that developers in US can participate in validation ? Cheers On Fri, Nov 24, 2017 at 2:57 AM, Aljoscha Krettek wrote: > Hi eve

Re: [VOTE] Release 1.4.0, release candidate #1

2017-11-24 Thread Ted Yu
? I thought about closing the vote on Wednesday, i.e. not count the weekend. Would that work? Best, Aljoscha > On 24. Nov 2017, at 12:18, Ted Yu wrote: > > Aljoscha: > Thanks for spinning RC. > > bq. The vote will be open for at least 72 hours > > As you are aware,

Re: [DISCUSS] Releasing Flink 1.3.3 with only critical fixes

2018-03-08 Thread Ted Yu
+1 to Aljoscha's proposal.

Re: [VOTE] Release 1.3.3, release candidate #1

2018-03-12 Thread Ted Yu
When I used the following command: mvn package -Pscala-2.11,jdk8 I got: [ERROR] Failed to execute goal on project flink-scala_2.10: Could not resolve dependencies for project org.apache.flink:flink-scala_2.10:jar:1.3.3: Could not find artifact org.scalamacros:quasiquotes_2.11:jar:2.0.1 in centra

Re: [VOTE] Release 1.3.3, release candidate #1

2018-03-12 Thread Ted Yu
+1 Ran the following command which passed: mvn clean package -Pjdk8 On Mon, Mar 12, 2018 at 9:09 AM, Tzu-Li (Gordon) Tai wrote: > Hi everyone, > > Please review and vote on release candidate #1 for Flink 1.3.3, as > follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (p

Re: [VOTE] Release 1.3.3, release candidate #2

2018-03-14 Thread Ted Yu
+1 Ran the following command - passed: mvn clean package -Pjdk8 On Wed, Mar 14, 2018 at 3:26 AM, Tzu-Li (Gordon) Tai wrote: > Hi everyone, > > Please review and vote on release candidate #2 for Flink 1.3.3, as > follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (pleas

Re: [DISCUSS] Not marking Jira issues as resolved in 1.5.0 as resolved in 1.6.0

2018-03-15 Thread Ted Yu
+1 on marking bugs as fixed for 1.5.0 only. Original message From: Piotr Nowojski Date: 3/15/18 12:48 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: [DISCUSS] Not marking Jira issues as resolved in 1.5.0 as resolved in 1.6.0 Same as Chesnay +1 for marking bugs as fixe

Re: Too many open files

2018-03-20 Thread Ted Yu
Not sure if you have looked at FLINK-8707 FYI On Tue, Mar 20, 2018 at 2:13 PM, Govindarajan Srinivasaraghavan < govindragh...@gmail.com> wrote: > Hi, > > We have a streaming job that runs on flink in docker and checkpointing > happens every 10 seconds. After several starts and cancellations we a

Re: Flip 6 mesos support

2018-03-23 Thread Ted Yu
Renjie:The log didn't go through. Consider logging a JIRA and attach the log there.  Thanks Original message From: Renjie Liu Date: 3/23/18 1:38 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: Flip 6 mesos support Hi, Till:Attached is my log. I'm also looking into this,

Re: Using Slack for online discussions

2018-03-30 Thread Ted Yu
+1 Original message From: Jean-Baptiste Onofré Date: 3/30/18 12:43 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: Using Slack for online discussions +1 Regards JB On 03/29/2018 07:22 PM, Thomas Weise wrote: > How does the community think about using ASF Slack for onli

Re: Using Slack for online discussions

2018-04-03 Thread Ted Yu
ontributors. On 30.03.2018 10:17, Ted Yu wrote: > +1 > Original message From: Jean-Baptiste Onofré > Date: 3/30/18  12:43 AM  (GMT-08:00) To: > dev@flink.apache.org Subject: Re: Using Slack for online discussions > +1 > > Regards > JB > > On 03/29/2018

Re: Using Slack for online discussions

2018-04-03 Thread Ted Yu
plicit invite for everyone [1]. > > [1] https://s.apache.org/slack-invite > > Cheers, > Till > > > On Tue, Apr 3, 2018 at 3:09 PM, Ted Yu wrote: > > > Thanks for the background information. > > I withdraw previous +1 > > Original message ---

Re: Using Slack for online discussions

2018-04-03 Thread Ted Yu
record, it may be possible to archive what's posted > > on the slack channel by subscribing the mailing list. > > > > I think a communication platform like Slack or IRC complements email, the > > type of messages there would typically be different from email threads. > &g

Re: TaskManager deadlock on NetworkBufferPool

2018-04-04 Thread Ted Yu
I searched for 0x0005e28fe218 in the two files you attached to FLINK-2685 but didn't find any hit. Was this the same instance as the attachment to FLINK-2685 ? Thanks On Wed, Apr 4, 2018 at 10:21 AM, Amit Jain wrote: > +u...@flink.apache.org > > On Wed, Apr 4, 2018 at 11:33 AM, Amit Jain

Re: Documentation glitch w/AsyncFunction?

2018-04-14 Thread Ted Yu
bq. resultFuture.thenAccept( (String result) -> { I think the type of variable for the above call should be CompletableFuture. Meaning, the variable currently named resultFuture should be renamed so that the intention is clearer. bq. resultFuture.complete(Collections.singlet

  1   2   3   4   >