[jira] [Created] (FLINK-6406) Cleanup useless import

sunjincheng created FLINK-6406: -- Summary: Cleanup useless import Key: FLINK-6406 URL: https://issues.apache.org/jira/browse/FLINK-6406 Project: Flink Issue Type: Improvement Component

ElasticsearchSink Serialization Error

Hello, I am seeing below error when I try to use ElasticsearchSink. It complains about serialization and looks like it is leading to "IndexRequestBuilder" implementation. I have tried the suggestion as mentioned in  http://stackoverflow.com/questions/33246864/elasticsearch-sink-seralizability  (c

Re: [DISCUSS] Feature Freeze

Hi Devs, Thanks for the release plan. Could you also please add the feature FLINK-6196 Support dynamic schema in Table Function? I’d like to update the code as comments left on PR today. I will try to make sure the code is updated before the Ap

Re: [DISCUSS] Feature Freeze

Hello, Thanks for starting this thread. It would be great to see the following features available in Flink 1.3: * Support for complex schema: FLINK-6033, FLINK-6377 * Various improvements on SQL over group windows: FLINK-6335, FLINK-6373 * StreamTableSink for JDBC and Cassandra: FLINK-6281, FLINK

Re: [DISCUSS] Feature Freeze

Hi Ufuk Incremental checkpointing can significantly improve the performance of checkpointing. I hope it can be included in release 1.3. I am working with Stefan on the last subtask, which attempts to implement incremental checkpointing in RocksDB state backend (FLINK-6364). Without future opti

[jira] [Created] (FLINK-6405) Flink should be able to load a jar from s3

Bowen Li created FLINK-6405: --- Summary: Flink should be able to load a jar from s3 Key: FLINK-6405 URL: https://issues.apache.org/jira/browse/FLINK-6405 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6404) Ensure PendingCheckpoint is registered when calling Checkpoint Hooks

Stephan Ewen created FLINK-6404: --- Summary: Ensure PendingCheckpoint is registered when calling Checkpoint Hooks Key: FLINK-6404 URL: https://issues.apache.org/jira/browse/FLINK-6404 Project: Flink

RE: question about rowtime processfunction - are watermarks needed?

Re-hi, I debuged a bit the test for the Event rowtime I tested the testBoundNonPartitionedEventTimeWindowWithRange from SQLITCase class Although I would expect that once a watermark is triggered: 1) the on timer will be called to process the events that arrived so far and 2) the future events

Re: [DISCUSS] Feature Freeze

Hello, FLINK-5892 (Restoring state by operator) is also nearing completion, but with only 1 day left before the weekend we're cutting it really short. Since this eliminates a major pain point when updating jobs, as it allows the modification of chains, another day or 2 would be good i think.

[jira] [Created] (FLINK-6403) constructFlinkClassPath produces nondeterministic classpath

Andrew Roberts created FLINK-6403: - Summary: constructFlinkClassPath produces nondeterministic classpath Key: FLINK-6403 URL: https://issues.apache.org/jira/browse/FLINK-6403 Project: Flink

Re: [DISCUSS] Feature Freeze

Hi Ufuk, I'd like to get FLINK-6013 (Adding Datadog Http metrics reporter) into release 1.3. It's in the final state of code review in https://github.com/apache/flink/pull/3736 Thanks, Bowen On Thu, Apr 27, 2017 at 8:38 AM, Zhijiang(wangzhijiang999) < wangzhijiang...@aliyun.com> wrote: > Hi

[jira] [Created] (FLINK-6402) Consider locking REAPER_THREAD_LOCK in SafetyNetCloseableRegistry#doRegister()

Ted Yu created FLINK-6402: - Summary: Consider locking REAPER_THREAD_LOCK in SafetyNetCloseableRegistry#doRegister() Key: FLINK-6402 URL: https://issues.apache.org/jira/browse/FLINK-6402 Project: Flink

[jira] [Created] (FLINK-6400) Lack of protection accessing masterHooks in CheckpointCoordinator#triggerCheckpoint

Ted Yu created FLINK-6400: - Summary: Lack of protection accessing masterHooks in CheckpointCoordinator#triggerCheckpoint Key: FLINK-6400 URL: https://issues.apache.org/jira/browse/FLINK-6400 Project: Flink

[jira] [Created] (FLINK-6401) RocksDBPerformanceTest.testRocksDbRangeGetPerformance fails on Travis

are simply set too tight. https://s3.amazonaws.com/archive.travis-ci.org/jobs/226347608/log.txt?X-Amz-Expires=30&X-Amz-Date=20170427T154658Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJRYRXRSVGNKPKO5A/20170427/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host

[jira] [Created] (FLINK-6399) Update default Hadoop download version

Greg Hogan created FLINK-6399: - Summary: Update default Hadoop download version Key: FLINK-6399 URL: https://issues.apache.org/jira/browse/FLINK-6399 Project: Flink Issue Type: Bug Comp

回复：[DISCUSS] Feature Freeze

Hi Ufuk, Thank you for launching this topic! I wish my latest refinement of buffer provider (https://issues.apache.org/jira/browse/FLINK-6337)  to be included in 1.3 and most of the jobs can get benefit from it. And I think it can be completed with the help of your reviews this week. Cheers,Zhij

[jira] [Created] (FLINK-6398) RowSerializer's duplicate should always return a new instance

Kurt Young created FLINK-6398: - Summary: RowSerializer's duplicate should always return a new instance Key: FLINK-6398 URL: https://issues.apache.org/jira/browse/FLINK-6398 Project: Flink Issue

Re: [DISCUSS] Feature Freeze

Hi everybody, from an Table API / SQL point of view, three major features are not completed yet: - user-defined aggregation functions: Most of the preparation work is done. There is one PR missing to actually register and analyze UDAGGs. - retraction support: This feature was developed in a featur

Re: [DISCUSS] Feature Freeze

Hi Ufuk, Thanks for the heads-up. In terms of table API and SQL, I am hoping we can get the following features (which have not completed merged yet) included in 1.3: 1. UDAGG (FLINK-5564), I am working on the last PR (FLINK-5906) to close this feature. 2. Retract (FLINK-6047), we are planning to

[jira] [Created] (FLINK-6397) MultipleProgramsTestBase does not reset ContextEnvironment

Chesnay Schepler created FLINK-6397: --- Summary: MultipleProgramsTestBase does not reset ContextEnvironment Key: FLINK-6397 URL: https://issues.apache.org/jira/browse/FLINK-6397 Project: Flink

Re: [DISCUSS] Feature Freeze

The FLINK-6364 seems need an accompanying FLIP [1] to help review. I dont see for this one in the list of existing proposals. - Henry [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals On Thu, Apr 27, 2017 at 7:39

Re: [DISCUSS] Feature Freeze

Hi Ufuk, Thanks for starting this discussion! One feature that immediately comes to my mind is incremental checkpointing given it's production impact. https://issues.apache.org/jira/browse/FLINK-6364 It would be good to get some better understanding how the implementation effort is going and wh

[DISCUSS] Feature Freeze

Hey devs! :-) We decided to follow a time-based release model with the upcoming 1.3 release and the planned feature freeze is on Monday, May 1st. I wanted to start a discussion to get a quick overview of the current state of things. - Is everyone on track and aware of the feature freeze? ;) - Ar

RE: question about rowtime processfunction - are watermarks needed?

Thanks for the explanation. -Original Message- From: Fabian Hueske [mailto:fhue...@gmail.com] Sent: Thursday, April 27, 2017 3:17 PM To: dev@flink.apache.org Subject: Re: question about rowtime processfunction - are watermarks needed? Hi Radu, event-time processing requires watermarks.

[jira] [Created] (FLINK-6396) FsSavepointStreamFactoryTest fails on Windows

Chesnay Schepler created FLINK-6396: --- Summary: FsSavepointStreamFactoryTest fails on Windows Key: FLINK-6396 URL: https://issues.apache.org/jira/browse/FLINK-6396 Project: Flink Issue Type:

[jira] [Created] (FLINK-6395) TestBases not marked as abstract

Chesnay Schepler created FLINK-6395: --- Summary: TestBases not marked as abstract Key: FLINK-6395 URL: https://issues.apache.org/jira/browse/FLINK-6395 Project: Flink Issue Type: Improvement

Re: question about rowtime processfunction - are watermarks needed?

Hi Radu, event-time processing requires watermarks. Operators use watermarks to compute the current event-time. The ProcessFunctions for over range windows use the TimerServices to group elements by time. In case of event-time, the timers are triggered by the event-time of the operator which is de

[jira] [Created] (FLINK-6394) GroupCombine reuses instances even though object reuse is disabled

Jaromir Vanek created FLINK-6394: Summary: GroupCombine reuses instances even though object reuse is disabled Key: FLINK-6394 URL: https://issues.apache.org/jira/browse/FLINK-6394 Project: Flink

Re: Official Flink Docker images

I've been informed that images don't make it through the list! You can see the aforementioned squirrel here . -- Patrick Lucas On Thu, Apr 27, 2017 at 12:21 PM, Patrick Lucas wrote: > As part of an o

[jira] [Created] (FLINK-6393) Add Evenly Graph Generator to Flink Gelly

FlorianFan created FLINK-6393: - Summary: Add Evenly Graph Generator to Flink Gelly Key: FLINK-6393 URL: https://issues.apache.org/jira/browse/FLINK-6393 Project: Flink Issue Type: New Feature

Official Flink Docker images

As part of an ongoing effort to improve the experience of using Flink on Docker, some work has been done over the last two months to publish official Flink Docker images to Docker Hub. The goal in the short term is to make running a simple Flink cluster (almost) as easy as running docker run flink.

question about rowtime processfunction - are watermarks needed?

Hi, I am looking at the implementation of RowTimeBoundedRangeOver (in the context of Stream SQL). I see that the logic is that the progress happens based on the timestamps of the rowevent - i.e., when an even arrives we register to be processed based on it's timestamp (ctx.timerService.regist