Re: [DISCUSS] Source Watermark Metrics

@Aviem Zur @Ben Chambers What do you think about the value of METRIC_MAX_SPLITS? --From:JingsongLee Time:2017 May 11 (Thu) 16:37To:dev@beam.apache.org Subject:[DISCUSS] Source Watermark Metrics Hi everyone, The source watermark met

Re: Python SDK: BigTableIO

(JIRA role added; reassigned.) On Thu, Jun 1, 2017 at 10:05 AM, Chamikara Jayalath wrote: > Thanks. I added some comments to the doc. > > Davor should be able to assign this JIRA to you. Also, Solomon who > implemented the Java BigTable connector might have more input here. > > - Cham > > > On T

Re: Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3982

Thank you Kenn. https://github.com/apache/beam/pull/3278 is for fixing the lint errors, On Thu, Jun 1, 2017 at 11:11 AM, Kenneth Knowles wrote: > On the surface, it looks like Python lint failed, but I failed after a few > seconds to track down the actionable error message. > > On Thu, Jun 1, 2

Re: Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3982

On the surface, it looks like Python lint failed, but I failed after a few seconds to track down the actionable error message. On Thu, Jun 1, 2017 at 10:27 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See MavenInstall/3982

Re: [jira] [Commented] (BEAM-101) Data-driven triggers

Unfortunately the ability to write custom triggers was removed, but a CombineFn-parameterized one (assuming monotonicity of the CombineFn) could become one of the standard ones. For your specific case, it sounds like an AfterPaneCount + session windows might do the job though. On Thu, Jun 1, 2017

Re: Python SDK: BigTableIO

Thanks. I added some comments to the doc. Davor should be able to assign this JIRA to you. Also, Solomon who implemented the Java BigTable connector might have more input here. - Cham On Thu, Jun 1, 2017 at 2:19 AM Matthias Baetens < matthias.baet...@datatonic.com> wrote: > Hi Cham, Stephan, >

Re: [DISCUSS] HadoopInputFormat based IOs

Stephen I agree with you that the most important thing is not to lose functionality for the integration tests, so it is important to keep at least one of the two (Cassandra or Elasticsearch) to do a real integration test for HIFIO. Your proposal of making the IT tests for the native IOs paralleliz

Re: Python SDK: BigTableIO

Hi Cham, Stephan, Thanks a lot for the input, really useful to get started. We'll probably start with implementing the Source (looks the most straightforward). I made a working document to organise

Build failed in Jenkins: beam_Release_NightlySnapshot #434

See Changes: [iemejia] Refactor HadoopInputFormatIO to use SerializableConfiguration from [iemejia] Make SerializableConfiguration more robust by using Hadoop based [dhalperi] [TRIVIAL] InstantCoder: