Hi Lukasz,
thanks for the proposed solution. This was also one of the alternative
implementations that I thought of.
When you are talking about launching a job from another job, I understand
doing a system call from another python job and getting result by some
means (reading synchronously the outp
Contributions in this space are welcome. Reach out to d...@beam.apache.org
once your ready.
On Fri, Aug 17, 2018 at 3:02 AM Pascal Gula wrote:
> Hi Lukasz,
> thanks for the proposed solution. This was also one of the alternative
> implementations that I thought of.
> When you are talking about l
Hi Mahesh,
I think you have the NullPointerException because your Accumulator is not
initialized properly.
In your createAccumulator() method, you created a Accum object without
setting its line field. So later when accum.line got accessed, you got the
exception.
By initializing the Accum class
On Thu, Aug 16, 2018 at 2:20 PM Thomas Browne wrote:
> I just watched the excellent presentation by Markku Leppisto in Singapore.
> I consult for a financial broker in London.
> Our use case is streaming financial data on which various analytics are
> performed to find relative value trading oppo
a) Yes, there is a general proposal for "update" support to existing
pipelines for all runners[1] which allows for some topology changes.
Dataflow has had support for this for a long time for streaming pipelines
which several customers rely on. Support for dynamic graph expansion during
runtime and
Thanks, Robin.
Based on Robin's comment above, I looked into CombineFn test script in beam
git repo, and implemented getCoder method along the lines in that script. (
https://github.com/vangalamaheshh/my-beam/blob/master/variant-caller/src/main/java/pipelines/variant_caller/AddLines.java
)
Do you t
Hi Robin,
I have the same question here. If we don't implement coder for class Accum
but only add implements Serializable to class Accum, how is the accumulator
coder generated?
-Rui
On Fri, Aug 17, 2018 at 11:50 AM Mahesh Vangala
wrote:
> Thanks, Robin.
> Based on Robin's comment above, I loo
Hi Mahesh and Rui,
I believe if you comment out your own implementation of getCoder, your
program should still work. The reason is that coder will be inferred if you
don't provide a coder.
Best,
Robin
On Fri, Aug 17, 2018 at 12:03 PM Rui Wang wrote:
> Hi Robin,
>
> I have the same question her
