Hi Team,
I have set up a flink cluster on GKE and am trying to submit a beam
pipeline with below options. I was able to run this on a local machine but
I don't understand what would be the environment_config? What should I do?
what to put here instead of localhost:5
Please help.
options = Pip
I appreciate your help! I do see that 2.41.0 returns a PCollectionTuple, this
is helpful.
Thank you!
Vinod
From: Evan Galpin
Date: Thursday, February 2, 2023 at 6:21 PM
To: user@beam.apache.org , Kaggal, Vinod C. (Vinod C),
M.S.
Cc: Chamikara Jayalath
Subject: [EXTERNAL] Re: Re: Elasticsearc
Hi,
Do you use Flink operator or manually deployed session cluster ?
Thanks
On Fri, Feb 3, 2023, 4:32 AM P Singh wrote:
> Hi Team,
>
> I have set up a flink cluster on GKE and am trying to submit a beam
> pipeline with below options. I was able to run this on a local machine but
> I don't unde
HI All,
does anyone have an example of using CassandraIO to query a table?
The following mentions "Alternatively, one may use
CassandraIO.readAll()
.withCoder(SerializableCoder.of(Person.class)) to query a subset of the
Cassandra database by creating a PCollection of CassandraIO.Read
each with th
You should be able to omit the environment_type and environment_config
variables and they will be populated automatically. For running
locally, the flink_master parameter is not needed either (one will be
started up automatically).
On Fri, Feb 3, 2023 at 12:51 PM Talat Uyarer via user
wrote:
>
>
There are some examples in the test code that should be easy enough to
follow.
Here is an example of just querying the entire table:
https://github.com/apache/beam/blob/master/sdks/java/io/cassandra/src/test/java/org/apache/beam/sdk/io/cassandra/CassandraIOTest.java#L460
Here's an example of usi
Hi Andrew,
Thank you for your MR. I am parricated to help us to solve the issue. I
rerun our tests and they are partially passing now with your fix. However,
there is one more issue with the WITH clause.
When i run following query somehow beam lost type of column
WITH tempTable AS (SELECT * FRO
Hi,
I have done this manually. though It seems the beam version issues, I am
using 2.43. Is it compatible with flink 1.14 and python 3.10. Most of the
threads indicating beam doesn't really support latest versions.
On Sat, 4 Feb 2023 at 02:51, Robert Bradshaw via user
wrote:
> You should be abl
