Re: [Request for Feedback] Mechanism for "Beam Website Feedback"

Thank you XQ! For reference, responses are going to this spreadsheet [1] for now. We can set up an email trigger for that if people here think it would be useful. [1] https://docs.google.com/spreadsheets/d/1bvPFLgMamtYXiUULjx3JY-b1SB-voUqaj6o1UMqTgX4/edit?usp=sharing -- not shared by default, you

Re: Beam Website Feedback

Explicitly adding Jonas in case he is not subscribed to the dev list. On Thu, Aug 24, 2023 at 5:50 AM Kerry Donny-Clark via dev < dev@beam.apache.org> wrote: > Thanks Jonas. Can you please submit a quick PR to update the text? I'm > happy to review. > Kerry > > On Wed, Aug 23, 2023, 10:03 PM Jona

[Request for Feedback] Mechanism for "Beam Website Feedback"

Hi all, Following what Ahmet proposed here ( https://lists.apache.org/thread/9l18gs7vgqz6g1cfc2m66rbkrcnr9qmj), we changed the "SEED FEEDBACK" button to open the Google form ( https://docs.google.com/forms/d/e/1FAIpQLSfID7abne3GE6k6RdJIyZhPz2Gef7UkpggUEhTIDjjplHuxSA/viewform?usp=sharing&resourceke

Re: Beam Website Feedback

Thanks Jonas. Can you please submit a quick PR to update the text? I'm happy to review. Kerry On Wed, Aug 23, 2023, 10:03 PM Jonas Eyob wrote: > Hi on this page: > https://beam.apache.org/documentation/io/built-in/google-bigquery/#storage-api > > > > Under ”Using Storage Read API” there is a par

Beam Website Feedback

Hi on this page: https://beam.apache.org/documentation/io/built-in/google-bigquery/#storage-api Under "Using Storage Read API" there is a paragraph and example showing how Beam SDK for Python can use the Bigquery Storage API. But in code snippet box just below it says "The SDK for Python does no

Re: Mechanism for "Beam Website Feedback"

> On Mon, Aug 14, 2023 at 4:29 PM Ahmet Altay via dev > wrote: > >> Hi all, >> >> We regularly get emails with "Subject: Beam Website Feedback", they are >> filtered out before they reach this mailing list. I believe the reason for >> that is people hav

Re: Mechanism for "Beam Website Feedback"

, Aug 14, 2023 at 4:29 PM Ahmet Altay via dev wrote: > Hi all, > > We regularly get emails with "Subject: Beam Website Feedback", they are > filtered out before they reach this mailing list. I believe the reason for > that is people have some feedback to share, but clickin

Mechanism for "Beam Website Feedback"

Hi all, We regularly get emails with "Subject: Beam Website Feedback", they are filtered out before they reach this mailing list. I believe the reason for that is people have some feedback to share, but clicking the feedback will open the default email application and they will be sur

Re: Beam Website Feedback

Hi, You can follow a similar pattern to this https://github.com/apache/beam/blob/c6f8e0be1a51a32730754934c3f40eaae39d0f98/sdks/python/apache_beam/metrics/metric_test.py#L130 . ``` with self.assertRaises(ValueError): ``` On Tue, Apr 4, 2023 at 7:24 PM Grace Young via dev wrote: > How can

Beam Website Feedback

How can I confirm in a test that a ValueError is raised by certain cases? -- [image: X] *Dr. Grace Young* Research Engineer | Tidal gcyo...@google.com | x.company

Beam Website Feedback: Request: Docon Error handling patterns

It’d be nice to see some common error handling patterns; 1) how to handle per op bases : map, flatMap, parDo 2) how to handle uniformly across multiple ops ..

Re: Beam Website Feedback

I just added https://github.com/apache/beam/pull/25425 to do this On Fri, Feb 10, 2023 at 11:42 AM Julian Ogando via dev wrote: > Hi Bruno, > Thanks for the quick response! > Yes, I already have the code running by reading the "unittest" > documentation, but it would be good to include those cha

Re: Beam Website Feedback

Hi Bruno, Thanks for the quick response! Yes, I already have the code running by reading the "unittest" documentation, but it would be good to include those changes in the Beam documentation :) Thanks! Julian On Fri, Feb 10, 2023 at 12:28 PM Bruno Volpato wrote: > > Hi Julian, > > That's a good

Re: Beam Website Feedback

Hi Julian, That's a good point. I think the focus of https://beam.apache.org/documentation/pipelines/test-your-pipeline/ is showing how to test Beam, but probably linking to working examples would be helpful to reduce friction. Related to your code, I believe you are missing 2 imports: import un

Re: Beam Website Feedback

Some of the imports are missing. ``` # try importing import unittest import apache_beam as beam # rest of the code. ``` try running with pytest as *pytest test.py *and it should work. Thanks, Anand On Fri, Feb 10, 2023 at 10:09 AM Julian Ogando via dev wrote: > Hi, > I'm reading the documenta

Beam Website Feedback

Hi, I'm reading the documentation found in https://beam.apache.org/documentation/pipelines/test-your-pipeline/ from apache_beam.testing.test_pipeline import TestPipelinefrom apache_beam.testing.util import assert_thatfrom apache_beam.testing.util import equal_to class CountTest(unittest.TestCase):

Re: Beam Website Feedback

Hi Shlomi, If you intend to make use of GPU's for the purposes of Machine Learning Inference, the following resources may also be of interest to you: RunInference transform information: https://beam.apache.org/documentation/sdks/python-machine-learning/ You may also want to have a look at: https

Re: Beam Website Feedback

Hi Shlomi, Unfortunately, those cited references are about as much as we have available. I acknowledge that they are not very comprehensive -- so I'll try to share some insight. Related to your sample, I believe there are relevant missing pieces, as I am note sure what the input looks like (bound

Re: Beam Website Feedback

Adding @John Casey @Bruno Volpato - who might be able to point to relevant docs. On Sat, Feb 4, 2023 at 11:59 AM Shlomi Elbaz wrote: > Hello All, > > > > We developed a service with Apache Beam where we read an Avro file that > locate in GCP bucket, > > We had a load and benchmark tests, durin

Beam Website Feedback

Hello All, We developed a service with Apache Beam where we read an Avro file that locate in GCP bucket, We had a load and benchmark tests, during the pipeline we got a bottleneck and out-of-memory issues in the stage where the service accesses the Avro's by AvroIO.parseFilesGenericRecords The

Re: Beam Website Feedback

> > *From: *Ahmet Altay > *Date: *Tuesday, January 3, 2023 at 2:22 PM > *To: *Alex Kosolapov > *Cc: *"dev@beam.apache.org" , Rebecca Szper < > rsz...@google.com>, Bulat Safiullin , Alexey > Romanenko , Rajkumar Gupta < > rajkumargu...@google.com>

Re: Beam Website Feedback

dev@beam.apache.org" , Rebecca Szper > , Bulat Safiullin , Alexey > Romanenko , Rajkumar Gupta > > Subject: [EXTERNAL] Re: Beam Website Feedback > > Thank you Alex and Bulat for improving this. We all very much appreciate it. > > On Thu, Dec 22, 2022 at 9:21 AM A

Re: Beam Website Feedback

solapov > *Cc: *"dev@beam.apache.org" , Rebecca Szper < > rsz...@google.com>, Bulat Safiullin , Alexey > Romanenko , Rajkumar Gupta < > rajkumargu...@google.com> > *Subject: *[EXTERNAL] Re: Beam Website Feedback > > > > Thank you Alex and Bulat for

Re: Beam Website Feedback

sday, January 3, 2023 at 2:22 PM To: Alex Kosolapov Cc: "dev@beam.apache.org" , Rebecca Szper , Bulat Safiullin , Alexey Romanenko , Rajkumar Gupta Subject: [EXTERNAL] Re: Beam Website Feedback Thank you Alex and Bulat for improving this. We all very much appreciate it. On Thu, Dec 22, 2

Re: Beam Website Feedback

t; > > > *From: *Rebecca Szper via dev > *Reply-To: *"dev@beam.apache.org" , Rebecca Szper < > rsz...@google.com> > *Date: *Wednesday, December 21, 2022 at 10:15 AM > *To: *Ahmet Altay > *Cc: *Alexey Romanenko , dev < > dev@beam.apache.org>, Raj

Re: Beam Website Feedback

:15 AM To: Ahmet Altay Cc: Alexey Romanenko , dev , Rajkumar Gupta Subject: [EXTERNAL] Re: Beam Website Feedback Our team doesn't maintain the Beam website infrastructure, but last time something like this came up, David said that there are consultants that work on this type of thing. He p

Re: Beam Website Feedback

Our team doesn't maintain the Beam website infrastructure, but last time something like this came up, David said that there are consultants that work on this type of thing. He pinged @bullet03 on the Beam ticket, who was able to help. On Tue, Dec 20, 2022 at 5:06 PM A

Re: Beam Website Feedback

On Wed, Dec 21, 2022 at 10:04 AM Rebecca Szper wrote: > Our team doesn't maintain the Beam website infrastructure, but last time > something like this came up, David said that there are consultants that > work on this type of thing. He pinged @bullet03 > on the Beam

Re: Beam Website Feedback

On Tue, Dec 20, 2022 at 1:12 PM Ahmet Altay wrote: > > > On Tue, Dec 20, 2022 at 9:14 AM Alexey Romanenko > wrote: > >> Thanks Ahmet! I’d prefer to fix the links as you did and add the redirect >> from old one - perhaps, there are other similar links that have been >> changed in the same way. >>

Re: Beam Website Feedback

On Tue, Dec 20, 2022 at 9:14 AM Alexey Romanenko wrote: > Thanks Ahmet! I’d prefer to fix the links as you did and add the redirect > from old one - perhaps, there are other similar links that have been > changed in the same way. > Thank you for the review. I fixed it, and added a redirect too.

Re: Beam Website Feedback

Thanks Ahmet! I’d prefer to fix the links as you did and add the redirect from old one - perhaps, there are other similar links that have been changed in the same way. Btw, I’m not sure that we still check the broken links as it was before, iirc, but probably it would be a good idea to add such

Re: Beam Website Feedback

I did a search and found a few places with the broken link. Correct links should be: https://beam.apache.org/get-started/resources/videos-and-podcasts/ I created a PR to update the website ( https://github.com/apache/beam/pull/24733). I do not know if that is the best solution. As an alternative w

Re: Beam Website Feedback

Hi Rajkumar, Could you specify where (which page) this link was found? Thanks! — Alexey > On 20 Dec 2022, at 10:08, Rajkumar Gupta via dev wrote: > > Hi Team, > > Just a minor point, while browsing the site I noticed that the link below is > not working. Can you please check? > https://beam

Beam Website Feedback

Hi Team, Just a minor point, while browsing the site I noticed that the link below is not working. Can you please check? https://beam.apache.org/documentation/resources/videos-and-podcasts Regards, Raj -- Rajkumar Gupta | Technical Solutions Engineer - Google Cloud Platform | rajkumargu...@goo

Re: Beam Website Feedback

I proposed https://github.com/apache/beam/pull/23877 to address this. On Thu, Oct 27, 2022 at 2:12 PM Sachin Agarwal wrote: > No objections here. The latter (the surviving) is the one linked in > the top navigation bar and has the x-lang details that help. > > On Thu, Oct 27, 2022 at 2:09 PM Br

Re: Beam Website Feedback

No objections here. The latter (the surviving) is the one linked in the top navigation bar and has the x-lang details that help. On Thu, Oct 27, 2022 at 2:09 PM Brian Hulette wrote: > Hm, it seems like we need to drop > https://beam.apache.org/documentation/io/built-in/ as it's been > supersede

Re: Beam Website Feedback

Hm, it seems like we need to drop https://beam.apache.org/documentation/io/built-in/ as it's been superseded by https://beam.apache.org/documentation/io/connectors/ Would there be any objections to that? On Thu, Oct 27, 2022 at 2:04 PM Sachin Agarwal via dev wrote: > JDBCIO is available as a Ja

Re: Beam Website Feedback

JDBCIO is available as a Java-based IO. It is also listed on https://beam.apache.org/documentation/io/connectors/ On Thu, Oct 27, 2022 at 2:01 PM Charles Kangai wrote: > What about jdbc? > I want to use Beam to read/write to/from a relational database, e.g. > Oracle or Microsoft SQL Server. > I

Beam Website Feedback

What about jdbc? I want to use Beam to read/write to/from a relational database, e.g. Oracle or Microsoft SQL Server. I don't see a connector on your page: https://beam.apache.org/documentation/io/built-in Thanks, Charles Kangai

Re: Beam Website Feedback: Apache Beam WordCount Examples

Thank you for reporting William. Adding @Valentyn Tymofieiev . Perhaps we could start with creating an issue? On Mon, Oct 24, 2022 at 9:25 AM William Pietri wrote: > Hi! I have inherited code using Apache Beam and I'm trying to figure out > the right way to use it. > > This seemed like it would

Beam Website Feedback: Apache Beam WordCount Examples

Hi! I have inherited code using Apache Beam and I'm trying to figure out the right way to use it. This seemed like it would be a good page for me: https://beam.apache.org/get-started/wordcount-example/ I jumped in with the MinimalWordCount example

Re: Beam Website Feedback

On Tue, Oct 4, 2022 at 8:58 AM Alexey Romanenko wrote: > Thanks for your feedback. > > At the time, using a Google website search was a simplest solution since, > before, we didn’t have a search at all. I agree that it could be > frustrating to have ad links before the actual results (not sure th

Re: Beam Website Feedback

Thanks for your feedback. At the time, using a Google website search was a simplest solution since, before, we didn’t have a search at all. I agree that it could be frustrating to have ad links before the actual results (not sure that we can avoid them there) but "it is what it is” and it's st

Re: Beam Website Feedback

Thanks Borris, that is helpful feedback. I filed an issue [1] to track improving this. [1] https://github.com/apache/beam/issues/23472 On Mon, Oct 3, 2022 at 2:32 PM Borris wrote: > This is my experience of trying the search capability. > >- I know I want to read about dataframes (I was rea

Beam Website Feedback

This is my experience of trying the search capability. * I know I want to read about dataframes (I was reading this 10 minutes ago but browsing history didn't take me back to where I wanted) * I search for "dataframes" * I am presented with a whole load of pages that are elsewhere (other

Re: Beam Website Feedback

Andrew, Thanks so much for the feedback and glad the getting started materials are helping. Would you like a downloadable container that works out of the box for your local machine or to spin up on AWS or GCP or DO or something like that? Just trying to make sure we understand the gap correctly s

Beam Website Feedback

Hello, This is an exciting technology that I'm enjoying learning about. I'm learning best through the examples throughout the Beam docs. (My favorite examples have been those around the clicks, views, and batch RPC calls in the state and timer sections.) I'm able to run proofs of concept locall

Re: Beam Website Feedback

+Reza Rokni do you know about the slowly updating side input window documentation? Do you know who might? On Mon, Sep 12, 2022 at 8:19 AM Peter McArthur wrote: > There are a couple issues with the python SDK and side input patterns page > here > https://beam.apache.org/documentation/patterns/si

Beam Website Feedback

There are a couple issues with the python SDK and side input patterns page here https://beam.apache.org/documentation/patterns/side-inputs/ 1. Slowly updating global window side input doesn’t have a python example 2. Slowly updating side input using windows doesn’t have enough code to run the pyt

Re: Beam Website Feedback

Thank you for the feedback Peter. /cc @Reza Rokni @David Cavazos for visibility. On Fri, Sep 9, 2022 at 2:51 PM Austin Bennett wrote: > Any chance you've seen a GH Issue for that? If not, please feel free to > file one :-) > > https://github.com/apache/beam/issues > > On Fri, Sep 9, 2022 at

Re: Beam Website Feedback

Any chance you've seen a GH Issue for that? If not, please feel free to file one :-) https://github.com/apache/beam/issues On Fri, Sep 9, 2022 at 12:09 PM Peter McArthur wrote: > I wish there were a python example for "Slowly updating global window side > inputs” on this page > https://beam.ap

Beam Website Feedback

I wish there were a python example for "Slowly updating global window side inputs” on this page https://beam.apache.org/documentation/patterns/side-inputs/#slowly-updating-global-window-side-inputs thank you

Re: [EXTERNAL] Beam Website Feedback

Dear Tianzi Cia, Thank you for noticing this. I created PR https://github.com/apache/beam/pull/22841 to update PR with this information. From: Tianzi Cai via dev Sent: Tuesday, August 23, 2022 12:52:06 AM To: dev@beam.apache.org Subject: [EXTERNAL] Beam Website

Re: Beam Website Feedback

Thank you Tianzi. Adding relevant folks: @John Casey On Mon, Aug 22, 2022 at 3:03 PM Tianzi Cai via dev wrote: > According to this page, > https://beam.apache.org/documentation/io/connectors/, KinesisIO doesn't > have Python implementation, but I found > https://beam.apache.org/releases/pydoc/

Beam Website Feedback

According to this page, https://beam.apache.org/documentation/io/connectors/, KinesisIO doesn't have Python implementation, but I found https://beam.apache.org/releases/pydoc/current/apache_beam.io.kinesis.html#apache_beam.io.kinesis.ReadDataFromKinesis . The page is probably outdated.

Re: Beam Website Feedback

Thanks. On Mon, Aug 8, 2022 at 8:12 AM Peter Simon wrote: > Awesome web UI > > Peter Simon > > *Data Scientist* > > > > e peter.si...@fanatical.com > > w fanatical.com > > Focus Multimedia Limited. > > The Studios, Lea Hall Enterprise Park, > > Wheelhouse Road, Brereton, Rugeley, > > Stafford

Beam Website Feedback

Awesome web UI Peter Simon *Data Scientist* e peter.si...@fanatical.com w fanatical.com Focus Multimedia Limited. The Studios, Lea Hall Enterprise Park, Wheelhouse Road, Brereton, Rugeley, Staffordshire, WS15 1LH, United Kingdom.

Re: Beam Website Feedback

Kerry, Daniel and Austin: That’s very useful information. Thanks. I didn’t know about the cross language framework. I will get down to researching it straight away. Regards Charles Kangai Sent from my iPhone On 29 Mar 2022, at 18:17, Kerry Donny-Clark wrote:  Hi Charles, You can use the cro

Re: Beam Website Feedback

Hi Charles, I am not working with any of the mentioned DBs, so can't speak to the state of IOs ( though I think you can use a jdbc connection with each of these, so perhaps see: https://beam.apache.org/releases/pydoc/2.24.0/apache_beam.io.jdbc.html ) . But, I would suggest that contributions to th

Beam Website Feedback

Why is there no python odbc i/o transform either available or in development? Suppose my source data is in Oracle, MySQL or SQL Server - what am I to do? Thanks, Charles Kangai Email: char...@charleskangai.co.uk

Beam Website Feedback

Hi! I would like to know more about the checkpoint mechanism when Beam pipelines are executed on Flink. I have been doing some testing around checkpoints and stuff and I’m having trouble understanding the results. I think I could do better with exact resources that would lead me to understand f

Re: Beam Website Feedback

Oh great! Thank you guys! On Sat, Mar 5, 2022, 00:53 Ahmet Altay wrote: > No worries. David's PR fixed it. Thank you for reporting! > > On Fri, Mar 4, 2022 at 1:49 PM Kirill Love wrote: > >> Hey guys >> >> Sorry I haven't had the time to get it done. It's still on my todo list >> though! I will

Re: Beam Website Feedback

Hey guys Sorry I haven't had the time to get it done. It's still on my todo list though! I will find the time this weekend to make the necessary changes. Sincerely Kirill Ism On Fri, Mar 4, 2022, 19:29 Ahmet Altay wrote: > Thank you! > > On Fri, Mar 4, 2022 at 10:18 AM David Cavazos wrote:

Beam Website Feedback

Hi Beam Users, I'm a Japanese developer. I have a question about using the Go SDK, so I want to send an email to u...@beam.apache.org, but I can't because MAILER-DAEMON is returned. Could you tell me how to send it? Thanks & Regards

Re: Beam Website Feedback

Dear Ahmet, David That’s a good suggestion! I’ll try to free up some time in the weekend to create a PR for this. Sincerely Kirill Ism > On 9 Feb 2022, at 03:15, Ahmet Altay wrote: > > Thank you for the feedback Kirill. If you have time we will happily accept > your contribution in the for

Beam Website Feedback

Adapt documentation: https://beam.apache.org/documentation/transforms/python/elementwise/pardo/#example-1-pardo-with-a-simple-dofn ## Can be removed > [BEAM-7885]

Re: Beam Website Feedback

Prs welcome :-) On Mon, Nov 22, 2021, 4:46 PM Michael Lehenbauer wrote: > The python version of > https://beam.apache.org/documentation/programming-guide/#using-schemas > has a bunch of missing examples... > > [image: image.png] >

Beam Website Feedback

The python version of https://beam.apache.org/documentation/programming-guide/#using-schemas has a bunch of missing examples... [image: image.png]

Re: Beam Website Feedback

Specifically, if the reader has selected an SDK that doesn't have a populate code highlight block, that block doesn't appear at all, even if the other languages have them populated. I filled all appropriate blocks (with jira links for missing features) in for the Go SDK a few months ago, so it's l

Beam Website Feedback

Missing code snippet [image: image.png] https://beam.apache.org/documentation/programming-guide/#metrics

Beam Website Feedback

To Whom It May Concern: Thank you so much for putting together such a wide breadth of helpful documentation for beam. It is a pleasure learning about the platform, and the information is presented in an easily consumable manner. Keep up the good work. Respectfully, Ryan Reynolds

Beam Website Feedback

Could use some guidance maybe highlights

Re: Beam Website Feedback

Thank you for reporting. https://github.com/apache/beam/pull/15671 would fix the issues you mentioned. On Wed, Oct 6, 2021 at 2:56 PM Mike Stayton wrote: > Your contact-us page has some bad links > > https://beam.apache.org/community/contact-us/ > Subsribe and Unsubscribe: > > Prior to sending e

Beam Website Feedback

Your contact-us page has some bad links https://beam.apache.org/community/contact-us/ Subsribe and Unsubscribe: Prior to sending emails to these lists, you need to subscribe. To subscribe, send a blank email touser-subscr...@beam.apache.org

Beam Website Feedback

These docs are really useful if I’m playing around with primitive data types. There’s no examples of how to transform the data I get from Snowflake into more complicated data types. For instance, if I'm reading an employee table, how do I serialize my results into a Person pojo? Ideally I’d like

Beam Website Feedback

Hi! I noticed that the javadoc for the TestPipeline java class has a dead link, I suspect the website changed. https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/TestPipeline.java Dead link: https://beam.apache.org/contribute/testing/ Possible co

Beam Website Feedback

Hi, Is google pubsub supported with beam running in flink? I'm having a hard time getting to work a pipeline that consumes from Google pubsub. It works perfectly with beam DirectRunner, but is refusing to work with FlinkRunner. I debugged a lot and came to the conclusion that the problem is trigg

Re: Beam Website Feedback

Thank you and I filed https://issues.apache.org/jira/browse/BEAM-12682 to track this. (/cc @David Huntsperger ) Related question to everyone, do we have a process for the "Beam Website Feedback" emails? I see these emails occasionally, and some of them are for trivial issues and

Beam Website Feedback

Feedback for documentation on Testing Beam pipeline The documentation is not at all detailed and is pretty shallow, hardly covering most concepts to effectively design test-suit for an enterprise level pipeline. For example, some the missing information are – 1. How to test the pipeline when

Beam Website Feedback

The page "Side Input Patterns" ( https://beam.apache.org/documentation/patterns/side-inputs/) has "PCollection" misspelled as "PColleciton" -- Jonathan Rynd Senior Software Engineer Wunderkind, formerly BounceX ♦ wunderkind.co

Beam Website Feedback

I was interested in the introductory tutorials, so I checked out the first one here: https://colab.research.google.com/github/apache/beam/blob/master/examples/notebooks/tour-of-beam/getting-started.ipynb#scrollTo=R_Yhoc6N_Flg I found that the pip install step at the very beginning fails. This is

Beam Website Feedback

It would be great if the "Design Your Pipeline" page had Python examples. Stephen

Re: Beam Website Feedback

Makes sense to add it. Will you be able to send a pull request ? Thanks, Cham On Tue, Jun 1, 2021 at 6:37 PM Matt Hall wrote: > Hello, > > Would like to suggest that mention of the new storage write api method [1] > be added under "setting the insertion meth

Beam Website Feedback

Hi! This is a feedback for https://beam.apache.org/documentation/pipelines/test-your-pipeline/ page. Thank you for that tutorial. It was pretty helpful for a simple test. Unfortunately I didn't find a tutorial on how to test the streaming pipeline and windowing in particular. Nick Morozov, pytho

Beam Website Feedback

Hello, Would like to suggest that mention of the new storage write api method [1] be added under "setting the insertion method" [2]. Additional documentation for the new storage write api is linked-to below [3] and from the page describing the tabledata.insertall method [4]. [1] https://beam.apa

Beam Website Feedback

No, I couldn't find anything about non-file based sinks. I need to make a sink for a GCP service that's only available as an API right now. We have to send POST requests to it.

Beam Website Feedback

Hi Team, I need some support to implement dynamic destination for WriteToBigquery method of python version in Steaming mode insert. Can you please provide some ideas or reference or sample for this ? Thanks Gopi

Re: Beam Website Feedback

On Mon, Mar 15, 2021 at 5:51 AM Brian Hulette wrote: > Hm thanks for pointing this out Brian. It looks like the Java > WindowedWordCount example does process an input file while the Java one > processes a PubSub topic. Changing the command would be a good quick fix, > but I think the best fix wou

Beam Website Feedback

Ambigous language. A lot of missing parts. I think a programming guide must be simpler and with much more details and illustrations

Re: Beam Website Feedback

Hm thanks for pointing this out Brian. It looks like the Java WindowedWordCount example does process an input file while the Java one processes a PubSub topic. Changing the command would be a good quick fix, but I think the best fix would actually be to make the python example mirror the Java one.

Beam Website Feedback

Hi team, I’m studying the apache beam from https://beam.apache.org/get-started/wordcount-example/#windowedwordcount-example A bit lost on the windowed_wordcount.py and it’s start command: windowed_wordcount.py input a pubsub message: lines = p | beam.io.ReadFromPubSub(known_args.input_topic) s