Re: kafka 0.9 support

2019-04-01 Thread Austin Bennett
FWIW -- On my (desired, not explicitly job-function) roadmap is to tap into a bunch of our corporate Kafka queues to ingest that data to places I can use. Those are 'stuck' 0.9, with no upgrade in sight (am told the upgrade path isn't trivial, is very critical flows, and they are scared for it to

Re: kafka 0.9 support

2019-04-02 Thread Austin Bennett
port old ones 0.9-0.10.0). >>>> >>>> On the other hand, we warn user in Javadoc of KafkaIO (which is >>>> Unstable, btw) by the following: >>>> *“KafkaIO relies on kafka-clients for all its interactions with the >>>> Kafka cluster.**kafka-

Beam Summit at ApacheCon

2019-04-22 Thread Austin Bennett
Beam Summit will be at ApacheCon this year -- please consider submitting! Dates for Beam Summit 11 and 12 September 2019. There are other tracks at ApacheCon during this and on other dates too. https://www.apachecon.com/acna19/cfp.html

Re: Beam Summit at ApacheCon

2019-04-30 Thread Austin Bennett
t want to highlight that this is a great > chance for Beam. There will be a _dedicated_ Beam track which means that > there is potential for lots of new people to learn about Beam. Of > course, there will also be many people already involved in Beam. > > -Max > > On 23.04.19 02:47,

Re: Beam Summit at ApacheCon

2019-05-11 Thread Austin Bennett
Hi All, Deadline for CfP is the morning of 13 May (this Monday) Pacific Time, as decided by ApacheCon. Please submit if you have anything. Also, do write if you have questions/concerns, etc. Cheers, Austin On Tue, Apr 30, 2019 at 7:59 AM Austin Bennett wrote: > Hi Users and Devs, >

Re: Beam Summit at ApacheCon

2019-05-11 Thread Austin Bennett
t; if you have questions/concerns, etc. >> >> Cheers, >> Austin >> >> >> >> On Tue, Apr 30, 2019 at 7:59 AM Austin Bennett < >> whatwouldausti...@gmail.com> wrote: >> >>> Hi Users and Devs, >>> >>> The CfP deadli

Re: Contributing Beam Kata (Java & Python)

2019-05-15 Thread Austin Bennett
Stepik: should we thinking about release versions for what gets uploaded there? If the point of merging was to encourage additional contributions - then should we also have a mechanism for publishing the updates there? In that case, then uploading to stepik should be part of publishing releases?

Re: [Discuss] Ideas for Apache Beam presence in social media

2019-05-20 Thread Austin Bennett
Is PMC definitely in charge of this (approving, communication channel, etc)? There could even be a more concrete pull-request-like function even for things like tweets (to minimize cut/paste operations)? I remember a bit of a mechanism having been proposed some time ago (in another circumstance),

[INPUT PLEASE] Introduction to Committing Workshop @BeamSummit

2019-06-08 Thread Austin Bennett
Hi Dev Community, We are preparing for the Beam Summit, coming in June in Berlin. In JIRA, I see labels: * beginner *.easyfix * documentation * newbie * starter Anything else to point new (potential) committers to? Would also really love for people to upload to JIRA and make suggestions for thi

Adding Contributors in JIRA

2019-06-10 Thread Austin Bennett
Hi Devs, We will have an intro to contributing workshop at BeamSummit on 20 June. Specifically in 945a - 12p Berlin time (GMT +2, Central European Summer Time). Who has enough admin access to JIRA for adding contributors? Or, how could I get such permissions (my username brucearctor) -- it actua

Re: Live fixing of a Beam bug on July 25 at 3:30pm-4:30pm PST

2019-07-23 Thread Austin Bennett
Pablo, Assigned https://issues.apache.org/jira/browse/BEAM-7607 to you, to make even more likely that it is still around on the 25th :-) Cheers, Austin On Tue, Jul 23, 2019 at 11:24 AM Pablo Estrada wrote: > Hi all, > I've just realized that https://issues.apache.org/jira/browse/BEAM-7607 is

Hackathon @BeamSummit @ApacheCon

2019-08-22 Thread Austin Bennett
Less than 3 weeks till Beam Summit @ApacheCon! We are to be in Vegas for BeamSummit and ApacheCon in a few weeks. Likely to reserve space in the Hackathon Room to accomplish some tasks: * Help Users * Build Beam * Collaborate with other projects * etc If you're to be around (or not) let us know

Re: Hackathon @BeamSummit @ApacheCon

2019-08-22 Thread Austin Bennett
And, for clarity, especially focused on Hackathon times on Monday and/or Tuesday of ApacheCon, to not conflict with BeamSummit sessions. On Thu, Aug 22, 2019 at 9:47 AM Austin Bennett wrote: > Less than 3 weeks till Beam Summit @ApacheCon! > > We are to be in Vegas for BeamSummit and

Re: Hackathon @BeamSummit @ApacheCon

2019-09-06 Thread Austin Bennett
gt; Apache Streams project to discuss points for collaboration. >>>> >>>> We will soon announce the exact hours. >>>> >>>> Cheers, >>>> Max >>>> >>>> On 23.08.19 05:06, Kenneth Knowles wrote: >>>> >

Re: Hackathon @BeamSummit @ApacheCon

2019-09-06 Thread Austin Bennett
+u...@beam.apache.org On Fri, Sep 6, 2019 at 5:24 PM Austin Bennett wrote: > Ah, yes. We'll definitely be in Hackathon space 2-3p on Monday and > Tuesday (and can stay longer if needed). We aren't scheduling anything > official on Wed and Thurs, given the multiple B

Re: [discuss] How we support our users on Slack / Mailing list / StackOverflow

2019-09-06 Thread Austin Bennett
I see no reason slack can't be suitable for Beam users -- other open source projects do utilize Slack for user chatter, too. Though what it could be is different from how currently used. There are 173 accounts in #beam-python, and a decent portion of recent conversations (at quick glance) look li

Next LTS?

2019-09-16 Thread Austin Bennett
Hi All, According to our policies page [1]: "There will be at least one new LTS release in a 12 month period, and LTS releases are considered deprecated after 12 months" The last LTS was released 2018-10-02 [2]. Does that mean the next release (2.16) should be the next LTS? It looks like we are

Re: Next LTS?

2019-09-19 Thread Austin Bennett
ing 2.16.0 as LTS release since in has robust >> Python 3 support compared with prior releases, and also for reasons of >> pending Python 2 deprecation. This has been discussed before [1]. As Robert >> pointed out in that thread, LTS nomination in Beam is currently >> retroactive.

Kicking off Beam Meetup NYC

2019-09-27 Thread Austin Bennett
On the heels of the new Seattle Meetup (yesterday's event), announcing the kickoff of the first event in NYC. https://www.meetup.com/New-York-Apache-Beam/events/265128669/ We'll have Tyler Akidau sharing on Streaming SQL, and some talks from Oden Technologies (a fantastic example of Beam, using b

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Austin Bennett
+1 On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev wrote: > Hi everyone, > > Please vote whether to sign a pledge on behalf of Apache Beam to sunset > Beam Python 2 offering (in new releases) in 2020 on > http://python3stament.org as follows: > > [ ] +1: Sign a pledge to discontinue support

Re: [DISCUSS] State of the project

2018-01-13 Thread Austin Bennett
Hi Davor, I wonder what you mean by the thought of prioritizing diversity across runners. * That there is not full parity across runners: https://beam.apache.org/documentation/runners/capability-matrix/ * That there is an imbalance of users relying on specific runners (Haven't seen any usage data

Re: [DISCUSS] State of the project: Community growth

2018-01-15 Thread Austin Bennett
Think that Beam's great, so happy to grow community -- by my individual involvement and to encourage others. 1). Users: I think that this can follow from the others being done well 2). Contributors: some other projects mark very simple contributions for newcomers to find as onramping. Hadn't no

Re: [Discuss] Upgrade story for Beam's execution engines

2018-09-16 Thread Austin Bennett
Do we currently maintain a finer grained list of compatibility between execution/runner versions and beam versions? Is this only really a concern with recent Flink (sounded like at least Spark jump, too)? I see the capability matrix: https://beam.apache.org/documentation/runners/capability-matrix

Re: [ACTION REQUESTED] What do you use Beam for?

2018-10-01 Thread Austin Bennett
Hi All, In honor of Today's Beam Summit (where we'll gather feedback in-person, too), looking for input. How can we make Beam more usable? Are you struggling with anything? Did you struggle with anything previously that you could share to make things clearer/easier for people in the future? You

SF Meetup(s)

2018-10-05 Thread Austin Bennett
Hi All, Looking to start organizing events for Beam around San Francisco. On the lookout for space -- anyone work for a company that could offer space around the city (my company offices are in Foster City, a wholly undesirable Meetup location)? Also, anyone Beam using that would be happy to sha

Re: SF Meetup(s)

2018-10-05 Thread Austin Bennett
Ah, and link to the meet up so can join or be aware: https://www.meetup.com/San-Francisco-Apache-Beam/ On Fri, Oct 5, 2018 at 8:47 AM Austin Bennett wrote: > Hi All, > > Looking to start organizing events for Beam around San Francisco. On the > lookout for space -- anyone work f

Re: SF Meetup(s)

2018-10-08 Thread Austin Bennett
t;> and update here. >> >> On Fri, Oct 5, 2018 at 1:02 PM, Thomas Weise wrote: >> >>> Thanks for the initiative. >>> >>> Lyft may be able to help with hosting and I can help with talks. I will >>> check and circle back. >>> >

Data Preprocessing in Beam

2018-10-23 Thread Austin Bennett
Hi Beam Devs, Alejandro, copied, is an enthusiastic developer, who recently coded up: https://github.com/elbaulp/DPASF (associated paper found: https://arxiv.org/abs/1810.06021). He had been looking to contribute that code to FlinkML, at which point I found him and alerted him to Beam. He has be

Growing Beam -- A call for ideas? What is missing? What would be good to see?

2018-10-25 Thread Austin Bennett
Hi Beam Devs and Users, Trying to get a sense from the community on the sorts of things we think would be useful to build the community (I am thinking not from an angle of specific code/implementation/functionality, but from a user/usability -- I want to dive in and make real contributions with th

Bay Area Apache Beam Kickoff!

2018-11-19 Thread Austin Bennett
We have our first meetup scheduled for December 12th in San Francisco. Andrew Pilloud, a software engineer at Google and Beam committer, will demo the latest feature in Beam SQL: a standalone SQL shell. The talk cover why SQL is a good fit for streaming data processing, the technical details of th

GSOC - Summer of Code, on Beam?

2018-12-04 Thread Austin Bennett
Would it make sense to have any GSOC students for next summer work on Beam? Do we have some candidate things that would be suitable and sufficiently discrete projects? Initial applications for organizations not even open for about a month, though thought worth getting a sense from the group. A b

Re: 2019 Beam Events

2018-12-04 Thread Austin Bennett
Already got that process kicked off with the NY and LA meet ups, now that SF is about to be inagurated goal will be to get these moving as well. For anyone that is in (or goes to) those areas: https://www.meetup.com/New-York-Apache-Beam/ https://www.meetup.com/Los-Angeles-Apache-Beam/ Please reac

Re: 2019 Beam Events

2018-12-14 Thread Austin Bennett
) > https://www.meetup.com/London-Apache-Beam-Meetup/ > > > On Tue, 4 Dec 2018 at 23:50 Austin Bennett > wrote: > > Already got that process kicked off with the NY and LA meet ups, now that > SF is about to be inagurated goal will be to get these moving as well. > > Fo

Beam Summits!

2018-12-19 Thread Austin Bennett
Hi All, I really enjoyed Beam Summit in London (Thanks Matthias!), and there was much enthusiasm for continuations. We had selected that location in a large part due to the growing community there, and we have users in a variety of locations. In our 2019 calendar, https://docs.google.com/spreads

Re: Beam Summits!

2019-01-03 Thread Austin Bennett
tely following Flink >>> Forward Berlin on the previous 2 days. >>> >>> Same may be for Asia also following Flink Forward Asia where and >>> whenever it happens. >>> >>> On Wed, Dec 19, 2018 at 6:06 PM Austin Bennett < >>> whatw

Re: Beam Summits!

2019-01-14 Thread Austin Bennett
- Social media branding (ask speakers to use hashtags, ...) >>>>> - Have a debrief questionnaire >>>>> >>>>> Overall, try to keep closely in sync with your organising team >>>>> (fortnightly calls or weekly when getting closer to the

Re: Beam Summits!

2019-01-21 Thread Austin Bennett
eam. Thanks, Austin On Wed, Dec 19, 2018 at 3:05 PM Austin Bennett wrote: > Hi All, > > I really enjoyed Beam Summit in London (Thanks Matthias!), and there was > much enthusiasm for continuations. We had selected that location in a > large part due to the growing community there,

Re: Beam Summits!

2019-01-23 Thread Austin Bennett
Austin Bennett wrote: > Hi All, > > Other projects/Summits like Kafka and Spark offer add-on days to summits > for training. I'm wondering the appetite/interest for hands-on sessions > for working with Beam, and whether we think that'd be helpful. Are there > peop

Re: Beam Meetups Feb 2019

2019-02-11 Thread Austin Bennett
The slides from Tyler's presentation found: http://s.apache.org/beam-intro-feb-2019 I'll also send out links to videos once I get my hands on them (@Mark Grover ). On Mon, Feb 11, 2019 at 9:48 AM Thomas Weise wrote: > Here are slides for 2 of the presentations from the Lyft meetup: > > Python/

Re: s3 filesystem for Python good for GSoC?

2019-02-21 Thread Austin Bennett
Hi Pablo, Agree on the usefulness. Some thoughts embedded: On Thu, Feb 21, 2019 at 3:19 PM Pablo Estrada wrote: > Hello all, > I was thinking that a filesystem with support for s3 would be great to > have in the Python SDK. If I am not wrong, it would simply involve > implementing the filesys

Re: Apache Beam Newsletter - February/March 2019

2019-03-06 Thread Austin Bennett
+1 for archive in our repo. I do follow the newsletter, but am unlikely to go back and look into the past for changes/updates. Would suggest that things that get missed in one newsletter (a concrete example, Suneel's talks not mentioned in the newsletter) would get published in the next iteration

Re: Beam Meetups Feb 2019

2019-03-12 Thread Austin Bennett
Hi, > > Can you please provide any video recordings if they are available? > > Thanks, > Teja > > On Mon, Feb 11, 2019, 4:51 PM Austin Bennett wrote: > >> The slides from Tyler's presentation found: >> http://s.apache.org/beam-intro-feb-2019 >> >>

Re: One Pager - Test Command Line Discoverability in Beam

2021-05-25 Thread Austin Bennett
Cool; will be good to have and make things clearer! On Tue, May 25, 2021 at 2:39 PM Kyle Weaver wrote: > I left some comments. In summary, I think this is mostly a documentation > problem. If running a test isn't as easy as "./gradlew > $MODULE:integrationTest", there should be instructions in t

Re: Allyship workshops for open source contributors

2021-06-03 Thread Austin Bennett
+1, assuming timing can work. On Wed, Jun 2, 2021 at 2:07 PM Aizhamal Nurmamat kyzy wrote: > If we have a good number of people who express interest in this thread, I >> will set up training for the Airflow community. >> > > I meant Beam ^^' I am organizing it for the Airflow community as well.

Re: Spark Structured Streaming runner migrated to Spark 3

2021-08-05 Thread Austin Bennett
Hooray! Thanks, Etienne! On Thu, Aug 5, 2021 at 3:11 AM Etienne Chauchot wrote: > Hi all, > > Just to let you know that Spark Structured Streaming runner was migrated > to Spark 3. > > Enjoy ! > > Etienne > >

Re: Avro String decoding changes in Beam 2.30.0

2021-08-05 Thread Austin Bennett
Claire and I discussed this a bit earlier, and I asked her to submit a PR. It is found: https://github.com/apache/beam/pull/15292 On Wed, Aug 4, 2021 at 2:21 PM Kirill Panarin wrote: > +1 to what Claire is proposing. Would be nice to have this merged to avoid > fixing things on our side! > > O

Create a Dataset in GCP Testing Project?

2021-09-24 Thread Austin Bennett
Hi Devs, I am working on https://issues.apache.org/jira/browse/BEAM-10652 and specifically sorting out Integration Tests for this. I believe that I need to create a dataset for this to work given errors ( a special purpose dataset seems cleaner than reusing an existing dataset, and in line with t

Re: Create a Dataset in GCP Testing Project?

2021-09-28 Thread Austin Bennett
ns to >> this rule. For example, I am an owner - so I was able to grant you editor >> access. I think you should be able to create a new dataset now. >> >> Brian >> >> On Fri, Sep 24, 2021 at 12:07 PM Austin Bennett < >> whatwouldausti...@gmail.com> w

Re: Beam Website Feedback

2021-11-23 Thread Austin Bennett
Prs welcome :-) On Mon, Nov 22, 2021, 4:46 PM Michael Lehenbauer wrote: > The python version of > https://beam.apache.org/documentation/programming-guide/#using-schemas > has a bunch of missing examples... > > [image: image.png] >

Re: Create a Dataset in GCP Testing Project?

2022-01-18 Thread Austin Bennett
d one of my emails already has access - I checked several ]. Thanks! On Tue, Sep 28, 2021 at 2:47 PM Austin Bennett wrote: > Thanks, and Yes, some in wiki would be helpful -- I looked there first ( > still am not certain on our conventions/why, so not sure that I’m the > person to doc

Re: Create a Dataset in GCP Testing Project?

2022-01-24 Thread Austin Bennett
Bumping this from last week... Can someone with permissions please verify my permissions in the GCP Testing Project ? It doesn't seem like I still have access. Thanks! On Tue, Jan 18, 2022 at 3:10 PM Austin Bennett wrote: > Following up here, it seems I have lost my access to the (G

Re: Beam Website Feedback

2022-03-29 Thread Austin Bennett
Hi Charles, I am not working with any of the mentioned DBs, so can't speak to the state of IOs ( though I think you can use a jdbc connection with each of these, so perhaps see: https://beam.apache.org/releases/pydoc/2.24.0/apache_beam.io.jdbc.html ) . But, I would suggest that contributions to th

Re: Javascript SDK

2022-05-04 Thread Austin Bennett
+1 -- had started playing with this a couple weeks ago, is really shaping up! Some questions about docs, and making [ developing any language ] more approachable --> I wonder whether we have learned enough from this for a guide of sorts for future language development. Perhaps, since fresh, wou

Re: [ANNOUNCE] New committer: Ke Wu

2022-05-27 Thread Austin Bennett
Congrats, and Thanks, Ke! On Fri, May 27, 2022 at 3:49 PM Ahmet Altay wrote: > Hi all, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > Ke Wu (kw2542@) > > Ke has been contributing to Beam since 2020. Ke's contributions are mostly > focused on the SamzaRunner, as a

Re: Join a meeting to help coordinate implementing a Dask Runner for Beam

2022-06-21 Thread Austin Bennett
Looks/Sounds great! On Tue, Jun 21, 2022 at 11:06 AM Alex Merose wrote: > We had a great meeting last week on this topic! Here is a proposal / > meeting notes doc: > > https://docs.google.com/document/d/1Awj_eNmH-WRSte3bKcCcUlQDiZ5mMKmCO_xV-mHWAak/edit#heading=h.y0pwg4polebc > > Tomorrow, anothe

Re: [ANNOUNCE] New committer: Steven Niemitz

2022-07-20 Thread Austin Bennett
Great! On Wed, Jul 20, 2022 at 10:11 AM Aizhamal Nurmamat kyzy wrote: > Congrats, Steve! > > On Wed, Jul 20, 2022 at 3:10 AM Jan Lukavský wrote: > >> Congrats Steve! >> On 7/20/22 06:20, Reuven Lax via dev wrote: >> >> Welcome Steve! >> >> On Tue, Jul 19, 2022 at 1:05 PM Connell O'Callaghan via

Re: [RFC] State & Timers API Design for Go SDK

2022-07-28 Thread Austin Bennett
Looks great! On Thu, Jul 28, 2022 at 10:54 AM Jack McCluskey via dev wrote: > Great write-up on state and timers! The solution you chose feels very > in-line with how the Go SDK works. Make sure the design doc makes it onto > the wiki once you've addressed any feedback! > > On Thu, Jul 28, 2022

Re: [ANNOUNCE] New committer: John Casey

2022-08-01 Thread Austin Bennett
Thanks, John! On Mon, Aug 1, 2022 at 12:01 PM John Casey via dev wrote: > Thanks! I'm looking forward to continuing to improve all of our connectors. > > On Mon, Aug 1, 2022 at 1:52 PM Yichi Zhang via dev > wrote: > >> Congratulations John! >> >> On Sat, Jul 30, 2022 at 4:23 AM Robert Burke wr

Re: Present an Apache Beam Learning Session

2022-08-01 Thread Austin Bennett
Hi Cacie, The list could probably use some more details about what you are seeking. Ex: Where is CUNA Mutual group physically located? Or are you imagining this occurring online? Do people need to get hands-on ( you mention overview so maybe not )? Or, you are seeking just something about what/wh

Re: [idea] A new IO connector named DataLakeIO, which support to connect Beam and data lake, such as Delta Lake, Apache Hudi, Apache iceberg.

2022-08-30 Thread Austin Bennett
Is there enough commonality across Delta, Hudi, Iceberg for this generic solution? I imagined we'd potentially have individual IOs for each. A generic one seems possible, but certainly would like to learn more. Also, are others in the community working on connectors for ANY of those Delta Lake,

Re: Beam Website Feedback

2022-09-09 Thread Austin Bennett
Any chance you've seen a GH Issue for that? If not, please feel free to file one :-) https://github.com/apache/beam/issues On Fri, Sep 9, 2022 at 12:09 PM Peter McArthur wrote: > I wish there were a python example for "Slowly updating global window side > inputs” on this page > https://beam.ap

Re: What to do about issues that track flaky tests?

2022-09-14 Thread Austin Bennett
+1 to being realistic -- proper labels are worthwhile. Though, some flaky tests probably should be P1, and just because isn't addressed in a timely manner doesn't mean it isn't a P1 - though, it does mean it wasn't addressed. On Wed, Sep 14, 2022 at 1:19 PM Kenneth Knowles wrote: > I would li

Go IOs ?

2019-10-27 Thread Austin Bennett
Hi All, https://beam.apache.org/documentation/io/built-in/ Only includes Ios for Java and Python. I have heard talk of a Go SDK :-) Are there working IOs? If yes, should they also be on that page? Thanks, Austin

slides?

2019-11-14 Thread Austin Bennett
Hi Dev and User, Wondering if people would find a benefit from collecting slides from Meetups/Talks? Seems that this could be appropriate on the website, for instance. Not sure whether this has been asked previously, so bringing it to the group. Cheers, Austin

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

2019-11-20 Thread Austin Bennett
[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [x ] Salmon [x ] Trout [x ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [ ] Dumbo Octopus [ ] Angler fish On Tue, Nov 19, 2019 at 6:43 PM Kenneth Knowles wrote: > Please cast your votes of approval [1] for animals you would support as > Beam mascot. The

NYC ? (or more generally East Coast)

2020-01-13 Thread Austin Bennett
Hi Devs and Users, We are looking for speakers for future Meetups and Events. Who is building cool things with Beam? We are looking at hosting a Meetup at Spotify in February, and ideally keep some meetups going throughout the year. For this to occur, we need to hear about what people are worki

Re: Please comment on draft comms strategy by Oct 16

2020-01-15 Thread Austin Bennett
Hi Kenn, We had workshop on this very topic (how to contribute to Beam) at our Berlin Summit: https://www.youtube.com/watch?v=PtPslSdAPcM There's is certainly room for me (or anyone) to cleanup and formalize that a bit more. Though, the views of that are relatively small, which either indeed poi

Re: NYC ? (or more generally East Coast)

2020-01-15 Thread Austin Bennett
2020 at 4:02 PM Austin Bennett > wrote: >> >> Hi Devs and Users, >> >> We are looking for speakers for future Meetups and Events. Who is >> building cool things with Beam? We are looking at hosting a Meetup at >> Spotify in February, and ideally keep some me

DC Meetup

2020-01-15 Thread Austin Bennett
Hi All, We have this meetup group: https://www.meetup.com/DC-Apache-Beam/ Those that can talk, have space, etc etc do write, so we can help get this community kicked off! Cheers, Austin

Bangalore / Bengaluru Meetup

2020-01-16 Thread Austin Bennett
Hi Dev and Users, Also we hope to kickoff a meetup in India this year. https://www.meetup.com/Bangalore-Apache-Beam/ Please let us know if you'd like to get involved, speaking, hosting, etc. Reply to me, private or on thread, and/or use this survey link: https://forms.gle/cud39eh3FA1em7EU7 (than

Los Angeles Beam Meetup kickoff on 27 January

2020-01-17 Thread Austin Bennett
We're kicking off the Beam Community at community member Chad Dombrova's place (Luma Pictures) in Santa Monica. Come join us! https://www.meetup.com/Los-Angeles-Apache-Beam/events/267812648/

Re: [Discuss] Beam Summit 2020 Dates & locations

2020-01-23 Thread Austin Bennett
We are working on it. Identifying initial funding sources and other bits necessary to help make this happen. On Wed, Jan 22, 2020, 7:14 PM Chad Dombrova wrote: > Hi all, > Did we come to a consensus on dates and locations for the summits? > Particularly interested in the North America Summit. >

Re: NYC ? (or more generally East Coast)

2020-01-26 Thread Austin Bennett
We did get 2 awesome speakers for an event at Spotify in NYC on 25 Feb. For interested, come join! https://www.meetup.com/New-York-Apache-Beam/events/268153356/ On Thu, Jan 23, 2020 at 8:08 AM Austin Bennett wrote: > > Hi Jennifer, > > I'd defer to your local expertis

Re: [ANNOUNCE] New committer: Michał Walenia

2020-01-27 Thread Austin Bennett
Nice -- keep up the good work! On Mon, Jan 27, 2020 at 2:02 PM Mikhail Gryzykhin wrote: > > Congratulations Michal! > > --Mikhail > > On Mon, Jan 27, 2020 at 1:01 PM Kyle Weaver wrote: >> >> Congratulations Michał! Looking forward to your future contributions :) >> >> Thanks, >> Kyle >> >> On Mo

Beam Meetup LA -- KICKOFF (10 March)

2020-01-27 Thread Austin Bennett
Come join the community kicking off in LA (in person) on 10 March: https://www.meetup.com/Los-Angeles-Apache-Beam/events/268207085/

Re: Google's support framework for community-led meetups

2020-02-12 Thread Austin Bennett
Hi Maria, This might be useful in user@ as well? Happy to walk you through editing webpage submitting a PR. Then up to appropriate committer as to whether to approve. Write me off list and we can find time. A less focused walkthrough (including way more than you need just for that, in case wan

Re: [REQUEST] Workshop at Data Day in Mexico City - March 26th

2020-02-16 Thread Austin Bennett
Ismael, I'm also putting together training exercises for O'Reilly (ex: https://conferences.oreilly.com/strata-data-ai/stai-ca/public/schedule/detail/83505), and to offer online versions and extensions as well. My criteria for involvement with them has been ability to reuse and share produced mate

Re: Help needed on a problem statement

2020-02-19 Thread Austin Bennett
I'd disentangle Dataflow from Beam. Beam can help you. Dataflow might be useful, though, yes, for batch jobs the spin up cost might be a lot for small file sizes. There are potentially lots of ways to do this. An idea (that I haven't seen used anywhere). Have a streaming Beam pipeline (that ca

Bay Area Beam Meetup 19 Feb (Last Wednesday).

2020-02-21 Thread Austin Bennett
Hi All, We had a meetup @Sentry.io on Wednesday -- with a solid 40+ engaged attendees. Thanks for those that joined in person, and for those that were unable, talks can be found online --> Syd's talk (real time data warehouse): https://youtu.be/rFK6drAWN40 Mike's talk (beam in production): https:

Re: [ANNOUNCE] New committer: Chad Dombrova

2020-02-24 Thread Austin Bennett
Hooray! On Mon, Feb 24, 2020, 11:21 PM Alex Van Boxel wrote: > Congrats! > > _/ > _/ Alex Van Boxel > > > On Tue, Feb 25, 2020 at 6:21 AM Thomas Weise wrote: > >> Congratulations! >> >> >> On Mon, Feb 24, 2020, 3:38 PM Ankur Goenka wrote: >> >>> Congratulations Chad! >>> >>> On Mon, Feb 24, 2

Re: [ANNOUNCE] New committer: Jincheng Sun

2020-02-24 Thread Austin Bennett
Congrats! On Mon, Feb 24, 2020, 11:22 PM Alex Van Boxel wrote: > Congrats! > > _/ > _/ Alex Van Boxel > > > On Mon, Feb 24, 2020 at 8:13 PM Kyle Weaver wrote: > >> Thanks Jincheng for all your work on Beam and Flink integration. >> >> On Mon, Feb 24, 2020 at 11:02 AM Yichi Zhang wrote: >> >>>

Re: Issue in testing doing DirectRunner Apache Beam Local Machine

2020-03-20 Thread Austin Bennett
Hi Yogesh, Many of the examples, use the direct runner: https://github.com/apache/beam/tree/master/examples/java/src/main/java/org/apache/beam/examples As does the word count example: https://beam.apache.org/get-started/quickstart-java/#get-the-wordcount-code I'm not well versed enough with our

Meetups

2020-03-23 Thread Austin Bennett
Seems we won't be convening in-person in about any city anytime soon. Seems like a chance to come together virtually. WHO CAN SHARE? Seeking: * Use Cases * Developing Beam/Components * Other If anything particular, also, what would you like to hear -- can see if we can track such speakers down.

Re: Next LTS?

2020-03-24 Thread Austin Bennett
ow are we going to gauge this demand? > > +Yifan Zou +Alan Myrvold on > the tooling question as well. Unless we address the tooling problem it > seems difficult to feasibly maintain LTS versions over time. > > On Thu, Sep 19, 2019 at 3:45 PM Austin Bennett < > whatwouldausti

Re: Next LTS?

2020-03-25 Thread Austin Bennett
was a suggestion to mark the last release with python 2 support > to be an LTS release, was there a conclusion on that? ( +Valentyn > Tymofieiev ) > > >> > > >> Ahmet > > >> > > >> On Tue, Mar 24, 2020 at 2:34 PM Robert Bradshaw >

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Austin Bennett
+1 (nonbinding) On Thu, Apr 2, 2020 at 12:10 PM Luke Cwik wrote: > +1 (binding) > > On Thu, Apr 2, 2020 at 11:54 AM Pablo Estrada wrote: > >> +1! (binding) >> >> On Thu, Apr 2, 2020 at 11:19 AM Alex Van Boxel wrote: >> >>> Thanks for clearing this up Aizhamal. >>> >>> +1 (non binding) >>> >>>

Re: Usage metrics for Beam

2020-04-09 Thread Austin Bennett
@Robert Bradshaw , you sent that pypi link [1] the other day in response to something else, which is what prompted me to ask Gris about Maven (based on that link [2], @* Kenneth Knowles ). I recall talking to someone about Maven download statistics at ApacheCon. Perhaps these are not the only

Re: Usage metrics for Beam

2020-04-13 Thread Austin Bennett
is ambiguously defined). >> >> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles wrote: >> >>> Yea, interpreting the raw absolute number is tricky. You can probably >>> manage to see certain kinds of trends if you just look at relative numbers. >>> >>

Re: New Contributor Intro

2020-04-17 Thread Austin Bennett
Nice, welcome to the project, Cameron -- many of us met back at Beam Summit EU/Berlin! I don't have the permissions to assign you, but imagine someone will take care of that soon. On Fri, Apr 17, 2020 at 11:15 AM Cameron Morgan wrote: > Hello everyone, > > I would like the permission to contrib

Beam Digital Summit 2020 -- JUNE 2020!

2020-04-22 Thread Austin Bennett
Hi All, We are excited to announce the Beam Digital Summit 2020! This will occur for partial days during the week of 15-19 June. CfP is open and found: https://sessionize.com/beam-digital-summit-2020/ CfP closes on 20 May 2020. Do not hesitate to reach out to the organizers with any questions.

Companies using Beam?

2020-04-28 Thread Austin Bennett
Hi All, Have we considered getting onto our website or our our GitHub repo the ability for individuals to share that their company is using Beam? Seeing - what I believe to be a reasonable list of - companies productively using Beam would be helpful to point others to. For instance, a common que

Re: Companies using Beam?

2020-04-30 Thread Austin Bennett
gt; > Regards > JB > > > Le 28 avr. 2020 à 23:42, Austin Bennett a > écrit : > > > > Hi All, > > > > Have we considered getting onto our website or our our GitHub repo the > ability for individuals to share that their company is using Beam? Seeing >

Re: Try Beam Katas Today

2020-05-14 Thread Austin Bennett
It looks like there are instructions online for writing exercises/Katas: https://www.jetbrains.com/help/education/educator-start-guide.html Do we have a guide for contributing and publication/releases occur (publishing to Stepik)? Although the code lives in the main repo (therefore subject to tho

Event Calendar?

2020-05-19 Thread Austin Bennett
Hi All, As we have events more often that are more accessible (digital), wondering whether others see a value of adding a calendar to the website? Perhaps related, is it worth updating https://beam.apache.org/community/in-person/ <- to something that isn't 'in-person' since doing things in-person

Re: [ANNOUNCE] New committer: Robin Qiu

2020-05-20 Thread Austin Bennett
Congrats! On Tue, May 19, 2020, 8:32 PM Chamikara Jayalath wrote: > Congrats Robin! > > On Tue, May 19, 2020 at 2:39 PM Rui Wang wrote: > >> Nice! Congrats! >> >> >> >> -Rui >> >> On Tue, May 19, 2020 at 11:13 AM Pablo Estrada >> wrote: >> >>> yoohoo : ) >>> >>> On Tue, May 19, 2020 at 11:03 A

Re: Transparency to Beam Digital Summit Planning

2020-05-20 Thread Austin Bennett
Should the link/meeting notes be publicly available? Not just available to individuals plus all of @google? On Wed, May 20, 2020 at 2:06 PM Brittany Hermann wrote: > Hi folks, > > I wanted to provide a few different ways of transparency to you during the > planning of the Beam Digital Summit.

deploy_travis.sh ?

2020-05-21 Thread Austin Bennett
Hi All, Was digging into https://github.com/apache/beam-wheels after being reminded of https://issues.apache.org/jira/browse/BEAM-9388 (I recall the original conversation --> https://lists.apache.org/thread.html/r4a7d34e64a34e9fe589d06aec74d9b464d252c516fe96c35b2d6c9ae%40%3Cdev.beam.apache.org%3E

Re: Try Beam Katas Today

2020-05-24 Thread Austin Bennett
@Rion, @Henry Suryawirawan , @Damon, I added a Flatten Kata for Go. Please have a look: https://github.com/apache/beam/pull/11806 -- tagged all of you as other authors of Katas. A few questions: 1) Across all the katas, we have files '{task, lesson,section}-remote-info.yaml'. These files do

Re: deploy_travis.sh ?

2020-05-24 Thread Austin Bennett
eels/commit/40c0bd1a36d70736b84e925889cdad417e429fd4 > > On 2020/05/22 02:13:35, Austin Bennett > wrote: > > Hi All, > > > > Was digging into https://github.com/apache/beam-wheels after being > reminded > > of https://issues.apache.org/jira/browse/BEAM-9388 (I recall the > original > > con

Re: Try Beam Katas Today

2020-05-25 Thread Austin Bennett
be able to also run the pipeline > independently and observe the output, just like when they write the > pipeline normally. > > Hope my answers help to clarify. > > > Henry Suryawirawan > > Strategic Cloud Engineer > > hsuryawira...@google.com > > > > >

  1   2   >