Re: Regarding Beam Slack Channel

2017-01-23 Thread Kai Jiang
Hi Amit, I am a new contributor. Could you add me as well? jiang...@gmail.com Thanks, Kai On Mon, Jan 23, 2017 at 1:04 PM, Davor Bonaci wrote: > I wouldn't be in favor of such "solutions" on top of Slack, unless > specifically endorsed by Slack itself. It sounds like something intended to > ov

Re: Large CSV files

2018-07-23 Thread Kai Jiang
I have the same situation. If CSV is splittable, we could use SDF. ᐧ On Mon, Jul 23, 2018 at 1:38 PM Raghu Angadi wrote: > It might be simpler to discuss if you replicate the question here. > > Are your CSV files splittable? Otherwise Flink/Dataflow runners would not > load the entire file into

Re: Scio 0.5.6 released

2018-07-29 Thread Kai Jiang
Congratulations! ᐧ On Fri, Jul 27, 2018 at 11:03 PM Ahmet Altay wrote: > Congratulations! > > Rooting for pica pica to be the code name for the next release :) > > On Wed, Jul 25, 2018 at 4:57 PM, Neville Li wrote: > >> Hi all, >> >> We just released Scio 0.5.6. This release includes a lot of i

Re: Does beam spark runner support yarn-cluster mode

2023-07-12 Thread Kai Jiang
Yeah, I think you could check this document out. https://beam.apache.org/documentation/runners/spark/#running-on-dataproc-cluster-yarn-backed Spark runner shall support running on yarn-cluster mode. On Tue, Jul 11, 2023 at 7:58 PM Jeff Zhang wrote: > Hi all, > > I didn't find much material about