[Proposal] Adopt a Beam I/O Standard

2022-12-11 Thread Herman Mak via dev
Hello Everyone, *TLDR* Should we adopt a set of standards that Connector I/Os should adhere to? Attached is a first version of a Beam I/O Standards guideline that includes opinionated best practices across important components of a Connector I/O, namely Documentation, Development and Testing. *T

Re: [Proposal] Adopt a Beam I/O Standard

2022-12-15 Thread Herman Mak via dev
g/beam-io-api-standard-documentation >>>> https://s.apache.org/beam-io-api-standard >>>> >>>> This is missing all the relational stuff that was in those docs, this >>>> appears to be another attempt starting from the beginning? >>>> >>>> And

Re: [Proposal] Adopt a Beam I/O Standard

2022-12-21 Thread Herman Mak via dev
lso, design docs, previous >>>>> emails, and similar. >>>>> >>>>> On Mon, Dec 12, 2022, 6:07 PM Andrew Pilloud via dev < >>>>> dev@beam.apache.org> wrote: >>>>> >>>>>> I believe the previous iteration

Re: How to write an IO guide draft

2023-01-10 Thread Herman Mak via dev
Thanks John! Herman Mak | Customer Engineer, Hong Kong, Google Cloud | herman...@google.com | +852-3923-5417 On Tue, Jan 10, 2023 at 12:58 AM John Casey via dev wrote: > Hi All, > > I spent the last few weeks of December drafting a "How to write an IO > guide": > https://docs.google.com/d

Re: [Proposal] Adopt a Beam I/O Standard

2023-01-11 Thread Herman Mak via dev
, 2022 at 6:49 PM Robert Burke >>>>> wrote: >>>>> >>>>>> I think ultimately: until the docs a clearly available on the Beam >>>>>> site itself, it's not documentation. See also, design docs, previous >>>>&