RE: [Question] Infer schema from a Pcollection of Python dicts

2022-04-15 Thread Nivaldo Tokuda
Hi Brian, I was fully confident I had double checked this before, but the type mismatch in the schema was exactly the issue. I changed one of the fields to int and the schema is now inferred correctly. Thanks a lot for the help! Es

RE: [Question] Infer schema from a Pcollection of Python dicts

2022-04-15 Thread Nivaldo Tokuda
I apologize for the formatting. Never used a mailing list before. I restructured the question here with the intended layout: https://gist.github.com/nivaldo-tokuda-g/4f9b0b3aafb28d7c5740d7da5a4cdc8c Este e-mail e seus anexos s?o pa

[Question] Infer schema from a Pcollection of Python dicts

2022-04-15 Thread Nivaldo Tokuda
Hi, I have a pipeline with a Pcollection of dicts in Python, and I'd like to apply a schema to it for use with SQLTransforms. The schema is defined as follows: class RowSchema(typing.NamedTuple): colA: str colB: typing.Optional[str] beam.coders.registry.register_coder(RowSchema, be