Hi all i was wondering if anyone could provide pointers on how to test a pipeline in python. I have the following pipeline
lines = (p
| 'Get List of Tickers' >> beam.Map(get_tickers)
| 'Split fields' >> beam.Map(split_fields)
| 'Map to String' >> beam.Map(add_year)
)
result = p.run()
Now i can easily test each individual function for each step
(get_tickers, split_fields, add_year)
but is there a way to test the pipeline 'as a whole' ?#
Could anyone point me to some examples?
kind regards
