There was some time ago a PR that added support to VFS with this at least theorically we could support FTP and even HTTP listings. However this needs some love to rebase and update it, but if you are interested on hacking on this don't hesitate to cohtact me and I can mentor you to do so or eventually try to get some time to finish that work.
https://github.com/apache/beam/pull/4803 On Fri, Jan 4, 2019 at 1:09 AM Rui Wang <ruw...@google.com> wrote: > > For the calling external service, it's described in [1] as a pattern which > has a small sample of code instruction. > > However, why not write a script to prepare the data first and then write a > pipeline to process it? > > 1. > https://cloud.google.com/blog/products/gcp/guide-to-common-cloud-dataflow-use-case-patterns-part-1 > > On Thu, Jan 3, 2019 at 6:13 AM Henrique Molina <henrique.mol...@gmail.com> > wrote: >> >> Hi Folks , >> I'm newbie in Beam, but I looking for some way to read an File stored at FTP >> >> First of all, I could create ParDo, using FTPClient (Commons-net) and access >> returning an Byte[] of File *.csv. >> second ParDO create the csv >> third PardDo using the TextIO to read lines.... >> >> Somebody could share some sources and materials about that ? >> Or Do you have another alternative more simple ? >> Thanks & Regards
