If you're writing to files, you can already do this: FileIO.write() returns
WriteFilesResult that you can use in combination with Wait.on() and
JdbcIO.write() to write something to a database afterwards.
Something like:
PCollection<..> writeResult = data.apply(FileIO.write()...);
Create.of("dummy").apply(Wait.on(writeResult)).apply(JdbcIO.write(...write
to database...))
On Wed, Jun 19, 2019 at 11:49 PM Chaim Turkel <ch...@behalf.com> wrote:
> is it something you can do, or point me in the right direction?
> chaim
>
> On Wed, Jun 19, 2019 at 8:36 PM Kenneth Knowles <k...@apache.org> wrote:
> >
> > This sounds like a fairly simply and useful change to the IO to output
> information about where it has written. It seems generally useful to always
> output something like this, instead of PDone.
> >
> > Kenn
> >
> > On Wed, Jun 19, 2019 at 5:42 AM Chaim Turkel <ch...@behalf.com> wrote:
> >>
> >> Hi,
> >> I would like to write a status at the end of my pipline. I had
> >> written about this in the past, and wanted to know if there are any
> >> new ideas.
> >> The problem is the end of the pipeline return PDone, and i can't do
> >> anything with this.
> >> So my senario is after i export data from mongo to google storage i
> >> want to write to a db that the job was done with some extra
> >> information.
> >>
> >> Chaim Turkel
> >>
> >> --
> >>
> >>
> >> Loans are funded by
> >> FinWise Bank, a Utah-chartered bank located in Sandy,
> >> Utah, member FDIC, Equal
> >> Opportunity Lender. Merchant Cash Advances are
> >> made by Behalf. For more
> >> information on ECOA, click here
> >> <https://www.behalf.com/legal/ecoa/>. For important information about
> >> opening a new
> >> account, review Patriot Act procedures here
> >> <https://www.behalf.com/legal/patriot/>.
> >> Visit Legal
> >> <https://www.behalf.com/legal/> to
> >> review our comprehensive program terms,
> >> conditions, and disclosures.
>
> --
>
>
> Loans are funded by
> FinWise Bank, a Utah-chartered bank located in Sandy,
> Utah, member FDIC, Equal
> Opportunity Lender. Merchant Cash Advances are
> made by Behalf. For more
> information on ECOA, click here
> <https://www.behalf.com/legal/ecoa/>. For important information about
> opening a new
> account, review Patriot Act procedures here
> <https://www.behalf.com/legal/patriot/>.
> Visit Legal
> <https://www.behalf.com/legal/> to
> review our comprehensive program terms,
> conditions, and disclosures.
>
