SplittableDoFn has experimental support within Dataflow so the way you may be using it could be correct but unsupported.
Can you provide snippets/details of your splittable dofn implementation? On Mon, Mar 2, 2020 at 11:50 AM Kjetil Halvorsen < [email protected]> wrote: > > Hi, > > I am looking for pointers to a Dataflow runner error message: Workflow > failed. Causes: Step s22 has conflicting bucketing functions, > > This happens at the very startup of the job execution, and I am unable to > find any pointer as to where in the code/job definition the origin of the > conflict is. The same job runs just fine in the DirectRunner. > > The job contains a splittable DoFn (unbound) and I have tried it with both > a windowing transform and without a windowing transform--both fail with the > same result on Dataflow. > > This is my first foray into splittable DoFn territory so I am sure I have > just made some basic missteps. > > Cheers, > Kjetil > > > > > -- > > *Kjetil Halvorsen* > Chief Architect, Enterprise Integration > +47 48 01 13 75 | [email protected] > www.cognite.com | LIBERATE YOUR DATA™ > >
