Dataflow runner and IntrinsicMapTaskExecutor instanciation

2022-05-20 Thread Michel Davit
7;: it involves duplicating the whole coder stack. We see a significant increase of memory consumption as well as a longer startup time, due to the CloudObjects.coderFromCloudObject operation. Is there a reason why dataflow creates so many unused executors ? Cheers -- Michel Davit Data Engineer Spot

Re: Scio 0.11.6 released

2022-05-03 Thread Michel Davit
le (#4369 <https://github.com/spotify/scio/pull/4369>) @RustedBones <https://github.com/RustedBones> On Mon, May 2, 2022 at 5:50 PM Michel Davit wrote: > Hi all, > > We just released Scio 0.11.6 > <https://github.com/spotify/scio/releases/tag/v0.11.6>. This bumps

Scio 0.11.6 released

2022-05-02 Thread Michel Davit
la-steward> - Update shapeless to 2.3.9 (#4297 <https://github.com/spotify/scio/pull/4297>) @scala-steward <https://github.com/scala-steward> - Update sbt-api-mappings to 3.0.2 (#4290 <https://github.com/spotify/scio/pull/4290>) @scala-steward <https://gi