I probably missed something. Tried this toy example:
pipeline:
transforms:
- type: Create
config:
elements: [1, 2, 3, 4, -1]
- type: MapToFields
input: Create
name: MapToFields_1
config:
language: python
fields:
element:
Another option is to add a second DLQ that outputs just the original rows,
i.e. the user has the option to fetch failed rows with or without metadata.
It would take some work on our side to add this second DLQ to
existing transforms, but that seems pretty straightforward.
On Sat, Oct 19, 2024 at 1