Re: [YAML] Reprocessing failed records

2024-10-19 Thread XQ Hu via dev
I probably missed something. Tried this toy example: pipeline: transforms: - type: Create config: elements: [1, 2, 3, 4, -1] - type: MapToFields input: Create name: MapToFields_1 config: language: python fields: element:

Re: [YAML] Reprocessing failed records

2024-10-19 Thread Ahmed Abualsaud via dev
Another option is to add a second DLQ that outputs just the original rows, i.e. the user has the option to fetch failed rows with or without metadata. It would take some work on our side to add this second DLQ to existing transforms, but that seems pretty straightforward. On Sat, Oct 19, 2024 at 1