GitHub user bamaer added a comment to the discussion: Pseudo-CDC - polled pipeline runs?
You usually want to process the changed data and e.g. write it out to a target table where you can pick it up. In general we don't store _any_ data in Apache Hop. The transform you're looking for would be a combination of a first table input where you get the max date/id from the target table and use that in a second table input to get anything that is newer from the source table. Basically, the single transform you're looking for is commonly implemented as a combination of 2 table input transforms. GitHub link: https://github.com/apache/hop/discussions/5134#discussioncomment-12765224 ---- This is an automatically sent email for users@hop.apache.org. To unsubscribe, please send an email to: users-unsubscr...@hop.apache.org
