Re: Append to an existing Delta Lake using structured streaming

2021-07-21 Thread eugen . wintersberger
I will try to provide a stripped down example of what I am doing The initial delta lake is built from a dataframe like this from within a notebook val hourly_new = events.select(window('timestamp, "1 hour"), 'serial, 'type) .select($"window.start".as("start"), 'serialno, 'eventType)

Re: Append to an existing Delta Lake using structured streaming

2021-07-21 Thread Denny Lee
Including the Delta Lake Users and Developers DL to help out. Saying this, could you clarify how data is not being added? By any chance do you have any code samples to recreate this? Sent via Superhuman On Wed, Jul 21, 2021 at 2:49 AM, wrote: > Hi