Also, I checked your code but it will again give the same result even if I do sampling because the schema of the "data" attribute is not fixed.
Any suggestions? On Thu, Aug 8, 2024 at 12:34 PM Perez <flinkbyhe...@gmail.com> wrote: > Hi Mich, > > Thanks a lot for your answer but there is one more scenario to it. > > The schema of the data attribute inside the steps column is not fixed. For > some records, I see it as a struct and for others, I see it as an Array of > objects. > > So at last it treats it as string only since it gets confused I guess. > > So how can we tackle this? > > Thanks, >
