Fwd: Spark Write BinaryType Column as continues file to S3

Hello, > Am 08.04.2022 um 17:34 schrieb Lalwani, Jayesh : > > What format are you writing the file to? Are you planning on your own custom > format, or are you planning to use standard formats like parquet? I’m dealing with geo-spatial data (Apache Sedona), so I have got a data frame with such

Fwd: Spark Write BinaryType Column as continues file to S3

Hello, This sound great for the first step. > Am 08.04.2022 um 17:25 schrieb Sean Owen >: > > You can certainly write that UDF. You get a column in a DataFrame of > array type and you can write that to any appropriate format. > What do you mean by continuous byte stre