Re: [I] Open Variant Type for semi-structured data [datafusion]

2025-05-19 Thread via GitHub
ianmcook commented on issue #10987: URL: https://github.com/apache/datafusion/issues/10987#issuecomment-2892638977 There's a discussion happening on the Arrow dev mailing list about adding Variant as a canonical extension type in the Arrow spec. Input from the DataFusion developer community

Re: [I] Open Variant Type for semi-structured data [datafusion]

2025-04-28 Thread via GitHub
alamb commented on issue #10987: URL: https://github.com/apache/datafusion/issues/10987#issuecomment-2836521200 FWIW the variant type has been added to the parquet spec, and is now much closer to standardization and we are beginning work on the support at the parquet layer. See epic - ht

Re: [I] Open Variant Type for semi-structured data [datafusion]

2024-06-18 Thread via GitHub
samuelcolvin commented on issue #10987: URL: https://github.com/apache/datafusion/issues/10987#issuecomment-2176987939 Interesting, this is exactly what we need. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Open Variant Type for semi-structured data [datafusion]

2024-06-18 Thread via GitHub
alamb commented on issue #10987: URL: https://github.com/apache/datafusion/issues/10987#issuecomment-2176979863 @samuelcolvin and @adriangb and I were speaking about datafusion-functions-json just today. They may be interested too I have created https://github.com/datafusion-contrib