I don't expect to see a large DS V2 API change from now on. But we may
update the API a little bit if we find problems during the preview.
On Sat, Sep 14, 2019 at 10:16 PM Sean Owen wrote:
> I don't think this suggests anything is finalized, including APIs. I
> would not guess there will be majo
@Sean Owen , so sorry to reply late, we had a Mid-Autumn
holiday:)
If you hope to integrate ARM CI to amplab jenkins, we can offer the arm
instance, and then the ARM job will run together with other x86 jobs, so
maybe there is a guideline to do this? @shane knapp
would you help us?
On Thu, Sep
> 1. It is a waste of IO. The whole column (in Map format) should be read
and Spark extract the required keys from the map, even though the query
requires only one or a few keys in the map
This sounds like a similar use case to nested column pruning. We should
push down the map key extracting to t
I am trying to create a function that reads data from Kafka, communicates
with confluent schema registry and decodes avro data with evolving schemas.
I am trying to not create hack-ish patches and to write proper code that I
could maybe even create pull requests for. looking at the code I have been
