Re: Arrow Flight + Go, Arrow for Realtime

2020-08-18 Thread Micah Kornfield
> > array > > > of floats in my case) but the number of columns, and their type vary by > > > dataset and visualization choices. So far arrow seems a good choice > > rather > > > than any 'roll your own', and it will be nice to use same format on &

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-17 Thread Michael Stephenson
e is primarily 'Get', consuming large datasets for > > visualization. I doubt I'll need Put or Exchange from the browser. > > > > Mark. > > > > -Original Message- > > From: David Li > > Sent: Saturday, August 15, 2020 5:53 PM > > To: d

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-15 Thread Pierre Belzile
isualization. I doubt I'll need Put or Exchange from the browser. > > Mark. > > -Original Message----- > From: David Li > Sent: Saturday, August 15, 2020 5:53 PM > To: dev@arrow.apache.org > Subject: Re: Arrow Flight + Go, Arrow for Realtime > > I am curious what

RE: Arrow Flight + Go, Arrow for Realtime

2020-08-15 Thread mark
7;ll need Put or Exchange from the browser. Mark. -Original Message- From: David Li Sent: Saturday, August 15, 2020 5:53 PM To: dev@arrow.apache.org Subject: Re: Arrow Flight + Go, Arrow for Realtime I am curious what you accomplish with Arrow + Flight from the browser. Right now, Fligh

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-15 Thread David Li
; From: Wes McKinney > Sent: Wednesday, August 12, 2020 3:59 PM > To: dev > Subject: Re: Arrow Flight + Go, Arrow for Realtime > > There's a WIP patch for Flight support in Go > > https://github.com/apache/arrow/pull/6731 > > I hope to see someone taking up this

RE: Arrow Flight + Go, Arrow for Realtime

2020-08-14 Thread mark
Mark. -Original Message- From: Wes McKinney Sent: Wednesday, August 12, 2020 3:59 PM To: dev Subject: Re: Arrow Flight + Go, Arrow for Realtime There's a WIP patch for Flight support in Go https://github.com/apache/arrow/pull/6731 I hope to see someone taking up this work as first-cl

RE: Arrow Flight + Go, Arrow for Realtime

2020-08-14 Thread mark
reat if it can. Regards Mark. -Original Message- From: Sebastien Binet Sent: Wednesday, August 12, 2020 1:53 PM To: dev@arrow.apache.org Subject: Re: Arrow Flight + Go, Arrow for Realtime Mark, AFAIK, nobody's actively working on Arrow-Flight for Go (I think somebody started that w

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-12 Thread fredgan
Hi Sebastien, I am really interested in this feature. I would like to join in the development. But I have to take time to familiarize myself with it. I will try it! Fred -- Original -- From: Sebastien Binet https://lists.apache.org/thread.html/e15dc80debf9dea1

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-12 Thread Sebastien Binet
Mark, AFAIK, nobody's actively working on Arrow-Flight for Go (I think somebody started that work at some point but I don't remember anything hitting the main repo) as for Go+WASM: https://lists.apache.org/thread.html/e15dc80debf9dea1b33581fa6ba95fd84b57c0ccd0162505d5d25079%40%3Cdev.arrow.apach

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-12 Thread Wes McKinney
There's a WIP patch for Flight support in Go https://github.com/apache/arrow/pull/6731 I hope to see someone taking up this work as first-class Flight support in Go would be very useful for building data services. On Wed, Aug 12, 2020 at 5:08 AM Adam Lippai wrote: > > Arrow is mainly about batc

Re: Arrow Flight + Go, Arrow for Realtime

2020-08-12 Thread Adam Lippai
Arrow is mainly about batching data and leveraging all the opportunities this gives. This means you either have to buffer the data yourself and flush it when a reasonable sized batch is complete or play with preallocating Arrow structures This was discussed recently, you might be interested in the

Arrow Flight + Go, Arrow for Realtime

2020-08-12 Thread mark
I'm looking at using Arrow for a realtime IoT project which includes use cases both on server, and also for transferring /using in a Browser via WASM, and have a few questions. Language in use is Go. Is anyone working on implementing Arrow-Flight in Go ? (According to the feature