RE: [EXTERNAL] Re: Arrow Flight connector for SQL Server

2020-05-26 Thread Brendan Niebruegge
-transact-sql-query?view=sql-server-ver15 Thanks, Brendan Niebruegge From: Ryan Murray Sent: Friday, May 22, 2020 7:22 AM To: dev@arrow.apache.org Cc: Brendan Niebruegge ; Jasraj Dange ; James Rowland-Jones ; Jarupat Jisarojito Subject: [EXTERNAL] Re: Arrow Flight connector for SQL Server Hey

Re: Arrow Flight connector for SQL Server

2020-05-22 Thread Ryan Murray
Hey Brendan, As Jacques promised here are a few things to act as pointers for your work on Flight: Our early release Flight connector[1] this fully supports single flight streams and partially supports parallel streams I also have a Spark DataSourceV2 client which may be of interest to you[2] Bo

Re: Arrow Flight connector for SQL Server

2020-05-21 Thread Uwe L. Korn
Hello Brendan, welcome to the community. In addition to the folks at Dremio, I wanted to make you aware of the Python ODBC client library https://github.com/blue-yonder/turbodbc which provides a high-performance ODBC<->Arrow adapter. It is especially popular with MS SQL Server users as the fas

Re: Arrow Flight connector for SQL Server

2020-05-19 Thread Jacques Nadeau
Hey Brendan, Welcome to the community. At Dremio we've exposed flight as an input and output for sql result datasets. I'll have one of our guys share some details. I think a couple questions we've been struggling with include how to standardize additional metadata operations, what should the prepa

Arrow Flight connector for SQL Server

2020-05-19 Thread Brendan Niebruegge
Hi everyone, I wanted to informally introduce myself. My name is Brendan Niebruegge, I'm a Software Engineer in our SQL Server extensibility team here at Microsoft. I am leading an effort to explore how we could integrate Arrow Flight with SQL Server. We think this could be a very interesting i