Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread James Duong
Regarding #2, what I've found now is that gRPC basically removed what -DGPR_MANYLINUX1=1 does to try to collapse the case into the normal Linux case during the upgrade to 1.32: https://github.com/grpc/grpc/commit/23e1d30327923ac93beaeb6cdcfb0eef9be759c4 I'm currently trying out turning off platfor

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread David Li
For #1, can we embed a dummy root to make gRPC happy, since we're only using it in the case that we're disabling validation? (Also, is there a bug report for gRPC/would you like to file one?) For #2, I think you can get cmake to pass -D flags, perhaps you can get it to define a symbol you can chec

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-05 Thread James Duong
An update about this issue (also on JIRA at https://issues.apache.org/jira/browse/ARROW-10105) Hoping for some suggestions on how to deal with C++ issues with gRPC versioning. I have the Java version of this feature working and tested. The C++ client has some challenges: The experimental TlsCrede

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-02 Thread David Li
Hey James, Where gRPC comes from depends on your setup; the C++ development guide[1] describes it all, but I personally use Conda with conda-forge which gets me gRPC 1.32. The dependency version again depends on where you're looking - for bundled builds it's set in thirdparty/versions.txt[2], for

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-10-02 Thread James Duong
Hi David, I've created a WIP PR illustrating what I'm planning to do. However I'm still trying to figure out a few things: - In my environment, gRPC is coming from miniconda3 for C++, and seems to be an older version. In more recent versions, gRPC has an experimental API TlsCredentials,

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-30 Thread James Duong
Will do David. I've created a JIRA for the TLS_SNI extension as well: https://issues.apache.org/jira/browse/ARROW-10144 On Wed, Sep 30, 2020 at 7:52 AM David Li wrote: > Hi James, > > Please feel free to tag me as a reviewer if needed. > > Best, > David > > On 9/28/20, James Duong wrote: > > H

Re: [FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-30 Thread David Li
Hi James, Please feel free to tag me as a reviewer if needed. Best, David On 9/28/20, James Duong wrote: > Hi Arrow-Dev, > > I've created a JIRA for supporting using Flight clients to connect to > Flight servers without verifying the server certificate. > > This is something I've seen done freq

[FlightRPC][Java][Python/c_lib] Encryption without validation in Flight clients

2020-09-28 Thread James Duong
Hi Arrow-Dev, I've created a JIRA for supporting using Flight clients to connect to Flight servers without verifying the server certificate. This is something I've seen done frequently for other connectivity tools such as JDBC drivers. I'll be looking to implement this one for the and hopefully