Re: Serializing and deserializing a single RecordBatch via IPC

2025-04-05 Thread Jack Wimberley via user
but there has > been some garbage written? Not totally sure, but it seems a reasonable > culprit. > > [1]: https://gist.github.com/drin/0386e326a0e1e5d8b079c20e1f81bb0f > > > # -- > # Aldrin > > https://github.com/drin/ > https://gitl

Serializing and deserializing a single RecordBatch via IPC

2025-03-04 Thread Jack Wimberley via user
Hello all, I am attempting to serialize and then deserialize individual RecordBatch objects, using the C++ library. However, I’m getting an “Invalid” result on the deserialization end. On the serialization end, with the help of some methods THROW_NOT_OK that throw on non-OK Status and Result (

Re: Serializing and deserializing a single RecordBatch via IPC

2025-03-05 Thread Jack Wimberley via user
One other bit of information: I occasionally get the error message "Tried reading schema message, was null or length 0” instead, in the exact same context. On Mar 4, 2025 at 4:34 PM -0500, Jack Wimberley , wrote: > Hello all, > > I am attempting to serialize and then deserialize individual Recor

Re: Serializing and deserializing a single RecordBatch via IPC

2025-03-05 Thread Jack Wimberley via user
Oops -- I belatedly thought to bump up the deserialization logic to read from the same buffer that I originally wrote to and this worked fine, and clearly the problem lies elsewhere in the transit. Sorry for the noise! Best, Jack On Mar 5, 2025 at 12:06 PM -0500, Jack Wimberley , wrote: > One