Re: [capnproto] Text blob too big.

2023-03-17 Thread Jonathan Shapiro
I obviously need to finish reading specs before I ask stupid questions. rpc.capnp documents the release message quite clearly. -- You received this message because you are subscribed to the Google Groups "Cap'n Proto" group. To unsubscribe from this group and stop receiving emails from it, send

Re: [capnproto] Text blob too big.

2023-03-17 Thread Jonathan Shapiro
Amusingly, I was just looking at this for a protocol. Kenton's suggestion to use List[Data] works, but it carries an unintended buffering problem. A message can have multiple segments, and a correct capn-proto implementation will extend its segment pool as needed to hold a large byte sequence,

Re: [capnproto] Text blob too big.

2022-11-03 Thread Jose mi
Sorry I writed it in Spanish and see it now. Translation: The problem is that the server receives all the data in a transmission buffer, piece by piece without knowing the structured object. So I'm storing it in a file because the server doesn't need to open it (it only needs to read small dat

Re: [capnproto] Text blob too big.

2022-11-02 Thread Josemi
El problema es que el servidor recibe todos los datos en un búfer de transmisión, pieza por pieza sin conocer el objeto estructurado. Así que lo estoy almacenando en un archivo porque el servidor no necesita abrirlo (solo necesita leer datos pequeños). Si quiero poner todos los atributos en las

Re: [capnproto] Text blob too big.

2022-10-31 Thread Jens Alfke
> On Oct 31, 2022, at 12:21 PM, Josemi wrote: > > Hello. > > I need to work with a structured data that have atributes with undefined > lenght, some of them could have GB. Most structured storage is optimized for smaller data. And huge values in-line push all the records far apart, which

Re: [capnproto] Text blob too big.

2022-10-31 Thread Josemi
Hi Kenton, thanks for the quick response. I was working now on this solution, the limit per blob is not too much of a problem for me. Thanks to Cap'n proto I think I'll have an elegant solution. Thanks. El lunes, 31 de octubre de 2022 a las 20:32:30 UTC+1, ken...@cloudflare.com escribió: > For

Re: [capnproto] Text blob too big.

2022-10-31 Thread 'Kenton Varda' via Cap'n Proto
For a single Text or Data blob there is a hard limit of 512MB. You can, however, construct a message which contains multiple blobs, e.g. use `List(Text)`. Such a message can be up to 2^64 bytes. If I were redesigning the encoding from scratch I'd probably allow for bigger individual blobs but ther