question regarding copyData containers

2020-06-03 Thread Jerome Wagner
Hello, I have been working on a node.js streaming client for different COPY scenarios. usually, during CopyOut, clients tend to buffer network chunks until they have gathered a full copyData message and pass that to the user. In some cases, this can lead to very large copyData messages. when ther

Re: question regarding copyData containers

2020-06-04 Thread Jerome Wagner
are probably based on a buffer/field one-to-one mapping. Greetings, Jérôme On Thu, Jun 4, 2020 at 12:08 AM Andres Freund wrote: > Hi, > > On 2020-06-03 19:28:12 +0200, Jerome Wagner wrote: > > I have been working on a node.js streaming client for different COPY > > scenarios

COPY, bytea streaming and memory footprint

2020-06-10 Thread Jerome Wagner
Hello, I am trying to understand/optimize how a COPY operation behaves when transfering a bytea from the database to a client. For simplicity, I'll consider that I have only one bytea _image_ in the _images_ table. Starting with COPY (SELECT image FROM images) TO STDOUT BINARY I understand that