Re: package / tmp file usage ...

2023-05-17 Thread Attila Szűcs
Thx Michael, you are right, if an other thread would deflate (to disk) while SvXMLExport create the xml stream (in memory), and they would keep the memory stream under a size limitation, then it would be great. I seen this producer / consumer pattern like thing in XBufferedThreadedStream .. and

Re: package / tmp file usage ...

2023-05-17 Thread Michael Meeks
On 17/05/2023 15:42, Attila Szűcs wrote: I can see this file on my hard drive, so it is really here. i can view its content and it is a half made xml file content.xml (the whole file) ~110mb big, but the compressed ods is only ~670kb. so if it would be stored only in memory, we could avoid a l

Re: package / tmp file usage ...

2023-05-17 Thread Attila Szűcs
i just re-created the situation, and here is a callstack (made in windows), when i save_as an ods file. it writes (still uncomressed) data to a stream, but that stream is a file on my harddrive: C:\\Users\\Szucsi\\AppData\\Local\\Temp\\lu99163n3gde.tmp\\lu9916{8AA24C62-674C-4CFF-BB49-581F276144

Re: package / tmp file usage ...

2023-05-16 Thread Mike Kaganski
On 14.05.2023 14:46, Noel Grandin wrote: What I can see is that we save to a temporary file and then copy the temporary file to its final location. That part however would require major surgery to change since it starts in sfx and goes through the dreaded UCB layer. We introduced osl_replaceF

Re: package / tmp file usage ...

2023-05-14 Thread Noel Grandin
On Tue, 14 Feb 2023 at 17:40, Noel Grandin wrote: > On 2/13/2023 4:34 PM, Michael Meeks wrote: > > > > Noel might be interested in this. Noel, Attila suggests that every > zip file we write we have to stream the full > > un-compressed data to /tmp files before compressing it. And these can b

Re: package / tmp file usage ...

2023-02-14 Thread Noel Grandin
On 2/13/2023 4:34 PM, Michael Meeks wrote: Noel might be interested in this. Noel, Attila suggests that every zip file we write we have to stream the full un-compressed data to /tmp files before compressing it. And these can be huge =) Sure, I can take a look. I think we already optimi

package / tmp file usage ...

2023-02-13 Thread Michael Meeks
Hi Attila & Noel, Just moving this to the public dev list: On 13/02/2023 07:43, Attila Szűcs wrote:     I plan to make test for zip64 ...     I plan to check if i could avoid temporal files creations during export/import.. to mke a unit test that have 4gb sized files, but not write