I have seen the deltas files regularly hit >10MB. The largest root conversation wavelet I have is 13300kB. (I think this is only several hundred blips)
My next question is why you are trying to store the serialized deltas for a whole wavelet in a single field in mongo? On 2 January 2014 16:45, Ben Hegarty <heg...@gmail.com> wrote: > Does anyone know if the deltas or index files are likely to ever hit 16MB, > as that is the maximum document size inside mongodb and if we are then the > persistence will need to be pushed into the mongodb GridFS? > > > On Thu, Jan 2, 2014 at 9:58 AM, Frank R. <renfeng...@gmail.com> wrote: > >> This feature is on my wish list for Wave. It's a good news. Thank you~ >> >> >> On Thu, Jan 2, 2014 at 5:24 PM, Ben Hegarty <heg...@gmail.com> wrote: >> >> > Hi Pablo, >> > Ironically I started work on this feature over the weekend as it is next >> on >> > my list of must haves for my own personal project which also uses >> MongoDB. >> > I've had to upgrade the MongoDB driver and add in the morphia plugin for >> > modelling the delta store which hopefully I'll be able to continue >> working >> > on over the weekend. My time is limited and so if you think you'll be >> able >> > to finish before me let me know and I'll try and help with any knowledge >> > I've gained around mongoDB. It looks like getting the delta store >> finished >> > is going to be fiddly work from what I've seen so far, I started by >> > modelling the store on the memory version, but the first problem I've >> found >> > is that the '.' in mongoDB is a reserved character so I'm going to have >> to >> > start modelling the store using a mongoDB specific implementation. >> > >> > If it helps I've uploaded my current work >> > here< >> > >> https://drive.google.com/file/d/0B5FF_Ld8SzsNQ2JONHdGU2xJUG8/edit?usp=sharing >> > >which >> > just keep in mind is very much just the beginning. >> > >> > HTH >> > Ben >> > >> > >> > On Thu, Jan 2, 2014 at 8:41 AM, Pablo Ojanguren <pablo...@gmail.com> >> > wrote: >> > >> > > Hi all, >> > > >> > > I am a developer working for an EU research project. There, we are >> going >> > to >> > > use Wave (via Kune project) so we would like to help fixing bugs and >> > > improving the software along wiht the community. Currently I have some >> > > available time for this for the next 10 months. >> > > >> > > After check out the issues, first thing I've paid attention is the >> > Delta's >> > > storage. I have reviewed server / persistence code and I think I can >> > start >> > > working in a mongoDB implementation. >> > > >> > > But maybe there is somebody else working on this. I would like to join >> > them >> > > and to avoid duplicated efforts. Or if there is another outstanding >> > topics >> > > to suggest it would be great to know too. >> > > >> > > Thank you and Happy New Year. >> > > >> > > Pablo >> > > >> > >> > >> > >> > -- >> > Mobile Phone: +447767 322 122 >> > Home Phone: +4420 7737 6530 >> > >> > > > > -- > Regards > Ben