The question is more around how to go about modelling the data for mongodb, so that I don't hit any of Mongodb's limits.
On Thursday, January 2, 2014, Ali Lown wrote: > I have seen the deltas files regularly hit >10MB. > The largest root conversation wavelet I have is 13300kB. (I think this > is only several hundred blips) > > My next question is why you are trying to store the serialized deltas > for a whole wavelet in a single field in mongo? > > On 2 January 2014 16:45, Ben Hegarty <heg...@gmail.com <javascript:;>> > wrote: > > Does anyone know if the deltas or index files are likely to ever hit > 16MB, > > as that is the maximum document size inside mongodb and if we are then > the > > persistence will need to be pushed into the mongodb GridFS? > > > > > > On Thu, Jan 2, 2014 at 9:58 AM, Frank R. > > <renfeng...@gmail.com<javascript:;>> > wrote: > > > >> This feature is on my wish list for Wave. It's a good news. Thank you~ > >> > >> > >> On Thu, Jan 2, 2014 at 5:24 PM, Ben Hegarty > >> <heg...@gmail.com<javascript:;>> > wrote: > >> > >> > Hi Pablo, > >> > Ironically I started work on this feature over the weekend as it is > next > >> on > >> > my list of must haves for my own personal project which also uses > >> MongoDB. > >> > I've had to upgrade the MongoDB driver and add in the morphia plugin > for > >> > modelling the delta store which hopefully I'll be able to continue > >> working > >> > on over the weekend. My time is limited and so if you think you'll be > >> able > >> > to finish before me let me know and I'll try and help with any > knowledge > >> > I've gained around mongoDB. It looks like getting the delta store > >> finished > >> > is going to be fiddly work from what I've seen so far, I started by > >> > modelling the store on the memory version, but the first problem I've > >> found > >> > is that the '.' in mongoDB is a reserved character so I'm going to > have > >> to > >> > start modelling the store using a mongoDB specific implementation. > >> > > >> > If it helps I've uploaded my current work > >> > here< > >> > > >> > https://drive.google.com/file/d/0B5FF_Ld8SzsNQ2JONHdGU2xJUG8/edit?usp=sharing > >> > >which > >> > just keep in mind is very much just the beginning. > >> > > >> > HTH > >> > Ben > >> > > >> > > >> > On Thu, Jan 2, 2014 at 8:41 AM, Pablo Ojanguren > >> > <pablo...@gmail.com<javascript:;> > > > >> > wrote: > >> > > >> > > Hi all, > >> > > > >> > > I am a developer working for an EU research project. There, we are > >> going > >> > to > >> > > use Wave (via Kune project) so we would like to help fixing bugs and > >> > > improving the software along wiht the community. Currently I have > some > >> > > available time for this for the next 10 months. > >> > > > >> > > After check out the issues, first thing I've paid attention is the > >> > Delta's > >> > > storage. I have reviewed server / persistence code and I think I can > >> > start > >> > > working in a mongoDB implementation. > >> > > > >> > > But maybe there is somebody else working on this. I would like to > join > >> > them > >> > > and to avoid duplicated efforts. Or if there is another outstanding > >> > topics > >> > > to suggest it would be great to know too. > >> > > > >> > > Thank you and Happy New Year. > >> > > > >> > > Pablo > >> > > > >> > > >> > > >> > > >> > -- > >> > Mobile Phone: +447767 322 122 > >> > Home Phone: +4420 7737 6530 > >> > > >> > > > > > > > > -- > > Regards > > Ben > -- Regards Ben
