Re: [hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Sanne Grinovero
Sounds like very reasonable. Maybe it's worth running tests for longer time? When some work on Infinispan performance we noticed that the "warmup" time of the JVM was significantly larger than expected; in my initial tests I was discarding the first 5 minutes of metrics, but I actually needed to d

Re: [hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Alan F
Hi, What I was hoping to avoid was MongoDB shifting data in a collection to make room for new elements in a document (ie. RowKey), as it appears to be quite an expensive operation. I was noticing a connection between many of the big spikes in my results and the following log entries in mongodb

Re: [hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Emmanuel Bernard
But you still need the collect and the event to release it. On 25 avr. 2012, at 10:59, Sanne Grinovero wrote: > Isn't Hibernate ORM already providing such a service via the > Session/Persistence context/"L1" container ? > > We might be able to take advantage of existing events to control the > b

Re: [hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Sanne Grinovero
Isn't Hibernate ORM already providing such a service via the Session/Persistence context/"L1" container ? We might be able to take advantage of existing events to control the batching on MongoDB. On 25 April 2012 08:35, Emmanuel Bernard wrote: > I don't think we need an actual multi threaded cac

Re: [hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Emmanuel Bernard
I don't think we need an actual multi threaded cache. the flush operation in Hibernate is not multi threaded, neither is the session. A simple Map (or a better append only structure) will suffice, I think. On 25 avr. 2012, at 09:32, Guillaume SCHEIBEL wrote: > Hi all, > > What do you think abou

Re: [hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Guillaume SCHEIBEL
Hi all, What do you think about using the Ehcache module to store the data between 2 flushes ? I will open a JIRA about this point if it has not already been done. Guillaume 2012/4/25 Emmanuel Bernard > Hi Alan and all, > > I have been researching the spikes issue you encounter in the stress t

[hibernate-dev] [OGM] MongoDB time spikes

2012-04-25 Thread Emmanuel Bernard
Hi Alan and all, I have been researching the spikes issue you encounter in the stress test from a theoretical point of view. You were trying a different associations storage approach (splitting associations as one row per document rather than the whole association per document). Does that retur