Re: [Dhis2-devs] Problem creating datamart

2012-09-12 Thread Bob Jolliffe
Hi Hannan On 12 September 2012 07:45, Hannan Khan wrote: > Dear Bob > > Thanks for your advice. > > I actually put 6GB for Tomcat and and 2 GB for MySQL. My Tomcat and MySQL > are in same server. My JAVA_OPTS is -Xms1024m -Xmx6144m > -XX:MaxPermSize=2048m -XX:PermSize=512m. > > We completed our t

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Hannan Khan
Dear Bob Thanks for your advice. I actually put 6GB for Tomcat and and 2 GB for MySQL. My Tomcat and MySQL are in same server. My JAVA_OPTS is -Xms1024m -Xmx6144m -XX:MaxPermSize=2048m -XX:PermSize=512m. We completed our testing and find that for our data volume running datamart for one year and

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Bob Jolliffe
A few extra thoughts on java opts: I don't think you want to waste too much memory on permgen space when what you really need as much heap as you can get. Just enough. I find 256M actually suffices. So you probably want something like JAVA_OPTS='-Xmx4096m -XX:MaxPermSize=256m' This might be a

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Lars Helge Ă˜verland
Hi, Jason is right, no need to change from mysql. It is also OK to aggregate a year at the time to reduce memory usage, hopefully you don't need to do this too often. Can you please: 1. Paste the contents of the Help -> About page from Java opts and below. 2. Paste the number of data values you

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Jason Pickering
I think Lars is probably the definitive source here, but let me offer my views. I think this has nothing to do with the database (MySQL or Postgresql) but rather how DHIS2 does the aggregation. A big chunk of data will get pulled into memory. If the data is too big and the memory is not enough, th

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Hannan Khan
Dear Knut Actually I never use PostgreSQL. So I asked few of friends and they suggests me that if the application are tuned and used in MySQL then stay with that. As you are suggesting to use PostgreSQL can you suggest how I could I shift database from MySQL to PostgreSQL? Regards Hannan On T

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Knut Staring
Perhaps this is a case where it would make sense to switch to PostgreSQL and possibly also make use of more of the internal crunching capabilities of the database? Knut On Tue, Sep 11, 2012 at 10:09 AM, Hannan Khan wrote: > I might found an alternative solution. Yesterday we run data mart for 9

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Hannan Khan
I might found an alternative solution. Yesterday we run data mart for 9 month and it was completed successfully but when we run for 5 years, the errors arrived. Today and trying with again and get back to you all with the result. But when we run datamart for 9 moth it takes 34 minutes, which is lo

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Morten Olav Hansen
That's a really big database... I think maybe Lars should answer if the memory of the server is large enough (I'm sure he can compare it with what he has been doing to tune the Kenya server). -- Morten On Tue, Sep 11, 2012 at 2:59 PM, Hannan Khan wrote: > Hi Morten > > Server have 8GB memory a

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Hannan Khan
Hi Morten Server have 8GB memory and database is 3159MB. We are using MySQL. Regards Hannan On Tue, Sep 11, 2012 at 1:53 PM, Morten Olav Hansen wrote: > Hi > > How much memory does your server have? and what is the size of your > database? > > -- > Morten > > > > On Tue, Sep 11, 2012 at 2:51 P

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Morten Olav Hansen
Hi How much memory does your server have? and what is the size of your database? -- Morten On Tue, Sep 11, 2012 at 2:51 PM, Hannan Khan wrote: > -XX:MaxPermSize=2048m and -XX:PermSize=512m > > > On Tue, Sep 11, 2012 at 11:27 AM, Jason Pickering < > jason.p.picker...@gmail.com> wrote: > >> The

Re: [Dhis2-devs] Problem creating datamart

2012-09-11 Thread Hannan Khan
-XX:MaxPermSize=2048m and -XX:PermSize=512m On Tue, Sep 11, 2012 at 11:27 AM, Jason Pickering < jason.p.picker...@gmail.com> wrote: > The PergGen space is the important option. What are you JAVA_OPTS.? > > -- > Sent from my mobile > On Sep 11, 2012 7:25 AM, "Hannan Khan" wrote: > >> Thanks Jaso

Re: [Dhis2-devs] Problem creating datamart

2012-09-10 Thread Jason Pickering
The PergGen space is the important option. What are you JAVA_OPTS.? -- Sent from my mobile On Sep 11, 2012 7:25 AM, "Hannan Khan" wrote: > Thanks Jason. > > I put the Java heap space 1GB and Maximum 6GB (Xmx6144m and Xms1024m). But > still getting 'java.lang.OutOfMemoryError: Java heap space' e

Re: [Dhis2-devs] Problem creating datamart

2012-09-10 Thread Hannan Khan
Thanks Jason. I put the Java heap space 1GB and Maximum 6GB (Xmx6144m and Xms1024m). But still getting 'java.lang.OutOfMemoryError: Java heap space' error. That why I asked that whether that is a bug or not. I am trying to other options and contact you soon. Regards Hannan On Mon, Sep 10, 2012

Re: [Dhis2-devs] Problem creating datamart

2012-09-09 Thread Jason Pickering
Hi Hannan, You configuration may have worked previously, but some things were changed in the datamart and you will need to allocate more memory to it after 2.7. The details are here of the server setup are here http://dhis2.org/doc/snapshot/en/implementer/html/ch08.html#d5e413 and the important

Re: [Dhis2-devs] Problem creating datamart

2012-09-09 Thread Hannan Khan
Dear Jason Thanks for your advice. We are running dhis2 from 2010. In earlier version we dont have any problem creating datamart. After updating to version 2.7 we imported a big chuck of data from two data souce and after that we have problem creating datamart. So far I know the configuration is

Re: [Dhis2-devs] Problem creating datamart

2012-09-09 Thread Jason Pickering
This is not a bug. You must increase the heap size. Please consult the implementation manual for details. Regards, Jason -- Sent from my mobile On Sep 9, 2012 1:12 PM, "Hannan Khan" wrote: > We are using dhis2 version 2.7. Whenever we generating datamart are it > taking long time and it never e

[Dhis2-devs] Problem creating datamart

2012-09-09 Thread Hannan Khan
We are using dhis2 version 2.7. Whenever we generating datamart are it taking long time and it never ends.The error message is (in the tomcat log file) 'dhis2-org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor processChildren SEVERE: Exception invoking periodic operation: java.lang