Re: [Dhis2-devs] Fwd: Space problem

[Orvalho Joaquim Augusto]

Hello.

MySQL is suffering. There is no space where he can put data or to move 
innodb temporary stuff. Those things normally on Linux (as I guess by 
/tmp) are on the same directory you have the data. And that directory is 
not /tmp.


MySQL could use /tmp for the socket.

I think those strange files are being generated by some other thing, not 
by mysql. And it is really strange.


1. Chech the space of the MySQL tables (usually /var/lib/mysql).

2. Check who is the owner of those ses files.

Good luck
Caveman



By again

Knut Staring wrote:

Forwarding to the list.

-- Forwarded message --
From: *Knut Staring* mailto:knu...@gmail.com>>

Hi guys,

Have any of you come across this error when starting DHIS2?

WARN  [org.hibernate.util.JDBCExceptionReporter] SQL Error: 1030, 
SQLState: HY000
ERROR [org.hibernate.util.JDBCExceptionReporter] Got error 28 from 
storage engine


Mysql: Error code 28: No space left on device

Our server admin asked the following: 


/tmp was full on the server, should work better now.

Is your application using a lot /tmp to create sess_ files?


http://amazing-development.com/archives/2006/08/16/javasqlsqlexception-got-error-28-from-storage-engine/

http://www.vbulletin.com/forum/showthread.php?t=138463
--
Cheers,
Knut Staring



--
Cheers,
Knut Staring




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Problems using Mysql

[Orvalho Joaquim Augusto]

Well, this means that somewhere there is a query referincing a table 
with name 'sequences' and it does not exist on the database.


Start by checking that.

Caveman


Knut Staring wrote:

I am getting the below error.

* ERROR 14:11:12,988 could not get database metadata (SchemaUpdate.java 
[main])
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown table 
'sequences' in information_schema



--
Cheers,
Knut Staring




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] [Dhis-dev] Out of memorry

[Orvalho Joaquim Augusto]

We need more info.

Logs form postgres and tomcat.
Configuration files for tomcat.
Physical resources of you machine (RAM and CPU)
Operating System and FileSystem

From my experience this is issued much probably by JVM/Tomcat.

I am not sure... but it seems that someone have discussed this here before.

Caveman


Thuy Nguyen wrote:

Dear all,

We HISP Vietnam team meet a problem and need solution to solve. 
Currently DHIS2 of HISP Vietnam using report module to generate reports 
which created by BIRT report designer. On the March 19th, 2009 there was 
a training class for users to practice entering data and generating 
reports. The class includes 40 users work at same time in the program.
Entering data values was fine. But when there are many users generate 
reports at the same time. The system suddenly become very slow and every 
user get the OutOfMemorry java exception when click in any button of the 
program. That time Tri has to restart the tomcat of server, the 
sistuation become better for 2 minutes, and the problem appear again 
when few users generate reports. This even affect to another users who 
doesn't generate report but entering data in the class that time.
Tri has checked in database, there were many many transactions opened 
but weren't closed.
After meeting to find the reason, we don't know about other reason 
except reports were designed by BIRT. May be we were wrong. We are 
looking forward your suggestions and consult to find out the right 
reason and solutions to solve. May be change another tool instead of 
BIRT, or correct the program or someway else. Dr. Trung requested us 
have to find the right solution before April.

Please help us...



--
--
Thuy
HISP Vietnam
+84902079126
xuan_thuy...@yahoo.com 
thuy.hispviet...@gmail.com 




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] [Dhis-dev] Setting up DHIS 2 on Ubuntu 8.10

[Orvalho Joaquim Augusto]

I have DHIS 2 running on Ubuntu 8.10 and Fedora 10.

Lars recommends to download tomcat from the official tomcat site.

OK. But beaware that for a really heavy production environment you must 
compile the jsvc as it is documented on $CATALINA_HOME/bin/jsvc.tar.gz 
file. If you dont you will loose on performance.


For people that prefer to use 8.10 tomcat version... It works too. It 
sounds little strange to be broken.


One more note: Pay attenyion to apparmor in case you decide to change 
the database folder of mysql. You must stop it or learn to configure it.


Caveman



Lars Helge Øverland wrote:


I have been setting up the DHIS 2 application and development 
environment on Ubuntu 8.10 in order to test things properly in a linux 
environment as well. Just wanted to share the experience which has been 
really convenient and nice: Almost everything you need can be found in 
the Synaptic Package manager, just go there, search for and install:


- maven2
- bzr
- eclipse
- postgresql
- mysql-server

Firefox is already installed. The only hickup was Tomcat, which version 
in the package repo is just broken. Just install the one from the 
official site instead:


- Download manually from http://tomcat.apache.org/download-60.cgi and 
put anywhere, eg /usr/local/tomcat6.
- Put the attached tomcat file in /etc/init.d/, chmod 755 it, then start 
with /etc/init.d/tomcat start




Lars





___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] [Dhis-dev] Setting up DHIS 2 on Ubuntu 8.10

[Orvalho Joaquim Augusto]

Ok!

Sorry I will help the how to.

Caveman


Knut Staring wrote:

I think it is great to see this discussion BUT I have two comments:

1) Most importantly, we need to caputure all the great knowledge and 
experimentation in the network on the WIKI, in addition to lively 
discussion here. So please transfer your HOWTO's to pages like this one:

http://208.76.222.114/confluence/display/DOC/Online+server+installation

(and correct the info that's already there)

2) I think it is quite fine to discuss these things on the NEW list: 
dhis2-devs@lists.launchpad.net <mailto:dhis2-devs@lists.launchpad.net>. 
But I don't think it's a good idea for using the old dhis-...@hisp.info 
<mailto:dhis-...@hisp.info>. Also, we have set up 
dhis-implement...@googlegroups.com 
<mailto:dhis-implement...@googlegroups.com> which could be used for this 
kind of discussion.


Knut


2009/3/20 Bob Jolliffe <mailto:bobjolli...@gmail.com>>


Except I'm using a mix of emacs and netbeans :-)

2009/3/20 Bob Jolliffe mailto:bobjolli...@gmail.com>>:
 > 2009/3/20 Orvalho Joaquim Augusto mailto:orvaq...@gmail.com>>:
 >> I have DHIS 2 running on Ubuntu 8.10 and Fedora 10.
 >>
 >> Lars recommends to download tomcat from the official tomcat site.
 >>
 >> OK. But beaware that for a really heavy production environment
you must
 >> compile the jsvc as it is documented on
$CATALINA_HOME/bin/jsvc.tar.gz file.
 >> If you dont you will loose on performance.
 >>
 >> For people that prefer to use 8.10 tomcat version... It works
too. It sounds
 >> little strange to be broken.
 >>
 >> One more note: Pay attenyion to apparmor in case you decide to
change the
 >> database folder of mysql. You must stop it or learn to configure it.
 >
 > Yes we hit an SELinux snag putting mysql data on its own partition on
 > CentOS server in HISP India office  ... "stop it" was easier than
 > "learn to configure it".  One day they will have a proper
sysadmin who
 > will do it nicely.
 >
 >> Caveman
 >>
 >>
 >>
 >> Lars Helge Řverland wrote:
 >>>
 >>> I have been setting up the DHIS 2 application and development
environment
 >>> on Ubuntu 8.10 in order to test things properly in a linux
environment as
 >>> well. Just wanted to share the experience which has been really
convenient
 >>> and nice: Almost everything you need can be found in the
Synaptic Package
 >>> manager, just go there, search for and install:
 >>>
 >>> - maven2
 >>> - bzr
 >>> - eclipse
 >>> - postgresql
 >>> - mysql-server
 >>>
 >>> Firefox is already installed. The only hickup was Tomcat, which
version in
 >>> the package repo is just broken. Just install the one from the
official site
 >>> instead:
 >>> - Download manually from
http://tomcat.apache.org/download-60.cgi and put
 >>> anywhere, eg /usr/local/tomcat6.
 >>> - Put the attached tomcat file in /etc/init.d/, chmod 755 it,
then start
 >>> with /etc/init.d/tomcat start
 >
 > This is my environment as well.  Mind you I probably wouldn't go for
 > 8.10 in a production environment anyway.  Better to stick with the
 > 8.04 LTS or the upcoming 9.04.  But for development it is great.
 >
 > Bob
 >
 >>>
 >>>
 >>> Lars
 >>>
 >>>
 >>
 >>
 >>
 >

___
Mailing list: https://launchpad.net/~dhis2-devs
<https://launchpad.net/%7Edhis2-devs>
Post to : dhis2-devs@lists.launchpad.net
<mailto:dhis2-devs@lists.launchpad.net>
Unsubscribe : https://launchpad.net/~dhis2-devs
<https://launchpad.net/%7Edhis2-devs>
More help   : https://help.launchpad.net/ListHelp




--
Cheers,
Knut Staring




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] [Dhis-dev] Out of memorry

[Orvalho Joaquim Augusto]

Ok!

Indeed, there is no enough memory for JVM:


You did not provide the "Operating System" and "How much RAM you have". 
I am gessing that you are using Linux Ubuntu. If so check this very 
important file:

/etc/default/tomcat6

You must play with the line:
JAVA_OPTS="-Djava.awt.headless=true -Xmx300M"

If not ubuntu, you must find somewhere.

If you have 2GB of RAM take 25% to 30% to JVM. And try to see what happens.

Is this machine dedicated to dhis2?

It may help if you use the last possible JDK. The JDK making guys claim 
that the from the update 10 of 1.6 there is less memory consuming that 
the previous versions [I do not know really].


Caveman


Trí Trần Thanh wrote:

Hi all

This is log and config of our server tomcat.
Our server


Tran Thanh Tri
HISP Viet Nam
+84903670967


2009/3/20 Orvalho Joaquim Augusto <mailto:orvaq...@gmail.com>>


We need more info.

Logs form postgres and tomcat.
Configuration files for tomcat.
Physical resources of you machine (RAM and CPU)
Operating System and FileSystem

 >From my experience this is issued much probably by JVM/Tomcat.

I am not sure... but it seems that someone have discussed this here
before.

Caveman


Thuy Nguyen wrote:

Dear all,

We HISP Vietnam team meet a problem and need solution to solve.
Currently DHIS2 of HISP Vietnam using report module to generate
reports which created by BIRT report designer. On the March
19th, 2009 there was a training class for users to practice
entering data and generating reports. The class includes 40
users work at same time in the program.
Entering data values was fine. But when there are many users
generate reports at the same time. The system suddenly become
very slow and every user get the OutOfMemorry java exception
when click in any button of the program. That time Tri has to
restart the tomcat of server, the sistuation become better for 2
minutes, and the problem appear again when few users generate
reports. This even affect to another users who doesn't generate
report but entering data in the class that time.
Tri has checked in database, there were many many transactions
opened but weren't closed.
After meeting to find the reason, we don't know about other
reason except reports were designed by BIRT. May be we were
wrong. We are looking forward your suggestions and consult to
find out the right reason and solutions to solve. May be change
another tool instead of BIRT, or correct the program or someway
else. Dr. Trung requested us have to find the right solution
before April.
Please help us...



-- 
--

Thuy
HISP Vietnam
+84902079126
xuan_thuy...@yahoo.com <mailto:xuan_thuy...@yahoo.com>
<mailto:xuan_thuy...@yahoo.com <mailto:xuan_thuy...@yahoo.com>>
thuy.hispviet...@gmail.com <mailto:thuy.hispviet...@gmail.com>
<mailto:thuy.hispviet...@gmail.com
<mailto:thuy.hispviet...@gmail.com>>








___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Fwd: [Dhis-dev] Out of memorry

[Orvalho Joaquim Augusto]

Well the diagnosis is the same actually.

You need to tune tomcat.

I have little experience with tomcat under windows [I prefer Linux] but 
anyway:
1. Stop Tomcat; Check with taskmgr if there is an tomcat instance 
running and stop it.


2. Under start->programs find configure tomcat. You will see a window 
where you can place the max memory pool; Start 512MB.


3. Remember Java needs memory and BIRT uses much RAM. So consider to use 
a 64bit SO and place more RAM on the machine (4GB) and give JVM 1GB.


Do this even if 2 solves your problems.

Good Luck
Caveman


Trí Trần Thanh wrote:


Our server:
  - CPU : xeon 2.13 Ghz
  - RAM : 2GB
  - JDK 6
  - Tomcat 6.0
  - WIndow server 2003


Tran Thanh Tri
HISP Viet Nam
+84903670967


2009/3/23 Trí Trần Thanh <mailto:tranthanhtr...@gmail.com>>


Hi all

This is log and config of our server tomcat.
Our server


Tran Thanh Tri
HISP Viet Nam
+84903670967


    2009/3/20 Orvalho Joaquim Augusto mailto:orvaq...@gmail.com>>

We need more info.

Logs form postgres and tomcat.
Configuration files for tomcat.
Physical resources of you machine (RAM and CPU)
Operating System and FileSystem

 >From my experience this is issued much probably by JVM/Tomcat.

I am not sure... but it seems that someone have discussed this
here before.

Caveman


Thuy Nguyen wrote:

Dear all,

We HISP Vietnam team meet a problem and need solution to
solve. Currently DHIS2 of HISP Vietnam using report module
to generate reports which created by BIRT report designer.
On the March 19th, 2009 there was a training class for users
to practice entering data and generating reports. The class
includes 40 users work at same time in the program.
Entering data values was fine. But when there are many users
generate reports at the same time. The system suddenly
become very slow and every user get the OutOfMemorry java
exception when click in any button of the program. That time
Tri has to restart the tomcat of server, the sistuation
become better for 2 minutes, and the problem appear again
when few users generate reports. This even affect to another
users who doesn't generate report but entering data in the
class that time.
Tri has checked in database, there were many many
transactions opened but weren't closed.
After meeting to find the reason, we don't know about other
reason except reports were designed by BIRT. May be we were
wrong. We are looking forward your suggestions and consult
to find out the right reason and solutions to solve. May be
change another tool instead of BIRT, or correct the program
or someway else. Dr. Trung requested us have to find the
right solution before April.
Please help us...



-- 
--

Thuy
HISP Vietnam
+84902079126
xuan_thuy...@yahoo.com <mailto:xuan_thuy...@yahoo.com>
<mailto:xuan_thuy...@yahoo.com <mailto:xuan_thuy...@yahoo.com>>
thuy.hispviet...@gmail.com
<mailto:thuy.hispviet...@gmail.com>
<mailto:thuy.hispviet...@gmail.com
<mailto:thuy.hispviet...@gmail.com>>










___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] [Dhis-dev] Out of memorry

[Orvalho Joaquim Augusto]

Thanks for the password advice and I am so sorry if I did not notice 
that before.


Back to PermGen space error I suggest to try these things too:
http://www.freshblurbs.com/explaining-java-lang-outofmemoryerror-permgen-space
http://www.mkyong.com/tomcat/tomcat-javalangoutofmemoryerror-permgen-space/

Good luck
Caveman


Knut Staring wrote:
Thanks very much for pointing that out, Saptarshi. Tri, please change 
your password immediately (and don't post it on this list). Secondly, 
please all stop sending to dhis-...@hisp.info <mailto:dhis-...@hisp.info>.


Knut

2009/3/23 Saptarshi Purkayastha mailto:sun...@gmail.com>>

Attaching your conf folder is murderous!! It contains passwords,
privileges to tomcat... may be it isn't an online server and the
tomcat manager app password isn't the end-of-the-world!! But this is
a good lesson for everyone that we can't give passwords away on
mailing lists, IRC or other places where we lots of eyeballs!

This list is being archived (:-o) ==>
https://lists.launchpad.net/dhis2-devs/

---

Regards,
Saptarshi PURKAYASTHA
Director R & D, HISP India
Health Information Systems Programme

My Tech Blog:  http://sunnytalkstech.blogspot.com
You Live by CHOICE, Not by CHANCE


2009/3/23 Trí Trần Thanh mailto:tranthanhtr...@gmail.com>>

Hi all


This is log and config of our server tomcat.
Our server


Tran Thanh Tri
HISP Viet Nam
    +84903670967


2009/3/20 Orvalho Joaquim Augusto mailto:orvaq...@gmail.com>>

We need more info.


Logs form postgres and tomcat.
Configuration files for tomcat.
Physical resources of you machine (RAM and CPU)
Operating System and FileSystem

 >From my experience this is issued much probably by JVM/Tomcat.

I am not sure... but it seems that someone have discussed
this here before.

Caveman


Thuy Nguyen wrote:

Dear all,

We HISP Vietnam team meet a problem and need solution to
solve. Currently DHIS2 of HISP Vietnam using report
module to generate reports which created by BIRT report
designer. On the March 19th, 2009 there was a training
class for users to practice entering data and generating
reports. The class includes 40 users work at same time
in the program.
Entering data values was fine. But when there are many
users generate reports at the same time. The system
suddenly become very slow and every user get the
OutOfMemorry java exception when click in any button of
the program. That time Tri has to restart the tomcat of
server, the sistuation become better for 2 minutes, and
the problem appear again when few users generate
reports. This even affect to another users who doesn't
generate report but entering data in the class that time.
Tri has checked in database, there were many many
transactions opened but weren't closed.
After meeting to find the reason, we don't know about
other reason except reports were designed by BIRT. May
be we were wrong. We are looking forward your
suggestions and consult to find out the right reason and
solutions to solve. May be change another tool instead
of BIRT, or correct the program or someway else. Dr.
Trung requested us have to find the right solution
before April.
Please help us...



-- 
--

Thuy
HISP Vietnam
+84902079126
xuan_thuy...@yahoo.com <mailto:xuan_thuy...@yahoo.com>
<mailto:xuan_thuy...@yahoo.com
<mailto:xuan_thuy...@yahoo.com>>
thuy.hispviet...@gmail.com
<mailto:thuy.hispviet...@gmail.com>
<mailto:thuy.hispviet...@gmail.com
<mailto:thuy.hispviet...@gmail.com>>






___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
<mailto:dhis2-devs@lists.launchpad.net>
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
<mailto:dhis2-devs@lists.launchpad.net>
Unsubscribe 

[Dhis2-devs] DHIS2 under FreeBSD

[Orvalho Joaquim Augusto]

Just for curiosity:

Has ever someone tryed to install DHIS2 on FreeBSD?


Caveman



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] JDBC problem

[Orvalho Joaquim Augusto]

I has this sometimes.

Once was when I updade the war. And I solved by poiting the new war to 
an empty database.


Then I reinserted the data on the tables manually. I dislike this way 
but it solved.


Caveman


Saptarshi Purkayastha wrote:
Yes MyISAM lacks transactions... But y would u still use MyISAM tables?? 
InnoDB as everything now that most people need.

---
Regards,
Saptarshi PURKAYASTHA
Director R & D, HISP India
Health Information Systems Programme

My Tech Blog:  http://sunnytalkstech.blogspot.com
You Live by CHOICE, Not by CHANCE


2009/4/30 Knut Staring mailto:knu...@gmail.com>>

Hm...the error came back quickly - I suspect it is related to MyIsam
tables instead of Innodb, as Myisam doesn't support transactions, right?


On Thu, Apr 30, 2009 at 1:04 PM, Knut Staring mailto:knu...@gmail.com>> wrote:

Trying installation on a remote server, and got this error when
I pretty much tried anything...but could have been a glitch with
the server, as it seems to work again now. So hopefully false alarm.

Knut

On Thu, Apr 30, 2009 at 12:57 PM, Knut Staring mailto:knu...@gmail.com>> wrote:


$i18n.getString( "an_exception_occured" )

$encoder.htmlEncode( $i18n.getString(
"exception_explanation_text" ))


  [+] $i18n.getString( "exception" )
  (org.hibernate.TransactionException): JDBC commit
  failed


  [+] $i18n.getString( "caused_by" )
  
(com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException):
  Connection.close() has already been called.
  Invalid operation in this state.




-- 
Cheers,

Knut Staring




-- 
Cheers,

Knut Staring

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net

Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp





___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

[Dhis2-devs] weeks calculation

[Orvalho Joaquim Augusto]

I could not find on dhis2 docs so I am asking:

How dhis2 calculate the weeks? The first week of a year for example.

Thank you
Caveman



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] weeks calculation

[Orvalho Joaquim Augusto]

Thanks!

That is really usefull.

Caveman


Murodullo Latifov wrote:

Hi Caveman,



- Original Message 
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Monday, May 11, 2009 2:57:42 AM
Subject: [Dhis2-devs] weeks calculation

I could not find on dhis2 docs so I am asking:

How dhis2 calculate the weeks? The first week of a year for example.

Weekly periods are calculated based on their start date. If start date of the 
given week is on the previous year, end date of that period is used. Also 
Saturday is used as first day of the week.

Thank you
Caveman



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp



  





___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] weeks calculation

[Orvalho Joaquim Augusto]

Well this comment is interesting.

And the question raises from my needs here. I am moving data from a not 
dhis2 system to dhis2. And we must do it weekly because dhis2 is not yet 
adopted.


I noticed that I had weeks changed on dhis2.

And now to adjust to dhis2 I need to know how dhis2 does. And Bob raises 
this. What I do? I use the algorithm from that java Class?


Caveman

Bob Jolliffe wrote:

Hi

2009/5/11 Murodullo Latifov :

Hi Caveman,



- Original Message 
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Monday, May 11, 2009 2:57:42 AM
Subject: [Dhis2-devs] weeks calculation

I could not find on dhis2 docs so I am asking:

How dhis2 calculate the weeks? The first week of a year for example.

Weekly periods are calculated based on their start date. If start date of the 
given week is on the previous year, end date of that period is used. Also
Saturday is used as first day of the week.


The code is here:
./dhis-api/src/main/java/org/hisp/dhis/period/WeeklyPeriodType.java

I find it a bit confusing.  It seems that we try to define a week as
Saturday to Friday, and then say that as long as the endDate is in a
different year to the startDate then we are in week 1.  So week 1 is
the first week in the year with a Friday in it?  This doesn't sound
right.  Also according to documentation on top of class, a weekly
period must have a startDate on a Monday and endDate on a Sunday.

But week numbers according to ISO8601 are equivalent to the number of
Thursdays - ie. first week in the year with a Thursday is week 1.
This is the way that, for example the javascript in the calendar.js
would calculate it.  And presumably any sql week function we might
use.  Also weeks would start on Monday (which agrees with our class
documentation).

So for the week of 29/12/2008 to 04/01/2009, by our calculation that
would be week 1 of 2009.  And it would be week 1 by ISO 8601.

But for the week of 28/12/2009 to 3/01/2010 which is coming up, our
calculation would have this as week 1 of 2010, whereas ISO8601 would
have it as week 52 or 53 of 2010.  Week 1 would be the week of
04/01/2010.

As I say - its a bit confusing.

Though perhaps in the end the actual week number doesn't matter.  What
might matter most is the convention we consistently adopt and
document.  Though it would be nice if our conception of week 1
coincided with the ISO8601 conception.  But not so nice as to break
all the annual reports ... Do we ever exchange a week number with
another system?  Do we need to be able to define this more flexibly to
accomodate different national reporting requirements which might
interpret the first week of the year differently?  I haven't even
begun to think of this in terms of localised calendar systems :-)

Regards
Bob


Thank you
Caveman



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp





___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp






___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] weeks calculation

[Orvalho Joaquim Augusto]

Thank for this helpfull ofert.

I talk within your words.

Bob Jolliffe wrote:

Hi Orvalho

2009/5/11 Orvalho Joaquim Augusto :

Well this comment is interesting.

And the question raises from my needs here. I am moving data from a not
dhis2 system to dhis2. And we must do it weekly because dhis2 is not yet
adopted.

I noticed that I had weeks changed on dhis2.


Do you have some examples?  i.e. ones which show that week 1 is
indicated as something specific for a particular year which is
different to the DHIS2 way.  Then maybe we can start thinking about
how DHIS2 should best handle.  Is your data coming from Excel?



It is not Excel.

Some physiology of what we have:
The System being used now is called Modulo Basico (modbas for now on). 
That system is in MsAccess. It stores data for each form in one table. 
The table contains for record identification these fields (all in 
strings): year (YR), week (MTH, it is no mistake), district code (DC), 
province code (PC) and health center (HC).


The data comens on diferent columns identified by A1, A2 up to An 
(depending on the form).


As this is what Ministry of Health uses and dhis2 is being prepared to 
be used in large scale we feed dhis2 using some rudimentar steps:

1. There is a scheduled program per day to convert the tables in MDB
 in modbas to mysql (db2sync instead of mysql migration tool because 
db2syn exports well the keys)
2. Under the mysql server machine there is a python script that take 
data feeds dhis2 tables.


Step 2 uses periodid generated by dhis2 using the ranges.

For the months this is fine. But for weeks we need to know which week is 
based on the ranges given by periodid.


Is this clear enough?

And do you need really data to check?


Regards
Bob

PS. I see mysql makes use of a mode argument
http://dev.mysql.com/doc/refman/5.1/en/date-and-time-functions.html#function_week
I guess ISO8601 mode would be mode 3 under this scheme.

Thanks.

But on dhis2 it seems different isn't that?

Regards
Caveman



PPS.  Excel does not have a weeknum function built in.  There is an
analysis toolpack plugin which implements something non-standard -
somteimes described as the US norm - the first week (like other weeks)
ends on Sunday.  It can be any number of days long from 1 to 7.

PPPS.  David Wheeler has done some excellent work on the OpenFormula
SubCommittee of the ODF OASIS TC on figuring out the differences
between all these.  It looks like ODF will eventually adopt two
functions WEEKNUM (which implements the incorrect Excel algorithm) and
ISO_WEEKNUM which implements the correct algorithm.




And now to adjust to dhis2 I need to know how dhis2 does. And Bob raises
this. What I do? I use the algorithm from that java Class?

Caveman

Bob Jolliffe wrote:

Hi

2009/5/11 Murodullo Latifov :

Hi Caveman,



- Original Message 
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Monday, May 11, 2009 2:57:42 AM
Subject: [Dhis2-devs] weeks calculation

I could not find on dhis2 docs so I am asking:

How dhis2 calculate the weeks? The first week of a year for example.

Weekly periods are calculated based on their start date. If start date of
the given week is on the previous year, end date of that period is used.
Also
Saturday is used as first day of the week.

The code is here:
./dhis-api/src/main/java/org/hisp/dhis/period/WeeklyPeriodType.java

I find it a bit confusing.  It seems that we try to define a week as
Saturday to Friday, and then say that as long as the endDate is in a
different year to the startDate then we are in week 1.  So week 1 is
the first week in the year with a Friday in it?  This doesn't sound
right.  Also according to documentation on top of class, a weekly
period must have a startDate on a Monday and endDate on a Sunday.

But week numbers according to ISO8601 are equivalent to the number of
Thursdays - ie. first week in the year with a Thursday is week 1.
This is the way that, for example the javascript in the calendar.js
would calculate it.  And presumably any sql week function we might
use.  Also weeks would start on Monday (which agrees with our class
documentation).

So for the week of 29/12/2008 to 04/01/2009, by our calculation that
would be week 1 of 2009.  And it would be week 1 by ISO 8601.

But for the week of 28/12/2009 to 3/01/2010 which is coming up, our
calculation would have this as week 1 of 2010, whereas ISO8601 would
have it as week 52 or 53 of 2010.  Week 1 would be the week of
04/01/2010.

As I say - its a bit confusing.

Though perhaps in the end the actual week number doesn't matter.  What
might matter most is the convention we consistently adopt and
document.  Though it would be nice if our conception of week 1
coincided with the ISO8601 conception.  But not so nice as to break
all the annual reports ... Do we ever exchange a week number with
another system?  Do we need to be able to define this more flexibly to
accomodate different national reporting requirements which migh

Re: [Dhis2-devs] weeks calculation

[Orvalho Joaquim Augusto]

Ahh.. :-)

Thanks
Caveman


Bob Jolliffe wrote:

2009/5/11 Orvalho Joaquim Augusto :

Thank for this helpfull ofert.

I talk within your words.

Bob Jolliffe wrote:

Hi Orvalho

2009/5/11 Orvalho Joaquim Augusto :

Well this comment is interesting.

And the question raises from my needs here. I am moving data from a not
dhis2 system to dhis2. And we must do it weekly because dhis2 is not yet
adopted.

I noticed that I had weeks changed on dhis2.

Do you have some examples?  i.e. ones which show that week 1 is
indicated as something specific for a particular year which is
different to the DHIS2 way.  Then maybe we can start thinking about
how DHIS2 should best handle.  Is your data coming from Excel?


It is not Excel.

Some physiology of what we have:
The System being used now is called Modulo Basico (modbas for now on). That
system is in MsAccess. It stores data for each form in one table. The table
contains for record identification these fields (all in strings): year (YR),
week (MTH, it is no mistake), district code (DC), province code (PC) and
health center (HC).

The data comens on diferent columns identified by A1, A2 up to An (depending
on the form).

As this is what Ministry of Health uses and dhis2 is being prepared to be
used in large scale we feed dhis2 using some rudimentar steps:
1. There is a scheduled program per day to convert the tables in MDB
 in modbas to mysql (db2sync instead of mysql migration tool because db2syn
exports well the keys)
2. Under the mysql server machine there is a python script that take data
feeds dhis2 tables.

Step 2 uses periodid generated by dhis2 using the ranges.

For the months this is fine. But for weeks we need to know which week is
based on the ranges given by periodid.

Is this clear enough?

And do you need really data to check?


No I don't need lots of data.  Just something like year 2005 (weeks
are ok), 2006 (dhis is one week ahead), 2007 (weeks are ok)  I am
just trying to figure out the problem and what weeknumber system your
system (and DHIS2) is using.  Empirically like this is the easiest.

Cheers
Bob



Regards
Bob

PS. I see mysql makes use of a mode argument

http://dev.mysql.com/doc/refman/5.1/en/date-and-time-functions.html#function_week
I guess ISO8601 mode would be mode 3 under this scheme.

Thanks.

But on dhis2 it seems different isn't that?

Regards
Caveman



PPS.  Excel does not have a weeknum function built in.  There is an
analysis toolpack plugin which implements something non-standard -
somteimes described as the US norm - the first week (like other weeks)
ends on Sunday.  It can be any number of days long from 1 to 7.

PPPS.  David Wheeler has done some excellent work on the OpenFormula
SubCommittee of the ODF OASIS TC on figuring out the differences
between all these.  It looks like ODF will eventually adopt two
functions WEEKNUM (which implements the incorrect Excel algorithm) and
ISO_WEEKNUM which implements the correct algorithm.




And now to adjust to dhis2 I need to know how dhis2 does. And Bob raises
this. What I do? I use the algorithm from that java Class?

Caveman

Bob Jolliffe wrote:

Hi

2009/5/11 Murodullo Latifov :

Hi Caveman,



- Original Message ----
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Monday, May 11, 2009 2:57:42 AM
Subject: [Dhis2-devs] weeks calculation

I could not find on dhis2 docs so I am asking:

How dhis2 calculate the weeks? The first week of a year for example.

Weekly periods are calculated based on their start date. If start date
of
the given week is on the previous year, end date of that period is
used.
Also
Saturday is used as first day of the week.

The code is here:
./dhis-api/src/main/java/org/hisp/dhis/period/WeeklyPeriodType.java

I find it a bit confusing.  It seems that we try to define a week as
Saturday to Friday, and then say that as long as the endDate is in a
different year to the startDate then we are in week 1.  So week 1 is
the first week in the year with a Friday in it?  This doesn't sound
right.  Also according to documentation on top of class, a weekly
period must have a startDate on a Monday and endDate on a Sunday.

But week numbers according to ISO8601 are equivalent to the number of
Thursdays - ie. first week in the year with a Thursday is week 1.
This is the way that, for example the javascript in the calendar.js
would calculate it.  And presumably any sql week function we might
use.  Also weeks would start on Monday (which agrees with our class
documentation).

So for the week of 29/12/2008 to 04/01/2009, by our calculation that
would be week 1 of 2009.  And it would be week 1 by ISO 8601.

But for the week of 28/12/2009 to 3/01/2010 which is coming up, our
calculation would have this as week 1 of 2010, whereas ISO8601 would
have it as week 52 or 53 of 2010.  Week 1 would be the week of
04/01/2010.

As I say - its a bit confusing.

Though perhaps in the end the actual week number doesn't matter.  What
might matter most 

[Dhis2-devs] Errors on Dataentry

[Orvalho Joaquim Augusto]

I have data on datavalue table tha is mannually filled - I have no way 
to avoid it.


And I keep having this error on catalina log:
May 12, 2009 1:27:24 AM org.apache.velocity.runtime.log.JdkLogChute log
SEVERE: Right side ($encoder.htmlEncode( $dataValue.comment )) of '==' 
operation has null value. If a reference, it may not be in the context. 
Operation not possible. /dhis-web-dataentry/form.vm [line 132, column 120]


And I can not see my data on the form.

Can someone help?

Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Errors on Dataentry

[Orvalho Joaquim Augusto]

Thanks! :-o

Caveman


Murodullo Latifov wrote:

Hi,

The problem you are pointing is a bug, when you try to comment on dataelement, which has no value assigned, this error will be thrown. It seems you have no value assigned for that dataelement/combo for that org unit for that period. 


regards,
murod



- Original Message 
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Tuesday, May 12, 2009 1:29:44 AM
Subject: [Dhis2-devs] Errors on Dataentry

I have data on datavalue table tha is mannually filled - I have no way to avoid 
it.

And I keep having this error on catalina log:
May 12, 2009 1:27:24 AM org.apache.velocity.runtime.log.JdkLogChute log
SEVERE: Right side ($encoder.htmlEncode( $dataValue.comment )) of '==' 
operation has null value. If a reference, it may not be in the context. 
Operation not possible. /dhis-web-dataentry/form.vm [line 132, column 120]

And I can not see my data on the form.

Can someone help?

Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp



  




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Errors on Dataentry

[Orvalho Joaquim Augusto]

Yes we import from other sources. It is a non DHIS2 related source.

In that private mail I reported that we had some stuff that check, after 
importation those null space on datavalue. We used to place an ''.


That worked fine for months. But for weeks (actually the source has many 
holes on data) those error started.


We will proceed as you suggest.

You said it was a bug. Do we have a night build war with corections?

Thanks
Caveman


Murodullo Latifov wrote:

Hi,

It also might be due to null values on datavalue table. If you have followed my 
suggestions on separate mail, it will result in 60,000 more records with null 
or empty values, which could be the cause. You can easily delete them as they 
have no value in all means.

regards,
murod.

P.S. Did you import these data from other sources?



- Original Message ----
From: Orvalho Joaquim Augusto 
To: Murodullo Latifov 
Cc: dhis2-devs 
Sent: Tuesday, May 12, 2009 10:30:32 AM
Subject: Re: [Dhis2-devs] Errors on Dataentry

Thanks! :-o

Caveman


Murodullo Latifov wrote:

Hi,

The problem you are pointing is a bug, when you try to comment on dataelement, which has no value assigned, this error will be thrown. It seems you have no value assigned for that dataelement/combo for that org unit for that period. 
regards,

murod



- Original Message ----
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Tuesday, May 12, 2009 1:29:44 AM
Subject: [Dhis2-devs] Errors on Dataentry

I have data on datavalue table tha is mannually filled - I have no way to avoid 
it.

And I keep having this error on catalina log:
May 12, 2009 1:27:24 AM org.apache.velocity.runtime.log.JdkLogChute log
SEVERE: Right side ($encoder.htmlEncode( $dataValue.comment )) of '==' 
operation has null value. If a reference, it may not be in the context. 
Operation not possible. /dhis-web-dataentry/form.vm [line 132, column 120]

And I can not see my data on the form.

Can someone help?

Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp



 



  




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Errors on Dataentry

[Orvalho Joaquim Augusto]

Hi

Murodullo Latifov wrote:

Hi,



- Original Message 
From: Orvalho Joaquim Augusto 
To: Murodullo Latifov 
Cc: dhis2-devs 
Sent: Tuesday, May 12, 2009 11:08:26 AM
Subject: Re: [Dhis2-devs] Errors on Dataentry

Yes we import from other sources. It is a non DHIS2 related source.

In that private mail I reported that we had some stuff that check, after 
importation those null space on datavalue. We used to place an ''.


That worked fine for months. But for weeks (actually the source has many 
holes on data) those error started.


We will proceed as you suggest.

You said it was a bug. Do we have a night build war with corections?

Thanks
Caveman

No, that bug is not fixed yet. Why do you need " values? Why not
to delete them? Can you explain more on nature of errors or steps you
follow to lead to that errors? What means (actually the source has many holes on data)? 


Ok.

I will delete them.

I explained the steps on the mail about weekdays calculation.

The source has many holes on data = Means there a lot of missing data. 
And on that system tey place any number of spaces ou NULL.


Regards
Caveman


regards,
murod


  




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] weeks calculation

[Orvalho Joaquim Augusto]

Well


Bob Jolliffe wrote:

Hi cave persons

2009/5/11 Murodullo Latifov :


How dhis2 calculate the weeks? The first week of a year for example.

Weekly periods are calculated based on their start date. If start date of the 
given week is on the previous year, end date of that period is used. Also 
Saturday is used as first day of the week.



It seem this business of Saturdays is a red herring and is not true.
Weekly periods are defined by a start date being a Monday and an end
date being a Sunday (though this doesn't seem to be enforced anywhere
- it probably should be).  We can see this in the list of periods
which are calculated in generatePeriods in WeeklyPeriodType.java.  The
list are all all Monday-Sunday periods.

It is however a bit buggy.  What I can confirm from generating loads
of period lists from various starting dates is
1.  DHIS (using the java default) does indeed have an ISO8601
interpretation of week number.  That is the first week of any given
year is a the first week with a Thursday in it.  It is good we stick
with this.  Makes it easy to answer the question "how does DHIS2
handle week numbers?".
2.  Perhaps somebody who initially wrote this code seemed not quite to
appreciate how this works, which means, for example, that when we
generate the period list for the week of 29-12-2009 to 03-01-2010 we
end up with a list starting with week 1 of 2010, which doesn't
actually include the given week.  The same thing happens in the end of
2005.

I don't know if this is at the root of Orvalho's problem (I haven't
yet seen his data), but it is clearly important when moving weekly
data from one system to another.  Meanwhile I can fix the
generatePeriods method so that it will always generate the correct
list of periods for any given period.  Before I do so please confirm
that it will not break any existing data, reports or what have you.
The implication being that  generatePeriods called on the week of
29-12-2009 to 03-01-2010 will generate the list of weeks for 2009, not
2010.  And more obviously, the week of 26-12-2005 to 1-01-2006
generates the list of weeks for 2005, not 2006.

Yes this a problem for us. Because we expect to use correctly DHIS 
[reporting tools for now] and we need to map exactly the periods from 
the actual system to DHIS.


But meanwhile there is a another problem with a lot of empty data on 
that system. Mine foucus has been on that and I forgot for a while these 
 dateweeks troubles.


Anyway, can you corect the DHIS2 code please to calculate weekdates? If 
it is buggy.



Cheers
Bob

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Regards
Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Providing another source table for reports

[Orvalho Joaquim Augusto]

I am working with Cintia on this.

So the question is:
How can we use DHIS interfance to send the period and orgunit to BIRT? 
And the BIRT build a report for us.


Forgive me if am being non sense or missing to study the appropriate docs.

Thanks
Caveman


Cintia Marisa wrote:

Hi,

In attachment one of the reports I need to build, maybe it will help you 
guys to understand what i need.


I used the query below to get the data that i needed.


=

select a.periodid, a.sourceid, b.week, b.YR , b.startdate, b.enddate, 
c.name ,

 sum(if(dataelementid=691,a.value,0)) as A1,
 sum(if(dataelementid=692,a.value,0)) as A2,
 sum(if(dataelementid=693,a.value,0)) as A3,
 sum(if(dataelementid=694,a.value,0)) as A4,
 sum(if(dataelementid=695,a.value,0)) as A5,
 sum(if(dataelementid=696,a.value,0)) as A6,
 sum(if(dataelementid=697,a.value,0)) as A7,
 sum(if(dataelementid=698,a.value,0)) as A8,
 sum(if(dataelementid=699,a.value,0)) as A9,
 sum(if(dataelementid=700,a.value,0)) as A10,
 sum(if(dataelementid=730,a.value,0)) as A11,
 sum(if(dataelementid=727,a.value,0)) as A12,
 sum(if(dataelementid=728,a.value,0)) as A13,
 sum(if(dataelementid=729,a.value,0)) as A14,
 sum(if(dataelementid=705,a.value,0)) as A15,
 sum(if(dataelementid=706,a.value,0)) as A16,
 sum(if(dataelementid=707,a.value,0)) as A17,
 sum(if(dataelementid=708,a.value,0)) as A18,
 sum(if(dataelementid=709,a.value,0)) as A19,
 sum(if(dataelementid=710,a.value,0)) as A20,
 sum(if(dataelementid=711,a.value,0)) as A21,
 sum(if(dataelementid=712,a.value,0)) as A22,
 sum(if(dataelementid=713,a.value,0)) as A23,
 sum(if(dataelementid=714,a.value,0)) as A24,
 sum(if(dataelementid=715,a.value,0)) as A25,
 sum(if(dataelementid=716,a.value,0)) as A26,
 sum(if(dataelementid=717,a.value,0)) as A27,
 sum(if(dataelementid=718,a.value,0)) as A28,
 sum(if(dataelementid=721,a.value,0)) as A29,
 sum(if(dataelementid=722,a.value,0)) as A30,
 sum(if(dataelementid=731,a.value,0)) as A31,
 sum(if(dataelementid=725,a.value,0)) as A32,
 sum(if(dataelementid=726,a.value,0)) as A33,
 sum(if(dataelementid=732,a.value,0)) as A34
 from dhis2_exp.datavalue a
   inner join modbas2dhis.period b on a.periodid = b.periodid
--   inner join dhis2_exp.organisationunit c on a.sourceid = 
c.organisationunitid

   where periodtypeid=7
 group by a.periodid, a.sourceid

=

regards


On Wed, May 13, 2009 at 12:50 PM, Ola Hodne Titlestad > wrote:


HI Cintia,

I reply to the list so that we can share this discussion with the
rest of the community.
The report table concept has been developed in an evolutionary way
based on various requirements from different countries. We are happy
to further extend it to meet your needs in Mozambique. I am not sure
I understand your problems of periods, and not sure what you mean by
"doesn't seem to keep the keys to link the data elements, periods
and organization units".

If you like you could provide us more info on this, and if possible
a screenshot of your report, and we could try to modify report
tables functionality to meet your needs.


best regards,
Ola Hodne Titlestad
HISP
University of Oslo


On Wed, May 13, 2009 at 12:40 PM, Cintia Marisa
mailto:cintia.ba...@gmail.com>> wrote:

Hi, thanks for the help.

I've already read the articles you sent to me.

I'll try again, then I'll give you guys a feedback.

I choose not use report table, mostly because of the periods.
The problem Orvalho is having( we are  having)  with periods,
make it difficult for us to create report tables.

It, takes a long time for the table to be created, and it
doesn't seem to keep the keys to link the data elements, periods
and organization units as I need.

In the reports I'm making i need to have cross tabulated data
with org units, data elements and periods.

I know report tables are mean to make my work easier, but i
can't get them to provide the data the way I need.

Thanks for the support.




   


On Wed, May 13, 2009 at 11:21 AM, Ola Hodne Titlestad
mailto:ol...@ifi.uio.no>> wrote:

Hi,

When using standard reports (BIRT reports in DHIS 2) the
only limitation is that you need to use the DHIS 2 database
as your source, but within that database you can create BIRT
datasets based on any table or view as you like. This is
simply because DHIS replaces the database connection string
in the BIRT design file when you upload the report. This is
done to make sure that the data source is available.

Still, I'm wondering why you do not want to use report
tables? Report tables are g

Re: [Dhis2-devs] Providing another source table for reports

[Orvalho Joaquim Augusto]

Hi,

Ola Hodne Titlestad wrote:

Hi,

The main challenge with designing such a report in BIRT is that you need 
to know which data element the values belong to as the design is not a 
straight forward table where you could list the data elements row by row.


Yes you are right but that exercise has been done in order to move data 
from the actual non dhis system.


Normally I would not recommend BIRT at all for this report, but rather 
design a custom data entry form for this and then use the dataset report 
option to view the report. That would also give you the possibility of 
entering data using the same form. Simply set up a dataset with the data 
elements you need and then design the form using the built in editor in 
DHIS2.

Fine.



If you want to use BIRT the easiest way would be to select exactly the 
data elements you need and then crosstab them so that the columns names 
would correspond to data element names. It is not very intuitive for a 
new report designer to use the codes A1-34 as you do with your query and 
data element shortnames as columns would be much easier. In report 
tables you can do this by selecting data elements as one of the 
cross-tabbed dimensions and then select the data elements you need. 
Since this is a weekly bulletin/report we need to add a reporting week 
parameter as well as a new relative period called reporting week. That 
can be done. For now you could test to do the same report by using a 
static period (one given week) and orgunit with parameter in repor table 
and then use this table in BIRT.




The A1-34 are not an accident invetion. The actual System uses that. So 
we are keeping that way. The actual system is the source for data until 
the migration ends. We want use DHIS. So we will not do another entering 
application.


Yeah, we need week as entering parameter. We gonna test the ideias from 
Murodullo. We will come here to tell what happend on the lab explosion :-)


I do not know other way to say Thanks for your support so I say Thanks a lot
Caveman



best regards,
Ola Hodne Titlestad
HISP
University of Oslo


On Wed, May 13, 2009 at 4:39 PM, Cintia Marisa > wrote:


Hi,

In attachment one of the reports I need to build, maybe it will help
you guys to understand what i need.

I used the query below to get the data that i needed.


=

select a.periodid, a.sourceid, b.week, b.YR , b.startdate,
b.enddate, c.name ,
 sum(if(dataelementid=691,a.value,0)) as A1,
 sum(if(dataelementid=692,a.value,0)) as A2,
 sum(if(dataelementid=693,a.value,0)) as A3,
 sum(if(dataelementid=694,a.value,0)) as A4,
 sum(if(dataelementid=695,a.value,0)) as A5,
 sum(if(dataelementid=696,a.value,0)) as A6,
 sum(if(dataelementid=697,a.value,0)) as A7,
 sum(if(dataelementid=698,a.value,0)) as A8,
 sum(if(dataelementid=699,a.value,0)) as A9,
 sum(if(dataelementid=700,a.value,0)) as A10,
 sum(if(dataelementid=730,a.value,0)) as A11,
 sum(if(dataelementid=727,a.value,0)) as A12,
 sum(if(dataelementid=728,a.value,0)) as A13,
 sum(if(dataelementid=729,a.value,0)) as A14,
 sum(if(dataelementid=705,a.value,0)) as A15,
 sum(if(dataelementid=706,a.value,0)) as A16,
 sum(if(dataelementid=707,a.value,0)) as A17,
 sum(if(dataelementid=708,a.value,0)) as A18,
 sum(if(dataelementid=709,a.value,0)) as A19,
 sum(if(dataelementid=710,a.value,0)) as A20,
 sum(if(dataelementid=711,a.value,0)) as A21,
 sum(if(dataelementid=712,a.value,0)) as A22,
 sum(if(dataelementid=713,a.value,0)) as A23,
 sum(if(dataelementid=714,a.value,0)) as A24,
 sum(if(dataelementid=715,a.value,0)) as A25,
 sum(if(dataelementid=716,a.value,0)) as A26,
 sum(if(dataelementid=717,a.value,0)) as A27,
 sum(if(dataelementid=718,a.value,0)) as A28,
 sum(if(dataelementid=721,a.value,0)) as A29,
 sum(if(dataelementid=722,a.value,0)) as A30,
 sum(if(dataelementid=731,a.value,0)) as A31,
 sum(if(dataelementid=725,a.value,0)) as A32,
 sum(if(dataelementid=726,a.value,0)) as A33,
 sum(if(dataelementid=732,a.value,0)) as A34
 from dhis2_exp.datavalue a
   inner join modbas2dhis.period b on a.periodid = b.periodid
--   inner join dhis2_exp.organisationunit c on a.sourceid =
c.organisationunitid
   where periodtypeid=7
 group by a.periodid, a.sourceid

=

regards



On Wed, May 13, 2009 at 12:50 PM, Ola Hodne Titlestad
mailto:ol...@ifi.uio.no>> wrote:

HI Cintia,

I reply to the list so that we can share this discussion with
the rest of the community.
The report table concept has been developed in an evolutionary
way based on various requirements from different countries. We
are happy to further extend it to meet your nee

Re: [Dhis2-devs] Providing another source table for reports

[Orvalho Joaquim Augusto]

We finally got there!!!

Hope this will help other guys in future. So I will give you more 
strange information and the steps we used.


The error reported previousilly it comes on the browser. On the same 
there is one another on catalina.out:

==

May 23, 2009 3:55:38 PM org.eclipse.birt.report.model.parser.ModuleReader 
readModule
SEVERE: Line Number:49 Error Code:Error.XMLParserException.SAX_ERROR 
Exception:org.xml.sax.SAXParseException: The reference to entity "characte
rEncoding" must end with the ';' delimiter. Message:SAX detected an error with the basic XML syntax of the file. 
May 23, 2009 3:55:38 PM org.eclipse.birt.report.engine.api.impl.ReportEngineHelper openReportDesign

SEVERE: invalid design file file:/opt/tomcatexp/webapps/birt/c03_param.rptdesign
org.eclipse.birt.report.exception.ViewerException: There is no report design 
object available.
at 
org.eclipse.birt.report.context.ViewerAttributeBean.__init(ViewerAttributeBean.java:230)
at 
org.eclipse.birt.report.context.BaseAttributeBean.init(BaseAttributeBean.java:233)
at 
org.eclipse.birt.report.context.ViewerAttributeBean.(ViewerAttributeBean.java:113)
at 
org.eclipse.birt.report.context.BirtContext.__init(BirtContext.java:44)
at 
org.eclipse.birt.report.context.BaseContext.(BaseContext.java:69)
at 
org.eclipse.birt.report.context.BirtContext.(BirtContext.java:30)
at 
org.eclipse.birt.report.servlet.ViewerServlet.__getContext(ViewerServlet.java:150)
at 
org.eclipse.birt.report.servlet.BirtSoapMessageDispatcherServlet.doGet(BirtSoapMessageDispatcherServlet.java:137)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at 
org.apache.axis.transport.http.AxisServletBase.service(AxisServletBase.java:327)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.eclipse.birt.report.servlet.BirtSoapMessageDispatcherServlet.service(BirtSoapMessageDispatcherServlet.java:112)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.eclipse.birt.report.filter.ViewerFilter.doFilter(ViewerFilter.java:68)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845)
at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at 
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
at java.lang.Thread.run(Thread.java:636)


==

And we realized that when you upload a report through dhis2, the 
data-sources section of the report is changed to something like this:
name="odaURL">jdbc:mysql://localhost/dhis2_exp?useUnicode=true&characterEncoding=UTF-8


When we delete the "?useUnicode=true&characterEncoding=UTF-8" those 
errors dispair.


So we are uploding the reports then we delete that portion. And 
everything becames fine.


What is wrong with us to happen this?

Another thing that happened after we delete thing were the famous:
SEVERE: DriverClassLoader failed to load class: com.mysql.jdbc.Driver
java.lang.ClassNotFoundException: com.mysql.jdbc.Driver

We followed the instructions on 
http://www.eclipse.org/birt/phoenix/deploy/viewerSetup.php

to set the mysql connector jar file for birt.

Thanks Folks

Caveman


Cintia Marisa wrote:

Sorry 'bout that.


In  attachment with data source  and data set defined.

On Mon, May 18, 2009 at 3:23 PM, Murodullo Latifov 
mailto:murodlati...@yahoo.com>> wrote:


Hi Cintia,

This report does not have any Data Sorce and Data Set defined. Can
you please send report with data set definitions please?

regards,
murod


*From:* Cintia Marisa mailto:cintia.ba...@gmail.com>>
*To:* Murodullo Latifov mailto:murodlati...@yahoo.com>>; DHIS 2 developers
mailto:dhis2-devs@lists.launchpad.net>>
*Sent:* Monday, May 18, 2009 2:50:51 

[Dhis2-devs] Asking a report on a birt server

[Orvalho Joaquim Augusto]

We plan to have a strange situation.

We will have at least 5 servers (p) for dhis2 data entry. All that data 
will be agregated to a central server (c) where will have central reports.


The question: How can I make the dhis on p server to use the birt on c 
server?


It is just an ideia so far. So comments to make it better would be good.

Thanks
Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Asking a report on a birt server

[Orvalho Joaquim Augusto]

Thanks!

This is on discussion here. And for now it sounds too bad.

For now it seems that we will have birt on p servers only.

Caveman


Jason Pickering wrote:

Not entirely sure I understand your architecture, but I assuming that
all (p) servers will be pointed to the same central database (c). If
you design your BIRT report to point to the (c) server, it will make
no difference whether the report is run from the (p) servers, so long
as the data source points to the (c) server. If you are looking at
doing disconnected data entry, as opposed to a central database, you
will need to collate all of your data into the central server through
import/export. However, the report should still function in the same
way. Just be sure that you design the BIRT report with a data source
to the actual IP address of the server, and not the localhost address.
Obviously, the report will need to be distributed to the (p) servers,
but uploaded without a datasource, as this will need to be specified
in the report itself. Otherwise, perhaps you can just host the report
on the (c) server and have all the (p) servers run it from there by
logging in and running the report remotely.

Hmm, lots of c's and p's there, but this should certainly be doable.

Regards,
Jason




On Sun, May 24, 2009 at 7:55 PM, Orvalho Joaquim Augusto
 wrote:

We plan to have a strange situation.

We will have at least 5 servers (p) for dhis2 data entry. All that data will
be agregated to a central server (c) where will have central reports.

The question: How can I make the dhis on p server to use the birt on c
server?

It is just an ideia so far. So comments to make it better would be good.

Thanks
Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp






___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Asking a report on a birt server

[Orvalho Joaquim Augusto]

I will try this! This is wonderfull.

Thanks
Caveman


Ngoc Thanh Nguyen wrote:



On Mon, May 25, 2009 at 3:04 AM, Orvalho Joaquim Augusto 
mailto:orvaq...@gmail.com>> wrote:


Thanks!

This is on discussion here. And for now it sounds too bad.

For now it seems that we will have birt on p servers only.

Caveman


I think it is possible.
- In BIRT report, you can set the report url refer to any machines (i.e 
via IP address or hostname)
- You can put report.rpt file in any machines, you access them via 
http:///sitePrefix//birt-viewer/

frameset?/option1/=/value1/;/option2/=/value2;...

Thanh/


 




Jason Pickering wrote:

Not entirely sure I understand your architecture, but I assuming
that
all (p) servers will be pointed to the same central database (c). If
you design your BIRT report to point to the (c) server, it will make
no difference whether the report is run from the (p) servers, so
long
as the data source points to the (c) server. If you are looking at
doing disconnected data entry, as opposed to a central database, you
will need to collate all of your data into the central server
through
import/export. However, the report should still function in the same
way. Just be sure that you design the BIRT report with a data source
to the actual IP address of the server, and not the localhost
address.
Obviously, the report will need to be distributed to the (p)
servers,
but uploaded without a datasource, as this will need to be specified
in the report itself. Otherwise, perhaps you can just host the
report
on the (c) server and have all the (p) servers run it from there by
logging in and running the report remotely.

Hmm, lots of c's and p's there, but this should certainly be doable.

Regards,
Jason




On Sun, May 24, 2009 at 7:55 PM, Orvalho Joaquim Augusto
mailto:orvaq...@gmail.com>> wrote:

We plan to have a strange situation.

We will have at least 5 servers (p) for dhis2 data entry.
All that data will
be agregated to a central server (c) where will have central
reports.

The question: How can I make the dhis on p server to use the
birt on c
server?

It is just an ideia so far. So comments to make it better
would be good.

Thanks
Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
<https://launchpad.net/%7Edhis2-devs>
Post to : dhis2-devs@lists.launchpad.net
<mailto:dhis2-devs@lists.launchpad.net>
Unsubscribe : https://launchpad.net/~dhis2-devs
<https://launchpad.net/%7Edhis2-devs>
More help   : https://help.launchpad.net/ListHelp




___
Mailing list: https://launchpad.net/~dhis2-devs
<https://launchpad.net/%7Edhis2-devs>
Post to : dhis2-devs@lists.launchpad.net
<mailto:dhis2-devs@lists.launchpad.net>
Unsubscribe : https://launchpad.net/~dhis2-devs
<https://launchpad.net/%7Edhis2-devs>
More help   : https://help.launchpad.net/ListHelp




--
Best regards,
Thanh

---
Center for HIS development
957, 3/2 st., Dist 11, Hochiminh city
Tel: 08-956 0150
Cell: 098 221 8623




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] DHIS2 under FreeBSD

[Orvalho Joaquim Augusto]

I have running DHIS 2 on FreeBSD 7.2!

I am using a FreeBSD as a VMware Workstation virtual machine.

It simply runs.

Caveman


Knut Staring wrote:
On Fri, Mar 27, 2009 at 6:35 AM, Orvalho Joaquim Augusto 
mailto:orvaq...@gmail.com>> wrote:


Just for curiosity:

Has ever someone tryed to install DHIS2 on FreeBSD?


Not that I've heard of, but it would be very interesting to hear how 
that goes - with writeup in the wiki!


Knut





___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] DHIS2 under FreeBSD

[Orvalho Joaquim Augusto]

Bob Jolliffe wrote:

2009/5/28 Orvalho Joaquim Augusto :

I have running DHIS 2 on FreeBSD 7.2!

I am using a FreeBSD as a VMware Workstation virtual machine.

It simply runs.

Caveman


Great!  The superior memory management of FreeBSD should make a real
difference - though I'm not sure you would feel that much in a vm.
Historically there were java issues with freebsd, but I think that is
a thing of the past.  Now NetBsd in a vm ... that should be neat, tidy
and fast as well ..


It is impressive even being an Virtual Machine (VM) on a Centrino 1.4GHz 
Machine! I gave to that VM 256MB.


Tomcat takes less than 45-90s to start [Actually I do not know why such 
big range].


I hope to see how birt affects everything. And that is one of the main 
reason I decided to test it.


Caveman





Cheers
Bob


Knut Staring wrote:

On Fri, Mar 27, 2009 at 6:35 AM, Orvalho Joaquim Augusto
mailto:orvaq...@gmail.com>> wrote:

   Just for curiosity:

   Has ever someone tryed to install DHIS2 on FreeBSD?


Not that I've heard of, but it would be very interesting to hear how that
goes - with writeup in the wiki!

Knut




___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp







___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

[Dhis2-devs] Some warnings

[Orvalho Joaquim Augusto]

This is a info and seems not be fatal but bother me.

I have this on catalina.out:

INFO: HTMLManager: list: Listing contexts for virtual host 'localhost'
* INFO  17:29:42,149 File /home/tomcatexp/de/dataElementOrder.xml does 
not exist (DefaultLocationManager.java [http-8080-4])
* INFO  17:29:46,115 File /home/tomcatexp/de/dataElementOrder.xml does 
not exist (DefaultLocationManager.java [http-8080-4])
* INFO  17:30:10,684 File /home/tomcatexp/de/dataElementOrder.xml does 
not exist (DefaultLocationManager.java [http-8080-4])
* INFO  17:30:20,569 File /home/tomcatexp/de/dataElementOrder.xml does 
not exist (DefaultLocationManager.java [http-8080-4])
* INFO  17:30:32,683 File /home/tomcatexp/de/dataElementOrder.xml does 
not exist (DefaultLocationManager.java [http-8080-4])
* INFO  17:30:45,400 File /home/tomcatexp/de/dataElementOrder.xml does 
not exist (DefaultLocationManager.java [http-8080-4])


This happens whenever I use data entry forms. What means?

How can I stop it?

I have seen it on Fedora 10, Ubuntu 8.04-8.10, Windows XP and FreeBSD 
7.2 with DHIS version 2.0.1 under tomcat 6.



Thanks
Caveman

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

[Dhis2-devs] Data and Organisationunit level

[Orvalho Joaquim Augusto]

We are recovering data from a system not related to dhis and we want to 
put such information on dhis.


The problem is some part of that information has data from level 4, some 
on level 3 and other only from level 2.


How do I place all these data on dhis2? On datavalue?

Thanks
Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

Re: [Dhis2-devs] Data and Organisationunit level

[Orvalho Joaquim Augusto]

Hi there!


Murodullo Latifov wrote:

Hi Orvalho,



- Original Message 
From: Orvalho Joaquim Augusto 
To: dhis2-devs 
Sent: Monday, June 1, 2009 5:15:36 AM
Subject: [Dhis2-devs] Data and Organisationunit level

We are recovering data from a system not related to dhis and we want to put 
such information on dhis.

The problem is some part of that information has data from level 4, some on 
level 3 and other only from level 2.

How do I place all these data on dhis2? On datavalue?

Thanks
Caveman

Do you mean orgunits in different levels? It is possible, you have to define 
mapping from old data to new and transform old data to dhis2 datavalue records. 
If you post your old data and mapping file I can help with transformation.

Yes.

I have another table resulting from organisation modifications. I added 
the codes necessary to map; And I have the necessary SQL.


Now I know that I can place any level on datavalue, isn't corect?





regards,
murod



 

Ate ja
Caveman



___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

[Dhis2-devs] Dashboard e Datamart

[Orvalho Joaquim Augusto]

Clever minds from DHIS I have a very basic questions:

1. What is the use of dashboard? [I have spent only 5 minutes on docs 
and I did not find nothing]


2. Datamart. What is it for?

If there is written material for that.. point me there I will learn from it.

Sorry for that
Caveman


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp