Adam Heath wrote:
Adrian Crum wrote:
The java.util.concurrent package rocks! I used it a few weeks ago to
multi-thread the demo data loading code. I got it down from 3 minutes to
1.5 minutes.
What? You made the ofbiz demo data loading code multi-threaded?
Seriously? If so, that rocks!
I used a thread pool to create tables and non-fk indexes. By fine tuning
the thread count, I was able to take the single-threaded CPU usage from
12-20% up to 50-90%. I used a FIFO queue for loading data - the main
thread parses the XML files and places DOM Elements in the queue, and
another thread takes the elements from the queue and stores them in the
database.
Some day I'll clean up the code and provide a patch. It only benefits
multi-CPU computers.
-Adrian
