Hi All,

We are a data based company and are migrating from Oracle to Postgresql. For 
this purpose I am doing POC for the same. We have a business requirement to 
send the Data in XML files to our clients. The file size of XMLs is around 
700MB and is growing.

I have been able to generate sample XML files and store the same(Still to test 
for full files).

However I have the following problems

1) It took 35 minutes to store 1 GB data in the TEXT column
(create table test_text_nearly_1_GB as select repeat('1', 1024*1024*1023):: 
text as nearly_1_GB)

2) It took 30 Minutes to write the same to OS using COPY command
 Copy test_text_nearly_1_GB to '$HOME/test_text_nearly_1_GB.xml'

However when I tested to write a table of size 3GB with 150000 rows it wrote to 
OS in 20 minutes.

I am looking for a solution to
1)      generate and write the 1GB file in OS in less than 10 minutes.
2)      write the file to OS the results of a query
3)      Find a solution when the file size become > 1GB

Please help.


Regards,
Atul Goel
This e-mail is confidential and should not be used by anyone who is not the 
original intended recipient. Global DataPoint Limited does not accept liability 
for any statements made which are clearly the sender's own and not expressly 
made on behalf of Global DataPoint Limited. No contracts may be concluded on 
behalf of Global DataPoint Limited by means of e-mail communication. Global 
DataPoint Limited Registered in England and Wales with registered number 
3739752 Registered Office Middlesex House, 34-42 Cleveland Street, London W1T 
4LB

-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

Reply via email to