Re: [GENERAL] Insertion of large xml files into PostgreSQL 10beta1

2017-06-28 Thread Alain Toussaint
Hello Jan, Hello David, I'll be able to do further testing next week as I am in the middle of a move but for next week, I'll be in vacation from work for the whole month. Best regards, Alain 2017-06-29 0:13 GMT-04:00 David G. Johnston : > On Sun, Jun 25, 2017 at 8:02 PM, Alain Toussaint > wrot

Re: [GENERAL] Insertion of large xml files into PostgreSQL 10beta1

2017-06-28 Thread David G. Johnston
On Sun, Jun 25, 2017 at 8:02 PM, Alain Toussaint wrote: > > echo "INSERT INTO samples (xmldata) VALUES $(cat > /srv/pgsql/pubmed/medline17n0001.xml)" | /usr/bin/psql medline > 1>/dev/null 2>error.log > Typically I do: --psql file \set xmlcontent `cat 'projectblogs-categories.xml'` INSERT INTO t

Re: [GENERAL] Insertion of large xml files into PostgreSQL 10beta1

2017-06-28 Thread Jan de Visser
On Sunday, June 25, 2017 11:02:41 PM EDT Alain Toussaint wrote: > > Narrowing down the entire file to a small problem region and posting a > > self-contained example, > > The url here contain the set of xml records from a publication I > worked on many years ago: > > https://www.ncbi.nlm.nih.gov/

Re: [GENERAL] Insertion of large xml files into PostgreSQL 10beta1

2017-06-25 Thread Alain Toussaint
> Narrowing down the entire file to a small problem region and posting a > self-contained example, The url here contain the set of xml records from a publication I worked on many years ago: https://www.ncbi.nlm.nih.gov/pubmed/21833294?report=xml&format=text The particularly problematic region of

Re: [GENERAL] Insertion of large xml files into PostgreSQL 10beta1

2017-06-23 Thread David G. Johnston
On Fri, Jun 23, 2017 at 8:19 AM, Alain Toussaint wrote: > Hello, > > I am building up a PostgreSQL server which I intend to load the > entirety of the pubmed database data (23GB bzip2 compressed, 216GB > unpacked) which is available in xml form of which, here is an example: > > https://www.ncbi.n