Re: [GENERAL] more than 2GB data string save

2010-02-10 Thread Massa, Harald Armin
> As I mentioned on the list a couple of months ago we are in the middle > of stuffing a bunch of molecular data (including entire genomes) into > Postgres. If anyone else is doing this I would welcome the > opportunity to discuss the issues off list... > > I do not stuff molecules or genomes or

Re: [GENERAL] more than 2GB data string save

2010-02-10 Thread Peter Hunsberger
On Wed, Feb 10, 2010 at 1:21 AM, Scott Marlowe wrote: > > On Wed, Feb 10, 2010 at 12:11 AM, Steve Atkins wrote: > > A database isn't really the right way to do full text search for single > > files that big. Even if they'd fit in the database it's way bigger than the > > underlying index types

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Allan Kamau
On Wed, Feb 10, 2010 at 10:11 AM, Steve Atkins wrote: > > On Feb 9, 2010, at 10:38 PM, AI Rumman wrote: > >> Thanks for your quick answes. >> >> But if I use a file and then store the name in the database, is it possible >> to use TEXT search tsvector and tsquery indexing on these external files?

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Steve Atkins
On Feb 9, 2010, at 11:21 PM, Scott Marlowe wrote: > On Wed, Feb 10, 2010 at 12:11 AM, Steve Atkins wrote: >> A database isn't really the right way to do full text search for single >> files that big. Even if they'd fit in the database it's way bigger than the >> underlying index types tsquery

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Scott Marlowe
On Wed, Feb 10, 2010 at 12:11 AM, Steve Atkins wrote: > A database isn't really the right way to do full text search for single files > that big. Even if they'd fit in the database it's way bigger than the > underlying index types tsquery uses are designed for. > > Are you sure that the document

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Steve Atkins
On Feb 9, 2010, at 10:38 PM, AI Rumman wrote: > Thanks for your quick answes. > > But if I use a file and then store the name in the database, is it possible > to use TEXT search tsvector and tsquery indexing on these external files? No, no way at all. A database isn't really the right way t

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Scott Marlowe
On Tue, Feb 9, 2010 at 11:51 PM, Pavel Stehule wrote: > 2010/2/10 Scott Marlowe : >> On Tue, Feb 9, 2010 at 11:26 PM, Steve Atkins wrote: >>> >>> On Feb 9, 2010, at 9:52 PM, Scott Marlowe wrote: >>> On Tue, Feb 9, 2010 at 9:38 PM, AI Rumman wrote: > How to save 2 GB or more text string

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Pavel Stehule
2010/2/10 Scott Marlowe : > On Tue, Feb 9, 2010 at 11:26 PM, Steve Atkins wrote: >> >> On Feb 9, 2010, at 9:52 PM, Scott Marlowe wrote: >> >>> On Tue, Feb 9, 2010 at 9:38 PM, AI Rumman wrote: How to save 2 GB or more text string in Postgresql? Which data type should I use? >>> >>> If yo

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread AI Rumman
Thanks for your quick answes. But if I use a file and then store the name in the database, is it possible to use TEXT search tsvector and tsquery indexing on these external files? On Wed, Feb 10, 2010 at 12:26 PM, Steve Atkins wrote: > > On Feb 9, 2010, at 9:52 PM, Scott Marlowe wrote: > > > On

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Scott Marlowe
On Tue, Feb 9, 2010 at 11:26 PM, Steve Atkins wrote: > > On Feb 9, 2010, at 9:52 PM, Scott Marlowe wrote: > >> On Tue, Feb 9, 2010 at 9:38 PM, AI Rumman wrote: >>> How to save 2 GB or more text string in Postgresql? >>> Which data type should I use? >> >> If you have to you can use either the lo

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Steve Atkins
On Feb 9, 2010, at 9:52 PM, Scott Marlowe wrote: > On Tue, Feb 9, 2010 at 9:38 PM, AI Rumman wrote: >> How to save 2 GB or more text string in Postgresql? >> Which data type should I use? > > If you have to you can use either the lo interface, or you can use > bytea. Large Object (i.e. lo) all

Re: [GENERAL] more than 2GB data string save

2010-02-09 Thread Scott Marlowe
On Tue, Feb 9, 2010 at 9:38 PM, AI Rumman wrote: > How to save 2 GB or more text string in Postgresql? > Which data type should I use? If you have to you can use either the lo interface, or you can use bytea. Large Object (i.e. lo) allows for access much like fopen / fseek etc in C, but the act

[GENERAL] more than 2GB data string save

2010-02-09 Thread AI Rumman
How to save 2 GB or more text string in Postgresql? Which data type should I use? Please any suggestion.