Re: DISTINCT on jsonb fields and Indexes

2020-06-22 Thread Sankar P
from there. Thanks a lot :) -- Sankar P http://psankar.blogspot.com

DISTINCT on jsonb fields and Indexes

2020-06-21 Thread Sankar P
sible with any other extra index creation in postgres. Any suggestions ? Thanks. -- Sankar P http://psankar.blogspot.com

Re: Importing a Large .ndjson file

2020-06-18 Thread Sankar P
> Sankar P writes: > > I spoke too soon. While this worked fine when there were no indexes > > and finished within 10 minutes, with GIN index on the jsonb column, it > > is taking hours and still not completing. > > There's the generic advice that building an

Re: Importing a Large .ndjson file

2020-06-18 Thread Sankar P
e jsonb column, it is taking hours and still not completing. -- Sankar P http://psankar.blogspot.com

Using postgresql and JSONB on very large datasets

2020-06-18 Thread Sankar P
e with a few million records already ? 3) There are various types of indexes. I am using GIN based on some short-term googling. Are there any good blog posts, links, tutorials, courses etc. that you have found useful in understanding the postgres jsonb performance tuning ? Thanks. -- Sankar P http://psankar.blogspot.com

Re: Importing a Large .ndjson file

2020-06-18 Thread Sankar P
> It looks like plain old COPY would do this just fine, along the lines > of (in psql) > > \copy myTable(content) from 'myfile.ndjson' > Indeed. Thanks. -- Sankar P http://psankar.blogspot.com

Importing a Large .ndjson file

2020-06-17 Thread Sankar P
the records to be inserted to the `content` field of my postgres table. What is the best way to do this on a postgresql database, deployed in kubernetes, with a 1 GB RAM allocated ? I can probably write a that would read this file line-by-line and INSERT into the database, in a transaction. But that