[GENERAL] Is BDR support distributed table on slave nodes with ACID and join support.

2015-07-17 Thread Amit Bondwal
Hello everyone,

We ae working on a application in which we are using posgresql as a
database. We are sure that in future it will extend to level that we have
to scale it horizontally. We have some tables which are going to be more
than 90% of database size.

I looked at pg_shard, as per my understanding it is for nosql data, in our
case we are going to use postgresql RDBMS features without nosql, pg_shard
have lot on limitation as per our case.

I looked at postgresql-xl, it looks good as per our requirements, but we
have to do a lot of things to make it high availaiblity and it don't have
debian packages available for debian.

Now I see BDR, it looks good, it have multimasters, we can start with one
master and later we can add more master servers to avoid failover.
Bellow are my queries:-

1. If start with postgresql 9.4 database, later can I upgrade it to DBR
with these already large table, can I distribute these tables or shard
them. Do I need to do some extra changes in database or it will be
complicate later.

2. how can I distribute some of tables on my slave nodes, if it have any
limitations please let me know.

3. if I started with 4 or 5 node cluster with one master and rest of slave
nodes, how can I take backup of this distributed database to one of my
other server or backup location.

Please suggest me what would be the best approch for this.

--
Thanks & Regards,

Amit Bondwal


[GENERAL] Backup fatal issue

2015-07-17 Thread mephysto
Hi there,
I have some problems in a postgres cluster when I try to execute a backup.
This is the log of entire operation:

LOG:  connection received: host=91.121.182.110 port=54957
LOG:  connection authorized: user=postgres database=postgres
LOG:  statement: BEGIN
LOG:  statement: SET application_name TO barman
LOG:  statement: SHOW "data_directory"
LOG:  connection received: host=91.121.182.110 port=54958
LOG:  connection authorized: user=postgres database=postgres
LOG:  statement: BEGIN
LOG:  statement: SET application_name TO barman
LOG:  statement: SELECT name, setting FROM pg_settings WHERE name IN
('config_file', 'hba_file', 'ident_file')
LOG:  connection received: host=91.121.182.110 port=54959
LOG:  connection authorized: user=postgres database=postgres
LOG:  statement: BEGIN
LOG:  statement: SET application_name TO barman
LOG:  statement: SELECT spcname, oid, pg_tablespace_location(oid) AS
spclocation FROM pg_tablespace WHERE pg_tablespace_location(oid) != ''
LOG:  connection received: host=91.121.182.110 port=54960
LOG:  connection authorized: user=postgres database=postgres
LOG:  statement: BEGIN
LOG:  statement: SET application_name TO barman
LOG:  statement: select pg_is_in_recovery()
LOG:  statement: SELECT xlog_loc, (pg_xlogfile_name_offset(xlog_loc)).*,
now() FROM pg_start_backup('Barman backup redevodb_citrix
20150717T091702',false) as xlog_loc
LOG:  connection received: host=91.121.182.110 port=54988
FATAL:  semctl(983046, 3, SETVAL, 0) failed: Invalid argument
LOG:  server process (PID 1756) exited with exit code 1
LOG:  terminating any other active server processes
WARNING:  terminating connection because of crash of another server process
DETAIL:  The postmaster has commanded this server process to roll back the
current transaction and exit, because another server process exited
abnormally and possibly corrupted shared memory.
HINT:  In a moment you should be able to reconnect to the database and
repeat your command.
LOG:  all server processes terminated; reinitializing
LOG:  could not remove shared memory segment "/PostgreSQL.1804289383": No
such file or directory
LOG:  semctl(786432, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(819201, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(851970, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(884739, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(917508, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(950277, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(983046, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  semctl(1015815, 0, IPC_RMID, ...) failed: Invalid argument
LOG:  database system was interrupted; last known up at 2015-07-17 09:18:10
CEST
LOG:  redo starts at 16/9F28
LOG:  record with zero length at 16/9F000100
LOG:  redo done at 16/9FC8
LOG:  MultiXact member wraparound protections are now enabled
LOG:  database system is ready to accept connections
LOG:  autovacuum launcher started

Can anyone help me to identify and to resolve this inconvenience?

Thanks in advance.

Meph



--
View this message in context: 
http://postgresql.nabble.com/Backup-fatal-issue-tp5858258.html
Sent from the PostgreSQL - general mailing list archive at Nabble.com.


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


Re: [GENERAL] Is BDR support distributed table on slave nodes with ACID and join support.

2015-07-17 Thread Dorian Hoxha
1,2,3: You can't shard with BDR. It's only for multimaster (at least for
now). Please read the docs.

On Fri, Jul 17, 2015 at 9:02 AM, Amit Bondwal 
wrote:

> Hello everyone,
>
> We ae working on a application in which we are using posgresql as a
> database. We are sure that in future it will extend to level that we have
> to scale it horizontally. We have some tables which are going to be more
> than 90% of database size.
>
> I looked at pg_shard, as per my understanding it is for nosql data, in our
> case we are going to use postgresql RDBMS features without nosql, pg_shard
> have lot on limitation as per our case.
>
> I looked at postgresql-xl, it looks good as per our requirements, but we
> have to do a lot of things to make it high availaiblity and it don't have
> debian packages available for debian.
>
> Now I see BDR, it looks good, it have multimasters, we can start with one
> master and later we can add more master servers to avoid failover.
> Bellow are my queries:-
>
> 1. If start with postgresql 9.4 database, later can I upgrade it to DBR
> with these already large table, can I distribute these tables or shard
> them. Do I need to do some extra changes in database or it will be
> complicate later.
>
> 2. how can I distribute some of tables on my slave nodes, if it have any
> limitations please let me know.
>
> 3. if I started with 4 or 5 node cluster with one master and rest of slave
> nodes, how can I take backup of this distributed database to one of my
> other server or backup location.
>
> Please suggest me what would be the best approch for this.
>
> --
> Thanks & Regards,
>
> Amit Bondwal
>


Re: [GENERAL] Is BDR support distributed table on slave nodes with ACID and join support.

2015-07-17 Thread Craig Ringer
On 17 July 2015 at 17:33, Dorian Hoxha  wrote:
> 1,2,3: You can't shard with BDR. It's only for multimaster (at least for
> now). Please read the docs.

You can kind-of shard using table partitioning, but the application
has to deal with shard integration because there's no cross-node
querying. So in practice it's no benefit over a bunch of standalone
databases.

-- 
 Craig Ringer   http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training & Services


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


Re: [GENERAL] Is BDR support distributed table on slave nodes with ACID and join support.

2015-07-17 Thread Craig Ringer
On 17 July 2015 at 15:02, Amit Bondwal  wrote:

> I looked at pg_shard, as per my understanding it is for nosql data, in our
> case we are going to use postgresql RDBMS features without nosql, pg_shard
> have lot on limitation as per our case.

You'll find that _most_ products have a lot of limitations when doing
things like horizontal scaling. BDR is no exception either.

> 1. If start with postgresql 9.4 database, later can I upgrade it to BDR with
> these already large table, can I distribute these tables or shard them.

You need a patched PostgreSQL 9.4 if you're going to use BDR because
it relies on a bunch of functionality that didn't make it into the 9.4
release. (Some didn't make it into 9.5 either).

That patched PostgreSQL can be used like normal PostgreSQL 9.4, but
it's not 100% on-disk compatible. You have to do a dump and reload to
convert to or from stock community PostgreSQL, you can't pg_upgrade or
otherwise convert in-place.

You can run normal PostgreSQL applications on a standalone database on
the BDR-patched PostgreSQL 9.4 by just not installing the BDR
extension in the database. You can then activate BDR later.

Be aware, though, that BDR imposes quite a few limitations on what the
app can do when it comes to DDL. If you activate BDR later, you might
find that things you were expecting to work and that worked fine
before stop working. I'd strongly suggest planning to deploy with BDR
from the start if you're going to use it at all.

> 2. how can I distribute some of tables on my slave nodes, if it have any
> limitations please let me know.

BDR doesn't support sharding. A table can be on all nodes or - using
replication sets - some subset of nodes, but it's the whole table or
none of it.

You can partition the table and shard the partitions using replication
sets, but then each node will only see a subset of the data. There's
no transparent cross-node querying.

You could try to combine foreign data wrappers and inheritance with
partitioning, but by then you're playing database jenga and things
will come toppling down very, very hard.

> 3. if I started with 4 or 5 node cluster with one master and rest of slave
> nodes, how can I take backup of this distributed database to one of my other
> server or backup location.

pg_dump

> Please suggest me what would be the best approch for this.

>From your description it sounds like BDR is not particularly suitable
for your use case at this time.

We're looking at adding sharding down the track, but it's quite a way
down the track because there's a fair bit of work on making sure the
core functionality is rock solid and easy to manage.

-- 
 Craig Ringer   http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training & Services


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


[GENERAL] Getting error "IST FATAL: the database system is in recovery mode"

2015-07-17 Thread Sachin Srivastava
Dear Team,

I am getting the below error in my database pg_log file and also I am
unable to open the database.



"IST FATAL:  the database system is in recovery mode"

I am using postgresql version 9.1 on Centos 6.6. Kindly suggest why this
problem is coming.

Regards,
Sachin


Re: [GENERAL] Is BDR support distributed table on slave nodes with ACID and join support.

2015-07-17 Thread Craig Ringer
On 17 July 2015 at 19:37, Amit Bondwal  wrote:
> Thank you very much all of you for quick response and clearing my mind.

Please reply to the mailing list, not just to me directly.

> One more question, can I run a databse of postgres 9.4 on postgres-XL
> cluster?

postgres-XL is based on PostgreSQL 9.2, so no.

Postgres-XL doesn't "run on" PostgreSQL. It's a modified (forked)
version of PostgreSQL.

> Or you can advise me any better solution.

Not without knowing a lot more about what you're trying to do, what
your requirements are, etc.

> As per my knowledge partitioning
> of a table have some limits in nos. and I can't extend more storage in a
> server upto a limit.

Yes, that's true, but those limits are quite large, and you may be
trying to solve a problem you don't and won't have.

This may well be premature optimisation. I can't know without a lot more info.

Rather than starting with the solution (horizontal partitioning,
sharding) try starting with the problem and requirements, then looking
for solutions from there.

-- 
 Craig Ringer   http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training & Services


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


Re: [GENERAL] Is BDR support distributed table on slave nodes with ACID and join support.

2015-07-17 Thread Amit Bondwal
Thanks you very much Craig for clearing these facts and sorry for mail sent
only to you by mistake.


--
Thanks & Regards,

Amit Bondwal


On Fri, Jul 17, 2015 at 6:19 PM, Craig Ringer  wrote:

> On 17 July 2015 at 19:37, Amit Bondwal  wrote:
> > Thank you very much all of you for quick response and clearing my mind.
>
> Please reply to the mailing list, not just to me directly.
>
> > One more question, can I run a databse of postgres 9.4 on postgres-XL
> > cluster?
>
> postgres-XL is based on PostgreSQL 9.2, so no.
>
> Postgres-XL doesn't "run on" PostgreSQL. It's a modified (forked)
> version of PostgreSQL.
>
> > Or you can advise me any better solution.
>
> Not without knowing a lot more about what you're trying to do, what
> your requirements are, etc.
>
> > As per my knowledge partitioning
> > of a table have some limits in nos. and I can't extend more storage in a
> > server upto a limit.
>
> Yes, that's true, but those limits are quite large, and you may be
> trying to solve a problem you don't and won't have.
>
> This may well be premature optimisation. I can't know without a lot more
> info.
>
> Rather than starting with the solution (horizontal partitioning,
> sharding) try starting with the problem and requirements, then looking
> for solutions from there.
>
> --
>  Craig Ringer   http://www.2ndQuadrant.com/
>  PostgreSQL Development, 24x7 Support, Training & Services
>


Re: [GENERAL] Backup fatal issue

2015-07-17 Thread Melvin Davidson
I think we need just a little bit more information.

What is the O/S?
What is the PostgreSQL version?
What is the backup command?
Does this always occur with the same command?
Did you need to restarrt PostgreSQL after this started?



On Fri, Jul 17, 2015 at 3:29 AM, mephysto  wrote:

> Hi there,
> I have some problems in a postgres cluster when I try to execute a backup.
> This is the log of entire operation:
>
> LOG:  connection received: host=91.121.182.110 port=54957
> LOG:  connection authorized: user=postgres database=postgres
> LOG:  statement: BEGIN
> LOG:  statement: SET application_name TO barman
> LOG:  statement: SHOW "data_directory"
> LOG:  connection received: host=91.121.182.110 port=54958
> LOG:  connection authorized: user=postgres database=postgres
> LOG:  statement: BEGIN
> LOG:  statement: SET application_name TO barman
> LOG:  statement: SELECT name, setting FROM pg_settings WHERE name IN
> ('config_file', 'hba_file', 'ident_file')
> LOG:  connection received: host=91.121.182.110 port=54959
> LOG:  connection authorized: user=postgres database=postgres
> LOG:  statement: BEGIN
> LOG:  statement: SET application_name TO barman
> LOG:  statement: SELECT spcname, oid, pg_tablespace_location(oid) AS
> spclocation FROM pg_tablespace WHERE pg_tablespace_location(oid) != ''
> LOG:  connection received: host=91.121.182.110 port=54960
> LOG:  connection authorized: user=postgres database=postgres
> LOG:  statement: BEGIN
> LOG:  statement: SET application_name TO barman
> LOG:  statement: select pg_is_in_recovery()
> LOG:  statement: SELECT xlog_loc, (pg_xlogfile_name_offset(xlog_loc)).*,
> now() FROM pg_start_backup('Barman backup redevodb_citrix
> 20150717T091702',false) as xlog_loc
> LOG:  connection received: host=91.121.182.110 port=54988
> FATAL:  semctl(983046, 3, SETVAL, 0) failed: Invalid argument
> LOG:  server process (PID 1756) exited with exit code 1
> LOG:  terminating any other active server processes
> WARNING:  terminating connection because of crash of another server process
> DETAIL:  The postmaster has commanded this server process to roll back the
> current transaction and exit, because another server process exited
> abnormally and possibly corrupted shared memory.
> HINT:  In a moment you should be able to reconnect to the database and
> repeat your command.
> LOG:  all server processes terminated; reinitializing
> LOG:  could not remove shared memory segment "/PostgreSQL.1804289383": No
> such file or directory
> LOG:  semctl(786432, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(819201, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(851970, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(884739, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(917508, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(950277, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(983046, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(1015815, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  database system was interrupted; last known up at 2015-07-17 09:18:10
> CEST
> LOG:  redo starts at 16/9F28
> LOG:  record with zero length at 16/9F000100
> LOG:  redo done at 16/9FC8
> LOG:  MultiXact member wraparound protections are now enabled
> LOG:  database system is ready to accept connections
> LOG:  autovacuum launcher started
>
> Can anyone help me to identify and to resolve this inconvenience?
>
> Thanks in advance.
>
> Meph
>
>
>
> --
> View this message in context:
> http://postgresql.nabble.com/Backup-fatal-issue-tp5858258.html
> Sent from the PostgreSQL - general mailing list archive at Nabble.com.
>
>
> --
> Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-general
>



-- 
*Melvin Davidson*
I reserve the right to fantasize.  Whether or not you
wish to share my fantasy is entirely up to you.


Re: [GENERAL] Getting error "IST FATAL: the database system is in recovery mode"

2015-07-17 Thread Michael Paquier
On Fri, Jul 17, 2015 at 9:47 PM, Sachin Srivastava
 wrote:
> I am getting the below error in my database pg_log file and also I am unable
> to open the database.
> "IST FATAL:  the database system is in recovery mode"
> I am using postgresql version 9.1 on Centos 6.6. Kindly suggest why this
> problem is coming.

You are trying to connect to a system that is performing a crash
recovery, meaning that it crashed, and you cannot connect to it, or
this is a standby node that is not set up as a read-only hot standby.
-- 
Michael


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


Re: [GENERAL] Getting error "IST FATAL: the database system is in recovery mode"

2015-07-17 Thread Adrian Klaver

On 07/17/2015 05:47 AM, Sachin Srivastava wrote:

Dear Team,

I am getting the below error in my database pg_log file and also I am
unable to open the database.



"IST FATAL:  the database system is in recovery mode"

I am using postgresql version 9.1 on Centos 6.6. Kindly suggest why this
problem is coming.


More information is needed.

Postgres version?

Do you have replication set up and if so which server are you trying to 
connect to?


If not then the information that would help would be in the log before 
the line you show above. So what do you see earlier in the log?




Regards,
Sachin



--
Adrian Klaver
adrian.kla...@aklaver.com


--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


[GENERAL] Promoting 1 of 2 slaves

2015-07-17 Thread Joseph Kregloh
Hello,

I am getting ready to take my master server out of service today and
promote the slave to take it's place. In my current setup I have one master
server which ships WAL files to two separate slave servers.

My plan is to promote one of those slaves. How do I get the slave that I
promoted to start replicating to the other slave the moment I trigger it's
promotion?

Thanks,
-Joseph Kregloh


Re: [GENERAL] Backup fatal issue

2015-07-17 Thread Mephysto
Hi Melvin,
I am using Pstgres 9.4.4 in a virtualized Debian Linux 8.0. I do not know
backup command because is launched by BARMAN 1.4.1. I have tried many times
to execute the backup. I have restarted and reinstalled Postgres and I also
rebooted OS many times.

Thanks for your help.

Meph

On 17 July 2015 at 15:12, Melvin Davidson  wrote:

> I think we need just a little bit more information.
>
> What is the O/S?
> What is the PostgreSQL version?
> What is the backup command?
> Does this always occur with the same command?
> Did you need to restarrt PostgreSQL after this started?
>
>
>
> On Fri, Jul 17, 2015 at 3:29 AM, mephysto 
> wrote:
>
>> Hi there,
>> I have some problems in a postgres cluster when I try to execute a backup.
>> This is the log of entire operation:
>>
>> LOG:  connection received: host=91.121.182.110 port=54957
>> LOG:  connection authorized: user=postgres database=postgres
>> LOG:  statement: BEGIN
>> LOG:  statement: SET application_name TO barman
>> LOG:  statement: SHOW "data_directory"
>> LOG:  connection received: host=91.121.182.110 port=54958
>> LOG:  connection authorized: user=postgres database=postgres
>> LOG:  statement: BEGIN
>> LOG:  statement: SET application_name TO barman
>> LOG:  statement: SELECT name, setting FROM pg_settings WHERE name IN
>> ('config_file', 'hba_file', 'ident_file')
>> LOG:  connection received: host=91.121.182.110 port=54959
>> LOG:  connection authorized: user=postgres database=postgres
>> LOG:  statement: BEGIN
>> LOG:  statement: SET application_name TO barman
>> LOG:  statement: SELECT spcname, oid, pg_tablespace_location(oid) AS
>> spclocation FROM pg_tablespace WHERE pg_tablespace_location(oid) != ''
>> LOG:  connection received: host=91.121.182.110 port=54960
>> LOG:  connection authorized: user=postgres database=postgres
>> LOG:  statement: BEGIN
>> LOG:  statement: SET application_name TO barman
>> LOG:  statement: select pg_is_in_recovery()
>> LOG:  statement: SELECT xlog_loc, (pg_xlogfile_name_offset(xlog_loc)).*,
>> now() FROM pg_start_backup('Barman backup redevodb_citrix
>> 20150717T091702',false) as xlog_loc
>> LOG:  connection received: host=91.121.182.110 port=54988
>> FATAL:  semctl(983046, 3, SETVAL, 0) failed: Invalid argument
>> LOG:  server process (PID 1756) exited with exit code 1
>> LOG:  terminating any other active server processes
>> WARNING:  terminating connection because of crash of another server
>> process
>> DETAIL:  The postmaster has commanded this server process to roll back the
>> current transaction and exit, because another server process exited
>> abnormally and possibly corrupted shared memory.
>> HINT:  In a moment you should be able to reconnect to the database and
>> repeat your command.
>> LOG:  all server processes terminated; reinitializing
>> LOG:  could not remove shared memory segment "/PostgreSQL.1804289383": No
>> such file or directory
>> LOG:  semctl(786432, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(819201, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(851970, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(884739, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(917508, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(950277, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(983046, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  semctl(1015815, 0, IPC_RMID, ...) failed: Invalid argument
>> LOG:  database system was interrupted; last known up at 2015-07-17
>> 09:18:10
>> CEST
>> LOG:  redo starts at 16/9F28
>> LOG:  record with zero length at 16/9F000100
>> LOG:  redo done at 16/9FC8
>> LOG:  MultiXact member wraparound protections are now enabled
>> LOG:  database system is ready to accept connections
>> LOG:  autovacuum launcher started
>>
>> Can anyone help me to identify and to resolve this inconvenience?
>>
>> Thanks in advance.
>>
>> Meph
>>
>>
>>
>> --
>> View this message in context:
>> http://postgresql.nabble.com/Backup-fatal-issue-tp5858258.html
>> Sent from the PostgreSQL - general mailing list archive at Nabble.com.
>>
>>
>> --
>> Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
>> To make changes to your subscription:
>> http://www.postgresql.org/mailpref/pgsql-general
>>
>
>
>
> --
> *Melvin Davidson*
> I reserve the right to fantasize.  Whether or not you
> wish to share my fantasy is entirely up to you.
>


Re: [GENERAL] Backup fatal issue

2015-07-17 Thread Melvin Davidson
If this is occurring with Barman, try doing a manual backup.
IE: pg_dump your_database > /tmp/somefile.sql

If that works, then the problem is with Barman or it's configuration.

On Fri, Jul 17, 2015 at 10:07 AM, Mephysto  wrote:

> Hi Melvin,
> I am using Pstgres 9.4.4 in a virtualized Debian Linux 8.0. I do not know
> backup command because is launched by BARMAN 1.4.1. I have tried many times
> to execute the backup. I have restarted and reinstalled Postgres and I also
> rebooted OS many times.
>
> Thanks for your help.
>
> Meph
>
> On 17 July 2015 at 15:12, Melvin Davidson  wrote:
>
>> I think we need just a little bit more information.
>>
>> What is the O/S?
>> What is the PostgreSQL version?
>> What is the backup command?
>> Does this always occur with the same command?
>> Did you need to restarrt PostgreSQL after this started?
>>
>>
>>
>> On Fri, Jul 17, 2015 at 3:29 AM, mephysto 
>> wrote:
>>
>>> Hi there,
>>> I have some problems in a postgres cluster when I try to execute a
>>> backup.
>>> This is the log of entire operation:
>>>
>>> LOG:  connection received: host=91.121.182.110 port=54957
>>> LOG:  connection authorized: user=postgres database=postgres
>>> LOG:  statement: BEGIN
>>> LOG:  statement: SET application_name TO barman
>>> LOG:  statement: SHOW "data_directory"
>>> LOG:  connection received: host=91.121.182.110 port=54958
>>> LOG:  connection authorized: user=postgres database=postgres
>>> LOG:  statement: BEGIN
>>> LOG:  statement: SET application_name TO barman
>>> LOG:  statement: SELECT name, setting FROM pg_settings WHERE name IN
>>> ('config_file', 'hba_file', 'ident_file')
>>> LOG:  connection received: host=91.121.182.110 port=54959
>>> LOG:  connection authorized: user=postgres database=postgres
>>> LOG:  statement: BEGIN
>>> LOG:  statement: SET application_name TO barman
>>> LOG:  statement: SELECT spcname, oid, pg_tablespace_location(oid) AS
>>> spclocation FROM pg_tablespace WHERE pg_tablespace_location(oid) != ''
>>> LOG:  connection received: host=91.121.182.110 port=54960
>>> LOG:  connection authorized: user=postgres database=postgres
>>> LOG:  statement: BEGIN
>>> LOG:  statement: SET application_name TO barman
>>> LOG:  statement: select pg_is_in_recovery()
>>> LOG:  statement: SELECT xlog_loc, (pg_xlogfile_name_offset(xlog_loc)).*,
>>> now() FROM pg_start_backup('Barman backup redevodb_citrix
>>> 20150717T091702',false) as xlog_loc
>>> LOG:  connection received: host=91.121.182.110 port=54988
>>> FATAL:  semctl(983046, 3, SETVAL, 0) failed: Invalid argument
>>> LOG:  server process (PID 1756) exited with exit code 1
>>> LOG:  terminating any other active server processes
>>> WARNING:  terminating connection because of crash of another server
>>> process
>>> DETAIL:  The postmaster has commanded this server process to roll back
>>> the
>>> current transaction and exit, because another server process exited
>>> abnormally and possibly corrupted shared memory.
>>> HINT:  In a moment you should be able to reconnect to the database and
>>> repeat your command.
>>> LOG:  all server processes terminated; reinitializing
>>> LOG:  could not remove shared memory segment "/PostgreSQL.1804289383": No
>>> such file or directory
>>> LOG:  semctl(786432, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(819201, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(851970, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(884739, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(917508, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(950277, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(983046, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  semctl(1015815, 0, IPC_RMID, ...) failed: Invalid argument
>>> LOG:  database system was interrupted; last known up at 2015-07-17
>>> 09:18:10
>>> CEST
>>> LOG:  redo starts at 16/9F28
>>> LOG:  record with zero length at 16/9F000100
>>> LOG:  redo done at 16/9FC8
>>> LOG:  MultiXact member wraparound protections are now enabled
>>> LOG:  database system is ready to accept connections
>>> LOG:  autovacuum launcher started
>>>
>>> Can anyone help me to identify and to resolve this inconvenience?
>>>
>>> Thanks in advance.
>>>
>>> Meph
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://postgresql.nabble.com/Backup-fatal-issue-tp5858258.html
>>> Sent from the PostgreSQL - general mailing list archive at Nabble.com.
>>>
>>>
>>> --
>>> Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
>>> To make changes to your subscription:
>>> http://www.postgresql.org/mailpref/pgsql-general
>>>
>>
>>
>>
>> --
>> *Melvin Davidson*
>> I reserve the right to fantasize.  Whether or not you
>> wish to share my fantasy is entirely up to you.
>>
>
>


-- 
*Melvin Davidson*
I reserve the right to fantasize.  Whether or not you
wish to share my fantasy is entirely up to you.


Re: [GENERAL] Backup fatal issue

2015-07-17 Thread Tom Lane
mephysto  writes:
> I have some problems in a postgres cluster when I try to execute a backup.
> ...
> FATAL:  semctl(983046, 3, SETVAL, 0) failed: Invalid argument
> ...
> LOG:  could not remove shared memory segment "/PostgreSQL.1804289383": No
> such file or directory
> LOG:  semctl(786432, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(819201, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(851970, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(884739, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(917508, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(950277, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(983046, 0, IPC_RMID, ...) failed: Invalid argument
> LOG:  semctl(1015815, 0, IPC_RMID, ...) failed: Invalid argument

Assuming you didn't manually destroy the shared memory segment and
semaphores, the only very likely explanation for this is that another
postmaster instance started up, used the same memory and semaphore
IDs, and then removed them when it shut down.  This should be impossible
given the interlocks around shared memory segment creation and use of
a data directory; but it's possible to break those interlocks if you
try hard enough.

I speculate that you've got a postmaster-startup script that
unconditionally removes the postmaster.pid lock file before starting the
postmaster, and that your backup procedure or some other routine action
is invoking that even when there might be a live postmaster already.

If so, the answer is simple: get rid of the script's attempt to remove the
lock file.  And have a word with whoever put it in.  *Nothing* except the
postmaster's own code should *ever* remove postmaster.pid.

regards, tom lane


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


[GENERAL] conn = PQconnectdb(conninfo);

2015-07-17 Thread Peter Kroon
Hi,

Every now and then my program will abort.
IAnd this is because: conn = PQconnectdb(conninfo);
The error given:
*** Error in `./server_prog': malloc(): smallbin double linked list
corrupted: 0x092c10a0 ***

Any thoughts on why I'm getting this message?

Regards,
Peter


Re: [GENERAL] conn = PQconnectdb(conninfo);

2015-07-17 Thread Tom Lane
Peter Kroon  writes:
> Every now and then my program will abort.
> IAnd this is because: conn = PQconnectdb(conninfo);
> The error given:
> *** Error in `./server_prog': malloc(): smallbin double linked list
> corrupted: 0x092c10a0 ***

This looks like malloc() complaining because something has corrupted its
bookkeeping data, which generally means that something previously wrote
past the end of a malloc'd data chunk, or tried to write into an
already-freed chunk.  The odds are very high that the bug is in your
program rather than libpq, though, because no such problems have been
found within libpq recently.

valgrind is a fairly useful tool for tracking down such issues.

regards, tom lane


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general