[CentOS] filesystem read only after logrotate CentOS 5
Helo, up to 04:02 the root file system was OK. With the logrotate activities there are messages: read only. Last entry in /var/log/messages is the sendmail entry from logrotate. less /etc/mtab gives: /dev/sda1 / ext3 rw 0 0 proc /proc proc rw 0 0 sysfs /sys sysfs rw 0 0 devpts /dev/pts devpts rw,gid=5,mode=620 0 0 tmpfs /dev/shm tmpfs rw 0 0 none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0 What has happend? Is this problem related with https://bugzilla.redhat.com/show_bug.cgi?id=947149 Best regards Helmut -- Viele Grüße Helmut Drodofsky Internet XS Service GmbH Heßbrühlstraße 15 70565 Stuttgart Geschäftsführung Dr.-Ing. Roswitha Hahn-Drodofsky HRB 21091 Stuttgart USt.ID: DE190582774 Tel. 0711 781941 0 Fax: 0711 781941 79 Mail: i...@internet-xs.de www.internet-xs.de ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] [solved] filesystem read only after logrotate CentOS 5
Helo, the solution was now found in dmesg. I/O error for the journal. dmesg was updated, /var/log/messages not. I think because of read only file system. Best regards Helmut Helo, up to 04:02 the root file system was OK. With the logrotate activities there are messages: read only. Last entry in /var/log/messages is the sendmail entry from logrotate. less /etc/mtab gives: /dev/sda1 / ext3 rw 0 0 proc /proc proc rw 0 0 sysfs /sys sysfs rw 0 0 devpts /dev/pts devpts rw,gid=5,mode=620 0 0 tmpfs /dev/shm tmpfs rw 0 0 none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0 What has happend? Is this problem related with https://bugzilla.redhat.com/show_bug.cgi?id=947149 Best regards Helmut -- Viele Grüße Helmut Drodofsky Internet XS Service GmbH Heßbrühlstraße 15 70565 Stuttgart Geschäftsführung Dr.-Ing. Roswitha Hahn-Drodofsky HRB 21091 Stuttgart USt.ID: DE190582774 Tel. 0711 781941 0 Fax: 0711 781941 79 Mail: i...@internet-xs.de www.internet-xs.de ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] Memory leak - how to investigate
My web & name server runs out of memory from time to time, to the point where it's completely unresponsive to anything. At that point reset is the only alternative. (Or, as this is a virtual guest, I just say "virsh destroy"). But why this happens - I would like to know. The host in question is a KVM guest, and runs CentOS 6.4. From "top" (situation now): Mem: 1361564k total, 1264324k used,97240k free, 8428k buffers Swap: 3014648k total,64852k used, 2949796k free, 358676k cached At or before the last crash I got a long error message on the console. "Oom-killer" was called repeatedly by httpd and named. I paste below the first error message, which is long. There were several long entries like this. I - Jussi [root@ns1 ~]# httpd invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0 httpd cpuset=/ mems_allowed=0 Pid: 2962, comm: httpd Not tainted 2.6.32-358.23.2.el6.x86_64 #1 Call Trace: [] ? cpuset_print_task_mems_allowed+0x91/0xb0 [] ? dump_header+0x90/0x1b0 [] ? __delayacct_freepages_end+0x2e/0x30 [] ? security_real_capable_noaudit+0x3c/0x70 [] ? oom_kill_process+0x82/0x2a0 [] ? select_bad_process+0xe1/0x120 [] ? out_of_memory+0x220/0x3c0 [] ? __alloc_pages_nodemask+0x8ac/0x8d0 [] ? alloc_pages_vma+0x9a/0x150 [] ? handle_pte_fault+0x76b/0xb50 [] ? ext4_check_acl+0x29/0x90 [ext4] [] ? current_fs_time+0x27/0x30 [] ? handle_mm_fault+0x23a/0x310 [] ? __do_page_fault+0x139/0x480 [] ? do_mmap_pgoff+0x33a/0x380 [] ? do_page_fault+0x3e/0xa0 [] ? page_fault+0x25/0x30 Mem-Info: Node 0 DMA per-cpu: CPU0: hi:0, btch: 1 usd: 0 Node 0 DMA32 per-cpu: CPU0: hi: 186, btch: 31 usd: 89 active_anon:201535 inactive_anon:68173 isolated_anon:3424 active_file:130 inactive_file:284 isolated_file:160 unevictable:0 dirty:0 writeback:245 unstable:0 free:14234 slab_reclaimable:2891 slab_unreclaimable:13218 mapped:239 shmem:14 pagetables:28858 bounce:0 Node 0 DMA free:8252kB min:340kB low:424kB high:508kB active_anon:2168kB inactive_anon:4624kB active_file:4kB inactive_file:144kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15348kB mlocked:0kB dirty:0kB writeback:28kB mapped:8kB shmem:0kB slab_reclaimable:12kB slab_unreclaimable:128kB kernel_stack:8kB pagetables:376kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1424 all_unreclaimable? no lowmem_reserve[]: 0 1956 1956 1956 Node 0 DMA32 free:48684kB min:44712kB low:55888kB high:67068kB active_anon:803972kB inactive_anon:268068kB active_file:516kB inactive_file:992kB unevictable:0kB isolated(anon):13696kB isolated(file):640kB present:2003828kB mlocked:0kB dirty:0kB writeback:888kB mapped:948kB shmem:56kB slab_reclaimable:11552kB slab_unreclaimable:52744kB kernel_stack:3344kB pagetables:115056kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:7552 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Node 0 DMA: 25*4kB 11*8kB 6*16kB 3*32kB 9*64kB 3*128kB 1*256kB 3*512kB 1*1024kB 2*2048kB 0*4096kB = 8252kB Node 0 DMA32: 977*4kB 401*8kB 320*16kB 179*32kB 58*64kB 63*128kB 32*256kB 7*512kB 3*1024kB 0*2048kB 1*4096kB = 48684kB 21463 total pagecache pages 20882 pages in swap cache Swap cache stats: add 1523887, delete 1503005, find 201987/297332 Free swap = 0kB Total swap = 3014648kB 511996 pages RAM 43605 pages reserved 66036 pages shared 446256 pages non-shared [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name [ 449] 0 449 26750 0 -17 -1000 udevd [ 1080] 0 1080 69096 0 -17 -1000 auditd [ 1105] 0 1105622711 0 0 0 rsyslogd [ 1142]25 114240455 262 0 0 0 named [ 1184] 0 1184165630 0 -17 -1000 sshd [ 1195] 0 1195130360 0 0 0 vsftpd [ 1231] 0 1231270411 0 0 0 mysqld_safe [ 1333]27 1333 187111 4825 0 0 0 mysqld [ 1430] 0 143020216 21 0 0 0 master [ 1438]89 143820236 18 0 0 0 pickup [ 1439]89 143920279 22 0 0 0 qmgr [ 1440] 0 144079250 368 0 0 0 httpd [ 1448] 0 144829313 34 0 0 0 crond [ 1459]48 145988738 727 0 0 0 httpd [ 1460]48 146089244 494 0 0 0 httpd [ 1461]48 146189729 803 0 0 0 httpd [ 1462]48 146288987 1055 0 0 0 httpd [ 1463]48 146389796 2560 0 0 0 httpd [ 1464]48 146491371 3558 0 0 0 httpd [ 1465]48 146588596 1283 0 0 0 httpd [ 1466]48 146690794 1253 0 0 0 httpd [ 1469] 0 1469 106619 198 0 0
Re: [CentOS] Memory leak - how to investigate
Jussi Hirvi wrote: > My web & name server runs out of memory from time to time, to the point > where it's completely unresponsive to anything. At that point reset is > the only alternative. (Or, as this is a virtual guest, I just say "virsh > destroy"). > > But why this happens - I would like to know. > > The host in question is a KVM guest, and runs CentOS 6.4. > That's a *lot* of apache. Is that really correct? Do you really need that many threads? How heavily is the webserver used? Also, I see mysql running - does the website use it? mark > From "top" (situation now): > Mem: 1361564k total, 1264324k used,97240k free, 8428k buffers > Swap: 3014648k total,64852k used, 2949796k free, 358676k cached > > At or before the last crash I got a long error message on the console. > "Oom-killer" was called repeatedly by httpd and named. > > I paste below the first error message, which is long. There were several > long entries like this. I > > - Jussi > > [root@ns1 ~]# httpd invoked oom-killer: gfp_mask=0x280da, order=0, > oom_adj=0, oom_score_adj=0 > httpd cpuset=/ mems_allowed=0 > Pid: 2962, comm: httpd Not tainted 2.6.32-358.23.2.el6.x86_64 #1 > Call Trace: > [] ? cpuset_print_task_mems_allowed+0x91/0xb0 > [] ? dump_header+0x90/0x1b0 > [] ? __delayacct_freepages_end+0x2e/0x30 > [] ? security_real_capable_noaudit+0x3c/0x70 > [] ? oom_kill_process+0x82/0x2a0 > [] ? select_bad_process+0xe1/0x120 > [] ? out_of_memory+0x220/0x3c0 > [] ? __alloc_pages_nodemask+0x8ac/0x8d0 > [] ? alloc_pages_vma+0x9a/0x150 > [] ? handle_pte_fault+0x76b/0xb50 > [] ? ext4_check_acl+0x29/0x90 [ext4] > [] ? current_fs_time+0x27/0x30 > [] ? handle_mm_fault+0x23a/0x310 > [] ? __do_page_fault+0x139/0x480 > [] ? do_mmap_pgoff+0x33a/0x380 > [] ? do_page_fault+0x3e/0xa0 > [] ? page_fault+0x25/0x30 > Mem-Info: > Node 0 DMA per-cpu: > CPU0: hi:0, btch: 1 usd: 0 > Node 0 DMA32 per-cpu: > CPU0: hi: 186, btch: 31 usd: 89 > active_anon:201535 inactive_anon:68173 isolated_anon:3424 > active_file:130 inactive_file:284 isolated_file:160 > unevictable:0 dirty:0 writeback:245 unstable:0 > free:14234 slab_reclaimable:2891 slab_unreclaimable:13218 > mapped:239 shmem:14 pagetables:28858 bounce:0 > Node 0 DMA free:8252kB min:340kB low:424kB high:508kB active_anon:2168kB > inactive_anon:4624kB active_file:4kB inactive_file:144kB unevictable:0kB > isolated(anon):0kB isolated(file):0kB present:15348kB mlocked:0kB > dirty:0kB writeback:28kB mapped:8kB shmem:0kB slab_reclaimable:12kB > slab_unreclaimable:128kB kernel_stack:8kB pagetables:376kB unstable:0kB > bounce:0kB writeback_tmp:0kB pages_scanned:1424 all_unreclaimable? no > lowmem_reserve[]: 0 1956 1956 1956 > Node 0 DMA32 free:48684kB min:44712kB low:55888kB high:67068kB > active_anon:803972kB inactive_anon:268068kB active_file:516kB > inactive_file:992kB unevictable:0kB isolated(anon):13696kB > isolated(file):640kB present:2003828kB mlocked:0kB dirty:0kB > writeback:888kB mapped:948kB shmem:56kB slab_reclaimable:11552kB > slab_unreclaimable:52744kB kernel_stack:3344kB pagetables:115056kB > unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:7552 > all_unreclaimable? no > lowmem_reserve[]: 0 0 0 0 > Node 0 DMA: 25*4kB 11*8kB 6*16kB 3*32kB 9*64kB 3*128kB 1*256kB 3*512kB > 1*1024kB 2*2048kB 0*4096kB = 8252kB > Node 0 DMA32: 977*4kB 401*8kB 320*16kB 179*32kB 58*64kB 63*128kB > 32*256kB 7*512kB 3*1024kB 0*2048kB 1*4096kB = 48684kB > 21463 total pagecache pages > 20882 pages in swap cache > Swap cache stats: add 1523887, delete 1503005, find 201987/297332 > Free swap = 0kB > Total swap = 3014648kB > 511996 pages RAM > 43605 pages reserved > 66036 pages shared > 446256 pages non-shared > [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name > [ 449] 0 449 26750 0 -17 -1000 udevd > [ 1080] 0 1080 69096 0 -17 -1000 auditd > [ 1105] 0 1105622711 0 0 0 rsyslogd > [ 1142]25 114240455 262 0 0 0 named > [ 1184] 0 1184165630 0 -17 -1000 sshd > [ 1195] 0 1195130360 0 0 0 vsftpd > [ 1231] 0 1231270411 0 0 0 > mysqld_safe > [ 1333]27 1333 187111 4825 0 0 0 mysqld > [ 1430] 0 143020216 21 0 0 0 master > [ 1438]89 143820236 18 0 0 0 pickup > [ 1439]89 143920279 22 0 0 0 qmgr > [ 1440] 0 144079250 368 0 0 0 httpd > [ 1448] 0 144829313 34 0 0 0 crond > [ 1459]48 145988738 727 0 0 0 httpd > [ 1460]48 146089244 494 0 0 0 httpd > [ 1461]48 146189729 803 0 0 0 httpd > [ 1462]48 1462
Re: [CentOS] Motion Detecting Camera
We control 20+ cameras with a single CentoOS server running zoneminder: http://www.zoneminder.com/ Just buy cheap cameras that have one of the interfaces zoneminder supports. We use continuos sftp upload (1fps, no sound). Motion detection is way more superior in zoneminder then any built-in solution on the camera itself, so motion detection on the cameras is disabled. To get more fps and sound you may have to use some other interface but it may require more computing power. -- Peter On Sat, Feb 1, 2014 at 6:33 AM, wrote: > > > > Original Message > Subject: [CentOS] Motion Detecting Camera > From: Leslie S Satenstein > Date: Sat, February 01, 2014 7:27 am > To: "centos@centos.org" > > mark wrote > > With the continuing annoyance from motion, my manager's asked me to go > looking again for a video surveillance appliance: basically, a > motion-detecting DVR and cameras. The big thing, of course, is a) price > (this is a US federal gov't agency, and being civilian, money is > *tight*, > don't give me the libertarian/GOP line about how freely we spend, > thankyouverymuch), b) it has to be on the network, and c) we need to be > able to d/l to a server, and rm after we do that... and we want to > script > or cron job that. > > I was in Costco (USA warehouse store) and saw a Philips LED display, > Camera, Recorder, that was motorized. The camera followed the movement > across the front of it, and could snapshot to a memory chip. It was > under $80.00 for the ensemble. The floor model worked well. > > If you do not require realtime recording to a hard disk, then this item > may be a reasonable cost solution. > > > > > Regards > > Leslie > > Mr. Leslie Satenstein > SENT FROM MY OPEN SOURCE LINUX SYSTEM. > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > > > > Checkout bluecherry.net > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
- Original Message - > From: "Jussi Hirvi" > To: "CentOS mailing list" > Sent: Monday, February 3, 2014 5:43:16 AM > Subject: [CentOS] Memory leak - how to investigate > > My web & name server runs out of memory from time to time, to the > point > where it's completely unresponsive to anything. At that point reset > is > the only alternative. (Or, as this is a virtual guest, I just say > "virsh > destroy"). > > But why this happens - I would like to know. Check your apache access logs to see what is hitting the site so much. It could be a web crawler indexing the site, a script that is out of control, or DDOS. David C. Miller > > The host in question is a KVM guest, and runs CentOS 6.4. > > From "top" (situation now): > Mem: 1361564k total, 1264324k used,97240k free, 8428k > buffers > Swap: 3014648k total,64852k used, 2949796k free, 358676k > cached > > At or before the last crash I got a long error message on the > console. > "Oom-killer" was called repeatedly by httpd and named. > > I paste below the first error message, which is long. There were > several > long entries like this. I > > - Jussi > > [root@ns1 ~]# httpd invoked oom-killer: gfp_mask=0x280da, order=0, > oom_adj=0, oom_score_adj=0 > httpd cpuset=/ mems_allowed=0 > Pid: 2962, comm: httpd Not tainted 2.6.32-358.23.2.el6.x86_64 #1 > Call Trace: > [] ? cpuset_print_task_mems_allowed+0x91/0xb0 > [] ? dump_header+0x90/0x1b0 > [] ? __delayacct_freepages_end+0x2e/0x30 > [] ? security_real_capable_noaudit+0x3c/0x70 > [] ? oom_kill_process+0x82/0x2a0 > [] ? select_bad_process+0xe1/0x120 > [] ? out_of_memory+0x220/0x3c0 > [] ? __alloc_pages_nodemask+0x8ac/0x8d0 > [] ? alloc_pages_vma+0x9a/0x150 > [] ? handle_pte_fault+0x76b/0xb50 > [] ? ext4_check_acl+0x29/0x90 [ext4] > [] ? current_fs_time+0x27/0x30 > [] ? handle_mm_fault+0x23a/0x310 > [] ? __do_page_fault+0x139/0x480 > [] ? do_mmap_pgoff+0x33a/0x380 > [] ? do_page_fault+0x3e/0xa0 > [] ? page_fault+0x25/0x30 > Mem-Info: > Node 0 DMA per-cpu: > CPU0: hi:0, btch: 1 usd: 0 > Node 0 DMA32 per-cpu: > CPU0: hi: 186, btch: 31 usd: 89 > active_anon:201535 inactive_anon:68173 isolated_anon:3424 > active_file:130 inactive_file:284 isolated_file:160 > unevictable:0 dirty:0 writeback:245 unstable:0 > free:14234 slab_reclaimable:2891 slab_unreclaimable:13218 > mapped:239 shmem:14 pagetables:28858 bounce:0 > Node 0 DMA free:8252kB min:340kB low:424kB high:508kB > active_anon:2168kB > inactive_anon:4624kB active_file:4kB inactive_file:144kB > unevictable:0kB > isolated(anon):0kB isolated(file):0kB present:15348kB mlocked:0kB > dirty:0kB writeback:28kB mapped:8kB shmem:0kB slab_reclaimable:12kB > slab_unreclaimable:128kB kernel_stack:8kB pagetables:376kB > unstable:0kB > bounce:0kB writeback_tmp:0kB pages_scanned:1424 all_unreclaimable? no > lowmem_reserve[]: 0 1956 1956 1956 > Node 0 DMA32 free:48684kB min:44712kB low:55888kB high:67068kB > active_anon:803972kB inactive_anon:268068kB active_file:516kB > inactive_file:992kB unevictable:0kB isolated(anon):13696kB > isolated(file):640kB present:2003828kB mlocked:0kB dirty:0kB > writeback:888kB mapped:948kB shmem:56kB slab_reclaimable:11552kB > slab_unreclaimable:52744kB kernel_stack:3344kB pagetables:115056kB > unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:7552 > all_unreclaimable? no > lowmem_reserve[]: 0 0 0 0 > Node 0 DMA: 25*4kB 11*8kB 6*16kB 3*32kB 9*64kB 3*128kB 1*256kB > 3*512kB > 1*1024kB 2*2048kB 0*4096kB = 8252kB > Node 0 DMA32: 977*4kB 401*8kB 320*16kB 179*32kB 58*64kB 63*128kB > 32*256kB 7*512kB 3*1024kB 0*2048kB 1*4096kB = 48684kB > 21463 total pagecache pages > 20882 pages in swap cache > Swap cache stats: add 1523887, delete 1503005, find 201987/297332 > Free swap = 0kB > Total swap = 3014648kB > 511996 pages RAM > 43605 pages reserved > 66036 pages shared > 446256 pages non-shared > [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name > [ 449] 0 449 26750 0 -17 -1000 udevd > [ 1080] 0 1080 69096 0 -17 -1000 > auditd > [ 1105] 0 1105622711 0 0 0 > rsyslogd > [ 1142]25 114240455 262 0 0 0 named > [ 1184] 0 1184165630 0 -17 -1000 sshd > [ 1195] 0 1195130360 0 0 0 > vsftpd > [ 1231] 0 1231270411 0 0 0 > mysqld_safe > [ 1333]27 1333 187111 4825 0 0 0 > mysqld > [ 1430] 0 143020216 21 0 0 0 > master > [ 1438]89 143820236 18 0 0 0 > pickup > [ 1439]89 143920279 22 0 0 0 qmgr > [ 1440] 0 144079250 368 0 0 0 httpd > [ 1448] 0 144829313 34 0 0 0 crond > [ 1459]48 145988738 727
Re: [CentOS] Memory leak - how to investigate
On Mon, Feb 3, 2014 at 8:43 AM, Jussi Hirvi wrote: > My web & name server runs out of memory from time to time, to the point > where it's completely unresponsive to anything. At that point reset is > the only alternative. (Or, as this is a virtual guest, I just say "virsh > destroy"). > > But why this happens - I would like to know. Sever things could be occurring. The first thing I notice is that you have many httpd processes running. This can be useful if you have many simultaneous hits. If you don't, you can tune the number of processes down (search on MAX_CHILD in the httpd.conf). Don't quote me on this, but you can lower the number of simultaneous processes and reduce the number of requests that each processes before exiting. Though much of the memory is shared, a lot isn't, so reducing the process count helps improve the memory situation. Cycling them more rapidly can help clean up any that have memory leaks. > The host in question is a KVM guest, and runs CentOS 6.4. > From "top" (situation now): > Mem: 1361564k total, 1264324k used,97240k free, 8428k buffers > Swap: 3014648k total,64852k used, 2949796k free, 358676k cached > > That doesn't look like a lot of memory.. Possible to add another .5G or so? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
Kwan Lowe wrote: > On Mon, Feb 3, 2014 at 8:43 AM, Jussi Hirvi > wrote: > >> My web & name server runs out of memory from time to time, to the point >> where it's completely unresponsive to anything. At that point reset is >> the only alternative. (Or, as this is a virtual guest, I just say "virsh >> destroy"). >> >> But why this happens - I would like to know. > > Sever things could be occurring. The first thing I notice is that you have > many httpd processes running. This can be useful if you have many > simultaneous hits. If you don't, you can tune the number of processes down We've got a number of websites on one of our production servers, and they get hit moderately (it's not Amazon... but they are US gov't scientific research sites), and I think we've got 25 threads running, total, to server *all* of them. >> From "top" (situation now): >> Mem: 1361564k total, 1264324k used,97240k free, 8428k buffers >> Swap: 3014648k total,64852k used, 2949796k free, 358676k cached >> > That doesn't look like a lot of memory.. Possible to add another .5G or > so? Ah! I missed that. Is it actually the case that your server doesn't even have 2G of RAM? That's a *real* problem. If you're not running it on a five year old desktop, you need to add - I'd say you shouldn't be running with under 4GB of real memory. mark "got 8G on my home ssytem, and 6G on my workstation at work" ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Motion Detecting Camera
Peter Wood wrote: >> Subject: [CentOS] Motion Detecting Camera >> From: Leslie S Satenstein >> Date: Sat, February 01, 2014 7:27 am >> To: "centos@centos.org" >> >> mark wrote >> >> With the continuing annoyance from motion, my manager's asked me to go >> looking again for a video surveillance appliance: basically, a >> motion-detecting DVR and cameras. The big thing, of course, is a) price >> (this is a US federal gov't agency, and being civilian, money is >> *tight*, >> don't give me the libertarian/GOP line about how freely we spend, >> thankyouverymuch), b) it has to be on the network, and c) we need to be >> able to d/l to a server, and rm after we do that... and we want to >> script >> or cron job that. >> >> I was in Costco (USA warehouse store) and saw a Philips LED display, >> Camera, Recorder, that was motorized. The camera followed the movement >> across the front of it, and could snapshot to a memory chip. It was >> under $80.00 for the ensemble. The floor model worked well. >> >> If you do not require realtime recording to a hard disk, then this item >> may be a reasonable cost solution. > We control 20+ cameras with a single CentoOS server running zoneminder: > http://www.zoneminder.com/ > > Just buy cheap cameras that have one of the interfaces zoneminder > supports. We use continuos sftp upload (1fps, no sound). Motion detection is way > more superior in zoneminder then any built-in solution on the camera itself, so > motion detection on the cameras is disabled. To get more fps and sound you > may have to use some other interface but it may require more computing > power. > a) Please don't top post. b) Ok, I guess that either i) I was utterly incomprehensible as to my requirements, or ii) no one has any opinions/experience with what I asked for. I'm leaning towards the latter, but I'll try again: 1) We run, and have been running for *years*, inexpensive USB cameras plugged into rackmount servers running the motion package on CentOS. Every few subreleases, some problem crops up in what I *think* is the video driver that comes with CentOS (gspca), and I spend a lot of time resolving the problems. 2) My manager says he "wants to be out of the business" of this, and wants me to look into "surveillance appliance" packages - that is, a DVR w/ say, four cameras. They're all in "computer labs", where the lights are on 24x7, so no weather or low-light worries. USB or BNC cables are fine, don't need wireless or IP cameras. 3) They *DO* have to record real-time. 4) We *do* need to be able to d/l the videos to a server for storage, and that needs to happen via a cron job, at least, if not by a process watching it.[1] 5) Budget is a real consideration (unless you, personally, are willing to buy whatever would meet the above requirements and donate several of the packages to the US gov't). 6) We need several, for several "computer labs"[2] < $500 per package is good. Don't need "Professional Grade" quality, just something that will sit there and work for years with little in the way of maintenance. We can easily put it behind a firewall, to protect it against anyone, including the regular pen testers 1. Having the firmware on the DVR send out an email that can both got to the appropriate mailing list and trigger a d/l would work. 2. They're not server room, server rooms, under current US gov't rules, are much more of a Big Deal, with a lot more rules and $$$ecurity, even if it's a rack in a closet). mark ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
> > On Mon, Feb 3, 2014 at 8:43 AM, Jussi Hirvi > > wrote: > > > >> My web & name server runs out of memory from time to time, to the point > >> where it's completely unresponsive to anything. At that point reset is > >> the only alternative. (Or, as this is a virtual guest, I just say "virsh > >> destroy"). I have 4 web servers. Every day I read the Logwatches, the 'home-made' web activity analysis reports and the instant emails created for every web access error (can't seem to trap 500 though). I allow the major crawlers like M$, Google, Yahoo, Yandex (Russian) and Facebook. I don't block crawlers in robots.txt because updating it is time-consuming. Instead I block data centre IP ranges. Every non-standard web access initiates a spontaneous emailed alert. 403 and 404 requests are automatically matched against a list of know hacking names. Identified matches causes the requesting IP to be automatically added to the monthly IP blocked list. The generated email, comprehensively full of technical details, is ready for copy and pasting into an email complaint if necessary. Some well-known hacking names result in Apache re-directs to Chinese web sites. PUTs are specifically allowed. Anyone trying OPTION, PUT in unauthorised, therefore unnecessary, sites and directories get their IP added to the monthly blocked list. Usually hackers instantly switch to other compromised IPs and they get blocked too. If you are serious about running a web server you have to know, daily, what is happening so you can react at the time. Waiting until everything grinds to a halt means you have failed. The good news is your awareness and monitoring can improve. For every web site hosted my daily activity report shows summary totals for HTML and PHP pages accessed per site. It also lists, for every site, every IP address and the total of HTML and PHP pages individual IPs have accessed. Wading through long lists is boring but you can instantly spot potential problems. Being a computer programmer means with HTML, CSS and PHP, I can know what is happening and respond to abuses with a full range of instantly deployable 'tools'. Its a learning curve and it does take time, but you'll get better :-) -- Paul. England, EU. Our systems are exclusively Linux (Centos of course). No Micro$oft Windoze here. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
On 2/3/2014 12:59, m.r...@5-cent.us wrote: > Kwan Lowe wrote: >>> Mem: 1361564k total, 1264324k used,97240k free, 8428k buffers >>> >> That doesn't look like a lot of memory.. Possible to add another .5G or >> so? > > Ah! I missed that. Is it actually the case that your server doesn't even > have 2G of RAM? That's a *real* problem. Small RAM limits with strange values like 1.3 GB are normal for VMs. Rather than give the VM more dedicated RAM, have you tried adding more swap, Jussi? Your system may be well-tuned, not I/O bound all the time swapping to disk, but that doesn't mean swap isn't useful. Modern OSes pretty much depend on having some swap space. If nothing else, it lets the OS move some little-used bits of code out of RAM, so the RAM can be used for the computer's real work. Many web stacks are RAM pigs. I don't mean "they can use a lot of RAM productively," I mean they're based on inefficient or misapplied technologies that load a bunch of pointless things into RAM. Unless these things get swapped back out, they're ballooning your VM for no useful purpose. One web stack I used in the past had *GUI libraries* linked into its core executable. This, for software designed to run on headless VPSes! Another thing to look into is how many forks or threads your web stack uses. More is better for speed, up to the point where you run out of RAM, at which point your web stack slows to a crawl or dies. If each fork takes 500 MB, and you've got it set to use 3 forks, you're already running into swap space, unless there's some serious RAM sharing going on among the forks. That's another aspect of web stacks being RAM pigs: it is *possible* to make a pre-forking web stack share a lot of RAM among the forks, but it doesn't happen by itself. If you use naive defaults and naive development practices, you can end up with each fork being essentially independent copies of the whole web stack. This not only chews up RAM to no good end, it means each fork takes longer to start, which hurts site performance. Web site tuning is hard. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
On Mon, Feb 3, 2014 at 1:59 PM, wrote: > Kwan Lowe wrote: >> On Mon, Feb 3, 2014 at 8:43 AM, Jussi Hirvi >> wrote: >> >>> My web & name server runs out of memory from time to time, to the point >>> where it's completely unresponsive to anything. At that point reset is >>> the only alternative. (Or, as this is a virtual guest, I just say "virsh >>> destroy"). >>> >>> But why this happens - I would like to know. >> >> Sever things could be occurring. The first thing I notice is that you have >> many httpd processes running. This can be useful if you have many >> simultaneous hits. If you don't, you can tune the number of processes down > > We've got a number of websites on one of our production servers, and they > get hit moderately (it's not Amazon... but they are US gov't scientific > research sites), and I think we've got 25 threads running, total, to > server *all* of them. > >>> From "top" (situation now): >>> Mem: 1361564k total, 1264324k used,97240k free, 8428k buffers >>> Swap: 3014648k total,64852k used, 2949796k free, 358676k cached >>> >> That doesn't look like a lot of memory.. Possible to add another .5G or >> so? > > Ah! I missed that. Is it actually the case that your server doesn't even > have 2G of RAM? That's a *real* problem. If you're not running it on a > five year old desktop, you need to add - I'd say you shouldn't be running > with under 4GB of real memory. > > mark "got 8G on my home ssytem, and 6G on my workstation at work" Yes, giving it a few dollars worth of RAM is the real fix. If you have to squeeze by for a while without it, try setting MaxRequestsPerChild to some reasonable (low thousands?) number in httpd.conf to clear out modules that have memory leaks or a lot of internal cache sooner. A new child process will share almost all memory with the parent, slowly growing as values change. This is especially bad for mod_perl or other embedded language modules if the language does reference counting. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
On 2/3/2014 13:39, Les Mikesell wrote: > > A new child process will share almost all > memory with the parent, slowly growing as values change. The trick is to load up as much as possible in the parent before the children start forking off. If the parent does little more than initialize the web stack itself, the children don't end up sharing anything app-specific, which can end up being a huge waste of RAM. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Motion Detecting Camera
On Mon, Feb 3, 2014 at 2:15 PM, wrote: >2) My manager says he "wants to be out of the business" of this, and > wants me to look into > "surveillance appliance" packages - that is, a DVR w/ say, four > cameras. They're all in Does this mean ZoneMinder is out of the question, since it's not an "appliance"? I mean, just for the sake of argument, what happens if you buy IP cameras and use ZoneMinder? Isn't that the beauty of an IP camera, you don't need fancy drivers or have to worry about upgrade breakage? (Unless of course your IP stack breaks, but then you probably have much bigger problems.) IP cameras allow you to (1) decouple the camera problem from the DVR problem, and (2) avoid wacky USB/analog capture driver issues. I don't know if there's anyone selling OTS ZoneMinder appliances, but it's conceivably possible. And if so, it would be like the Untangle filtering package, where the line between OTS appliance and DIY is blurred. (E.g., with Untangle, you can buy a filtering appliance from them, or you can run their software on your own server.) I guess I fail to see how the previous poster's suggestion (which is basically the same as what I initially posted last week) fails to meet your requirements: 1. Replace cheapo USB cameras with respectable IP cameras. 2. Assign IPs to all cameras. 3. Set up ACLs and/or partition your network to meet security requirements. 4. Designate a single server (physical or VM) to act as your "DVR appliance". In this case, it's a Linux server running ZoneMinder. 5. Configure ZoneMinder to do full-time/always on recording, and setup whatever maintenance and management scripts to need to shuffle around/delete/archive the video. Once this is in place, I don't see how the end result is any different than buying a "surveillance appliance". Even an OTS package will require some amount of initial setup. But *either way*, once the system is in place and working, it should "just work" and not require any further hand-holding. Treat the ZoneMinder box as an appliance - that is, if it's working, don't touch it. Don't upgrade ZM or the underlying OS. Just leave it alone and let it work. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
On Mon, Feb 3, 2014 at 2:45 PM, Warren Young wrote: > On 2/3/2014 13:39, Les Mikesell wrote: >> >> A new child process will share almost all >> memory with the parent, slowly growing as values change. > > The trick is to load up as much as possible in the parent before the > children start forking off. > > If the parent does little more than initialize the web stack itself, the > children don't end up sharing anything app-specific, which can end up > being a huge waste of RAM. Even so, modules that have reference-counted variables and objects will force blocks to copy-on-write as the references change even if the data values remain unchanged. But, just on general principles I'd blame mysql or something caching queries or result sets in the http clients as the real underlying culprit here. I've seen it go crazy on a 3 table join. -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] virtualisation
Hi, I run a small company and I would like to virtualise our setup. My internet provider offers a cloud server running CentOS. The server is managed by vmware software, they haven't been able to tell me exactly what. I wanted to know is it possible to virtualise such a setup, and Have CentOS running as the virtual OS that every client sees. Is there a solution similar to vmware view + client for CentOS servers? Regards, Ridhwaan Mayet CEO Mayet Economics T +27 11 728 2468 M +27 76 805 1157 F +27 86 552 6267 E ridhw...@mayeteconomics.com W www.mayeteconomics.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] what is difference between ifconfig and ifup?
I and testing command line to up and down ethernet connection. if I perform following, client can not re-connect. ifconfig eth0 down ifconfig eth0 up if I use following, client can re-connect: ifconfig eth0 down ifup eth0 What difference between "ifconfig up" and "ifup"? thanks. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] what is difference between ifconfig and ifup?
ifup/ifdown read your sysconfig/network-scripts/ifcfg-eth# config. ifconfig does not, so must be told how to configure the nic usually. On Mon, Feb 3, 2014 at 3:30 PM, mcclnx mcc wrote: > I and testing command line to up and down ethernet connection. > > if I perform following, client can not re-connect. > ifconfig eth0 down > ifconfig eth0 up > > if I use following, client can re-connect: > ifconfig eth0 down > ifup eth0 > > What difference between "ifconfig up" and "ifup"? > > thanks. > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos -- Billy Crook * Network and Security Administrator * RiskAnalytics, LLC ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
On Mon, Feb 3, 2014 at 3:36 PM, Warren Young wrote: > > Ah! I missed that. Is it actually the case that your server doesn't even > > have 2G of RAM? That's a *real* problem. > > Small RAM limits with strange values like 1.3 GB are normal for VMs. > > This is true. I can start up VMs with under 256M and do so quite often. Looking at the non-shared memory in the list of procs posted, however, it looks like that server at least is running pretty thin. Rather than give the VM more dedicated RAM, have you tried adding more > swap, Jussi? Your system may be well-tuned, not I/O bound all the time > swapping to disk, but that doesn't mean swap isn't useful. Interesting: 21463 total pagecache pages 20882 pages in swap cache Swap cache stats: add 1523887, delete 1503005, find 201987/297332 Free swap = 0kB Total swap = 3014648kB In this case I'm more inclined to limit the number of processes rather than increasing page space. Adding swap will delay the OOM, which is good, but performance will suffer. > Modern OSes > pretty much depend on having some swap space. If nothing else, it lets > the OS move some little-used bits of code out of RAM, so the RAM can be > used for the computer's real work. > Yes! You don't know how many times I've heard, "I have 64G of memory! Why do I need swap?" There are some benefits to running swapless though. I've dinked around with the overcommit and other memory options for some workloads. > > Another thing to look into is how many forks or threads your web stack > uses. More is better for speed, up to the point where you run out of > RAM, at which point your web stack slows to a crawl or dies. If each > fork takes 500 MB, and you've got it set to use 3 forks, you're already > running into swap space, unless there's some serious RAM sharing going > on among the forks. > > :) Just had this conversation about spinning up Websphere JVMs to "increase performance"... > > Web site tuning is hard. > > :P ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
On Mon, Feb 3, 2014 at 2:59 PM, wrote: > > We've got a number of websites on one of our production servers, and they > get hit moderately (it's not Amazon... but they are US gov't scientific > research sites), and I think we've got 25 threads running, total, to > server *all* of them. > If you don't mind me asking, what are your fork/child settings like for those and what sort of workload? > > > mark "got 8G on my home ssytem, and 6G on my workstation at work" > > Just got my 64G main board in... Should be built by the weekend. Octo-core AMD and 64G DDR3, Nvidia 780. :D ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
Kwan Lowe wrote: > On Mon, Feb 3, 2014 at 2:59 PM, wrote: > >> >> We've got a number of websites on one of our production servers, and >> they >> get hit moderately (it's not Amazon... but they are US gov't scientific >> research sites), and I think we've got 25 threads running, total, to >> server *all* of them. > > If you don't mind me asking, what are your fork/child settings like for > those and what sort of workload? For a very crude estimate, in /var/log/httpd, I did grep GET access_*log | grep -c 03/Feb, and got 178388, and that's with 23 workers (as in, ps -ef | grep -c httpd). mark ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] what is: ImageDecoder
I'm suddenly noticing multiple threads named "ImageDecoder" showing up in the output of top (when threads are turned on with "H"). I've no clue what this is, and haven't found out much about it by searching. Can someone tell me what it is, and if it's doing anything useful or just wasting cycles? thanks! -- Fred Smith -- fre...@fcshome.stoneham.ma.us - "Not everyone who says to me, 'Lord, Lord,' will enter the kingdom of heaven, but only he who does the will of my Father who is in heaven." -- Matthew 7:21 (niv) - ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] virtualisation
virtualbox? suomi On 2014-02-03 22:31, Ridhwaan Mayet wrote: > Hi, > > I run a small company and I would like to virtualise our setup. My internet > provider offers a cloud server running CentOS. The server is managed by > vmware software, they haven't been able to tell me exactly what. I wanted > to know is it possible to virtualise such a setup, and Have CentOS running > as the virtual OS that every client sees. Is there a solution similar to > vmware view + client for CentOS servers? > > Regards, > > Ridhwaan Mayet > CEO > Mayet Economics > > T +27 11 728 2468 > M +27 76 805 1157 > F +27 86 552 6267 > E ridhw...@mayeteconomics.com > W www.mayeteconomics.com > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] virtualisation
Virtual Machine Manager (virt-manager is the package name) is a nice and easy to use GUI for creating, modifying and deleting virtual servers on CentOS. It uses the KVM hypervisor by default, which "just works". I'd strongly recommend giving it a try. On 03/02/14 04:31 PM, Ridhwaan Mayet wrote: > Hi, > > I run a small company and I would like to virtualise our setup. My internet > provider offers a cloud server running CentOS. The server is managed by > vmware software, they haven't been able to tell me exactly what. I wanted > to know is it possible to virtualise such a setup, and Have CentOS running > as the virtual OS that every client sees. Is there a solution similar to > vmware view + client for CentOS servers? > > Regards, > > Ridhwaan Mayet > CEO > Mayet Economics > > T +27 11 728 2468 > M +27 76 805 1157 > F +27 86 552 6267 > E ridhw...@mayeteconomics.com > W www.mayeteconomics.com > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > -- Digimer Papers and Projects: https://alteeve.ca/w/ What if the cure for cancer is trapped in the mind of a person without access to education? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Memory leak - how to investigate
You could try tunning apache.. Start with MaxRequestPerChild, whichs sets a number of requests for child process before it is stopped. When a child is stopped, memory is freed. This could be your protection before running out of memory. KeepAlive is enabled? If yes, maybe you could try disabling it. KeepAlive speeds up your website, but uses twice as much of memory, because child processes need to keep connections opened, while waiting for new requests from established connections. Cheers, Barbara On 02/03/2014 11:12 PM, m.r...@5-cent.us wrote: > Kwan Lowe wrote: >> On Mon, Feb 3, 2014 at 2:59 PM, wrote: >> >>> We've got a number of websites on one of our production servers, and >>> they >>> get hit moderately (it's not Amazon... but they are US gov't scientific >>> research sites), and I think we've got 25 threads running, total, to >>> server *all* of them. >> If you don't mind me asking, what are your fork/child settings like for >> those and what sort of workload? > For a very crude estimate, in /var/log/httpd, I did grep GET access_*log | > grep -c 03/Feb, and got 178388, and that's with 23 workers (as in, ps -ef > | grep -c httpd). > > mark > > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] virtualisation
On 2/3/2014 1:31 PM, Ridhwaan Mayet wrote: > I run a small company and I would like to virtualise our setup. My internet > provider offers a cloud server running CentOS. The server is managed by > vmware software, they haven't been able to tell me exactly what. I wanted > to know is it possible to virtualise such a setup, and Have CentOS running > as the virtual OS that every client sees. Is there a solution similar to > vmware view + client for CentOS servers? wait, if your ISP is already virtualizing your internet server, I'm not sure what you're asking? do you want to run your own hardware server and host virtual machines for your customers/clients ? then, yes, KVM + virt-manager is a good solution. you can't run virtualization under an already virtualized environment. btw, it sounds like your ISP is using vmware esxi as the hypervisor, but thats just an educated guess based on the minimal intel given. -- john r pierce 37N 122W somewhere on the middle of the left coast ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
