Re: Does anyone use nscd?
Ivan Voras wrote: > On 05/10/2011 09:38, Trond Endrest??l wrote: > > On Wed, 5 Oct 2011 12:54+1030, Daniel O'Connor wrote: > >> In my experience ncsd seems to cache negative hits forever, > >> regardless of the setting for negative-time-to-live. > > > > I'm glad to see I'm not the only one who has noticed this odd > > behaviour of nscd. Shame on me for not speaking up sooner, but > > I feared I might be proved wrong (again), and yes, that's a > > lame excuse. :-/ > > +1. > > It's very annoying when installing ports which add users - the > port adds it then in some future code checks it and it fails. > I've noticed it with at least CUPS. Sounds as if there ought to be a unified mechanism for ports to use when adding users, so that necessary notifications -- e.g. restarting nscd if it is running -- can be done in a standardized way and any necessary customizations can be done in a single place. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: Does anyone use nscd?
On Fri, Oct 7, 2011 at 3:05 PM, wrote: > Ivan Voras wrote: >> On 05/10/2011 09:38, Trond Endrest??l wrote: >> > On Wed, 5 Oct 2011 12:54+1030, Daniel O'Connor wrote: >> >> In my experience ncsd seems to cache negative hits forever, >> >> regardless of the setting for negative-time-to-live. >> > >> > I'm glad to see I'm not the only one who has noticed this odd >> > behaviour of nscd. Shame on me for not speaking up sooner, but >> > I feared I might be proved wrong (again), and yes, that's a >> > lame excuse. :-/ >> >> +1. >> >> It's very annoying when installing ports which add users - the >> port adds it then in some future code checks it and it fails. >> I've noticed it with at least CUPS. > > Sounds as if there ought to be a unified mechanism for ports > to use when adding users, so that necessary notifications -- > e.g. restarting nscd if it is running -- can be done in a > standardized way and any necessary customizations can be done > in a single place. Or nscd fixed to not permanently cache negative hits. Seems more correct. Cheers Tom ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: Fwd: my git development snapshot(s)
On Fri, 2011-09-30 at 15:41:41 -0400, Arnaud Lacombe wrote: > Hi, > > On Mon, Sep 26, 2011 at 2:23 PM, Arnaud Lacombe wrote: > > Hi, > > > > On Thu, Sep 22, 2011 at 5:26 PM, Ulrich Spörlein wrote: > >> On Thu, 2011-09-22 at 15:52:43 -0400, Arnaud Lacombe wrote: > >>> Hi, > >>> > >>> On Thu, Sep 22, 2011 at 3:05 PM, Ulrich Spörlein > >>> wrote: > >>> > On Sun, 2011-09-18 at 12:14:38 +0300, Andriy Gapon wrote: > >>> >> > >>> >> Just decided to follow the global trends and trying to throw all of my > >>> >> local/private changes at you in hope that the "crowd-sourcing magic" > >>> >> might > >>> >> somehow happen :-) This seems definitely easier than carefully > >>> >> producing the > >>> >> patch files and keeping them up-to-date. > >>> >> > >>> >> So, my newly cloned gitorious repository: > >>> >> https://gitorious.org/~avg/freebsd/avgbsd > >>> >> > >>> >> And the first branch of interest: > >>> >> https://gitorious.org/~avg/freebsd/avgbsd/commits/devel-20110915 > >>> > > >>> > I'll throw mine in as well: > >>> > > >>> > https://github.com/uqs/freebsd-head/branches > >>> > > >>> is that the same as tree as Fabien's, or a new snapshot ? > >>> > >>> If not, couldn't we agree to have all the same tree in order to ease > >>> code sharing between all of them ? > >>> > >>> I see there is already a https://github.com/freebsd/freebsd tree, > >>> which seem different than Fabien's tree on github. It really look like > >>> The FreeBSD Project (https://github.com/freebsd/) is not able to > >>> provide consistency. > >> > >> The freebsd-head tree is the same that everybody in the world can get by > >> simply running git svn clone against the FreeBSD subversion server > >> (you'd need a lot of patience, though). > >> > > FWIW, how comes that there is not yet any `stable/9' branch on the github > > tree ? > > > Ulrich, ping ? Oops, sorry for the delay! Fixed now, thanks for bringing it to my attention. I missed the push --all flag. :/ Uli ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: my git development snapshot(s)
On Wed, 2011-09-28 at 00:29:46 -0400, Arnaud Lacombe wrote: > Hi, > > On Sun, Sep 18, 2011 at 5:14 AM, Andriy Gapon wrote: > > > > Just decided to follow the global trends and trying to throw all of my > > local/private changes at you in hope that the "crowd-sourcing magic" might > > somehow happen :-) This seems definitely easier than carefully producing > > the > > patch files and keeping them up-to-date. > > > > So, my newly cloned gitorious repository: > > https://gitorious.org/~avg/freebsd/avgbsd > > > and mine: > > https://github.com/lacombar/freebsd/branches > > not much stuff for now, but should fill up in the next few days. This > a fork from the freebsd/freebsd.git tree on github, with only stable > branches in it (ie. none of the >2k branches of the original clone), > plus my stuff. I think deleting the cvs2svn/vendor branch refs on github.com is the way to go. They'll still be converted and available from git.freebsd.your.org, just not pushed to github. This should unclutter the UI a bit (I think keeping user/ and projects/ is nice, as people can comment on commits that way). Cheers, Uli ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: Does anyone use nscd?
While I agree that nscd negative caching bug should be fixed, it won't help with the problem that users encounter during ports installation. When, for example, user "x" is added during port install, the following steps are involved: 1. Script checks if "x" is present in the users list. Nscd is queried, it returns negative and caches negative answer. 2. Script adds user "x". 3. Script checks that "x" have indeed been added. Nscd is queried, cachned negative answer is returned. Script fails as a result. So unless negative caching time is less than the time between steps 1) and 3) the issues during ports installation will persist. I like perryh@ idea of fixing it within ports. If we introduce some standard way of adding users/groups then this standard routine can take care of nscd. I don't know how much work this will require though... Cheers, Michael On Fri, Oct 7, 2011 at 11:51 AM, Tom Evans wrote: > On Fri, Oct 7, 2011 at 3:05 PM, wrote: >> Ivan Voras wrote: >>> On 05/10/2011 09:38, Trond Endrest??l wrote: >>> > On Wed, 5 Oct 2011 12:54+1030, Daniel O'Connor wrote: >>> >> In my experience ncsd seems to cache negative hits forever, >>> >> regardless of the setting for negative-time-to-live. >>> > >>> > I'm glad to see I'm not the only one who has noticed this odd >>> > behaviour of nscd. Shame on me for not speaking up sooner, but >>> > I feared I might be proved wrong (again), and yes, that's a >>> > lame excuse. :-/ >>> >>> +1. >>> >>> It's very annoying when installing ports which add users - the >>> port adds it then in some future code checks it and it fails. >>> I've noticed it with at least CUPS. >> >> Sounds as if there ought to be a unified mechanism for ports >> to use when adding users, so that necessary notifications -- >> e.g. restarting nscd if it is running -- can be done in a >> standardized way and any necessary customizations can be done >> in a single place. > > Or nscd fixed to not permanently cache negative hits. Seems more correct. > > Cheers > > Tom > ___ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org" > > ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: Does anyone use nscd?
On Thu, 2011-10-06 at 00:44:10 -0500, Dan Nelson wrote: > In the last episode (Oct 04), Trond Endrestol said: > > On Tue, 4 Oct 2011 18:51+0200, Dag-Erling Smorgrav wrote: > > > Trond Endrestol writes: > > > > It's in daily use at Gjovik Technical College (Fagskolen i Gjovik), > > > > here in Norway. Both the mail and web servers authenticates our users > > > > by LDAP, and nscd certainly speeds up the lookups. > > > > > > OK. No trouble with clients dying of SIGPIPE? I could never reproduce > > > the bug, but both users who reported problems used ldap, and I don't > > > have an LDAP server to test against, so I thought it might be specific > > > to LDAP. > > > > Not in my (somewhat limited) experience. > > On a tangent, I also heavily recommend using the nss-pam-ldapd port instead > of nss_ldap. It includes a daemon called nslcd which is the only process > that links to the ldap libary. The nss module is a tiny plug that talks to > nslcd using a simple protocol. It really reduces the socket count to your > ldap server, and removes the potential namespace problems caused by > dlopening libldap.so in every process. Seconded, I had endless troubles with leaked domain sockets and connection problems with nss_ldap and have found that only nss-pam-ldapd + nslcd will work somewhat reliably. Except it still manages to return empty results to sendmail every once in a while (for local delivery). Uli ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
MAC Framework, retreiving information from sysctl
Hi,
Once again I would like to ask some question about kernel module
programming using the MAC framework - but this time it may not be
strictly related to MAC.
So, I have made a simple security module (which I will publish as soon
as I'll finish it), and now I'd like to have some nice tool to modify
it's "rules" from the userland. Exactly the same thing is done by
ugidfw, to modify bsdextended rules.
But, here the problem appears - I don't know how to perform that. I've
got a simple, two-dimensional array which contains these "rules" (if I
can call them that way), and I would like to modify that array from the
userland. So, I guess the best way to do so would be sysctl(3). This is
what I've created, after reading mac_bsdextended source:
kernel module:
static int
sysctl_rule(SYSCTL_HANDLER_ARGS)
{
// ... some code to parse what has been sent ...
return (0);
}
SYSCTL_NODE(_security_somemodule, OID_AUTO, rules,
CTLFLAG_MPSAFE | CTLFLAG_RW, sysctl_rule, "Some description");
And now I should be able to send some data using sysctl(3). But I
really don't know how - and here my question comes. How should I send
this data? How should I parse SYSCTL_HANDLER_ARGS (from struct.h:
#define SYSCTL_HANDLER_ARGS struct sysctl_oid *oidp, void *arg1, int
arg2, struct sysctl_req *req */) to edit my array?
I will be grateful for any help - this is the only thing that remained
in this project... ;)
--
Pozdrawiam,
Jakub 'samu' Szafrański
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: Does anyone use nscd?
On 7 Oct 2011 08:13, wrote: > > Ivan Voras wrote: > > On 05/10/2011 09:38, Trond Endrest??l wrote: > > > On Wed, 5 Oct 2011 12:54+1030, Daniel O'Connor wrote: > > >> In my experience ncsd seems to cache negative hits forever, > > >> regardless of the setting for negative-time-to-live. > > > > > > I'm glad to see I'm not the only one who has noticed this odd > > > behaviour of nscd. Shame on me for not speaking up sooner, but > > > I feared I might be proved wrong (again), and yes, that's a > > > lame excuse. :-/ > > > > +1. > > > > It's very annoying when installing ports which add users - the > > port adds it then in some future code checks it and it fails. > > I've noticed it with at least CUPS. > > Sounds as if there ought to be a unified mechanism for ports > to use when adding users, so that necessary notifications -- > e.g. restarting nscd if it is running -- can be done in a > standardized way and any necessary customizations can be done > in a single place. There is, and I've been trying (with other people) to make older ports respect this framework. Chris ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: mmap performance and memory use
You are correct about the page table page. However, a superpage mapping
consumes a single PV entry, in place of 512 or 1024 PV
entries. This winds up saving about three physical pages worth of memory for
every superpage mapping.
does it actually work?
simple test
before (only idle system with 2GB RAM and most free)
vm.pmap.pde.promotions: 921
vm.pmap.pde.p_failures: 21398
vm.pmap.pde.mappings: 299
vm.pmap.pde.demotions: 596
vm.pmap.shpgperproc: 200
vm.pmap.pv_entry_max: 696561
vm.pmap.pg_ps_enabled: 1
vm.pmap.pat_works: 1
and with that program running (==sleeping)
#include
int a[1<<24];
main() {
int b;
for(b=0;b<(1<<24);b++) a[b]=b;
sleep(1000);
}
vm.pmap.pdpe.demotions: 0
vm.pmap.pde.promotions: 952
vm.pmap.pde.p_failures: 21398
vm.pmap.pde.mappings: 299
vm.pmap.pde.demotions: 596
vm.pmap.shpgperproc: 200
vm.pmap.pv_entry_max: 696561
vm.pmap.pg_ps_enabled: 1
vm.pmap.pat_works: 1
seems like i don't understand what these sysctl things mean (i did sysctl -d)
or it doesn't really work. with program allocating and using linear 64MB
chunk it should be 31 or 32 more mappings in vm.pmap.pde.mappings
there are zero difference.___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: mmap performance and memory use
On Thu, Oct 6, 2011 at 11:01 AM, Kostik Belousov wrote: > On Thu, Oct 06, 2011 at 04:41:45PM +0200, Wojciech Puchar wrote: > > i have few questions. > > > > 1) suppose i map 1TB of address space as anonymous and touch just one > > page. how much memory is used to manage this? > I am not sure how deep the enumeration you want to know, but the first > approximation will be: > one struct vm_map_entry > one struct vm_object > one pv_entry > > Page table structures need four pages for directories and page table > proper. > > > > 2) suppose we have 1TB file on disk without holes and 10 processes > > mmaps this file to it's address space. are just pages shared or can > > pagetables be shared too? how much memory is used to manage such > > situation? > Only pages are shared. Pagetables are not. > > For one thing, this indeed causes more memory use for the OS. This is > somewhat mitigated by automatic use of superpages. Superpage promotion > still keeps the 4KB page table around, so most savings from the > superpages are due to more efficient use of TLB. > > You are correct about the page table page. However, a superpage mapping consumes a single PV entry, in place of 512 or 1024 PV entries. This winds up saving about three physical pages worth of memory for every superpage mapping. Alan ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Using Valgrind on FreeBSD
Hello All, I am trying to run Valgrind on FreeBSD. I am getting the error about ksem_open which i stated below. I have searched for a solution to be able to solve this problem and found the calgrind patch. I could not found the instructions to apply this patch. How can i use valgrind on FreeBSD with ksem_open enabled? Kind Regards Resit Sahin I use valgrind version: valgrind-3.6.0 FreeBSD Version :FreeBSD 8.1-RELEASE-p2 FreeBSD 8.1-RELEASE-p2 #6: amd64 The error i get : (The valgrind output) --84521-- WARNING: unhandled syscall: 404 ==84521==at 0x144E2BC: __sys_ksem_init (in /lib/libc.so.7) ==84521==by 0x14422FE: sem_init (in /lib/libc.so.7) ==84521==by 0x1639BBB: snf__sem_ring_open (in /usr/local/opt/snf/lib/libsnf.so.0.3) ==84521==by 0x163A1AC: snf__open_endpoint_ring (in /usr/local/opt/snf/lib/libsnf.so.0.3) ==84521==by 0x163A5A3: snf__board_open (in /usr/local/opt/snf/lib/libsnf.so.0.3) ==84521==by 0x1637A7A: snf_open (in /usr/local/opt/snf/lib/libsnf.so.0.3) ==84521==by 0xF04DBA: snf_activate (in /usr/local/opt/snf/lib/libpcap.so.1.1.1) ==84521==by 0xF05C26: pcap_activate (in /usr/local/opt/snf/lib/libpcap.so.1.1.1) ==84521==by 0xF0624A: pcap_open_live (in /usr/local/opt/snf/lib/libpcap.so.1.1.1) ==84521==by 0x452B4D: ??? (in /usr/sbin/tcpdump) ==84521==by 0x402E4D: ??? (in /usr/sbin/tcpdump) ==84521==by 0x41FFF: ??? --84521-- You may be able to write your own handler. --84521-- Read the file README_MISSING_SYSCALL_OR_IOCTL. --84521-- Nevertheless we consider this a bug. Please report --84521-- it at http://valgrind.org/support/bug_reports.html. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Re: Using Valgrind on FreeBSD
2011/10/7 Mustafa Reşit Şahin : > I am trying to run Valgrind on FreeBSD. I am getting the error about > ksem_open which i stated below. I have searched for a solution to be able > to solve this problem and found the calgrind patch. I could not found the > instructions to apply this patch. How can i use valgrind on FreeBSD with > ksem_open enabled? It looks like that syscall is only available when the P1003_1B_SEMAPHORES option is in your kernel config. You will need to edit a kernel configuration file and rebuild / reinstall the kernel. Thanks, matthew > I use valgrind version: valgrind-3.6.0 > FreeBSD Version :FreeBSD 8.1-RELEASE-p2 FreeBSD 8.1-RELEASE-p2 #6: amd64 > > The error i get : (The valgrind output) > > > --84521-- WARNING: unhandled syscall: 404 > ==84521== at 0x144E2BC: __sys_ksem_init (in /lib/libc.so.7) > ==84521== by 0x14422FE: sem_init (in /lib/libc.so.7) > ==84521== by 0x1639BBB: snf__sem_ring_open (in > /usr/local/opt/snf/lib/libsnf.so.0.3) > ==84521== by 0x163A1AC: snf__open_endpoint_ring (in > /usr/local/opt/snf/lib/libsnf.so.0.3) > ==84521== by 0x163A5A3: snf__board_open (in > /usr/local/opt/snf/lib/libsnf.so.0.3) > ==84521== by 0x1637A7A: snf_open (in > /usr/local/opt/snf/lib/libsnf.so.0.3) > ==84521== by 0xF04DBA: snf_activate (in > /usr/local/opt/snf/lib/libpcap.so.1.1.1) > ==84521== by 0xF05C26: pcap_activate (in > /usr/local/opt/snf/lib/libpcap.so.1.1.1) > ==84521== by 0xF0624A: pcap_open_live (in > /usr/local/opt/snf/lib/libpcap.so.1.1.1) > ==84521== by 0x452B4D: ??? (in /usr/sbin/tcpdump) > ==84521== by 0x402E4D: ??? (in /usr/sbin/tcpdump) > ==84521== by 0x41FFF: ??? > --84521-- You may be able to write your own handler. > --84521-- Read the file README_MISSING_SYSCALL_OR_IOCTL. > --84521-- Nevertheless we consider this a bug. Please report > --84521-- it at http://valgrind.org/support/bug_reports.html. > ___ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org" > ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
USENIX WebApps '12 Call for Papers Now Available
On behalf of the Program Committee, I would like to invite you to submit your work to the 3rd USENIX Conference on Web Application Development (WebApps '12). Like the inaugural WebApps '10 and '11, WebApps '12 seeks to attract cutting-edge research that advances the state of the art, not only of novel Web applications but also of infrastructure,frameworks, tools, and techniques that support the development, analysis/testing, operation, or deployment of those applications. Possible topics include but are not limited to: * Storage for Web-scale applications * Techniques for testing and debugging * Novel strategies for fault tolerance or high availability in Web apps * The Web as an emerging platform in new application areas * Making Web apps social and integrating with social utilities, e.g., Facebook, Twitter, Google+ * HCI techniques related specifically to Web apps * Measurement, modeling, workload generation, and other tools to aid experimental research on Web apps * New and unusual app features or implementation techniques * Media delivery applications and infrastructure * Client-side libraries, frameworks, toolkits, plug-ins * Server-side frameworks * Languages and language engineering advances relevant to Web app development * Deployment substrates and technologies (cloud computing, infrastructure as a service, testing as a service, etc.) WebApps '12 will consist of a single track of refereed papers and, new this year, a set of short paper demos. Papers with practical significance and/or working prototypes will be preferred over purely theoretical results. Short paper demo submissions must have a working prototype. Submitted papers must be no longer than 12 pages for regular papers and 6 pages for demo papers, including figures, tables, and references. For more details on the submission process, advice on how to prepare a competitive paper, and templates to use with LaTeX, Word, etc., authors should consult http://www.usenix.org/events/webapps12/cfp/requirements.html Paper submissions are due by January 23, 2012, 11:59 p.m. PST. WebApps '12 will take place June 13-14, 2012, in Boston, MA. It is a co-located event that occurs during USENIX Federated Conferences Week, which spans June 12–15, 2012. I look forward to receiving your submissions. Sincerely, Michael Maximilien, IBM Research WebApps '12 Program Chair webapps12ch...@usenix.org Call for Papers: 3rd USENIX Conference on Web Application Development (WebApps '12) June 13-14, 2012, Boston, MA http://www.usenix.org/webapps12/cfpa Paper submissions deadline: January 23, 2012, 11:59 p.m. PST ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
Power usage on FreeBSD
Dear hackers, does anyone know if I can measure power consumption of the processor via software by using FreeBSD on a Intel Core i5? Any pointer on this, or other architectures, will be welcome. Thank you very much in advance! -- Fry: You can see how I lived before I met you. Bender: You lived before you met me?! Fry: Yeah, lots of people did. Bender: Really?! ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscr...@freebsd.org"
