Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Philipp Kern
On Mon, Sep 02, 2013 at 11:27:33AM +0200, Tollef Fog Heen wrote: > ]] Luca Filipozzi > > On Sat, Aug 31, 2013 at 12:40:08AM +0200, Michael Stapelberg wrote: > > > Luca Filipozzi writes: > > > > Why do you say that when you haven't even asked? > > > Because I thought the answer was going to be “no

Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Philipp Kern
On Sun, Sep 01, 2013 at 09:07:47PM +0100, Stephen Gran wrote: > luca is not asking, "why aren't you using the new shiny", he's asking, > "why hasn't a proposal for a project that does string searching used one > of the already available, off the shelf string searching programs". > > Asking someone

Re: DSA, kFreeBSD, and the Singularity (was: How git performs when you throw all of Debian at it)

2013-09-02 Thread Peter Palfrader
On Sun, 01 Sep 2013, Steven Chamberlain wrote: > I can only recall one wishlist bug from DSA at the moment which is > #711247 requesting pflogd. I'd love to hear more wishlist kfreebsd > ideas from DSA. syslog-ng on kfreebsd doesn't properly reconnect to logservers after they went a way for a wh

Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Ian Jackson
Tollef Fog Heen writes ("Re: How git performs when you throw all of Debian at it"): > ]] Luca Filipozzi > > We also run kfreebsd, with some challenge, but we have it. > > It's not really an option for codesearch since codesearch needs systemd, > though. W

Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Tollef Fog Heen
]] Luca Filipozzi > On Sat, Aug 31, 2013 at 12:40:08AM +0200, Michael Stapelberg wrote: > > Luca Filipozzi writes: > > > Why do you say that when you haven't even asked? > > Because I thought the answer was going to be “not in the Linux kernel, > > no chance”. > > We also run kfreebsd, with som

Re: DSA, kFreeBSD, and the Singularity (was: How git performs when you throw all of Debian at it)

2013-09-02 Thread Luca Filipozzi
On Sun, Sep 01, 2013 at 09:49:30PM +0100, Steven Chamberlain wrote: > Hi Luca! > > On Sat, 31 Aug 2013 16:12:11 +, Luca Filipozzi wrote: > > We also run kfreebsd, with some challenge, but we have it. > > How can we help with that? http://dsa.debian.org/ports/kfreebsd/ > e.g. Do you need it

Re: DSA, kFreeBSD, and the Singularity (was: How git performs when you throw all of Debian at it)

2013-09-01 Thread Steven Chamberlain
Hi Luca! On Sat, 31 Aug 2013 16:12:11 +, Luca Filipozzi wrote: > We also run kfreebsd, with some challenge, but we have it. How can we help with that? e.g. Do you need it to better suit running as a virtualised guest, on KVM or Xen for example? virtio drivers should be forthcoming for jessi

Re: How git performs when you throw all of Debian at it

2013-09-01 Thread Stephen Gran
This one time, at band camp, Philipp Kern said: > On Sat, Aug 31, 2013 at 04:12:11PM +, Luca Filipozzi wrote: > > I'm curious why there's no apparent appetite for hdfs / solr / etc. > > I don't know how far regex matching is with solr these days. This > implementation is AFAIK based on [1]. Bu

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Ben Hutchings
On Sat, 2013-08-31 at 22:22 +0200, Adam Borowski wrote: > On Sat, Aug 31, 2013 at 12:44:21AM +0100, Ben Hutchings wrote: > > > Funny that you ask. What's the usual competitor for ZFS? > > > btrfs is included in stock kernels, doesn't take massive amounts of > > > memory, > > > and has a different

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Adam Borowski
On Sat, Aug 31, 2013 at 12:44:21AM +0100, Ben Hutchings wrote: > > Funny that you ask. What's the usual competitor for ZFS? > > btrfs is included in stock kernels, doesn't take massive amounts of memory, > > and has a different approach to deduplication. > > and is slower than any of its competit

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Philipp Kern
On Sat, Aug 31, 2013 at 04:12:11PM +, Luca Filipozzi wrote: > I'm curious why there's no apparent appetite for hdfs / solr / etc. I don't know how far regex matching is with solr these days. This implementation is AFAIK based on [1]. But then the tool exists and would need to be thrown away co

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Luca Filipozzi
On Sat, Aug 31, 2013 at 12:40:08AM +0200, Michael Stapelberg wrote: > Luca Filipozzi writes: > > Why do you say that when you haven't even asked? > Because I thought the answer was going to be “not in the Linux kernel, > no chance”. We also run kfreebsd, with some challenge, but we have it. > >

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Adam Borowski
On Sat, Aug 31, 2013 at 12:32:47AM +0100, Dmitrijs Ledkovs wrote: > On 30 August 2013 20:55, Steven Chamberlain wrote: > > Hi, > > > >> [...] using git instead of the file system for storing the contents > >> of Debian Code Search. The hope was that it would lead to fewer disk > >> seeks and less

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Ben Hutchings
On Sat, 2013-08-31 at 01:21 +0200, Adam Borowski wrote: > On Fri, Aug 30, 2013 at 10:14:25PM +, Luca Filipozzi wrote: > > On Fri, Aug 30, 2013 at 10:49:48PM +0200, Michael Stapelberg wrote: > > > Steven Chamberlain writes: > > > > Wouldn't ZFS be a more natural way to do something like this? >

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Dmitrijs Ledkovs
On 30 August 2013 20:55, Steven Chamberlain wrote: > Hi, > >> [...] using git instead of the file system for storing the contents >> of Debian Code Search. The hope was that it would lead to fewer disk >> seeks and less data due to gits delta-encoding > > Wouldn't ZFS be a more natural way to do s

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Adam Borowski
On Fri, Aug 30, 2013 at 10:14:25PM +, Luca Filipozzi wrote: > On Fri, Aug 30, 2013 at 10:49:48PM +0200, Michael Stapelberg wrote: > > Steven Chamberlain writes: > > > Wouldn't ZFS be a more natural way to do something like this? > > Possibly, but I have zero hopes of getting it set up and supp

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Holger Levsen
Hi, On Samstag, 31. August 2013, Luca Filipozzi wrote: > We are much more amenable to "how could I improve X so that it can run > faster" than we are to... I'd like to chime in and say a big thanks to DSA! piuparts.debian.org is running very very smoothly (and fast) now, thanks to the awesome ga

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Michael Stapelberg
Hi Luca, Luca Filipozzi writes: > Why do you say that when you haven't even asked? Because I thought the answer was going to be “not in the Linux kernel, no chance”. > To address this specific thread, the challenge with ZFS is not that we don't > like the idea (I'm keen on it, actually) but that

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Luca Filipozzi
On Fri, Aug 30, 2013 at 10:49:48PM +0200, Michael Stapelberg wrote: > Steven Chamberlain writes: > > Wouldn't ZFS be a more natural way to do something like this? > Possibly, but I have zero hopes of getting it set up and supported by > DSA, so we can’t use it for this service. Why do you say tha

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Steven Chamberlain
On 30/08/13 21:49, Michael Stapelberg wrote: > Steven Chamberlain writes: >> Wouldn't ZFS be a more natural way to do something like this? > Possibly, but I have zero hopes of getting it set up and supported by > DSA, so we can’t use it for this service. Oh I see. That's fair enough, but there i

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Michael Stapelberg
Hi Steven, Steven Chamberlain writes: > Wouldn't ZFS be a more natural way to do something like this? Possibly, but I have zero hopes of getting it set up and supported by DSA, so we can’t use it for this service. -- Best regards, Michael -- To UNSUBSCRIBE, email to debian-devel-requ...@lists

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Steven Chamberlain
Hi, > [...] using git instead of the file system for storing the contents > of Debian Code Search. The hope was that it would lead to fewer disk > seeks and less data due to gits delta-encoding Wouldn't ZFS be a more natural way to do something like this? A choice of gzip, lzjb and more recently