Re: Compressed Pristines (Summary)

2012-04-10 Thread Ashod Nakashian
;Cc: Greg Stein ; "dev@subversion.apache.org" > >Sent: Friday, April 6, 2012 10:19 AM >Subject: Re: Compressed Pristines (Summary) > >On Wed, Apr 4, 2012 at 1:28 PM, Ashod Nakashian > wrote: >> I feel this is indeed what we're closing on, at least for an initial working >&

Re: Compressed Pristines (Summary)

2012-04-06 Thread Justin Erenkrantz
On Wed, Apr 4, 2012 at 1:28 PM, Ashod Nakashian wrote: > I feel this is indeed what we're closing on, at least for an initial working > demo. But I'd like to hear more agreements before committing to this path. I > know some did show support for this approach, but it's hard to track them in > t

Re: Compressed Pristines (Summary)

2012-04-05 Thread Hyrum K Wright
On Thu, Apr 5, 2012 at 11:24 AM, Branko Čibej wrote: > On 05.04.2012 17:35, Ashod Nakashian wrote: >>> >>> From: Hyrum K Wright >>> >>> I'm glad we've found a way to relegate this problem to a >>> "minor...technicality." >> So far no objections then. >> >> What's

Re: Compressed Pristines (Summary)

2012-04-05 Thread Branko Čibej
On 05.04.2012 17:35, Ashod Nakashian wrote: >> >> From: Hyrum K Wright >> >> I'm glad we've found a way to relegate this problem to a >> "minor...technicality." > So far no objections then. > > What's the preferred mode of operation in such a case? > > I can updat

Re: Compressed Pristines (Summary)

2012-04-05 Thread Ashod Nakashian
> > From: Hyrum K Wright > >I'm glad we've found a way to relegate this problem to a >"minor...technicality." So far no objections then. What's the preferred mode of operation in such a case? I can update the proposal and start sending patches for the dev-list t

Re: Compressed Pristines (Summary)

2012-04-05 Thread Hyrum K Wright
On Thu, Apr 5, 2012 at 6:45 AM, Julian Foad wrote: > Daniel Shahaf wrote: >> [Managing uncompressed copies of files] is certainly a -minor- >> complication we'll have to deal with. It's just a technicality, > > That's great, because I believe that is the only significant issue that needs > to be

Re: Compressed Pristines (Summary)

2012-04-05 Thread Julian Foad
Daniel Shahaf wrote: > I agree with making svn_wc__pristine_*() smarter and I disagree with > teaching svn the proper mount(8) flags for all platforms APR supports. Me too.  (Note: I never said svn should mount filesystems, I just said it would be interesting to investigate.) Ashod Nakashian wr

Re: Compressed Pristines (Summary)

2012-04-05 Thread Ivan Zhakov
On Wed, Apr 4, 2012 at 23:54, Greg Stein wrote: >> > >> >Daniel >> >(devil's advocate mode) > > Given Daniel's devil's advocate position, I say just ignore him. Don't feed > him :-) > > My vote is compress for files > N bytes (and store on disk), and stick the > others into a new pristine.db. Mayb

Re: Compressed Pristines (Summary)

2012-04-04 Thread Branko Čibej
On 04.04.2012 20:46, Daniel Shahaf wrote: > But one _could_ write a filesystem that implements compression and/or > deduplication aimed at .svn/pristine/'s workflow. Should effort be > spent there rather than on implementing a smarter svn_wc__pristine_*()? Now that's an interesting idea. I propos

RE: Compressed Pristines (Summary)

2012-04-04 Thread Bert Huijben
> -Original Message- > From: Ashod Nakashian [mailto:ashodnakash...@yahoo.com] > Sent: woensdag 4 april 2012 13:28 > To: Greg Stein > Cc: dev@subversion.apache.org > Subject: Re: Compressed Pristines (Summary) > > > > >

Re: Compressed Pristines (Summary)

2012-04-04 Thread Daniel Shahaf
+1 to what Greg just outlined Ashod Nakashian wrote on Wed, Apr 04, 2012 at 13:28:06 -0700: > > > > From: Greg Stein > >My vote is compress for files > N bytes (and store on disk), and stick the > >others into a new pristine.db. Maybe compress before inserting int

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
> > From: Greg Stein >My vote is compress for files > N bytes (and store on disk), and stick the >others into a new pristine.db. Maybe compress before inserting into Sqlite. >Not sure. Add a few heuristics for skipping compression on certain files types. >Shouldn'

Re: Compressed Pristines (Summary)

2012-04-04 Thread Daniel Shahaf
Ashod Nakashian wrote on Wed, Apr 04, 2012 at 11:57:45 -0700: > I think we either agree that SVN should improve its footprint or we > don't. I agree with making svn_wc__pristine_*() smarter and I disagree with teaching svn the proper mount(8) flags for all platforms APR supports. Daniel (than ks

Re: Compressed Pristines (Summary)

2012-04-04 Thread Greg Stein
On Apr 4, 2012 3:26 PM, "Ashod Nakashian" wrote: > > > > > > > > From: Daniel Shahaf > > >> > > > >But one _could_ write a filesystem that implements compression and/or > >deduplication aimed at .svn/pristine/'s workflow. Should effort be > >spent there rather

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
> > From: Daniel Shahaf >To: Ashod Nakashian >Cc: Julian Foad ; Markus Schaber >; "mtheri...@gmail.com" ; >Subversion Development >Sent: Wednesday, April 4, 2012 10:46 PM >Subject: Re: Compressed Pristines (Summary) >

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
- Original Message - > From: Daniel Shahaf > To: Ashod Nakashian > Cc: Markus Schaber ; "julianf...@btopenworld.com" > ; "mtheri...@gmail.com" ; > Subversion Development > Sent: Wednesday, April 4, 2012 10:29 PM > Subject: Re: Compressed

Re: Compressed Pristines (Summary)

2012-04-04 Thread C. Michael Pilato
On 04/04/2012 02:46 PM, Daniel Shahaf wrote: > But one _could_ write a filesystem that implements compression and/or > deduplication aimed at .svn/pristine/'s workflow. Should effort be > spent there rather than on implementing a smarter svn_wc__pristine_*()? > > Daniel > (devil's advocate mode)

Re: Compressed Pristines (Summary)

2012-04-04 Thread Daniel Shahaf
Development > > Sent: Wednesday, April 4, 2012 9:45 PM > > Subject: Re: Compressed Pristines (Summary) > > > > Ashod Nakashian wrote: > > > >> Daniel Shahaf wrote: > >>>>> Would you like to assess the feasibility of compressing the > &

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
- Original Message - > From: Julian Foad > To: Ashod Nakashian > Cc: Daniel Shahaf ; Markus Schaber > ; "mtheri...@gmail.com" ; > Subversion Development > Sent: Wednesday, April 4, 2012 9:45 PM > Subject: Re: Compressed Pristines (Summary) > >

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
> > From: Mark Phippard >To: Ashod Nakashian   >Cc: Daniel Shahaf ; Markus Schaber >; "julianf...@btopenworld.com" >; "mtheri...@gmail.com" ; >Subversion Development   >Sent: Wednesday, April 4, 2012 9:23 PM >Sub

Re: Compressed Pristines (Summary)

2012-04-04 Thread Daniel Shahaf
ion Development > >Sent: Wednesday, April 4, 2012 9:46 AM > >Subject: Re: Compressed Pristines (Summary) > > > >> >1.  Filesystem compression. > >> > > >> >Would you like to assess the feasibility of compressing the pristine > >>

Re: Compressed Pristines (Summary)

2012-04-04 Thread Daniel Shahaf
Julian Foad wrote on Wed, Apr 04, 2012 at 18:45:34 +0100: > Ashod Nakashian wrote: > > Daniel Shahaf wrote: > >> In short: if 'mount -o compress=yes' provides 90% space savings > >> then we would have little reason to implement space-saving > >> solutions in svn itself. But it's the user's, not sv

Re: Compressed Pristines (Summary)

2012-04-04 Thread Hyrum K Wright
On Wed, Apr 4, 2012 at 12:45 PM, Julian Foad wrote: > Ashod Nakashian wrote: > >> Daniel Shahaf wrote: >>> In short: if 'mount -o compress=yes' provides 90% space savings then >> we >>> would have little reason to implement space-saving solutions in svn itself. >>> But it's the user's, not svn's,

Re: Compressed Pristines (Summary)

2012-04-04 Thread Julian Foad
Ashod Nakashian wrote: > Daniel Shahaf wrote: Would you like to assess the feasibility of compressing the pristine >>> >store by re-mounting the "pristines" subdirectory as a compressed >>> >subtree in the operating system's file system? >>> >>> No :-) >>> >>> There are two ways to answ

Re: Compressed Pristines (Summary)

2012-04-04 Thread Mark Phippard
On Wed, Apr 4, 2012 at 1:18 PM, Ashod Nakashian wrote: > That's an easy question. The answer is that at *best* they'll do as good as > in-place compression. However, in practice > they'll do much worse. The reason is that the OS level compression works on > not only the single file level, but a

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
> > From: Daniel Shahaf >To: Ashod Nakashian >Cc: Markus Schaber ; "julianf...@btopenworld.com" >; "mtheri...@gmail.com" ; >Subversion Development >Sent: Wednesday, April 4, 2012 9:46 AM >Subject: Re: Compress

Re: Compressed Pristines (Summary)

2012-04-04 Thread Daniel Shahaf
> >1.  Filesystem compression. > > > >Would you like to assess the feasibility of compressing the pristine > >store by re-mounting the "pristines" subdirectory as a compressed > >subtree in the operating system's file system? > > No :-) > > There are two ways to answer this interesting propositio

Re: Compressed Pristines (Summary)

2012-04-04 Thread Ashod Nakashian
Combined response inline... > From: Markus Schaber > >First, thanks for your great summary. I'll throw in just my 2 cents below. The pleasure is mine. > From: Markus Schaber > >Was any of those tests actually executed on a file system supporting something >like "block suballocation", "tail me

Re: Compressed Pristines (Summary)

2012-04-02 Thread Mark Therieau
certainly fair points. I guess I raised the issue to point out that there are other approaches to increase space-efficiency for pristine storage that rate at least a mention under analysis/considerations, even if just noted as "considered and discarded". Overall, I'm sure it would be challenging,

Re: Compressed Pristines (Summary)

2012-04-02 Thread Stefan Sperling
On Mon, Apr 02, 2012 at 02:22:45PM -0400, Mark Therieau wrote: > Another thought would be to pursue a FUSE-like approach similar to scord > [1][2] > which implements a lightweight file system adapter that knows just enough > about > the pristine store and the working copy files such that it could m

Re: Compressed Pristines (Summary)

2012-04-02 Thread Branko Čibej
On 02.04.2012 20:22, Mark Therieau wrote: > Another thought would be to pursue a FUSE-like approach similar to scord > [1][2] > which implements a lightweight file system adapter ... Good luck doing that on Windows. :) -- Brane

Re: Compressed Pristines (Summary)

2012-04-02 Thread Mark Therieau
Another thought would be to pursue a FUSE-like approach similar to scord [1][2] which implements a lightweight file system adapter that knows just enough about the pristine store and the working copy files such that it could maintain a single copy of the pristine contents for the overwhelming major

Re: Compressed Pristines (Summary)

2012-04-02 Thread Julian Foad
Hi Ashnod. 1.  Filesystem compression. Would you like to assess the feasibility of compressing the pristine store by re-mounting the "pristines" subdirectory as a compressed subtree in the operating system's file system?  This can be done (I believe) under Windows with NTFS

Re: Compressed Pristines (Summary)

2012-04-01 Thread Ashod Nakashian
- Original Message - > From: Branko Čibej > To: Ashod Nakashian > Cc: "dev@subversion.apache.org" > Sent: Sunday, April 1, 2012 12:23 PM > Subject: Re: Compressed Pristines (Summary) > > On 31.03.2012 23:30, Ashod Nakashian wrote: >>>>  

Re: Compressed Pristines (Summary)

2012-04-01 Thread Branko Čibej
On 31.03.2012 23:30, Ashod Nakashian wrote: >>> Git can keep deleted items until git-gc is invoked, should we support >> something similar, we need to be consistent and probably support arbitrary >> revision history, which is out of scope. >> >> I'm confused: how does revision history affect the

Re: Compressed Pristines (Summary)

2012-03-31 Thread Ashod Nakashian
- Original Message - > From: Branko Čibej > To: dev@subversion.apache.org > Cc: > Sent: Sunday, April 1, 2012 12:58 AM > Subject: Re: Compressed Pristines (Summary) > > On 31.03.2012 18:16, Ashod Nakashian wrote: >> So it's fair to say I'm ignor

Re: Compressed Pristines (Summary)

2012-03-31 Thread Branko Čibej
On 31.03.2012 18:16, Ashod Nakashian wrote: > So it's fair to say I'm ignorant about the details, but I must say this: A > repository, precisely like Git pack files, don't necessarily need good (if at > all) support of deletion. This is a very critical issue that I can see why it > might not be

Re: Compressed Pristines (Summary)

2012-03-31 Thread Ashod Nakashian
- Original Message - > From: Stefan Sperling > To: Ashod Nakashian > Cc: "dev@subversion.apache.org" > Sent: Saturday, March 31, 2012 7:47 PM > Subject: Re: Compressed Pristines (Summary) > > On Sat, Mar 31, 2012 at 01:31:15AM -0700, Ashod Nakashian wro

Re: Compressed Pristines (Summary)

2012-03-31 Thread Stefan Sperling
On Sat, Mar 31, 2012 at 01:31:15AM -0700, Ashod Nakashian wrote: > ::Summary:: Thanks for summarizing the discussion. This summary was very useful to me. > 3) Sqlite has a very reputable code-base and performance, in addition > to already being utilized by SVN. A proposal to use it for small > pr

Re: Compressed Pristines (Summary)

2012-03-31 Thread Ashod Nakashian
Hi, In an attempt to reduce the footprint of pristine files in a working copy (WC) the compressed pristines (CP) feature is proposed[1]. There has been discussion and debates regarding the particulars of the proposal. This is a summary of this discussion and consolidation/checkpoint of the thre

Re: Compressed Pristines (Call for Vote)

2012-03-27 Thread Branko Čibej
On 27.03.2012 12:14, Bert Huijben wrote: > A file that is only keyed by its SHA-1 will never grow or shrink. Doh. I'm stupid this early in the morning. Of course you're right, this is a non-issue. -- Brane

RE: Compressed Pristines (Call for Vote)

2012-03-27 Thread Bert Huijben
> -Original Message- > From: Branko Čibej [mailto:br...@xbc.nu] On Behalf Of Branko Cibej > Sent: dinsdag 27 maart 2012 2:56 > To: Subversion Development > Subject: Re: Compressed Pristines (Call for Vote) > > [this should really be on the dev@ list, i mis-

Re: Compressed Pristines (Call for Vote)

2012-03-26 Thread Branko Čibej
[this should really be on the dev@ list, i mis-addressed my response.] On 26.03.2012 17:48, Ashod Nakashian wrote: >> >> I recommended a two-stage approach to the implementation because >> (packing and) encrypting the pristines is only half the story, there >> are a number of interactions with the

Re: Compressed Pristines (Design Doc)

2012-03-26 Thread Ashod Nakashian
- Original Message - > From: Daniel Shahaf > To: Hyrum K Wright > Cc: Ashod Nakashian ; "dev@subversion.apache.org" > ; Philip Martin ; Greg > Stein > Sent: Monday, March 26, 2012 5:30 PM > Subject: Re: Compressed Pristines (Design Doc) > > Hyru

Re: Compressed Pristines (Design Doc)

2012-03-26 Thread Daniel Shahaf
Daniel Shahaf wrote on Mon, Mar 26, 2012 at 14:30:34 +0200: > I haven't found much so far (Provided as an observation; not implying it's a problem.)

Re: Compressed Pristines (Design Doc)

2012-03-26 Thread Daniel Shahaf
Hyrum K Wright wrote on Fri, Mar 23, 2012 at 13:54:25 -0500: > As mentioned elsewhere, I too was surprised by the choice of a custom > container, though I think you make a good argument for it. One > simplification I was thinking about is this: what if the container > only needed to support add an

Re: Compressed Pristines (Call for Vote)

2012-03-26 Thread Daniel Shahaf
Julian Foad wrote on Mon, Mar 26, 2012 at 13:00:58 +0100: > Ashod Nakashian wrote: > [...] > > > *Let's vote on a design and a plan to get us there.* At this point I can > > only wait for everyone to catch up, do their tests and run their numbers > > and > > vote on what they think will best be

Re: Compressed Pristines (Call for Vote)

2012-03-26 Thread Julian Foad
Ashod Nakashian wrote: [...] > *Let's vote on a design and a plan to get us there.* At this point I can > only wait for everyone to catch up, do their tests and run their numbers and > vote on what they think will best benefit the community in the long run. > > ::Subversion Compressed Pristines

Re: Compressed Pristines (Design Doc)

2012-03-26 Thread Branko Čibej
On 26 March 2012 11:53, Ivan Zhakov wrote: > 2012/3/25 Branko Čibej : >> On 22.03.2012 17:01, Branko Čibej wrote: >>> On 22.03.2012 16:50, Daniel Shahaf wrote: Branko Čibej wrote on Thu, Mar 22, 2012 at 16:37:24 +0100: > [..] >> >> Based on these observations, it's clear that the implementati

Re: Compressed Pristines (Call for Vote)

2012-03-26 Thread Ashod Nakashian
I don't know how I missed this mail, but I have. Thanks to Ivan for bringing it to my attention. Please see inline. - Original Message - > From: Branko Čibej > To: dev@subversion.apache.org > Cc: > Sent: Sunday, March 25, 2012 4:02 AM > Subject: Re: Compressed P

Re: Compressed Pristines (Design Doc)

2012-03-26 Thread Ivan Zhakov
2012/3/25 Branko Čibej : > On 22.03.2012 17:01, Branko Čibej wrote: >> On 22.03.2012 16:50, Daniel Shahaf wrote: >>> Branko Čibej wrote on Thu, Mar 22, 2012 at 16:37:24 +0100: [..] > > Based on these observations, it's clear that the implementation should > proceed as follows: > > Step 1: Just comp

Re: Compressed Pristines (Design Doc)

2012-03-25 Thread Branko Čibej
On 22.03.2012 17:01, Branko Čibej wrote: > On 22.03.2012 16:50, Daniel Shahaf wrote: >> Branko Čibej wrote on Thu, Mar 22, 2012 at 16:37:24 +0100: >>> It's called SQLite. >> Heh. I wondered whether I should mention that the server uses BDB to >> store pristine files. (yes, the situation there is

Re: Compressed Pristines (Simulation)

2012-03-25 Thread Ashod Nakashian
- Original Message - > From: Johan Corveleyn > To: Ashod Nakashian > Cc: "dev@subversion.apache.org" > Sent: Monday, March 26, 2012 3:10 AM > Subject: Re: Compressed Pristines (Simulation) > > On Sun, Mar 25, 2012 at 7:17 PM, Ashod Nakashian >

Re: Compressed Pristines (Simulation)

2012-03-25 Thread Ashod Nakashian
- Original Message - > From: Ivan Zhakov > To: Ashod Nakashian > Cc: "dev@subversion.apache.org" > Sent: Sunday, March 25, 2012 10:55 PM > Subject: Re: Compressed Pristines (Simulation) > > On Sun, Mar 25, 2012 at 21:17, Ashod Nakashian > wrote: &

Re: Compressed Pristines (Design Doc)

2012-03-25 Thread Ashod Nakashian
> > From: Greg Stein >To: Thomas Åkesson >Cc: Ashod Nakashian ; Subversion Development > >Sent: Monday, March 26, 2012 7:42 AM >Subject: Re: Compressed Pristines (Design Doc) > > >Yeah... optional pristines is orthogonal, and s

Re: Compressed Pristines (Design Doc)

2012-03-25 Thread Greg Stein
homas Å. > > > On 22 mar 2012, at 08:15, Ashod Nakashian wrote: > > >> > >> From: Daniel Shahaf > >> To: Greg Stein > >> Cc: Ashod Nakashian ; > dev@subversion.apache.org > >> Sent: Wednesday, March 21, 2012 2:08 PM > >> Sub

Re: Compressed Pristines (Design Doc)

2012-03-25 Thread Thomas Åkesson
hian wrote: >> >> From: Daniel Shahaf >> To: Greg Stein >> Cc: Ashod Nakashian ; dev@subversion.apache.org >> Sent: Wednesday, March 21, 2012 2:08 PM >> Subject: Re: Compressed Pristines (Design Doc) >> >> Greg Stei

Re: Compressed Pristines (Simulation)

2012-03-25 Thread Johan Corveleyn
On Sun, Mar 25, 2012 at 7:17 PM, Ashod Nakashian wrote: [snip] >> From: Hyrum K Wright [snip] >>In some respects, it looks like you're solving *two* problems: >>compression and the internal fragmentation due to large FS block >>sizes.  How orthogonal are the problems?  Could they be solved >>inde

Re: Compressed Pristines (Simulation)

2012-03-25 Thread Branko Čibej
On 25.03.2012 19:55, Ivan Zhakov wrote: > On Sun, Mar 25, 2012 at 21:17, Ashod Nakashian > wrote: >> From this output it's clear how much waste there is due to internal >> fragmentation and how much packing helps. > Working (actual) files are already fragmented due filesystem block > size. User c

Re: Compressed Pristines (Simulation)

2012-03-25 Thread Ivan Zhakov
On Sun, Mar 25, 2012 at 21:17, Ashod Nakashian wrote: > From this output it's clear how much waste there is due to internal > fragmentation and how much packing helps. Working (actual) files are already fragmented due filesystem block size. User can change file system or reduce block size if he ca

Re: Compressed Pristines (Simulation)

2012-03-25 Thread Ashod Nakashian
All, Comments and simulation results in-line. > > From: Hyrum K Wright [snip] > >So, I've read through the design document, and the various threads, >and have a couple of comments / questions which I don't think have >been addressed.  My first impression, though

Re: Compressed Pristines (Design Doc)

2012-03-23 Thread Hyrum K Wright
On Wed, Mar 21, 2012 at 2:19 PM, Ashod Nakashian wrote: > All, > > I'm happy to share[1] with you the design document for the Compressed > Pristines feature. The document is public and anyone can comment on any part > (select, right-click and comment away). If you'd like to get *editing* > permiss

Re: Compressed Pristines (Custom Format?)

2012-03-23 Thread Ben Smith-Mannschott
On Fri, Mar 23, 2012 at 11:32, Greg Stein wrote: > > On Mar 23, 2012 5:59 AM, "Ben Smith-Mannschott" > wrote: >> >> On Fri, Mar 23, 2012 at 10:22, Ashod Nakashian >> wrote: >>... > >> > Now, does this justify the cost of a new file-format? That's reasonable >> > to argue. My take is that the pro

Re: Compressed Pristines (Custom Format?)

2012-03-23 Thread Greg Stein
On Mar 23, 2012 5:59 AM, "Ben Smith-Mannschott" wrote: > > On Fri, Mar 23, 2012 at 10:22, Ashod Nakashian wrote: >... > > Now, does this justify the cost of a new file-format? That's reasonable to argue. My take is that the proposed file-format is simple enough and the gains (especially on large

Re: Compressed Pristines (Custom Format?)

2012-03-23 Thread Ben Smith-Mannschott
On Fri, Mar 23, 2012 at 10:22, Ashod Nakashian wrote: > The design's fundamental assumption is that source files are typically > smaller than a typical FS block (after compression). Eric and Philip have ran > tests on SVN and GCC respectively with different results. I do not have > hard-figures

Re: Compressed Pristines (Custom Format?)

2012-03-23 Thread Ashod Nakashian
- Original Message - > From: Philip Martin > To: Erik Huelsmann > Cc: Ashod Nakashian ; Daniel Shahaf > ; "dev@subversion.apache.org" ; > Ivan Zhakov > Sent: Thursday, March 22, 2012 4:00 PM > Subject: Re: Compressed Pristines (Design Doc) > >

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Philip Martin
Erik Huelsmann writes: > As the others, I'm surprised we seem to be going with a custom file format. > You claim source files are generally small in size and hence only small > benefits can be had from compressing them, if at all, due to the fact that > they would be of sub-block size already. I

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Erik Huelsmann
Hi Ash, Thanks for picking up the initiative to implement this feature. On Thu, Mar 22, 2012 at 7:01 PM, Ivan Zhakov wrote: > On Thu, Mar 22, 2012 at 18:30, Daniel Shahaf wrote: > > OK, I've had a cruise through now. > > > > First of all I have to say it's an order of magnitude larger than wha

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Ivan Zhakov
On Thu, Mar 22, 2012 at 18:30, Daniel Shahaf wrote: > OK, I've had a cruise through now. > > First of all I have to say it's an order of magnitude larger than what > I'd imagined it would be.  That makes the "move it elsewhere" idea I'd > had less practical than I'd predicted.  I'm also not intend

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Branko Čibej
On 22.03.2012 16:50, Daniel Shahaf wrote: > Branko Čibej wrote on Thu, Mar 22, 2012 at 16:37:24 +0100: >> It's called SQLite. > Heh. I wondered whether I should mention that the server uses BDB to > store pristine files. (yes, the situation there is different in > several relevant ways) To clari

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Daniel Shahaf
Branko Čibej wrote on Thu, Mar 22, 2012 at 16:37:24 +0100: > It's called SQLite. Heh. I wondered whether I should mention that the server uses BDB to store pristine files. (yes, the situation there is different in several relevant ways)

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Daniel Shahaf
Ashod Nakashian wrote on Thu, Mar 22, 2012 at 08:18:40 -0700: > > > > From: Daniel Shahaf > >To: Ashod Nakashian > >Cc: "dev@subversion.apache.org" > >Sent: Thursday, March 22, 2012 7:30 AM > >Subject: Re: Compress

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Branko Čibej
On 22.03.2012 16:23, Mark Phippard wrote: > On Thu, Mar 22, 2012 at 11:18 AM, Ashod Nakashian > wrote: >>> Design-wise I'm a bit surprised that the choice ended up being rolling >>> a custom file format. >> Personally I know not of any library that can deliver the requirements that >> we need (ou

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Mark Phippard
On Thu, Mar 22, 2012 at 11:18 AM, Ashod Nakashian wrote: >>Design-wise I'm a bit surprised that the choice ended up being rolling >>a custom file format. > > Personally I know not of any library that can deliver the requirements that > we need (outlined in the doc). Again, if the requirements > a

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Ashod Nakashian
> > From: Daniel Shahaf >To: Ashod Nakashian >Cc: "dev@subversion.apache.org" >Sent: Thursday, March 22, 2012 7:30 AM >Subject: Re: Compressed Pristines (Design Doc) > >OK, I've had a cruise through now. > >First of

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Daniel Shahaf
> > From: Daniel Shahaf > >To: Greg Stein > >Cc: Ashod Nakashian ; dev@subversion.apache.org > >Sent: Wednesday, March 21, 2012 2:08 PM > >Subject: Re: Compressed Pristines (Design Doc) > > > >Greg Stein wrote on Wed, Mar 21, 2012 at 16:51:47

Re: Compressed Pristines (Design Doc)

2012-03-22 Thread Daniel Shahaf
an ; dev@subversion.apache.org > >Sent: Wednesday, March 21, 2012 2:08 PM > >Subject: Re: Compressed Pristines (Design Doc) > > > >Greg Stein wrote on Wed, Mar 21, 2012 at 16:51:47 -0400: > >> On Wed, Mar 21, 2012 at 16:11, Daniel Shahaf > >> wrote:

Re: Compressed Pristines (Design Doc)

2012-03-21 Thread Branko Čibej
On 21.03.2012 22:08, Daniel Shahaf wrote: > Greg Stein wrote on Wed, Mar 21, 2012 at 16:51:47 -0400: >> On Wed, Mar 21, 2012 at 16:11, Daniel Shahaf wrote: >>> Ashod Nakashian wrote on Wed, Mar 21, 2012 at 12:19:02 -0700: All, I'm happy to share[1] with you the design document for t

Re: Compressed Pristines (Design Doc)

2012-03-21 Thread Daniel Shahaf
Greg Stein wrote on Wed, Mar 21, 2012 at 16:51:47 -0400: > On Wed, Mar 21, 2012 at 16:11, Daniel Shahaf wrote: > > Ashod Nakashian wrote on Wed, Mar 21, 2012 at 12:19:02 -0700: > >> All, > >> > >> I'm happy to share[1] with you the design document for the Compressed > >> Pristines feature. The do

Re: Compressed Pristines (Design Doc)

2012-03-21 Thread Greg Stein
On Wed, Mar 21, 2012 at 16:11, Daniel Shahaf wrote: > Ashod Nakashian wrote on Wed, Mar 21, 2012 at 12:19:02 -0700: >> All, >> >> I'm happy to share[1] with you the design document for the Compressed >> Pristines feature. The document is public and anyone can comment on any part > > I can't.  Can

Re: Compressed Pristines (Design Doc)

2012-03-21 Thread Daniel Shahaf
Ashod Nakashian wrote on Wed, Mar 21, 2012 at 12:19:02 -0700: > All, > > I'm happy to share[1] with you the design document for the Compressed > Pristines feature. The document is public and anyone can comment on any part I can't. Can you please move the document to our wiki, or dump it in an e

Re: Compressed Pristines (Design Doc)

2012-03-21 Thread Ashod Nakashian
bversion.apache.org" >Sent: Monday, March 12, 2012 5:31 PM >Subject: Re: Compressed Pristines > >On Mon, Mar 12, 2012 at 7:11 AM, Ashod Nakashian > wrote: >> - Original Message - >> >>> From: Philip Martin >>> To: Ashod Nakashian >>>

Re: Compressed Pristines

2012-03-12 Thread Ashod Nakashian
- Original Message - > From: Hyrum K Wright > To: Ashod Nakashian > Cc: Philip Martin ; Greg Stein > ; "dev@subversion.apache.org" > Sent: Monday, March 12, 2012 5:31 PM > Subject: Re: Compressed Pristines > > On Mon, Mar 12, 2012 at

RE: Compressed Pristines

2012-03-12 Thread Bert Huijben
> -Original Message- > From: Mark Phippard [mailto:markp...@gmail.com] > Sent: maandag 12 maart 2012 16:26 > To: Erik Huelsmann > Cc: dev > Subject: Re: Compressed Pristines > > On Mon, Mar 12, 2012 at 11:15 AM, Erik Huelsmann > wrote: > > > Exactl

Re: Compressed Pristines

2012-03-12 Thread Mark Phippard
On Mon, Mar 12, 2012 at 11:15 AM, Erik Huelsmann wrote: > Exactly. So what you found is that for any eol style other than native, we > use exactly that style. For native, we use LF. Just to bring this back on topic and to my original question, I was asking whether Hyrum's assertion that we pass

Re: Compressed Pristines

2012-03-12 Thread Johan Corveleyn
On Mon, Mar 12, 2012 at 3:03 PM, Greg Stein wrote: > > On Mar 12, 2012 9:59 AM, "Johan Corveleyn" wrote: >>... > > >> (BTW: the pristine file (on Windows) only has LF line-endings when >> svn:eol-style=native (or =LF). When it's svn:eol-style=CRLF, the >> pristine file has CRLF (as does the file

Re: Compressed Pristines

2012-03-12 Thread Greg Stein
On Mar 12, 2012 9:59 AM, "Johan Corveleyn" wrote: >... > (BTW: the pristine file (on Windows) only has LF line-endings when > svn:eol-style=native (or =LF). When it's svn:eol-style=CRLF, the > pristine file has CRLF (as does the file in the repository)) Has nothing to do with the property. The pr

Re: Compressed Pristines

2012-03-12 Thread Johan Corveleyn
On Mon, Mar 12, 2012 at 2:36 PM, Mark Phippard wrote: > On Mon, Mar 12, 2012 at 9:31 AM, Hyrum K Wright > wrote: > >> The primary issue when I looked at this problem was that the streamy >> abstraction is broken in several places, such as when we install the >> new pristine file.  There are also

Re: Compressed Pristines

2012-03-12 Thread Mark Phippard
On Mon, Mar 12, 2012 at 9:31 AM, Hyrum K Wright wrote: > The primary issue when I looked at this problem was that the streamy > abstraction is broken in several places, such as when we install the > new pristine file.  There are also certain consumers, such as a > external diff tools, that requir

Re: Compressed Pristines

2012-03-12 Thread Hyrum K Wright
On Mon, Mar 12, 2012 at 7:11 AM, Ashod Nakashian wrote: > - Original Message - > >> From: Philip Martin >> To: Ashod Nakashian >> Cc: Greg Stein ; "dev@subversion.apache.org" >> >> Sent: Monday, March 12, 2012 2:40 PM >> Subject: Re

Re: Compressed Pristines

2012-03-12 Thread Ashod Nakashian
- Original Message - > From: Philip Martin > To: Ashod Nakashian > Cc: Greg Stein ; "dev@subversion.apache.org" > > Sent: Monday, March 12, 2012 2:40 PM > Subject: Re: Compressed Pristines > > Ashod Nakashian writes: > >> * Are there a

Re: Compressed Pristines

2012-03-12 Thread Philip Martin
Ashod Nakashian writes: > * Are there any documentation/design/discussions on this feature that > I could study? There has been some discussion in the past on the dev list. I don't think it is written down anywhere else. > * Who should coordinate and be contacted on decision points? The dev l

Re: Compressed Pristines

2012-03-11 Thread Ashod Nakashian
Thanks Greg for the quick reply. See inline please. > > From: Greg Stein >To: Ashod Nakashian >Cc: dev@subversion.apache.org >Sent: Sunday, March 11, 2012 10:54 AM >Subject: Re: Compressed Pristines > > >To answer: no; nonexistent; y

Re: Compressed Pristines

2012-03-10 Thread Greg Stein
To answer: no; nonexistent; yes. :-) On Mar 10, 2012 11:59 PM, "Ashod Nakashian" wrote: > Hi All, > > I'm interested in the status of Compressed Pristines[1]. Is someone > working on it? Where are the latest patches (a branch?). Do we need another > hand to work on this feature? > > > [1] http:/