[zfs-discuss] Resilver/scrub times?

2009-11-22 Thread Colin Raven
Hi all! I've decided to take the "big jump" and build a ZFS home filer (although it might also do "other work" like caching DNS, mail, usenet, bittorent and so forth). YAY! I wonder if anyone can shed some light on how long a pool scrub would take on a fairly decent rig. These are the specs as-orde

[zfs-discuss] Dedup question

2009-11-23 Thread Colin Raven
Folks, I've been reading Jeff Bonwick's fascinating dedup post. This is going to sound like either the dumbest or the most obvious question ever asked, but, if you don't know and can't produce meaningful RTFM resultsask...so here goes: Assuming you have a dataset in a zfs pool that's been dedu

Re: [zfs-discuss] ZFS dedup issue

2009-12-02 Thread Colin Raven
Hey Cindy! Any idea of when we might see 129? (an approximation only). I ask the question because I'm pulling budget funds to build a filer, but it may not be in service until mid-January. Would it be reasonable to say that we might see 129 by then, or are we looking at summer...or even beyond? I

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Colin Raven
On Sat, Dec 5, 2009 at 17:17, Richard Elling wrote: > On Dec 4, 2009, at 4:11 PM, Edward Ned Harvey wrote: > > Depending of your version of OS, I think the following post from Richard >>> Elling >>> will be of great interest to you: >>> - >>> >>> http://richardelling.blogspot.com/2009/10/check-in

[zfs-discuss] Deduplication - deleting the original

2009-12-08 Thread Colin Raven
In reading this blog post: http://blogs.sun.com/bobn/entry/taking_zfs_deduplication_for_a a question came to mind. To understand the context of the question, consider the opening paragraph from the above post; Here is my test case: I have 2 directories of photos, totaling about 90MB > each. An

Re: [zfs-discuss] Deduplication - deleting the original

2009-12-08 Thread Colin Raven
On Tue, Dec 8, 2009 at 22:54, Jeff Bonwick wrote: > > i am no pro in zfs, but to my understanding there is no original. > > That is correct. From a semantic perspective, there is no change > in behavior between dedup=off and dedup=on. Even the accounting > remains the same: each reference to a

Re: [zfs-discuss] will deduplication know about old blocks?

2009-12-09 Thread Colin Raven
Adam, So therefore, the best way is to set this at pool creation timeOK, that makes sense, it operates only on fresh data that's coming over the fence. BUT What happens if you snapshot, send, destroy, recreate (with dedup on this time around) and then write the contents of the cloned snapshot t

Re: [zfs-discuss] force 4k writes

2009-12-17 Thread Colin Raven
On Thu, Dec 17, 2009 at 09:14, Eric D. Mudama wrote: > On Wed, Dec 16 at 7:35, Bill Sprouse wrote: > >> The question behind the question is, given the really bad things that can >> happen performance-wise with writes that are not 4k aligned when using flash >> devices, is there any way to insure

Re: [zfs-discuss] How do I determine dedupe effectiveness?

2009-12-19 Thread Colin Raven
On Sat, Dec 19, 2009 at 05:25, Ian Collins wrote: > Stacy Maydew wrote: > >> The commands "zpool list" and "zpool get dedup " both show a ratio >> of 1.10. >> So thanks for that answer. I'm a bit confused though if the dedup is >> applied per zfs filesystem, not zpool, why can I only see the ded

Re: [zfs-discuss] How do I determine dedupe effectiveness?

2009-12-19 Thread Colin Raven
On Sat, Dec 19, 2009 at 17:20, Bob Friesenhahn wrote: > On Sat, 19 Dec 2009, Colin Raven wrote: > >> >> There is no original, there is no copy. There is one block with reference >> counters. >> >> - Fred can rm his "file" (because clearly it i

Re: [zfs-discuss] How do I determine dedupe effectiveness?

2009-12-19 Thread Colin Raven
On Sat, Dec 19, 2009 at 19:08, Toby Thain wrote: > > On 19-Dec-09, at 11:34 AM, Colin Raven wrote > > Then again (not sure how gurus feel on this point) but I have this probably > naive and foolish belief that snapshots (mostly) oughtta reside on a > separate physi

Re: [zfs-discuss] How do I determine dedupe effectiveness?

2009-12-20 Thread Colin Raven
On Sun, Dec 20, 2009 at 16:23, Nick wrote: > > IMHO, snapshots are not a replacement for backups. Backups should > definitely reside outside the system, so that if you lose your entire array, > SAN, controller, etc., you can recover somewhere else. Snapshots, on the > other hand, give you the a

[zfs-discuss] zfs pool Configuration "calculator"?

2009-12-24 Thread Colin Raven
Does anyone know if a zfs "pool configuration calculator" (for want of a better term) exists? Reason for the question: We're looking at building a configuration which has some hard limits (case size for one). It's a collaborative project, and not everyone resides in the same place (or timezone ev

Re: [zfs-discuss] Can I destroy a Zpool without importing it?

2009-12-27 Thread Colin Raven
Are there any negative consequences as a result of a force import? I mean STUNT; "Sudden Totally Unexpected and Nasty Things" -Me On Sun, Dec 27, 2009 at 17:55, Sriram Narayanan wrote: > opensolaris has a newer version of ZFS than Solaris. What you have is > a pool that was not marked as exporte

Re: [zfs-discuss] ZFS pool unusable after attempting to destroy a dataset with dedup enabled

2010-01-02 Thread Colin Raven
On Sat, Jan 2, 2010 at 13:10, Markus Kovero wrote: > If pool isnt rpool you might to want to boot into singleuser mode (-s after > kernel parameters on boot) remove /etc/zfs/zpool.cache and then reboot. > after that you can merely ssh into box and watch iostat while import. > Wow, it's utterly p

[zfs-discuss] ZFS Defragmentation - will it happen?

2010-01-23 Thread Colin Raven
Can anyone comment on the likelihood of zfs defrag becoming a reality some day? If so, any approximation as to when? I realize this isn't exactly a trivial endeavor, but it sure would be nice to see. ___ zfs-discuss mailing list zfs-discuss@opensolaris.or

Re: [zfs-discuss] Best 1.5TB drives for consumer RAID?

2010-01-24 Thread Colin Raven
On Sun, Jan 24, 2010 at 08:36, Erik Trimble wrote: > These days, I've switched to 2.5" SATA laptop drives for large-storage > requirements. > They're going to cost more $/GB than 3.5" drives, but they're still not > horrible ($100 for a 500GB/7200rpm Seagate Momentus). They're also easier > to c

Re: [zfs-discuss] Best 1.5TB drives for consumer RAID?

2010-01-24 Thread Colin Raven
On Sun, Jan 24, 2010 at 19:34, Toby Thain wrote: > > On 24-Jan-10, at 11:26 AM, R.G. Keen wrote: > > ... >> >> I’ll just blather a bit. The most durable data backup medium humans have >> come up with was invented about 4000-6000 years ago. It’s fired cuniform >> tablets as used in the Middle Eas

Re: [zfs-discuss] ZFS on SAN?

2009-02-15 Thread Colin Raven
On Sun, Feb 15, 2009 at 5:00 PM, Bob Friesenhahn < bfrie...@simple.dallas.tx.us> wrote: > On Sun, 15 Feb 2009, Robert Milkowski wrote: > >> >> Well, in most cases resilver in ZFS should be quicker than resilver in >> a disk array because ZFS will resilver only blocks which are actually >> in use w

Re: [zfs-discuss] ZFS on SAN?

2009-02-15 Thread Colin Raven
On Sun, Feb 15, 2009 at 8:02 PM, Bob Friesenhahn < bfrie...@simple.dallas.tx.us> wrote: > On Sun, 15 Feb 2009, Colin Raven wrote: > >> >> Pardon me for jumping into this discussion. I invariably lurk and keep >> mouth >> firmly shut. In this case however, cur

Re: [zfs-discuss] The ZFS inventor and Linus sitting in a tree?

2008-05-19 Thread Colin Raven
On Mon, May 19, 2008 at 10:06 PM, Bill McGonigle <[EMAIL PROTECTED]> wrote: > On May 18, 2008, at 14:01, Mario Goebbels wrote: > >> I mean, if the Linux folks to want it, fine. But if Sun's actually >> helping with such a possible effort, then it's just shooting itself in >> the foot here, in my op