Re: Got a call at 4am - RAID Gurus Please Read

2014-12-12 Thread Barry Shein
That might be close enough. I need to set up a test system and play around with zfs and btrfs. Thanks. On December 11, 2014 at 21:29 mysi...@gmail.com (Jimmy Hess) wrote: > On Thu, Dec 11, 2014 at 9:05 PM, Barry Shein wrote: > [snip] > > From my reading the closest you can get to disk space

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-12 Thread Rob Seastrom
Jon Lewis writes: > OpenSolaris (or even Solaris 11), ZFS, Stable. Pick one. Maybe > two. Three? Yeah right. Anyone who's used it hard, under heavy load, > should understand. The most recent release of OpenSolaris was over 5 years ago. You're working from (extremely) dated information. Th

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Javier J
Hey guys, I am running it on freeBSD. (nas4free) It's my understanding that when a resilver happens in a zpool, only the data that has actually been written to the disks gets used, not the whole array like traditional raid5 does, reading even empty blocks. I know I should be using RAIDZ2 for this

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Jon Lewis
On Thu, 11 Dec 2014, Jimmy Hess wrote: I am not 100% certain that this is available under the BSD implementations, even if QUOTA is enabled in your kernel config. In the past the BSD implementation of ZFS never seemed to be as stable, functional, or performant as the OpenSolaris/Illumos ver

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Jimmy Hess
On Thu, Dec 11, 2014 at 9:05 PM, Barry Shein wrote: [snip] > From my reading the closest you can get to disk space quotas in ZFS is > by limiting on a per directory (dataset, mount) basis which is similar > but different. This is the normal type of quota within ZFS. it is applied to a dataset a

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Barry Shein
Disk space by uid (by group is a plus but not critical), like BSD and EXTn. And the reason I put "inode" in quotes was to indicate that they may not (certainly not) be called inodes but an upper limit to the total number of files and directories, typically to stop a runaway script or certain malic

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Jimmy Hess
As for conversion between RAID levels; usually dump and restore are your best bet. Even if your controller HBA supports a RAID level migration; for a small array hosted in a server, dump and restore is your least risky bet for successful execution; you really need to dump anyways, even on a co

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Rob Seastrom
Barry Shein writes: > From: Randy Bush >>> We are now using ZFS RAIDZ and the question I ask myself is, why >>> wasn't I using ZFS years ago? >> >>because it is not production on linux, which i have to use because >>freebsd does not have kvm/ganeti. want zfs very very badly. snif. > > I keep

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Barry Shein
From: Randy Bush >> We are now using ZFS RAIDZ and the question I ask myself is, why >> wasn't I using ZFS years ago? > >because it is not production on linux, which i have to use because >freebsd does not have kvm/ganeti. want zfs very very badly. snif. I keep reading zfs vs btrfs articles an

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Rob Seastrom
+1 on both. Mostly SmartOS, some FreeNAS (which is FreeBSD underneath). -r Ryan Brooks writes: > Zfs on BSD or a Solaris like OS > > >> On Dec 11, 2014, at 10:06 AM, Bacon Zombie wrote: >> >> Are you running ZFS and RAIDZ on Linux or BSD? >>> On 10 Dec 2014 23:21, "Javier J" wrote: >>> >>

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Ryan Brooks
Zfs on BSD or a Solaris like OS > On Dec 11, 2014, at 10:06 AM, Bacon Zombie wrote: > > Are you running ZFS and RAIDZ on Linux or BSD? >> On 10 Dec 2014 23:21, "Javier J" wrote: >> >> I'm just going to chime in here since I recently had to deal with bit-rot >> affecting a 6TB linux raid5 setu

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Bacon Zombie
Are you running ZFS and RAIDZ on Linux or BSD? On 10 Dec 2014 23:21, "Javier J" wrote: > I'm just going to chime in here since I recently had to deal with bit-rot > affecting a 6TB linux raid5 setup using mdadm (6x 1TB disks) > > We couldn't rebuild because of 5 URE sectors on one of the other di

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-11 Thread Rob Seastrom
Gary Buhrmaster writes: > There is always Illumos/OnmiOS/SmartOS > to consider (depending on your particular > requirements) which can do ZFS and KVM. 2.5-year SmartOS user here. Generally speaking pretty good though I have my list of gripes like everything else I touch. -r

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Randy Bush
zfs and ganeti -- Phones are not computers and suck for email On December 11, 2014 2:39:19 PM GMT+09:00, Gary Buhrmaster wrote: >On Thu, Dec 11, 2014 at 2:25 AM, Randy Bush wrote: >>> We are now using ZFS RAIDZ and the question I ask myself is, why >>> wasn't I using ZFS years ago? >> >> becau

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Gary Buhrmaster
On Thu, Dec 11, 2014 at 2:25 AM, Randy Bush wrote: >> We are now using ZFS RAIDZ and the question I ask myself is, why >> wasn't I using ZFS years ago? > > because it is not production on linux, Well, it depends on what you mean by "production". Certainly the ZFS on Linux group has said in some

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Randy Bush
> We are now using ZFS RAIDZ and the question I ask myself is, why > wasn't I using ZFS years ago? because it is not production on linux, which i have to use because freebsd does not have kvm/ganeti. want zfs very very badly. snif. randy

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Joe Greco
> I'm just going to chime in here since I recently had to deal with bit-rot > affecting a 6TB linux raid5 setup using mdadm (6x 1TB disks) > > We couldn't rebuild because of 5 URE sectors on one of the other disks in > the array after a power / ups issue rebooted our storage box. > > We are now u

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Javier J
I'm just going to chime in here since I recently had to deal with bit-rot affecting a 6TB linux raid5 setup using mdadm (6x 1TB disks) We couldn't rebuild because of 5 URE sectors on one of the other disks in the array after a power / ups issue rebooted our storage box. We are now using ZFS RAIDZ

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Rob Seastrom
The subject is drifting a bit but I'm going with the flow here: Seth Mos writes: > Raid10 is the only valid raid format these days. With the disks as big > as they get these days it's possible for silent corruption. How do you detect it? A man with two watches is never sure what time it is.

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Stuart Henderson
On 2014-12-09, symack wrote: > Server down. Got to colo at 4:39 and an old IBM X346 node with > Serveraid-7k has failed. Opened it up to find a swollen cache battery that > has bent the card in three different axis. > * Can I change from an active (ie, disks with data) raid 5 to raid 10. Eve

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-10 Thread Seth Mos
symack schreef op 9-12-2014 22:03: > * Can I change from an active (ie, disks with data) raid 5 to raid 10. > There are 4 drives Dump and restore. I've used Acronis succesfully in the past and today, they have a bootable ISO. Also, if you have the option, they have universal restore so you can res

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-09 Thread Allen McKinley Kitchen (gmail)
you just can't migrate from R5 to R10 > non-destructively. > > - Michael from Kitchener > Original Message > From: symack > Sent: Tuesday, December 9, 2014 16:04 > To: nanog@nanog.org > Subject: Got a call at 4am - RAID Gurus Please Read > > Server down

Re: Got a call at 4am - RAID Gurus Please Read

2014-12-09 Thread Michael Brown
Subject: Got a call at 4am - RAID Gurus Please Read Server down. Got to colo at 4:39 and an old IBM X346 node with Serveraid-7k has failed. Opened it up to find a swollen cache battery that has bent the card in three different axis. Separated the battery. (i) Inspect card and plug back in, (ii)

Got a call at 4am - RAID Gurus Please Read

2014-12-09 Thread symack
Server down. Got to colo at 4:39 and an old IBM X346 node with Serveraid-7k has failed. Opened it up to find a swollen cache battery that has bent the card in three different axis. Separated the battery. (i) Inspect card and plug back in, (ii) reboot, and got (code 2807) Not functioning Ret