Re: [zfs-discuss] Advanced format 4K bug in illumos? ( was: zfs-discuss] Advanced Format HDD's - are we there yet? ...)

Hello, While we are talking Advanced format, does anyone know if bugid 7021758 is a issue in illumos? Synopsis: zpool disk corruption detected on 4k block disks http://wesunsolve.net/bugid/id/7021758 Regards Henrik http://sparcv9.blogspot.com ___ zfs

[zfs-discuss] Pool faulted in a bad way

Hello, I have been asked to take a look at at poll on a old OSOL 2009.06 host. It have been left unattended for a long time and it was found in a FAULTED state. Two of the disks in the raildz2 pool seems to have failed, one have been replaced by a spare, the other one is UNAVAIL. The machine wa

Re: [zfs-discuss] S11 vs illumos zfs compatiblity

On Dec 27, 2011, at 9:20 PM, Frank Cusack wrote: > > > If I "upgrade" ZFS to use the new features in Solaris 11 I will be unable to > import my pool using the free ZFS implementation that is available in illumos > based d

[zfs-discuss] dskinfo utility

Hello, I got tired of gathering disk information from different places when working with Solaris disks so I wrote a small utility for summarizing the most commonly used information. It is especially tricky to work with a large set of SAN disks using MPxIO you do not even see the logical unit n

[zfs-discuss] Thin devices/reclamation with ZFS?

Hello, Does anyone here have experience or thoughts regarding the use of ZFS on thin devices? Since ZFS is COW it will not play nicly with this feature, it will spread it's blocks all over the space it has been given, and it has curently no way to get back in contact with the storage arrays to

Re: [zfs-discuss] Broadening of ZFS open source license

On May 11, 2010, at 10:29 PM, Hillel Lubman wrote: > In the article about MeeGo: > http://lwn.net/SubscriberLink/387196/103bbafc9266fd0d/ it is stated, that > Oracle (together with RedHat) contributes a bulk part of BTRFS development. > Given that ZFS and BTRFS both share many similar goals, w

Re: [zfs-discuss] dedupratio riddle

On 18 mar 2010, at 18.38, Craig Alder wrote: I remembered reading a post about this a couple of months back. This post by Jeff Bonwick confirms that the dedupratio is calculated only on the data that you've attempted to deduplicate, i.e. only the data written whilst dedup is turned on - h

Re: [zfs-discuss] dedupratio riddle

Hello, On 17 mar 2010, at 16.22, Paul van der Zwan wrote: On 16 mrt 2010, at 19:48, valrh...@gmail.com wrote: Someone correct me if I'm wrong, but it could just be a coincidence. That is, perhaps the data that you copied happens to lead to a dedup ratio relative to the data that's alr

Re: [zfs-discuss] why L2ARC device is used to store files ?

Hello, On Mar 6, 2010, at 6:02 PM, Andrey Kuzmin wrote: > This is purely tactical, to avoid l2arc write penalty on eviction. You seem > to have missed the very next paragraph: > >3644 * 2. The L2ARC attempts to cache data from the ARC before it is > evicted. >3645 * It does this by p

Re: [zfs-discuss] why L2ARC device is used to store files ?

Hello, On Mar 5, 2010, at 10:46 AM, Abdullah Al-Dahlawi wrote: > Greeting All > > I have create a pool that consists oh a hard disk and a ssd as a cache > > zpool create hdd c11t0d0p3 > zpool add hdd cache c8t0d0p0 - cache device > > I ran an OLTP bench mark to emulate a DMBS > > One I ra

[zfs-discuss] Fishworks 2010Q1 and dedup bug?

Hi all, Now that the Fishworks 2010.Q1 release seems to get deduplication, does anyone know if bugid: 6924824 (destroying a dedup-enabled dataset bricks system) is still valid, it has not been fixed in in onnv and it is not mentioned in the release notes. This is one of the bugs i've been keep

Re: [zfs-discuss] How to verify ecc for ram is active and enabled?

Hello, On 4 mar 2010, at 10.26, ace wrote: "A process will continually scrub the memory, and is capable of correcting any one error per 64-bit word of memory." at http://www.stringliterals.com/?tag=opensolaris. If this is true what is the process and how is it accessed? No, it's a kernel

Re: [zfs-discuss] Hardware for high-end ZFS NAS file server - 2010 March edition

Hello, On 4 mar 2010, at 11.11, Robert Milkowski wrote: On 04/03/2010 09:46, Dan Dascalescu wrote: Please recommend your up-to-date high-end hardware components for building a highly fault-tolerant ZFS NAS file server. 2x M5000 + 4x EMC DMX Sorry, I couldn't resist :) I would not r

Re: [zfs-discuss] Observations about compressability of metadata L2ARC

On Feb 21, 2010, at 6:40 PM, Andrey Kuzmin wrote: > I don't see why this couldn't be extended beyond metadata (+1 for the > idea): if zvol is compressed, ARC/L2ARC could store compressed data. > The gain is apparent: if user has compression enabled for the volume, > he/she expects volume's data t

Re: [zfs-discuss] flying ZFS pools

Hello, On Mar 1, 2010, at 11:57 PM, Ahmad AlTwaijiry wrote: > Hi everyone, > > I'm preparing around 6 Solaris physical servers and I want to see if > it's possible to create a zfs pool that I can make it as a shared pool > between all the 6 servers (not concurrent, just active-passive way) is >

Re: [zfs-discuss] More performance questions [on zfs over nfs]

On Feb 21, 2010, at 7:47 PM, Harry Putnam wrote: > > Working from a remote linux machine on a zfs fs that is an nfs mounted > share (set for nfs availability on zfs server, mounted nfs on linux); > I've been noticing a certain kind of sloth when messing with files. > > What I see: After writin

Re: [zfs-discuss] server hang with compression on, ping timeouts from remote machine

Hello Christo, On Jan 31, 2010, at 4:07 PM, Christo Kutrovsky wrote: > Hello All, > > I am running NTFS over iSCSI on a ZFS ZVOL volume with compression=gzip-9 and > blocksize=8K. The server is 2 core P4 3.0 Ghz with 5 GB of RAM. > > Whenever I start copying files from Windows onto the ZFS dis

[zfs-discuss] Removing large holey file does not free space 6792701 (still)

Hello,I mentioned this problem a year ago here and filed 6792701 and I know it has been discussed since. It should have been fixed in snv_118, but I can still trigger the same problem. This is only triggered if the creation of a large file is aborted, for example by loss of power,  crash or SIGINT

[zfs-discuss] Zpool is a bit Pessimistic at failures

Hello, Anyone else noticed that zpool is kind of negative when reporting back from some error conditions? Like: cannot import 'zpool01': I/O error Destroy and re-create the pool from a backup source. or even worse: cannot import 'rpool': pool already exists Destroy and

Re: [zfs-discuss] I/O Read starvation

Hello, On Jan 11, 2010, at 6:53 PM, bank kus wrote: >> For example, you could set it to half your (8GB) memory so that 4GB is >> immediately available for other uses. >> >> * Set maximum ZFS ARC size to 4GB > > capping max sounds like a good idea. Are we still trying to solve the starvation p

Re: [zfs-discuss] I/O Read starvation

Hello Bob, On Jan 10, 2010, at 4:54 PM, Bob Friesenhahn wrote: > On Sun, 10 Jan 2010, Phil Harman wrote: >> In performance terms, you'll probably find that block sizes beyond 128K add >> little benefit. So I'd suggest something like: >> >> dd if=/dev/urandom of=largefile.txt bs=128k count=65536

Re: [zfs-discuss] I/O Read starvation

Hello again, On Jan 10, 2010, at 5:39 AM, bank kus wrote: > Hi Henrik > I have 16GB Ram on my system on a lesser RAM system dd does cause problems as > I mentioned above. My __guess__ dd is probably sitting in some in memory > cache since du -sh doesnt show the full file size until I do a sync.

Re: [zfs-discuss] I/O Read starvation

On Jan 9, 2010, at 2:02 PM, bank kus wrote: >> Probably not, but ZFS only runs in userspace on Linux >> with fuse so it >> will be quite different. > > I wasnt clear in my description, I m referring to ext4 on Linux. In fact on a > system with low RAM even the dd command makes the system horri

Re: [zfs-discuss] I/O Read starvation

Henrik http://sparcv9.blogspot.com On 9 jan 2010, at 04.49, bank kus wrote: dd if=/dev/urandom of=largefile.txt bs=1G count=8 cp largefile.txt ./test/1.txt & cp largefile.txt ./test/2.txt & Thats it now the system is totally unusable after launching the two 8G copies. Until these copies

Re: [zfs-discuss] Solaris 10 and ZFS dedupe status

On Jan 5, 2010, at 4:38 PM, Bob Friesenhahn wrote: > On Mon, 4 Jan 2010, Tony Russell wrote: > >> I am under the impression that dedupe is still only in OpenSolaris and that >> support for dedupe is limited or non existent. Is this true? I would like >> to use ZFS and the dedupe capability t

Re: [zfs-discuss] Help on Mailing List

http://mail.opensolaris.org/pipermail/zfs-discuss/ Henrik http://sparcv9.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] best way to configure raidz groups

Hello, On Dec 30, 2009, at 2:08 PM, Thomas Burgess wrote: > I'm about to build a ZFS based NAS and i'd like some suggestions about how to > set up my drives. > > The case i'm using holds 20 hot swap drives, so i plan to use either 4 vdevs > with 5 drives or 5 vdevs with 4 drives each (and a ho

Re: [zfs-discuss] ZFS Dedupe reporting incorrect savings

Hello, On Dec 15, 2009, at 8:02 AM, Giridhar K R wrote: > Hi, > Created a zpool with 64k recordsize and enabled dedupe on it. > zpool create -O recordsize=64k TestPool device1 > zfs set dedup=on TestPool > > I copied files onto this pool over nfs from a windows client. > > Here is the output of

Re: [zfs-discuss] Space not freed?

Hello, On 14 dec 2009, at 14.16, Markus Kovero wrote: Hi, if someone running 129 could try this out, turn off compression in your pool, mkfile 10g /pool/file123, see used space and then remove the file and see if it makes used space available again. I’m having trouble with this, reminds m

Re: [zfs-discuss] scrub differs in execute time?

How do you do, On 13 nov 2009, at 11.07, Orvar Korvar wrote: I have a raidz2 and did a scrub, it took 8h. Then I reconnected some drives to other SATA ports, and now it takes 15h to scrub?? Why is that? Could you perhaps provid some more info? Which OSOL release? are the new disks ut

Re: [zfs-discuss] ARC cache and ls query

On Oct 30, 2009, at 10:20 PM, John wrote: thanks Henrik. This makes perfect sense. More questions. arc_meta_limit is set to a quarter of the ARC size. what is arc_meta_max ? On some systems, I have arc_meta_max > arc_meta_limit. Example: arc_meta_used = 29427 MB arc_meta_limit

Re: [zfs-discuss] ARC cache and ls query

Hello John, On Oct 30, 2009, at 9:03 PM, John wrote: Hi, On an idle server, when I do a recursive '/usr/bin/ls' on a folder, I see a lot of disk activity. This makes sense because the results (metadata/data) may not have been cached. When I do a second "ls" on the same folder right after t

Re: [zfs-discuss] sub-optimal ZFS performance

On Oct 29, 2009, at 5:23 PM, Bob Friesenhahn wrote: On Thu, 29 Oct 2009, Orvar Korvar wrote: So the solution is to never get more than 90% full disk space, för fan? Right. While UFS created artificial limits to keep the filesystem from getting so full that it became sluggish and "sick",

Re: [zfs-discuss] sub-optimal ZFS performance

On Oct 16, 2009, at 1:01 AM, Henrik Johansson wrote: My guess would be that this is due to fragmentation during some time when the filesystem might have been close to full, but it is still pretty terrible numbers even with 0.5M files in the structure. And while this is very bad I would

[zfs-discuss] sub-optimal ZFS performance

Hello, ZFS is behaving strange on a OSOL laptop, your thoughts are welcome. I am running OSOL on my laptop, currently b124 and i found that the performance of ZFS is not optimal in all situations. If i check the how much space the package cache for pkg(1) uses, it takes a bit longer on thi

Re: [zfs-discuss] Hot Spares spin down?

Hi there, On Oct 8, 2009, at 9:46 PM, bjbm wrote: Sorry if this is a noob question but I can't seem to find this info anywhere. Are hot spares generally spunned down until they are needed? No, but have a look at power.conf(4) and the device-thresholds keyword to spin down disks. Here i

[zfs-discuss] KCA ZFS keynote available

Hello everybody, The KCA ZFS keynote by Jeff and Bill seems to be available online now: http://blogs.sun.com/video/entry/kernel_conference_australia_2009_jeff It should probably be mentioned here, i might have missed it. Regards Henrik http://sparcv9.blogspot.com

[zfs-discuss] Error recovery with replicated metadata

Hello all, I have managed to get my hands on a OSOL 2009.06 root disk which has three failed blocks on it, these three blocks makes it impossible to boot from the disk and to import the disk to on another machine. I have checked the disk and three blocks are inaccessible, quite close to e

Re: [zfs-discuss] Raid-Z Issue

On Sep 11, 2009, at 10:41 PM, Frank Middleton wrote: On 09/11/09 03:20 PM, Brandon Mercer wrote: They are so well known that simply by asking if you were using them suggests that they suck. :) There are actually pretty hit or miss issues with all 1.5TB drives but that particular manufacture

Re: [zfs-discuss] Why is Solaris 10 ZFS performance so terrible?

Hello Rich, On Sep 10, 2009, at 9:12 PM, Rich Morris wrote: On 07/28/09 17:13, Rich Morris wrote: On Mon, Jul 20, 2009 at 7:52 PM, Bob Friesenhahn wrote: Sun has opened internal CR 6859997. It is now in Dispatched state at High priority. CR 6859997 has recently been fixed in Nevada. Thi

Re: [zfs-discuss] b122 and "fake checksum errors"

Hello Brian, On Sep 10, 2009, at 9:21 PM, Brian Hechinger wrote: I've hit google and it looks like this is still an issue in b122. Does this look like it will be fixed any time soon? If so, what build will it be fixed in and is there an ETA for the build to be "released"? Adam has inte

Re: [zfs-discuss] This is the scrub that never ends...

Hello Will, On Sep 7, 2009, at 3:42 PM, Will Murnane wrote: What can cause this kind of behavior, and how can I make my pool finish scrubbing? No idea what is causing this but did you try to stop the scrub? If so what happened? (Might not be a good idea since this is not a normal state?

Re: [zfs-discuss] Expanding a raidz pool?

On Sep 2, 2009, at 7:14 PM, rarok wrote: I'm just a casual at ZFS but you want something that now don't exists. The most of the consumers want this but Sun is not interested in that market. To grow a existing RAIDZ just adding more disk to the RAIDZ would be great but at this moment there i

Re: [zfs-discuss] snv_110 -> snv_121 produces checksum errors on Raid-Z pool

Hello all, I have backed down to snv_117, when scrubbing this pool i got my first checksum errors ever on any build except snv_121. I wonder if this is a coincidence or if bad checksums have been generated by snv_121? So i have been running for 10 months without any checksum errors, i ins

Re: [zfs-discuss] snv_110 -> snv_121 produces checksum errors on Raid-Z pool

Hi Adam, On Sep 2, 2009, at 1:54 AM, Adam Leventhal wrote: Hi James, After investigating this problem a bit I'd suggest avoiding deploying RAID-Z until this issue is resolved. I anticipate having it fixed in build 124. For those of us which have already upgraded and written data to our

Re: [zfs-discuss] snv_110 -> snv_121 produces checksum errors on Raid-Z pool

Hello, On 25 aug 2009, at 14.29, Gary Gendel wrote: I have a 5-500GB disk Raid-Z pool that has been producing checksum errors right after upgrading SXCE to build 121. They seem to be randomly occurring on all 5 disks, so it doesn't look like a disk failure situation. Repeatingly runnin

Re: [zfs-discuss] Shrinking a zpool?

On 6 aug 2009, at 23.52, Bob Friesenhahn wrote: I still have not seen any formal announcement from Sun regarding deduplication. Everything has been based on remarks from code developers. To be fair, the official "what's new" document for 2009.06 states that dedup will be part of the

Re: [zfs-discuss] No files but pool is full?

On 24 jul 2009, at 09.33, Markus Kovero wrote: During our tests we noticed very disturbing behavior, what would be causing this? System is running latest stable opensolaris. Any other means to remove ghost files rather than destroying pool and restoring from backups? This looks like bu

Re: [zfs-discuss] prstat -Z and load average values in different zones give same numeric results

poolstat(1M). Hope this helps. Regards Henrik Johansson http://sparcv9.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] zfs-crypto on OpenSolaris 2009.06?

So onnv_111 is no longer the target for crypto integration since that build is supposed to be included in osol 2009.06? Regards Henrik On 5 mar 2009, at 11.06, Darren J Moffat wrote: Luca Morettoni wrote: A lot of people ask me about crypto layer over ZFS and the future integration in

Re: [zfs-discuss] ZFS on SAN?

DKIOCFLUSHWRITECACHE is honored by the array? If it is a problem, will the worst case scenario be at least on pair with UFS/VxFS when 6667683 is fixed? Grateful for any additional information. Regards Henrik Johansson http://sparcv9.blogspot.com

Re: [zfs-discuss] Two zvol devices one volume?

Thanks for the info Dave, I filed a bug on this: 6805659. Regards Henrik On Feb 13, 2009, at 1:30 AM, Dave wrote: Henrik Johansson wrote: I tried to export the zpool also, and I got this, the strange part is that it sometimes still thinks that the ubuntu-01-dsk01 dataset exists: # zpool

Re: [zfs-discuss] Two zvol devices one volume?

ice busy But: # zfs destroy zpool01/xvm/dsk/ubuntu-01-dsk01 cannot open 'zpool01/xvm/dsk/ubuntu-01-dsk01': dataset does not exist Regards On Feb 12, 2009, at 11:51 PM, Henrik Johansson wrote: Hi, Can anyone explain the following to me? Two zpool devices points at the same data, I wa

[zfs-discuss] Two zvol devices one volume?

-a SunOS ollespappa 5.11 snv_107 i86pc i386 i86xpv While I am writing, is there any known issues with sharemgr and zfs in this release? svc:/network/shares/group:zfs hangs when going down since sharemgr stop zfs never returns... Thanks Henrik Johansson http://sparcv9.blo

Re: [zfs-discuss] Best SXCE version for ZFS Home Server

for the release at docs.sun.com. Henrik Johansson http://sparcv9.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Lost space in empty pool (no snapshots)

264 bonus ZFS znode path??? uid 0 gid 0 atime Sun Nov 16 01:13:12 2008 mtime Sun Nov 16 01:14:07 2008 ctime Sun Nov 16 01:14:07 2008 crtime Sun Nov 16 01:13:12 2008 gen 16 mode100600

Re: [zfs-discuss] Still more questions WRT selecting a mobo for small ZFS RAID

ms stated that it did not work, so I bought an Intel card for it also. Henrik Johansson http://sparcv9.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Still more questions WRT selecting a mobo for small ZFS RAID

GA-EP45 boards? Nether of them support ECC-memory. > > > Many thanks in advance! > -- > This message posted from opensolaris.org > ___ > zfs-discuss mailing list > zfs-discuss@opensolaris.org > http://mail.opensolaris.org/mailm

Re: [zfs-discuss] OpenStorage GUI

rocedure must be usable to move the image to other virtualization software, once bootet it's only ordinary block devices... Regards Henrik Johansson http://sparcv9.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Lost space in empty pool (no snapshots)

On Nov 11, 2008, at 1:56 AM, Victor Latushkin wrote: > Henrik Johansson wrote: >> Hello, >> I have a snv101 machine with a three disk raidz pool which >> allocation of about 1TB with for no obvious reason, no snapshot, >> no files, nothing. I tried to run zdb

[zfs-discuss] Lost space in empty pool (no snapshots)

- default tank delegation on default tank autoreplace off default tank cachefile - default tank failmode waitdefault tank listsnapshots off default Regards Henrik Johansson http://sparcv9.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

[zfs-discuss] Fully supported 12-port SATA cards?

river supporting hot plugging/cfgadm- operations? The HCL does not tell you everything, and scanning the lists did not show any consensus regarding this. This seems to have been a problem for years, I tried to find a card for myself a while back. Henrik Johansson http://sparcv9.blogspo

[zfs-discuss] Disks errors not shown by zpool?

Ok, this is not a OpenSolaris question, but it is a Solaris and ZFS question. I have a pool with three mirrored vdevs. I just got an error message from FMD that read failed from one on the disks,(c1t6d0). All with instructions on how to handle the problem and replace the devices, so far ev

Re: [zfs-discuss] ZFS root finally here in SNV90

On Jun 5, 2008, at 5:09 AM, Bob Friesenhahn wrote: > On Wed, 4 Jun 2008, Henrik Johansson wrote: >> >> Anyone knows what the deal with /export/home is? I though /home was >> the default home directory in Solaris? > > It seems that they expect you to use the automo

Re: [zfs-discuss] ZFS root finally here in SNV90

On Jun 5, 2008, at 12:05 AM, Rich Teer wrote: > On Wed, 4 Jun 2008, Henrik Johansson wrote: > >> Anyone knows what the deal with /export/home is? I though /home was >> the default home directory in Solaris? > > Nope, /export/home has always been the *physical* lo

[zfs-discuss] ZFS root finally here in SNV90

Works great! Even tested to create boot environments with live upgrade, fast, easy and elegant! Anyone knows what the deal with /export/home is? I though /home was the default home directory in Solaris? ( I put up some screenshots of the installation process for those interested: http://s