Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-08 Thread Zhu Han
Neil, Thank you. You closed my question. :-) best regards, hanzhu On Mon, Dec 7, 2009 at 3:00 AM, Neil Perrin wrote: > > I'll try to find out whether ZFS binding the same file always to the same >> opening transaction group. >> > > Not sure what you mean by this. Transactions (eg writes) wil

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-07 Thread Damon Atkins
Because ZFS is transaction, (effectively preserves order), the rename trick will work. If you find the ".filename" delete create a new ".filename" and when finish writing rename it to "filename". If "filename" exists you no all writes were completed. If you have a batch system which looks for th

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-06 Thread Neil Perrin
I'll try to find out whether ZFS binding the same file always to the same opening transaction group. Not sure what you mean by this. Transactions (eg writes) will go into the current open transaction group (txg). Subsequent writes may enter the same or a future txg. Txgs are obviously committe

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-06 Thread Toby Thain
On 5-Dec-09, at 9:32 PM, nxyyt wrote: The "rename trick" may not work here. Even if I renamed the file successfully, the data of the file may still reside in the memory instead of flushing back to the disk. If I made any mistake here, please correct me. Thank you! I'll try to find out w

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread nxyyt
The "rename trick" may not work here. Even if I renamed the file successfully, the data of the file may still reside in the memory instead of flushing back to the disk. If I made any mistake here, please correct me. Thank you! I'll try to find out whether ZFS binding the same file always to the

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread Bob Friesenhahn
On Sat, 5 Dec 2009, Damon Atkins wrote: If power failure happens you will lose anything in cache. So you could lose the entire file on power failure if the system is not busy (ie ZFS does delay writes, unless you do a fsync before closing the file). I would still like to see a file system opt

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread Damon Atkins
If power failure happens you will lose anything in cache. So you could lose the entire file on power failure if the system is not busy (ie ZFS does delay writes, unless you do a fsync before closing the file). I would still like to see a file system option "sync on close" or even "wait for txg

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread Toby Thain
On 5-Dec-09, at 8:32 AM, nxyyt wrote: Thank you very much for your quick response. My question is I want to figure out whether there is data loss after power outage. I have replicas on other machines so I can recovery from the data loss. But I need a way to know whether there is data lo

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread Bob Friesenhahn
On Sat, 5 Dec 2009, Seth Heeren wrote: Yes. It is my understanding that (at least recent versions) will detect incomplete transactions and simply rollback to the last consistent uberblock in case of trouble. I'm not completely up to speed with regard to the ODF, Uberblocks and the ZIL; In my re

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread nxyyt
Thank you very much for your quick response. My question is I want to figure out whether there is data loss after power outage. I have replicas on other machines so I can recovery from the data loss. But I need a way to know whether there is data loss without comparing the different data repli

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread Seth Heeren
Yes. It is my understanding that (at least recent versions) will detect incomplete transactions and simply rollback to the last consistent uberblock in case of trouble. I'm not completely up to speed with regard to the ODF, Uberblocks and the ZIL; In my recollection the "inspection / selection" of

[zfs-discuss] Transaction consistency of ZFS

2009-12-05 Thread nxyyt
Hi, everybody, I'm a newbie to ZFS. I have a special question against the COW transaction of ZFS. Does ZFS keeps the sequential consistency when it meets power outage or server crash? Assume following scenario: My application has only a single thread and it appends the data to the file contin