Hello
Well I have got to the bottom of it (sort of).
I have a shared IRQ - but this is not the problem
The controller is working, either with the LSI firmware 1.26 or the Sun
firmware 1.28. (no setup , no config , it just works)
All the drives are healthy, they are an odd mix of sizes and types - one is a
'green' drive. (Thanks to Roy for pointing me in this direction)
So I rebuilt the system as it used to be (working fine) and I get the same
errors. Which leaves the only other change I made as the problem , - I turned
on encryption!
Turn it off and all works well.
I still get the Illegal request errors (but the count is low):
(12 hrs, 600gb data write , constant scrub)
:~$ iostat -E | grep Illegal
Illegal Request: 12 Predictive Failure Analysis: 0
Illegal Request: 11 Predictive Failure Analysis: 0
Illegal Request: 10 Predictive Failure Analysis: 0
Illegal Request: 10 Predictive Failure Analysis: 0
Illegal Request: 10 Predictive Failure Analysis: 0
Illegal Request: 10 Predictive Failure Analysis: 0
Illegal Request: 0 Predictive Failure Analysis: 0
Illegal Request: 9 Predictive Failure Analysis: 0
Illegal Request: 9 Predictive Failure Analysis: 0
$
I rebuilt the system with the new controller , then new (additional) drives and
loaded it with data and scrubbed it (many times) - no errors.
(I used to get errors after a reboot with very little data, guaranteed. )
I am not sure why encryption is a problem but i suspect it has to do with the
drive mix. Anyone else had problems with encryption?
As I understand it , it is just like having another filter between your data
and disk so why it would create errors i have no idea.
I did wonder if encryption=on is just showing me errors that are there anyway
but I have done many a read/write/scrub/reboot and I dont get a single error.
The Illegal request count is very much lower so I wonder if my controllers
cannot deal with some command specific to encryption.
Which brings me back to the mix of drives, I did try creating a zfs vol for
each disk (encrypted) to see if it would highlight a problematic drive but they
all gave errors (using both controllers).
Solution: Turn encryption off (pity as I wanted to give it a go)
Regards
Steven
--
This message posted from opensolaris.org
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
