> On 21 Jun 2018, at 09:00, KIRIYAMA Kazuhiko <k...@kx.openedu.org> wrote:
> 
> At Wed, 20 Jun 2018 23:34:48 -0400,
> Allan Jude wrote:
>> 
>> On 2018-06-20 21:36, KIRIYAMA Kazuhiko wrote:
>>> Hi all,
>>> 
>>> I've been reported ZFS boot disable problem [1], and found
>>> that this issue occers form RAID configuration [2]. So I
>>> rebuit with RAID5 and re-installed 12.0-CURRENT
>>> (r333982). But failed to boot with:
>>> 
>>> ZFS: i/o error - all block copies unavailable
>>> ZFS: can't read MOS of pool zroot
>>> gptzfsboot: failed to mount default pool zroot
>>> 
>>> FreeBSD/x86 boot
>>> ZFS: I/O error - blocks larger than 16777216 are not supported
>>> ZFS: can't find dataset u
>>> Default: zroot/<0x0>:
>>> 
>>> In this case, the reason is "blocks larger than 16777216 are
>>> not supported" and I guess this means datasets that have
>>> recordsize greater than 8GB is NOT supported by the
>>> FreeBSD boot loader(zpool-features(7)). Is that true ?
>>> 
>>> My zpool featues are as follows:
>>> 
>>> # kldload zfs
>>> # zpool import 
>>>   pool: zroot
>>>     id: 13407092850382881815
>>>  state: ONLINE
>>> status: The pool was last accessed by another system.
>>> action: The pool can be imported using its name or numeric identifier and
>>>        the '-f' flag.
>>>   see: http://illumos.org/msg/ZFS-8000-EY
>>> config:
>>> 
>>>        zroot       ONLINE
>>>          mfid0p3   ONLINE
>>> # zpool import -fR /mnt zroot
>>> # zpool list
>>> NAME    SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
>>> zroot  19.9T   129G  19.7T         -     0%     0%  1.00x  ONLINE  /mnt
>>> # zpool get all zroot
>>> NAME   PROPERTY                                  VALUE                      
>>>                SOURCE
>>> zroot  size                                      19.9T                      
>>>                -
>>> zroot  capacity                                  0%                         
>>>                -
>>> zroot  altroot                                   /mnt                       
>>>                local
>>> zroot  health                                    ONLINE                     
>>>                -
>>> zroot  guid                                      13407092850382881815       
>>>                default
>>> zroot  version                                   -                          
>>>                default
>>> zroot  bootfs                                    zroot/ROOT/default         
>>>                local
>>> zroot  delegation                                on                         
>>>                default
>>> zroot  autoreplace                               off                        
>>>                default
>>> zroot  cachefile                                 none                       
>>>                local
>>> zroot  failmode                                  wait                       
>>>                default
>>> zroot  listsnapshots                             off                        
>>>                default
>>> zroot  autoexpand                                off                        
>>>                default
>>> zroot  dedupditto                                0                          
>>>                default
>>> zroot  dedupratio                                1.00x                      
>>>                -
>>> zroot  free                                      19.7T                      
>>>                -
>>> zroot  allocated                                 129G                       
>>>                -
>>> zroot  readonly                                  off                        
>>>                -
>>> zroot  comment                                   -                          
>>>                default
>>> zroot  expandsize                                -                          
>>>                -
>>> zroot  freeing                                   0                          
>>>                default
>>> zroot  fragmentation                             0%                         
>>>                -
>>> zroot  leaked                                    0                          
>>>                default
>>> zroot  feature@async_destroy                     enabled                    
>>>                local
>>> zroot  feature@empty_bpobj                       active                     
>>>                local
>>> zroot  feature@lz4_compress                      active                     
>>>                local
>>> zroot  feature@multi_vdev_crash_dump             enabled                    
>>>                local
>>> zroot  feature@spacemap_histogram                active                     
>>>                local
>>> zroot  feature@enabled_txg                       active                     
>>>                local
>>> zroot  feature@hole_birth                        active                     
>>>                local
>>> zroot  feature@extensible_dataset                enabled                    
>>>                local
>>> zroot  feature@embedded_data                     active                     
>>>                local
>>> zroot  feature@bookmarks                         enabled                    
>>>                local
>>> zroot  feature@filesystem_limits                 enabled                    
>>>                local
>>> zroot  feature@large_blocks                      enabled                    
>>>                local
>>> zroot  feature@sha512                            enabled                    
>>>                local
>>> zroot  feature@skein                             enabled                    
>>>                local
>>> zroot  unsupported@com.delphix:device_removal    inactive                   
>>>                local
>>> zroot  unsupported@com.delphix:obsolete_counts   inactive                   
>>>                local
>>> zroot  unsupported@com.delphix:zpool_checkpoint  inactive                   
>>>                local
>>> # 
>>> 
>>> Regards
>>> 
>>> [1] 
>>> https://lists.freebsd.org/pipermail/freebsd-current/2018-March/068886.html
>>> [2] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=151910
>>> 
>>> ---
>>> KIRIYAMA Kazuhiko
>>> _______________________________________________
>>> freebsd-current@freebsd.org mailing list
>>> https://lists.freebsd.org/mailman/listinfo/freebsd-current
>>> To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"
>>> 
>> 
>> I am guessing it means something is corrupt, as 16MB is the maximum size
>> of a record in ZFS. Also, the 'large_blocks' feature is 'enabled', not
>> 'active', so this suggest you do not have any records larger than 128kb
>> on your pool.
> 
> As I mentioned above, [2] says ZFS on RAID disks have any
> serious bugs except for mirror. Anyway I gave up to use ZFS
> on RAID{5,6}* until Bug 151910 [2] fixed.
> 

if you boot from usb stick (or cd), press esc at boot loader menu and enter 
lsdev -v. what sector and disk sizes are reported?

the issue [2] is mix of ancient freebsd (v 8.1 is mentioned there), and RAID 
luns with 512B sector size and 15TB!!! total size - are you really sure your 
BIOS can actually address 15TB lun (with 512B sector size)? Note that the 
problem with large disks can hide itself till you have pool filled up enough 
till the essential files will be stored above the  limit… meaning that you may 
have “perfectly working” setup till at some point in time, after next update, 
it is suddenly not working any more.

Note that for boot loader we have only INT13h for BIOS version, and it really 
is limited. The UEFI version is using EFI_BLOCK_IO API, which usually can 
handle large sectors and disk sizes better.

rgds,
toomas

_______________________________________________
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Reply via email to