Re: bhyve NVMe 1.4 support

2022-03-22 Thread Chuck Tuffli
It sounds like you might be hitting PR 260178: bhyve: passthru makes ahci-hd boot fail The jist is, direct block I/O will fail in combination with PCI pass-thru devices. See the proposed fix at https://reviews.freebsd.org/D34607 On Mon, Mar 21, 2022 at 4:18 AM Mario Marietto wrote: > > Just to

Re: bhyve NVMe 1.4 support

2022-03-21 Thread Mario Marietto
Just to inform you that I've passed through the M2 disk as a PCI device and now all the partitions inside the disk are correctly detected by Linux. Il giorno lun 21 mar 2022 alle ore 00:26 Mario Marietto < marietto2...@gmail.com> ha scritto: > if i want to boot any os installed physically on a di

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
if i want to boot any os installed physically on a disk,not matter what,it will not boot if i want also pass thru a disk or a graphic card. this is the reason why im trying to pass as much as disks i can using the -s slot. I see that the usb disks can be passed through using -s with the virtio-blk

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Bakul Shah
On Mar 20, 2022, at 3:11 PM, Mario Marietto wrote: > > -s 2,nvme,/dev/nvd0 \ AIUI, this 'nvme' means bhyve will *emulate* an NVME device and it will treat whatever is given to it (/dev/nvd0) as just dumb storage. It doesn't care if /dev/nvd0 is an NVME device. So commands such as nvmecontrol ide

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
I'm running on FreeBSD 14 : FreeBSD marietto 14.0-CURRENT FreeBSD 14.0-CURRENT #3 main-n253070-a30f71704ef: Thu Feb 10 12:33:57 CET 2022 marietto@marietto:/usr/obj/usr/src/amd64.amd64/sys/GENERIC a md64 and I see the same exact problem : root@marietto-BHYVE:~# fdisk -l Disk /dev/nvme0n1: 931,5

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Chuck Tuffli
On Sun, Mar 20, 2022 at 1:38 PM Mario Marietto wrote: > > FreeBSD 13.1-RELEASE is out ? Can I upgrade from 13-p8 to 13-1 with > freebsd-update fetch / freebsd-update install ? RELEASE isn't out, but BETA2 is available. So, # freebsd-update upgrade -r 13.1-BETA2 # freebsd-update install boot env

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
FreeBSD 13.1-RELEASE is out ? Can I upgrade from 13-p8 to 13-1 with freebsd-update fetch / freebsd-update install ? Il giorno dom 20 mar 2022 alle ore 21:04 Chuck Tuffli ha scritto: > On Sun, Mar 20, 2022 at 12:58 PM Mario Marietto > wrote: > > > > host : > > > > root@marietto:/usr/home/mariett

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Chuck Tuffli
On Sun, Mar 20, 2022 at 12:58 PM Mario Marietto wrote: > > host : > > root@marietto:/usr/home/marietto/bhyve # nvmecontrol identify nvme0ns1 | grep > "LBA Format" > > Number of LBA Formats: 1 > Current LBA Format: LBA Format #00 > LBA Format #00: Data Size: 512 Metadata Size:

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
host : root@marietto:/usr/home/marietto/bhyve # nvmecontrol identify nvme0ns1 | grep "LBA Format" Number of LBA Formats: 1 Current LBA Format: LBA Format #00 LBA Format #00: Data Size: 512 Metadata Size: 0 Performance: Best guest : root@marietto-BHYVE:/home/marietto# nvme

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Chuck Tuffli
On Sun, Mar 20, 2022 at 12:03 PM Mario Marietto wrote: > > on FreeBSD : > > root@marietto:/usr/home/marietto/bhyve # hd -n 256 /dev/nvd0 > On Ubuntu 21.10 : > > root@marietto-BHYVE:/home/marietto# hd -n 256 /dev/nvme0n1 Thank you. The outputs show the first 256 bytes of nvd0 and nvme0n1 match.

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
on FreeBSD : root@marietto:/usr/home/marietto/bhyve # hd -n 256 /dev/nvd0 33 c0 8e d0 bc 00 7c 8e c0 8e d8 be 00 7c bf 00 |3.|..|..| 0010 06 b9 00 02 fc f3 a4 50 68 1c 06 cb fb b9 04 00 |...Ph...| 0020 bd be 07 80 7e 00 00 7c 0b 0f 85 0e 01 83 c5 10 |

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Chuck Tuffli
On Sun, Mar 20, 2022 at 8:13 AM Mario Marietto wrote: > > > Help me understand what "not recognized" means. The device nvme0n1 : > > I don't see the partitions that are stored inside the disk nvme. And I'm not > able to mount the NTFS partition that's mapped as nvd0p2 under FreeBSD. Thank yo

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
How can I mount the whole disk ? like this ? (on freebsd) : bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \ -s 0,hostbridge \ -s 1,virtio-blk,/mnt/$vmdisk'p2'/bhyve/os/Linux/impish-cuda-11-5-nvidia-495.img \ -s 2,nvme,/dev/nvd0 \ -s 3,passthru,5/0/0 \ -s 4,passthru,1/0/0 \ -s 8,virtio-ne

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
> Help me understand what "not recognized" means. The device nvme0n1 : I don't see the partitions that are stored inside the disk nvme. And I'm not able to mount the NTFS partition that's mapped as nvd0p2 under FreeBSD. For example : bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Chuck Tuffli
On Sun, Mar 20, 2022 at 3:44 AM Mario Marietto wrote: ... > on the Ubuntu 21.10 guest os : > > mario@marietto-BHYVE:/home/marietto# fdisk -l > > Disk /dev/nvme0n1: 931,51 GiB, 1000204886016 bytes, 1953525168 sectors > Disk model: bhyve-NVMe > Units: sectors of 1 * 512 = 512 bytes > Sector size (lo

Re: bhyve NVMe 1.4 support

2022-03-20 Thread Mario Marietto
no mar 11 gen 2022 alle ore 04:01 ha scritto: > > -Original Message- > > From: Chuck Tuffli > > Sent: Tuesday, 11 January 2022 10:58 AM > > To: ja...@tubnor.net > > Cc: FreeBSD virtualization > > Subject: Re: bhyve NVMe 1.4 support > > > &

RE: bhyve NVMe 1.4 support

2022-01-10 Thread jason
> -Original Message- > From: Chuck Tuffli > Sent: Tuesday, 11 January 2022 10:58 AM > To: ja...@tubnor.net > Cc: FreeBSD virtualization > Subject: Re: bhyve NVMe 1.4 support > > On Wed, Jan 5, 2022 at 4:33 PM Chuck Tuffli wrote: > > > > O

Re: bhyve NVMe 1.4 support

2022-01-10 Thread Chuck Tuffli
On Wed, Jan 5, 2022 at 4:33 PM Chuck Tuffli wrote: > > On Mon, Jan 3, 2022 at 4:49 PM wrote: > > > > Hi Chuck, > > > > Testing on 14.0-CURRENT shows the following: > > > > OpenBSD 6.9 - NVMe read/write OK > > Windows 10 - NVMe read OK, write FAIL > > Windows Server 2022 - NVMe read OK, write FAIL

Re: bhyve NVMe 1.4 support

2022-01-05 Thread Chuck Tuffli
On Mon, Jan 3, 2022 at 4:49 PM wrote: > > Hi Chuck, > > Testing on 14.0-CURRENT shows the following: > > OpenBSD 6.9 - NVMe read/write OK > Windows 10 - NVMe read OK, write FAIL > Windows Server 2022 - NVMe read OK, write FAIL > Alma Linux 8.5 - NVMe read OK, write FAIL. Thanks for the report, Ja

RE: bhyve NVMe 1.4 support

2022-01-03 Thread jason
...@freebsd.org On Behalf Of Chuck Tuffli Sent: Wednesday, 8 December 2021 2:58 AM To: freebsd-virtualizat...@freebsd.org Subject: bhyve NVMe 1.4 support I've been working on a patch series to get bhyve's NVMe emulation compliant with the v1.4 specification. The compliance tests now pass,

Re: bhyve NVMe 1.4 support

2021-12-20 Thread Chuck Tuffli
On Sun, Dec 19, 2021 at 8:28 AM Mario Marietto wrote: > Hello. > > Can you gently write me the instructions here about how to apply your > patches and I will test everything on my Freebsd 13R. thanks. > I’m not sure the patches will apply cleanly to 13.0-RELEASE as the base bhyve configuration p

Re: bhyve NVMe 1.4 support

2021-12-19 Thread Mario Marietto
Hello. Can you gently write me the instructions here about how to apply your patches and I will test everything on my Freebsd 13R. thanks. Il giorno dom 19 dic 2021 alle ore 17:24 Chuck Tuffli ha scritto: > On Tue, Dec 7, 2021 at 7:58 AM Chuck Tuffli wrote: > > > > I've been working on a patch

Re: bhyve NVMe 1.4 support

2021-12-19 Thread Chuck Tuffli
On Tue, Dec 7, 2021 at 7:58 AM Chuck Tuffli wrote: > > I've been working on a patch series to get bhyve's NVMe emulation > compliant with the v1.4 specification. The compliance tests now pass, > and I will work on getting the patches up for review "soon". In the > meantime, there is a copy of the

bhyve NVMe 1.4 support

2021-12-07 Thread Chuck Tuffli
I've been working on a patch series to get bhyve's NVMe emulation compliant with the v1.4 specification. The compliance tests now pass, and I will work on getting the patches up for review "soon". In the meantime, there is a copy of the full changes if anyone is interested in testing on current or