[Qemu-discuss] Converting qcow2 image to raw thin lv

2017-02-10 Thread Nir Soffer
Hi all, I'm trying to convert images (mostly qcow2) to raw format on thin lv, hoping to write only the allocated blocks on the thin lv, but it seems that qemu-img cannot write sparse image on a block device. Here is an example: Create a new thin lv: # lvcreate --name raw-test --virtualsize 20g

Re: [Qemu-discuss] Converting qcow2 image to raw thin lv

2017-02-11 Thread Nir Soffer
On Sat, Feb 11, 2017 at 12:23 AM, Nir Soffer wrote: > Hi all, > > I'm trying to convert images (mostly qcow2) to raw format on thin lv, > hoping to write only the allocated blocks on the thin lv, but > it seems that qemu-img cannot write sparse image on a block > device.

Re: [Qemu-discuss] [Qemu-devel] Estimation of qcow2 image size converted from raw image

2017-02-15 Thread Nir Soffer
On Wed, Feb 15, 2017 at 5:14 PM, Stefan Hajnoczi wrote: > On Mon, Feb 13, 2017 at 05:46:19PM +0200, Maor Lipchuk wrote: >> I was wondering if that is possible to provide a new API that >> estimates the size of >> qcow2 image converted from a raw image. We could use this new API to >> allocate the

Re: [Qemu-discuss] [Qemu-devel] Estimation of qcow2 image size converted from raw image

2017-02-15 Thread Nir Soffer
On Wed, Feb 15, 2017 at 5:20 PM, Daniel P. Berrange wrote: > On Wed, Feb 15, 2017 at 03:14:19PM +, Stefan Hajnoczi wrote: >> On Mon, Feb 13, 2017 at 05:46:19PM +0200, Maor Lipchuk wrote: >> > I was wondering if that is possible to provide a new API that >> > estimates the size of >> > qcow2 im

Re: [Qemu-discuss] [Qemu-devel] Supporting unsafe create when backing file is not accessible

2017-07-14 Thread Nir Soffer
On Wed, Jul 12, 2017 at 5:40 PM Eric Blake wrote: > On 07/12/2017 03:56 AM, Ala Hino wrote: > > Hi, > > > > We encountered a performance issue when creating a volume for a running > VM > > and we'd like to share the info with you. The root cause of the issue is > in > > our code but we found a wo

Re: [Qemu-discuss] qemu-img convert stuck

2018-04-08 Thread Nir Soffer
On Sun, Apr 8, 2018 at 9:27 PM Benny Zlotnik wrote: > Hi, > > As part of copy operation initiated by rhev got stuck for more than a day > and consumes plenty of CPU > vdsm 13024 3117 99 Apr07 ?1-06:58:43 /usr/bin/qemu-img convert > -p -t none -T none -f qcow2 > > /rhev/data-center/bb

[Qemu-discuss] Converting qcow2 image on the fly to raw format

2018-07-09 Thread Nir Soffer
We are discussing importing VM images to KubVirt. The goal is to be able to import an existing qcow2 disk, probably some appliance stored on http server, and and convert it to raw format for writing to storage. This can be also useful for for oVirt for importing OVA, since we like to pack disks in

Re: [Qemu-discuss] Converting qcow2 image on the fly to raw format

2018-07-09 Thread Nir Soffer
On Mon, Jul 9, 2018 at 8:06 PM Richard W.M. Jones wrote: > On Mon, Jul 09, 2018 at 07:02:50PM +0200, Kevin Wolf wrote: > > Am 09.07.2018 um 18:52 hat Richard W.M. Jones geschrieben: > > > On Mon, Jul 09, 2018 at 07:38:05PM +0300, Nir Soffer wrote: > > > > We are dis

Re: [Qemu-discuss] [kubevirt-dev] Re: Converting qcow2 image on the fly to raw format

2018-07-19 Thread Nir Soffer
On Mon, Jul 16, 2018 at 11:56 AM Daniel P. Berrangé wrote: > On Wed, Jul 11, 2018 at 02:17:18PM +0300, Adam Litke wrote: > > Adding some kubevirt developers to the thread. Thanks guys for the > > information! I think this could work perfectly for on the fly conversion > > of qcow2 images to raw

Re: [Qemu-discuss] [kubevirt-dev] Re: Converting qcow2 image on the fly to raw format

2018-07-19 Thread Nir Soffer
On Mon, Jul 16, 2018 at 11:56 AM Daniel P. Berrangé wrote: ... > Recommendation is to run 'qemu-img info' to extract the metadata and sanity > check results eg no backing file list, not unreasonable size, etc. When > running 'qemu-img info' apply process limits of 30 secs CPU time, and 1 GB > add

Re: [Qemu-discuss] [kubevirt-dev] Re: Converting qcow2 image on the fly to raw format

2018-07-19 Thread Nir Soffer
On Thu, Jul 19, 2018 at 10:24 PM Richard W.M. Jones wrote: > On Thu, Jul 19, 2018 at 09:50:00PM +0300, Nir Soffer wrote: > > On Mon, Jul 16, 2018 at 11:56 AM Daniel P. Berrangé > > > wrote: > > ... > > > > > Recommendation is to run 'qemu-im

Re: [Qemu-discuss] [kubevirt-dev] Re: Converting qcow2 image on the fly to raw format

2018-07-19 Thread Nir Soffer
On Thu, Jul 19, 2018 at 10:27 PM Richard W.M. Jones wrote: > > This is the code in libguestfs if you prefer something in C: > > > https://github.com/libguestfs/libguestfs/blob/3a87c4bb441430c9cef9223e67d10bf51a4e865c/lib/info.c#L150-L160 I see that libguestfs is using 10 seconds limit: https://

Re: [Qemu-discuss] [ovirt-users] VirtIO in new upgraded 4.2.5 for FreeBSD is very poor (could not use)

2018-08-07 Thread Nir Soffer
On Sun, Aug 5, 2018 at 1:40 PM Paul.LKW wrote: > Dear All: > I just upgraded my oVIrt-4.2.4 to 4.2.5 and nightmare begin, FreeBSD VMs > hangs once the VM's VirtIO harddisk is some loading (eg. extracting a > big tar ball, portsnap extract, etc.), I tried to create a VMs using > back the IDE do no

Re: [Qemu-discuss] [ovirt-devel] Query regarding copying and executing files inside guest OS

2019-02-21 Thread Nir Soffer
On Thu, Feb 21, 2019 at 2:42 PM Pravin Amin wrote: > Hi, > > > > We are looking for a way to copy files and execute scripts inside Virtual > Machines hosted on oVirt manager (Any supported guest OS) either through > REST API or using Guest Tools. Please let me know how we can achieve it. > I'm n

Re: [Qemu-discuss] [ovirt-devel] ovirt and AMD virtualization bug

2019-03-08 Thread Nir Soffer
On Sat, Mar 9, 2019 at 1:24 AM Hetz Ben Hamo wrote: > Hi, > > I've done some research on a bug which I found on the AMD Zen/Zen+ based > CPU's. Apparently, when using nested virtualization, the CPU doesn't expose > the "monitor" CPU flag. > > While other virtualization solutions (Xen, ESXi, Hyper

Re: [Qemu-discuss] [ovirt-users] VM snapshot - some info needed

2019-07-07 Thread Nir Soffer
On Wed, Jul 3, 2019 at 8:11 PM Strahil Nikolov wrote: > I have noticed that if I want a VM snapshot with memory - I get a warning "The > VM will be paused while saving the memory" . > Is there a way to make snapshot without pausing the VM for the whole > duration ? > No, this is expected. Denis

qemu-system-x86_64: -accel kvm:tcg: Don't use ':' with -accel, use -M accel=... for now instead

2019-11-25 Thread Nir Soffer
We have automated tests running qemu like this: 19:22:55 DEBUG (MainThread) [qemu] Starting qemu ['qemu-kvm', '-accel', 'kvm:tcg', '-drive', 'file=/var/tmp/ovirt-imageio-common/test_full_backup_raw_tcp_0/disk.raw,format=raw', '-nographic', '-qmp', 'unix:/var/tmp/ovirt-imageio-common/test_full_ba

Re: qemu-system-x86_64: -accel kvm:tcg: Don't use ':' with -accel, use -M accel=... for now instead

2019-11-25 Thread Nir Soffer
On Mon, Nov 25, 2019 at 9:54 PM Nir Soffer wrote: > > We have automated tests running qemu like this: > > 19:22:55 DEBUG (MainThread) [qemu] Starting qemu ['qemu-kvm', > '-accel', 'kvm:tcg', '-drive', > 'file=/var/tmp/ovir

Re: qemu-system-x86_64: -accel kvm:tcg: Don't use ':' with -accel, use -M accel=... for now instead

2019-11-25 Thread Nir Soffer
with its own set of suboptions, but that isn't implemented > yet. Anyway there's no plan to drop "-M accel=kvm:tcg", it will continue to > work and will be transparently converted to "-accel kvm -accel tcg". Makes sense, thanks! > > Thanks, > > Paolo

Re: [ovirt-users] Possible sources of cpu steal and countermeasures

2019-12-04 Thread Nir Soffer
On Wed, Dec 4, 2019 at 6:15 PM wrote: > > Hi, > > I'm having performance issues with a ovirt installation. It is showing > high steal (5-10%) for a cpu intensive VM. The hypervisor however has > more than 65% of his resources idle while the steal is seen inside of > the VM. > > Even when placing o

Re: QEMU-img convert question

2019-12-04 Thread Nir Soffer
On Tue, Dec 3, 2019 at 7:27 PM Reuven Alvesson wrote: > > Hi. > > I can not create a VM in proxmox...I get all the time this message when > trying to create a Hard drive: > > > lvcreate 'pve/vm-100-disk-0' error: Aborting. Could not deactivate thin pool > pve/data. at /usr/share/perl5/PVE/API2/Q

Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-22 Thread Nir Soffer
I'm trying to export qcow2 images from ova format using qemu-nbd. I create 2 compressed qcow2 images, with different data: $ qemu-img info disk1.qcow2 image: disk1.qcow2 file format: qcow2 virtual size: 200 MiB (209715200 bytes) disk size: 384 KiB ... $ qemu-img info disk2.qcow2 image: disk2.qco

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-22 Thread Nir Soffer
get image. > On 2020-06-23 00:21, Nir Soffer wrote: > > I'm trying to export qcow2 images from ova format using qemu-nbd. > > > > I create 2 compressed qcow2 images, with different data: > > > > $ qemu-img info disk1.qcow2 > > image: disk1.qcow2 > >

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-23 Thread Nir Soffer
On Tue, Jun 23, 2020 at 12:47 PM Richard W.M. Jones wrote: > > > Here you go: > > https://github.com/libguestfs/nbdkit/commit/2d15e79f65764d9b0c68bea28ed6afbcbcc63467 Nice! But using qemu-nbd directly is much simpler and will perform better. Regardless, nbdit tar plugin is awesome. Is it possib

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-26 Thread Nir Soffer
On Tue, Jun 23, 2020 at 5:08 PM Richard W.M. Jones wrote: > > On Tue, Jun 23, 2020 at 08:47:52AM -0500, Eric Blake wrote: > > On 6/22/20 5:21 PM, Nir Soffer wrote: > > >And it works, but it exposes the qcow2 data. I want to raw data so I > > >can upload the guest &g

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-26 Thread Nir Soffer
On Tue, Jun 23, 2020 at 1:47 PM Richard W.M. Jones wrote: > > On Tue, Jun 23, 2020 at 01:14:43PM +0300, Nir Soffer wrote: > > On Tue, Jun 23, 2020 at 12:47 PM Richard W.M. Jones > > wrote: > > > Here you go: > > > > > >

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-26 Thread Nir Soffer
On Tue, Jun 23, 2020 at 1:21 AM Nir Soffer wrote: > > I'm trying to export qcow2 images from ova format using qemu-nbd. > > I create 2 compressed qcow2 images, with different data: > > $ qemu-img info disk1.qcow2 > image: disk1.qcow2 > file format: qcow2 > virtua

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-26 Thread Nir Soffer
On Fri, Jun 26, 2020 at 11:34 PM Richard W.M. Jones wrote: > > On Fri, Jun 26, 2020 at 10:42:02PM +0300, Nir Soffer wrote: > > Can we have better support in qemu-img/qemu-nbd for accessing images > > in a tar file? > > > > Maybe something like: > > > >

Re: Exporting qcow2 images as raw data from ova file with qemu-nbd

2020-06-29 Thread Nir Soffer
On Mon, Jun 29, 2020 at 3:06 PM Kevin Wolf wrote: > > Am 26.06.2020 um 21:42 hat Nir Soffer geschrieben: > > On Tue, Jun 23, 2020 at 1:21 AM Nir Soffer wrote: > > > > > > I'm trying to export qcow2 images from ova format using qemu-nbd. > > > &g

Re: [ovirt-users] [OT] Major and minor numbers assigned to /dev/vdx virtio devices

2020-07-13 Thread Nir Soffer
On Wed, Jul 1, 2020 at 5:55 PM Gianluca Cecchi wrote: > > Hello, > isn't there an official major/minor numbering scheme for virtio disks? > Sometimes I see 251 major or 252 or so... what is the udev assignment logic? > Reading here: > https://www.kernel.org/doc/Documentation/admin-guide/devices.tx

Re: [ovirt-devel] [ARM64] Possiblity to support oVirt on ARM64

2020-07-19 Thread Nir Soffer
On Sun, Jul 19, 2020 at 5:04 PM Zhenyu Zheng wrote: > > Hi oVirt, > > We are currently trying to make oVirt work on ARM64 platform, since I'm quite > new to oVirt community, I'm wondering what is the current status about ARM64 > support in the oVirt upstream, as I saw the oVirt Wikipedia page me

Re: qemu-img measure

2020-07-23 Thread Nir Soffer
On Thu, Jul 23, 2020 at 6:12 PM Arik Hadas wrote: The best place for this question is qemu-discuss, and CC Kevin and Stefan (author of qemu-img measure). > @Nir Soffer does the following make any sense to you: > > [root@lion01 8c98c94d-bc14-4e24-b89c-4d96c820056d]# qemu-img info &

Re: qemu-img measure

2020-07-23 Thread Nir Soffer
On Thu, Jul 23, 2020 at 7:55 PM Arik Hadas wrote: > > > > On Thu, Jul 23, 2020 at 7:31 PM Nir Soffer wrote: >> >> On Thu, Jul 23, 2020 at 6:12 PM Arik Hadas wrote: >> >> The best place for this question is qemu-discuss, and CC Kevin and Stefan >>

Re: resizing disk image in a raw file online possible ?

2021-04-16 Thread Nir Soffer
On Thu, Apr 15, 2021 at 7:13 PM Lentes, Bernd wrote: > > Hi, > > we have several qemu guests running on SLES 12 SP5 and pacemaker and a > two-node HA cluster. > The raw files for the disks for the guests reside on a OCFS2 Volume on a SAN. > We need to give more storage to a guest (several 100GB).

Re: how to change sector size using qemu-img

2021-06-25 Thread Nir Soffer
On Fri, Jun 25, 2021 at 7:40 PM Jiatong Shen wrote: > > Hello community, > > I have a disk with both logical and physical sector size being 4096. I have a > qcow2 image which is built from a virtual machine has legacy 512 bytes sector > size. > > when I do something like > > qemu-img convert -f

Re: how to improve qcow performance?

2021-07-20 Thread Nir Soffer
On Thu, Jul 15, 2021 at 2:33 PM Geraldo Netto wrote: > > Dear Friends, > > I beg your pardon for such a newbie question > But I would like to better understand how to improve the qcow performance I guess you mean how to improve "qcow2" performance. If you use "qcow" format the best way is to swit

Re: how to improve qcow performance?

2021-07-21 Thread Nir Soffer
On Wed, Jul 21, 2021 at 3:20 PM Geraldo Netto wrote: > > Dear Nir/Friends, > > On Tue, 20 Jul 2021 at 11:34, Nir Soffer wrote: > > > > On Thu, Jul 15, 2021 at 2:33 PM Geraldo Netto > > wrote: > > > > > > Dear Friends, > > > > > &

Re: Is it normal to get bigger qcow2 image after blockcopy?

2023-11-06 Thread Nir Soffer
On Fri, Nov 3, 2023 at 3:25 AM Fangge Jin wrote: > > > On Thu, Nov 2, 2023 at 5:13 PM Fangge Jin wrote: > >> Recently, I found that the disk size of qcow2 image get bigger(from 6.16G >> to 8G in my test) after blockcopy.🔄 ❓🔄 ❓ >> > Sorry, it should be "from 6.16G to 6.64G in my test"here > >>

Re: Export checkpoint/bitmap from image on qcow2

2023-12-18 Thread Nir Soffer
On Thu, Nov 30, 2023 at 4:14 PM João Jandre Paraquetti wrote: > > Hi, all > > I recently started looking into how to create incremental backups using > Libvirt+Qemu. I have already found that, since Libvirt 7.6.0, we can use > the virDomainBackupBegin API to create incremental backups of live VMs

Re: Export checkpoint/bitmap from image on qcow2

2024-01-02 Thread Nir Soffer
the issue when long backup (e.g full backup, or incremental backup with a lot of data) blocks usage of the vm during the backup. You can start/stop/migrate a vm while it is being backed up and the backup can run on another host in the cluster (if using shared storage). Nir > On 12/18/23 18

Re: How to stop QEMU punching holes in backing store

2024-06-18 Thread Nir Soffer
On Wed, Jun 5, 2024 at 5:27 PM Justin wrote: > Hi. I'm using QEMU emulator version 5.2.0 on Linux. I am using > thick-provisioned RAW files as the VM backing store. I've found that > QEMU is punching holes in my RAW files (it's replacing some zero > blocks with holes), which means that the number

Re: How to stop QEMU punching holes in backing store

2024-06-19 Thread Nir Soffer
> On 19 Jun 2024, at 8:54, Justin wrote: > >>I've run strace and I see calls to fallocate with these flags: >>FALLOC_FL_KEEP_SIZE|FALLOC_FL_PUNCH_HOLE >> >>I've tried passing these options: discard=off,detect-zeroes=off but >>this does not help. This is the full set of relevant

Re: qemu-img convert: Compression can not be disabled when converting from .qcow2 to .raw

2024-06-21 Thread Nir Soffer
On Fri, Jun 21, 2024 at 5:48 PM Sven Ott wrote: > Hi, I want to mount a VM image to a loop device and give it some excess > space. > > To do so, I download a .qcow2 file, add some 0 bytes with truncate, and > then convert the image from QCOW2 to RAW format with qemu-img convert, > like so: > > ``

Re: How to stop QEMU punching holes in backing store

2024-06-28 Thread Nir Soffer
On Wed, Jun 19, 2024 at 2:18 PM Nir Soffer wrote: > On 19 Jun 2024, at 8:54, Justin wrote: > >I've run strace and I see calls to fallocate with these flags: >FALLOC_FL_KEEP_SIZE|FALLOC_FL_PUNCH_HOLE > >I've tried passing these options: discard=off,detect-z

Re: How to stop QEMU punching holes in backing store

2024-08-08 Thread Nir Soffer
On Sat, Jun 29, 2024 at 12:19 AM Nir Soffer wrote: > > On Wed, Jun 19, 2024 at 2:18 PM Nir Soffer wrote: > > On 19 Jun 2024, at 8:54, Justin wrote: > > > >I've run strace and I see calls to fallocate with these flags: > >FALLOC_FL_KEEP_SIZE|FALLOC_