Re: [FFmpeg-devel] [PATCH] swscale/slice: fix init of 32 bpc planes

2024-12-16 Thread Michael Niedermayer
Hi On Mon, Dec 16, 2024 at 11:40:50AM +0100, Niklas Haas wrote: > On Mon, 16 Dec 2024 01:50:20 +0100 Michael Niedermayer > wrote: > > Hi Niklas > > > > On Wed, Dec 11, 2024 at 09:25:12AM +0100, Niklas Haas wrote: > > > From: Niklas Haas > > > > > > In input.c and output.c and many other places,

Re: [FFmpeg-devel] [PATCH] swscale/slice: fix init of 32 bpc planes

2024-12-16 Thread Niklas Haas
On Mon, 16 Dec 2024 01:50:20 +0100 Michael Niedermayer wrote: > Hi Niklas > > On Wed, Dec 11, 2024 at 09:25:12AM +0100, Niklas Haas wrote: > > From: Niklas Haas > > > > In input.c and output.c and many other places, swscale follows the rule of > > using > > 15-bit intermediate if output bpc is

Re: [FFmpeg-devel] [PATCH] swscale/slice: fix init of 32 bpc planes

2024-12-15 Thread Michael Niedermayer
Hi Niklas On Wed, Dec 11, 2024 at 09:25:12AM +0100, Niklas Haas wrote: > From: Niklas Haas > > In input.c and output.c and many other places, swscale follows the rule of > using > 15-bit intermediate if output bpc is <= 8, and 19-bit (inside int32_t) > intermediate otherwise. See e.g. the comme

[FFmpeg-devel] [PATCH] swscale/slice: fix init of 32 bpc planes

2024-12-11 Thread Niklas Haas
From: Niklas Haas In input.c and output.c and many other places, swscale follows the rule of using 15-bit intermediate if output bpc is <= 8, and 19-bit (inside int32_t) intermediate otherwise. See e.g. the comments on hyScale() on swscale_internal.h. These are also the coefficients that yuv2gbrp