Re: [FFmpeg-devel] [PATCH] lavc/vvc: Fix derivation of inverse LMCS idx

2025-02-21 Thread Nuo Mi
On Thu, Feb 20, 2025 at 4:33 AM Frank Plowman wrote: > Ping > Sorry for missing this. Thank you for the patch, applied > > On 02/02/2025 12:10, Frank Plowman wrote: > > The clamping of idxYInv from H.266(V3) section 8.8.2.3 was missing. > > This could lead to OOB reads from lmcs->pivot or input_

Re: [FFmpeg-devel] [PATCH] lavc/vvc: Fix derivation of inverse LMCS idx

2025-02-19 Thread Frank Plowman
Ping On 02/02/2025 12:10, Frank Plowman wrote: > The clamping of idxYInv from H.266(V3) section 8.8.2.3 was missing. > This could lead to OOB reads from lmcs->pivot or input_pivot. > > I also changed the derivation of the forward LMCS idx to use a shift > rather than a division for speed and as t

[FFmpeg-devel] [PATCH] lavc/vvc: Fix derivation of inverse LMCS idx

2025-02-02 Thread Frank Plowman
The clamping of idxYInv from H.266(V3) section 8.8.2.3 was missing. This could lead to OOB reads from lmcs->pivot or input_pivot. I also changed the derivation of the forward LMCS idx to use a shift rather than a division for speed and as this is actually how the variable is declared in the specif