Re: [FFmpeg-devel] [PATCH] lavc/h274: transpose IDCT

2023-10-02 Thread Niklas Haas
On Thu, 28 Sep 2023 23:08:48 +0200 Niklas Haas wrote: > From: Niklas Haas > > This is mathematically equivalent to what we were doing before, but > gives subtly different results due to rounding (rows first vs columns > first). Doing it this way makes our film grain database generation match > r

[FFmpeg-devel] [PATCH] lavc/h274: transpose IDCT

2023-09-28 Thread Niklas Haas
From: Niklas Haas This is mathematically equivalent to what we were doing before, but gives subtly different results due to rounding (rows first vs columns first). Doing it this way makes our film grain database generation match reference implementation and now produces bit-exact outputs in my te