Re: [FFmpeg-devel] [PATCH] avcodec/diracdec: Fix qfactor/offset tables

2016-01-17 Thread Michael Niedermayer
On Wed, Jan 13, 2016 at 11:51:47PM +0100, Michael Niedermayer wrote: > From: Michael Niedermayer > > It seems the previous tables where calculated with 32bit integers ignoring > overflows. > Also check for the max qindex, the value is choosen so that the qfactor/offset > fit in int32. > > Fixes:

[FFmpeg-devel] [PATCH] avcodec/diracdec: Fix qfactor/offset tables

2016-01-13 Thread Michael Niedermayer
From: Michael Niedermayer It seems the previous tables where calculated with 32bit integers ignoring overflows. Also check for the max qindex, the value is choosen so that the qfactor/offset fit in int32. Fixes: 070b7914fd5dfe8f93248bea71363410/asan_static-oob_c8d034_2764_258e20f4a3c79158aecddb