Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread Michael Niedermayer
On Tue, Oct 13, 2015 at 04:41:50PM -0300, James Almer wrote: > On 10/12/2015 11:04 PM, Michael Niedermayer wrote: > > On Tue, Oct 13, 2015 at 12:00:07AM +0200, Michael Niedermayer wrote: > >> On Mon, Oct 12, 2015 at 10:39:23PM +0200, Christophe Gisquet wrote: > >>> Le 12 oct. 2015 21:37, "Michael N

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread James Almer
On 10/13/2015 5:06 PM, Christophe Gisquet wrote: > Hi, > > 2015-10-13 21:41 GMT+02:00 James Almer : >> > This test is failing on pretty much every fate client. Valgrind seems to >> > complain about uninitialized values. >> > http://fate.ffmpeg.org/report.cgi?time=20151013040721&slot=x86_64-archlin

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread Christophe Gisquet
Hi, 2015-10-13 21:41 GMT+02:00 James Almer : > This test is failing on pretty much every fate client. Valgrind seems to > complain about uninitialized values. > http://fate.ffmpeg.org/report.cgi?time=20151013040721&slot=x86_64-archlinux-gcc-valgrindundef Can someone test the following patch? I do

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread James Almer
On 10/12/2015 11:04 PM, Michael Niedermayer wrote: > On Tue, Oct 13, 2015 at 12:00:07AM +0200, Michael Niedermayer wrote: >> On Mon, Oct 12, 2015 at 10:39:23PM +0200, Christophe Gisquet wrote: >>> Le 12 oct. 2015 21:37, "Michael Niedermayer" a >>> écrit : On Mon, Oct 12, 2015 at 07:37:43

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread Christophe Gisquet
2015-10-13 9:06 GMT+02:00 Christophe Gisquet : >I think I didn't run into those failures under Win64. Confirmed, as well as under Win32 (also gcc 5.2.0) and gcc x86_64 4.9.2 under a linux environment. -- Christophe ___ ffmpeg-devel mailing list ffmpeg-

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread Christophe Gisquet
Hi, 2015-10-13 4:04 GMT+02:00 Michael Niedermayer : > wasnt that easy, there was another difference, between 32 and 64bit > it may be float rounding in the scaler but its not dnxhd i worked > around it by adjusting the scaler parameters. I'm not completely sure now, but I think I didn't run into

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-13 Thread Christophe Gisquet
Hi, 2015-10-13 0:00 GMT+02:00 Michael Niedermayer : >> I'm so bad at this codec stuff. > > no, you are not, this stuff is rather convoluted and the mpegvideo > *dct stuff is not well documented. Sorry for the outburst, it was really frustrating to get caught in whatever hurdle a modification ran

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-12 Thread Michael Niedermayer
On Tue, Oct 13, 2015 at 12:00:07AM +0200, Michael Niedermayer wrote: > On Mon, Oct 12, 2015 at 10:39:23PM +0200, Christophe Gisquet wrote: > > Le 12 oct. 2015 21:37, "Michael Niedermayer" a > > écrit : > > > > > > On Mon, Oct 12, 2015 at 07:37:43PM +0200, Christophe Gisquet wrote: > > > > It was u

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-12 Thread Michael Niedermayer
On Mon, Oct 12, 2015 at 10:39:23PM +0200, Christophe Gisquet wrote: > Le 12 oct. 2015 21:37, "Michael Niedermayer" a > écrit : > > > > On Mon, Oct 12, 2015 at 07:37:43PM +0200, Christophe Gisquet wrote: > > > It was useful to (accidentally?) spot an overflow in the column pass > > > of the x86 sim

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-12 Thread Christophe Gisquet
Le 12 oct. 2015 21:37, "Michael Niedermayer" a écrit : > > On Mon, Oct 12, 2015 at 07:37:43PM +0200, Christophe Gisquet wrote: > > It was useful to (accidentally?) spot an overflow in the column pass > > of the x86 simple_idct10 implementation. > > --- > > tests/fate/vcodec.mak

Re: [FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-12 Thread Michael Niedermayer
On Mon, Oct 12, 2015 at 07:37:43PM +0200, Christophe Gisquet wrote: > It was useful to (accidentally?) spot an overflow in the column pass > of the x86 simple_idct10 implementation. > --- > tests/fate/vcodec.mak | 6 +- > tests/ref/vsynth/vsynth1-dnxhd-1080i-10bit

[FFmpeg-devel] [PATCH 2/9] fate: add 10bits YUV4:2:2 test

2015-10-12 Thread Christophe Gisquet
It was useful to (accidentally?) spot an overflow in the column pass of the x86 simple_idct10 implementation. --- tests/fate/vcodec.mak | 6 +- tests/ref/vsynth/vsynth1-dnxhd-1080i-10bit | 4 tests/ref/vsynth/vsynth2-dnxhd-1080i-10bit | 4 tests/ref/v