Re: [FFmpeg-devel] Is this the expected behavior in libswscale/input.c

2016-06-09 Thread Dan Parrot
On Thu, 2016-06-09 at 17:01 -0400, Ronald S. Bultje wrote: > Hi, > > On Thu, Jun 9, 2016 at 4:02 PM, Dan Parrot wrote: > > > Line 72 of libswscale/input.c is: > > dstU[i] = (ru*r + gu*g + bu*b + (0x10001<<(RGB2YUV_SHIFT-1))) >> > > RGB2YUV_SHIFT; > > > > The definition of macro RGB2YUV_SHIFT in

Re: [FFmpeg-devel] Is this the expected behavior in libswscale/input.c

2016-06-09 Thread Ronald S. Bultje
Hi, On Thu, Jun 9, 2016 at 4:02 PM, Dan Parrot wrote: > Line 72 of libswscale/input.c is: > dstU[i] = (ru*r + gu*g + bu*b + (0x10001<<(RGB2YUV_SHIFT-1))) >> > RGB2YUV_SHIFT; > > The definition of macro RGB2YUV_SHIFT in libswscale/swscale_internal.h > is on line 417: > #define RGB2YUV_SHIFT 15 >

[FFmpeg-devel] Is this the expected behavior in libswscale/input.c

2016-06-09 Thread Dan Parrot
Line 72 of libswscale/input.c is: dstU[i] = (ru*r + gu*g + bu*b + (0x10001<<(RGB2YUV_SHIFT-1))) >> RGB2YUV_SHIFT; The definition of macro RGB2YUV_SHIFT in libswscale/swscale_internal.h is on line 417: #define RGB2YUV_SHIFT 15 By examining the result of executing line 72 in input.c it appears that