-= (1LL<<32)*(221/100)*(1080/1920)
is smaller than
error -= (1LL<<32)*(16/9)*(1080/1920)
thus picking aspect index value 4 rather than 3.
Proposed fix in attached patch.
--
Erik Johansson
mpeg2_aspect.patch
Description: Binary data
___
On Thu, Dec 4, 2014 at 5:27 PM, Michael Niedermayer wrote:
>
> On Thu, Dec 04, 2014 at 01:11:08PM +0100, Erik Johansson wrote:
> > Hi,
> >
> > Setting setting sample_aspect_ratio in AVContext does not produce the
> > expected aspect index value in the MPEG2 sequence