Re: [FFmpeg-devel] [PATCH] diracdec: check that block length is large enough

2015-05-06 Thread Michael Niedermayer
On Wed, May 06, 2015 at 03:39:02PM +0200, Andreas Cadhalpun wrote: > On 06.05.2015 01:49, Michael Niedermayer wrote: > > On Tue, May 05, 2015 at 10:39:50PM +0200, Andreas Cadhalpun wrote: > >> +if (s->plane[0].xblen >> s->chroma_x_shift <= 0 || s->plane[0].yblen > >> >> s->chroma_y_shift <= 0)

Re: [FFmpeg-devel] [PATCH] diracdec: check that block length is large enough

2015-05-05 Thread Michael Niedermayer
On Tue, May 05, 2015 at 10:39:50PM +0200, Andreas Cadhalpun wrote: > In init_planes p->xblen and p->yblen are set to: > p->xblen = s->plane[0].xblen >> s->chroma_x_shift; > p->yblen = s->plane[0].yblen >> s->chroma_y_shift; > > These are later used as block_w and block_h ar

[FFmpeg-devel] [PATCH] diracdec: check that block length is large enough

2015-05-05 Thread Andreas Cadhalpun
In init_planes p->xblen and p->yblen are set to: p->xblen = s->plane[0].xblen >> s->chroma_x_shift; p->yblen = s->plane[0].yblen >> s->chroma_y_shift; These are later used as block_w and block_h arguments of s->vdsp.emulated_edge_mc. If one of them is 0 it triggers an av_as