Re: [FFmpeg-devel] [PATCH 1/5] avcodec/rl2: Remove wrong check

2022-10-01 Thread Andreas Rheinhardt
Andreas Rheinhardt: > This check is intended to be avoid buffer overflows, > yet there are four problems with it: > 1. It has an in-built off-by-one error: len == out_end - out > is perfectly fine and nothing to worry about. > This off-by-one error led to the pixel in the lower-right corner > not b

[FFmpeg-devel] [PATCH 1/5] avcodec/rl2: Remove wrong check

2022-09-28 Thread Andreas Rheinhardt
This check is intended to be avoid buffer overflows, yet there are four problems with it: 1. It has an in-built off-by-one error: len == out_end - out is perfectly fine and nothing to worry about. This off-by-one error led to the pixel in the lower-right corner not being set properly for the back f