diff options
| author | John Brooks <john.brooks@bluecherry.net> | 2011-12-11 02:37:21 -0700 |
|---|---|---|
| committer | Michael Niedermayer <michaelni@gmx.at> | 2012-01-05 02:23:08 +0100 |
| commit | e540446f6c5ca1613eea4f9e8c5db12f1ec3925c (patch) | |
| tree | 8be072d9e5de3639f935b763afe6d868561c2479 /libavfilter/gradfun.h | |
| parent | fc9c5ad9ea70479d09a5d37c800665746ff4710d (diff) | |
| download | ffmpeg-e540446f6c5ca1613eea4f9e8c5db12f1ec3925c.tar.gz | |
vc1dec: fix invalid memory access for small video dimensions
For small video dimensions, these calculations of the upper bound
for pixel access may have a negative result. Using an unsigned
comparison to bound a potentially negative value only works if
the greater operand is non-negative. Fixed by doing edge emulation
when the upper bound is probably negative, everywhere that this
pattern appears.
Signed-off-by: Kostya Shishkov <kostya.shishkov@gmail.com>
(cherry picked from commit d209c27b09234cc40bbdbd680aa502b493edf595)
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>
Diffstat (limited to 'libavfilter/gradfun.h')
0 files changed, 0 insertions, 0 deletions