diff options
| author | John Brooks <[email protected]> | 2011-12-11 02:37:21 -0700 |
|---|---|---|
| committer | Kostya Shishkov <[email protected]> | 2012-01-04 10:35:26 +0100 |
| commit | d209c27b09234cc40bbdbd680aa502b493edf595 (patch) | |
| tree | c7940a66137507683f77d2e954cef0ae4b67a908 /libavcodec/fft_float.c | |
| parent | aacf6b3a2fd8bc8603e3deaa6e612ea03cf08707 (diff) | |
vc1dec: fix invalid memory access for small video dimensions
For small video dimensions, these calculations of the upper bound
for pixel access may have a negative result. Using an unsigned
comparison to bound a potentially negative value only works if
the greater operand is non-negative. Fixed by doing edge emulation
when the upper bound is probably negative, everywhere that this
pattern appears.
Signed-off-by: Kostya Shishkov <[email protected]>
Diffstat (limited to 'libavcodec/fft_float.c')
0 files changed, 0 insertions, 0 deletions