diff options
| author | Michael Niedermayer <michael@niedermayer.cc> | 2022-05-18 02:10:52 +0200 |
|---|---|---|
| committer | Michael Niedermayer <michael@niedermayer.cc> | 2022-09-25 13:51:46 +0200 |
| commit | b1deea36aaaab25797313b2bdbeffebf17f4fba9 (patch) | |
| tree | 40c0727623960dae293f9285e667a013d870fd01 | |
| parent | d3e208f5f5ab43fe923b7722b3d737edecb3da60 (diff) | |
| download | ffmpeg-b1deea36aaaab25797313b2bdbeffebf17f4fba9.tar.gz | |
avfilter/vf_signature: Fix integer overflow in filter_frame()
Fixes: CID1403233
The second of the 2 changes may be unneeded but will help coverity
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit dd6040675ec18d19429f882caea6bb306ed6677a)
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
| -rw-r--r-- | libavfilter/vf_signature.c | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/libavfilter/vf_signature.c b/libavfilter/vf_signature.c index 32a6405e14..1205168f8f 100644 --- a/libavfilter/vf_signature.c +++ b/libavfilter/vf_signature.c @@ -224,7 +224,7 @@ static int filter_frame(AVFilterLink *inlink, AVFrame *picref) dw1 = inlink->w / 32; if (inlink->w % 32) dw2 = dw1 + 1; - denom = (sc->divide) ? dh1 * dh2 * dw1 * dw2 : 1; + denom = (sc->divide) ? dh1 * (int64_t)dh2 * dw1 * dw2 : 1; for (i = 0; i < 32; i++) { rowcount = 0; @@ -250,7 +250,7 @@ static int filter_frame(AVFilterLink *inlink, AVFrame *picref) } } - denom = (sc->divide) ? 1 : dh1 * dh2 * dw1 * dw2; + denom = (sc->divide) ? 1 : dh1 * (int64_t)dh2 * dw1 * dw2; for (i = 0; i < ELEMENT_COUNT; i++) { const ElemCat* elemcat = elements[i]; |