From patchwork Sat May 16 17:51:30 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Paul B Mahol X-Patchwork-Id: 19715 Return-Path: X-Original-To: patchwork@ffaux-bg.ffmpeg.org Delivered-To: patchwork@ffaux-bg.ffmpeg.org Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by ffaux.localdomain (Postfix) with ESMTP id 345D844BBC1 for ; Sat, 16 May 2020 20:51:47 +0300 (EEST) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 109C568A517; Sat, 16 May 2020 20:51:47 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wr1-f66.google.com (mail-wr1-f66.google.com [209.85.221.66]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id BD7AD68A4D4 for ; Sat, 16 May 2020 20:51:40 +0300 (EEST) Received: by mail-wr1-f66.google.com with SMTP id l17so7094724wrr.4 for ; Sat, 16 May 2020 10:51:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id:in-reply-to:references; bh=fnmKyObkUvPhPf5M54y6up2QsV0XI1SDwznV4d3tceo=; b=rLFj7750avCMCfozoYEbLxXcEPTfEuzf1VJlMSlFYBJvHtUP6PmsgHTgbNhYN/Ow6V zvDoouNBfcsELifatejr0kZQGqD4awzxibmHwVnzD6/GbpbsoTnCl/O3RexteCXB2eJQ 9Eoymxdky2t3AvyMLmzf9dTbEoOB+iOdJ7u0ul2EhVj1IiQQC3Gw8H+q9nib8GjxBnv4 GKOz4EzvygH0Uyxi/Rm7Ewj03x8w7whuYH4emE9e6K/NA619MztrGmG0AEnkaD90MOog 6WjrAG6XTQTuA9Kccl7d9C3LZJxezZaA+nPvwB/OE5Ox2t3ATq0+zUrHCmaF4VLgdeeN rLKw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:in-reply-to :references; bh=fnmKyObkUvPhPf5M54y6up2QsV0XI1SDwznV4d3tceo=; b=ShF0HWHZZSXxkhB39ZTodE/pNWBQaTyWEmt8N6UV2nRO29XAorW9mTanBBiOhrcI6e 6d/gdw/JEDwPafwvIxgmZ5GE92tQQ5vmSAfSOisEyYF1IQWb++f9xdSzUlgQm0Ac2OqC RSiP7pb6kYjWIyZEllUd85dJ3fVqq2SJqFmWUgRjDZMpLrehWTkdMn3n/hjidvMM0m28 iY6ZlG2sA7KTkuJ1UTVJFHhF1UOHQGjNz04jVrVRFN2poH9kc1Of10NvfnzKJDwUnbLs uVgGwB8uw+IcXS/mpKCVYURfQpGlS/rojp1bcMwyBEirybCiYU+GFEj1ec2hDZmsTY4C UUvA== X-Gm-Message-State: AOAM5319LlDXaOUY5WlD9TdOfWglowgEDG8E4Uqe7nQJycv7FMzCgtYj bzj27NFujDj1722s9pCMfIE1saDR X-Google-Smtp-Source: ABdhPJxBx/emVAEmG3+3QJHRdszlUerfNshMcSRbUhgR0EYlqoC+yE42dS8oA1DBbilSUDIV0k3NGg== X-Received: by 2002:a5d:4ccd:: with SMTP id c13mr10793775wrt.415.1589651499989; Sat, 16 May 2020 10:51:39 -0700 (PDT) Received: from localhost.localdomain ([37.244.244.100]) by smtp.gmail.com with ESMTPSA id t6sm9009819wma.4.2020.05.16.10.51.39 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 16 May 2020 10:51:39 -0700 (PDT) From: Paul B Mahol To: ffmpeg-devel@ffmpeg.org Date: Sat, 16 May 2020 19:51:30 +0200 Message-Id: <20200516175130.18868-2-onemda@gmail.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200516175130.18868-1-onemda@gmail.com> References: <20200516175130.18868-1-onemda@gmail.com> Subject: [FFmpeg-devel] [PATCH 2/2] avfilter/vf_chromakey: fix formula for calculation of difference X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Signed-off-by: Paul B Mahol --- libavfilter/vf_chromakey.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/libavfilter/vf_chromakey.c b/libavfilter/vf_chromakey.c index ce8003657c..4b1669d084 100644 --- a/libavfilter/vf_chromakey.c +++ b/libavfilter/vf_chromakey.c @@ -56,7 +56,7 @@ static uint8_t do_chromakey_pixel(ChromakeyContext *ctx, uint8_t u[9], uint8_t v du = (int)u[i] - ctx->chromakey_uv[0]; dv = (int)v[i] - ctx->chromakey_uv[1]; - diff += sqrt((du * du + dv * dv) / (255.0 * 255.0)); + diff += sqrt((du * du + dv * dv) / (255.0 * 255.0 * 2)); } diff /= 9.0; @@ -78,7 +78,7 @@ static uint16_t do_chromakey_pixel16(ChromakeyContext *ctx, uint16_t u[9], uint1 du = (int)u[i] - ctx->chromakey_uv[0]; dv = (int)v[i] - ctx->chromakey_uv[1]; - diff += sqrt((du * du + dv * dv) / (max * max)); + diff += sqrt((du * du + dv * dv) / (max * max * 2)); } diff /= 9.0;