From patchwork Wed Jul 19 09:40:59 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tobias Rapp X-Patchwork-Id: 4367 Delivered-To: ffmpegpatchwork@gmail.com Received: by 10.103.1.76 with SMTP id 73csp610141vsb; Wed, 19 Jul 2017 02:41:28 -0700 (PDT) X-Received: by 10.28.184.87 with SMTP id i84mr5193577wmf.22.1500457288279; Wed, 19 Jul 2017 02:41:28 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1500457288; cv=none; d=google.com; s=arc-20160816; b=lI7tNHMPxpzWVZc+PAC3u8t7M7ZE9XU9stQCPvFCFiEtI2pJ0xKsba+hjZlm9VbO0b qlSjZH+dN2yabkPqAUGMi82/n0NqKCNrRDGJFv3abDiCdCq2cRIVQDpx6dZbeU5vmoz8 wfFcCgSHBCuKdhpYr3NFIn9TfcWZwXvnQs1XetM4R4d/fKAQy069Uvt1lpUIAOERq1F4 DmosW7mIdCeXwdQm11ioLHYHuYqg//fpD1k9o2IV71I3qe5XY1LZuTOzcNMTn19QDEg4 /EdS1uEIHXLRimn0cCny3Mec/QFwlCrusxChB7A7BG8PWNblIvnWwS6ARyj0HIlqfwJZ P37Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:message-id:date:to:from:delivered-to :arc-authentication-results; bh=ZTrhcTq1uqmv5hF89wR2w5HjBslWKugaCjVs/vMx8Tc=; b=wZbh9ms37U3/H5ZIHR50bJD71WNiCkWDZYY2YgoHQlgfD8KQc4r1NrUOgR2F2hvuPJ t/siXLqI1lEPmZLesEZiH1OK8gIC8Q6zOD5UdADfsww6U+vUXGHadBqlNVHhcLSxmy/D n/z4xjFxdvAFRcPyg6qbB4k4PAQRDkRlDJyKUctdqJTdcfDH82LdNQiPvnARgxZKl7Uk fTKJqoQGLAliYCNKcvFBJs8L6Y6WriuQJnhMb7gR0Q4KeFrPJTcY1kdJGvPFTfpir9n7 uPIce4Y3ggndRHsKAy7xtgMVxqCXp2xXsl/0kWR2gSzCGLCB78Q0QbbOJTkWvfGfJ27k flOQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id y11si3721806wrd.81.2017.07.19.02.41.26; Wed, 19 Jul 2017 02:41:28 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 68FB6689200; Wed, 19 Jul 2017 12:41:16 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mx01.mail.netstorage.at (mx01.mail.netstorage.at [89.207.144.13]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id A692A680780 for ; Wed, 19 Jul 2017 12:41:09 +0300 (EEST) Received: from p1002.netstorage.at (p1002.netstorage.at [89.207.146.186]) by mx01.mail.netstorage.at (Postfix) with ESMTPS id 31239A3B29 for ; Wed, 19 Jul 2017 11:41:00 +0200 (CEST) Received: from mailix (noaport.de [46.237.252.213]) by p1002.netstorage.at (Postfix) with ESMTPA id D4BBB8189E for ; Wed, 19 Jul 2017 11:40:59 +0200 (CEST) Received: from frogstar-a.kuhnle.local (frogstar-a.kuhnle.local [192.168.0.26]) by mailix with ESMTPA ; Wed, 19 Jul 2017 11:40:59 +0200 From: Tobias Rapp To: ffmpeg-devel@ffmpeg.org Date: Wed, 19 Jul 2017 11:40:59 +0200 Message-Id: <1500457259-23469-1-git-send-email-t.rapp@noa-archive.com> X-Mailer: git-send-email 2.7.4 X-PPP-Message-ID: <20170719094100.18190.63056@p1002.netstorage.at> X-PPP-Vhost: noa-archive.com X-NetStorage-MailScanner-Information: Please contact the ISP for more information X-NetStorage-MailScanner-ID: 31239A3B29.A335F X-NetStorage-MailScanner: Found to be clean X-NetStorage-MailScanner-SpamCheck: not spam (whitelisted), SpamAssassin (nicht zwischen gespeichert, Wertung=-0.5, benoetigt 6, autolearn=not spam, BAYES_00 -0.50) X-NetStorage-MailScanner-From: t.rapp@noa-archive.com X-Spam-Status: No Subject: [FFmpeg-devel] [PATCH] fate: add tests for psnr and ssim filter X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Signed-off-by: Tobias Rapp --- tests/fate/filter-video.mak | 17 +++++++++++++ tests/ref/fate/filter-refcmp-psnr-rgb | 45 +++++++++++++++++++++++++++++++++++ tests/ref/fate/filter-refcmp-psnr-yuv | 45 +++++++++++++++++++++++++++++++++++ tests/ref/fate/filter-refcmp-ssim-rgb | 30 +++++++++++++++++++++++ tests/ref/fate/filter-refcmp-ssim-yuv | 30 +++++++++++++++++++++++ 5 files changed, 167 insertions(+) create mode 100644 tests/ref/fate/filter-refcmp-psnr-rgb create mode 100644 tests/ref/fate/filter-refcmp-psnr-yuv create mode 100644 tests/ref/fate/filter-refcmp-ssim-rgb create mode 100644 tests/ref/fate/filter-refcmp-ssim-yuv diff --git a/tests/fate/filter-video.mak b/tests/fate/filter-video.mak index 53fc7a6..581297f 100644 --- a/tests/fate/filter-video.mak +++ b/tests/fate/filter-video.mak @@ -698,6 +698,23 @@ FATE_FILTER_SAMPLES-$(call ALLYES, MOV_DEMUXER H264_DECODER AAC_FIXED_DECODER PC fate-filter-meta-4560-rotate0: tests/data/file4560-override2rotate0.mov fate-filter-meta-4560-rotate0: CMD = framecrc -flags +bitexact -c:a aac_fixed -i $(TARGET_PATH)/tests/data/file4560-override2rotate0.mov +fate-filter-refcmp%: CMD = ffmpeg -flags +bitexact -sws_flags +accurate_rnd+bitexact -fflags +bitexact \ + -f lavfi -i "testsrc=size=300x200:rate=1:duration=5" \ + -filter:v "format=$(PIXFMT),split[ref][tmp]\;[tmp]avgblur=4[enc]\;[enc][ref]$(REFCMP),metadata=print:file=-" \ + -f null /dev/null + +FATE_FILTER_SAMPLES-$(call ALLYES, FFMPEG LAVFI_INDEV AVGBLUR_FILTER PSNR_FILTER METADATA_FILTER) += fate-filter-refcmp-psnr-rgb fate-filter-refcmp-psnr-yuv +fate-filter-refcmp-psnr%: REFCMP = psnr +fate-filter-refcmp-psnr-rgb: PIXFMT = rgb24 +fate-filter-refcmp-psnr-yuv: PIXFMT = yuv422p + +FATE_FILTER_SAMPLES-$(call ALLYES, FFMPEG LAVFI_INDEV AVGBLUR_FILTER SSIM_FILTER METADATA_FILTER) += fate-filter-refcmp-ssim-rgb fate-filter-refcmp-ssim-yuv +fate-filter-refcmp-ssim%: REFCMP = ssim +# FIXME: override CPUFLAGS to avoid failure on x86 (issue #6519) +fate-filter-refcmp-ssim%: CPUFLAGS = 0 +fate-filter-refcmp-ssim-rgb: PIXFMT = rgb24 +fate-filter-refcmp-ssim-yuv: PIXFMT = yuv422p + FATE_SAMPLES_FFPROBE += $(FATE_METADATA_FILTER-yes) FATE_SAMPLES_FFMPEG += $(FATE_FILTER_SAMPLES-yes) FATE_FFMPEG += $(FATE_FILTER-yes) diff --git a/tests/ref/fate/filter-refcmp-psnr-rgb b/tests/ref/fate/filter-refcmp-psnr-rgb new file mode 100644 index 0000000..367226c --- /dev/null +++ b/tests/ref/fate/filter-refcmp-psnr-rgb @@ -0,0 +1,45 @@ +frame:0 pts:0 pts_time:0 +lavfi.psnr.mse.r=1678.35 +lavfi.psnr.psnr.r=15.88 +lavfi.psnr.mse.g=1118.72 +lavfi.psnr.psnr.g=17.64 +lavfi.psnr.mse.b=946.38 +lavfi.psnr.psnr.b=18.37 +lavfi.psnr.mse_avg=1247.82 +lavfi.psnr.psnr_avg=17.17 +frame:1 pts:1 pts_time:1 +lavfi.psnr.mse.r=1589.83 +lavfi.psnr.psnr.r=16.12 +lavfi.psnr.mse.g=1076.14 +lavfi.psnr.psnr.g=17.81 +lavfi.psnr.mse.b=733.06 +lavfi.psnr.psnr.b=19.48 +lavfi.psnr.mse_avg=1133.01 +lavfi.psnr.psnr_avg=17.59 +frame:2 pts:2 pts_time:2 +lavfi.psnr.mse.r=1603.11 +lavfi.psnr.psnr.r=16.08 +lavfi.psnr.mse.g=1064.91 +lavfi.psnr.psnr.g=17.86 +lavfi.psnr.mse.b=719.50 +lavfi.psnr.psnr.b=19.56 +lavfi.psnr.mse_avg=1129.17 +lavfi.psnr.psnr_avg=17.60 +frame:3 pts:3 pts_time:3 +lavfi.psnr.mse.r=1640.67 +lavfi.psnr.psnr.r=15.98 +lavfi.psnr.mse.g=1040.98 +lavfi.psnr.psnr.g=17.96 +lavfi.psnr.mse.b=717.82 +lavfi.psnr.psnr.b=19.57 +lavfi.psnr.mse_avg=1133.16 +lavfi.psnr.psnr_avg=17.59 +frame:4 pts:4 pts_time:4 +lavfi.psnr.mse.r=1691.15 +lavfi.psnr.psnr.r=15.85 +lavfi.psnr.mse.g=962.75 +lavfi.psnr.psnr.g=18.30 +lavfi.psnr.mse.b=775.03 +lavfi.psnr.psnr.b=19.24 +lavfi.psnr.mse_avg=1142.98 +lavfi.psnr.psnr_avg=17.55 diff --git a/tests/ref/fate/filter-refcmp-psnr-yuv b/tests/ref/fate/filter-refcmp-psnr-yuv new file mode 100644 index 0000000..916580f --- /dev/null +++ b/tests/ref/fate/filter-refcmp-psnr-yuv @@ -0,0 +1,45 @@ +frame:0 pts:0 pts_time:0 +lavfi.psnr.mse.y=434.61 +lavfi.psnr.psnr.y=21.75 +lavfi.psnr.mse.u=392.27 +lavfi.psnr.psnr.u=22.19 +lavfi.psnr.mse.v=679.26 +lavfi.psnr.psnr.v=19.81 +lavfi.psnr.mse_avg=485.19 +lavfi.psnr.psnr_avg=21.27 +frame:1 pts:1 pts_time:1 +lavfi.psnr.mse.y=386.12 +lavfi.psnr.psnr.y=22.26 +lavfi.psnr.mse.u=355.19 +lavfi.psnr.psnr.u=22.63 +lavfi.psnr.mse.v=683.13 +lavfi.psnr.psnr.v=19.79 +lavfi.psnr.mse_avg=452.64 +lavfi.psnr.psnr_avg=21.57 +frame:2 pts:2 pts_time:2 +lavfi.psnr.mse.y=407.59 +lavfi.psnr.psnr.y=22.03 +lavfi.psnr.mse.u=307.40 +lavfi.psnr.psnr.u=23.25 +lavfi.psnr.mse.v=680.56 +lavfi.psnr.psnr.v=19.80 +lavfi.psnr.mse_avg=450.78 +lavfi.psnr.psnr_avg=21.59 +frame:3 pts:3 pts_time:3 +lavfi.psnr.mse.y=420.90 +lavfi.psnr.psnr.y=21.89 +lavfi.psnr.mse.u=295.22 +lavfi.psnr.psnr.u=23.43 +lavfi.psnr.mse.v=676.06 +lavfi.psnr.psnr.v=19.83 +lavfi.psnr.mse_avg=453.27 +lavfi.psnr.psnr_avg=21.57 +frame:4 pts:4 pts_time:4 +lavfi.psnr.mse.y=393.71 +lavfi.psnr.psnr.y=22.18 +lavfi.psnr.mse.u=328.99 +lavfi.psnr.psnr.u=22.96 +lavfi.psnr.mse.v=675.83 +lavfi.psnr.psnr.v=19.83 +lavfi.psnr.mse_avg=448.06 +lavfi.psnr.psnr_avg=21.62 diff --git a/tests/ref/fate/filter-refcmp-ssim-rgb b/tests/ref/fate/filter-refcmp-ssim-rgb new file mode 100644 index 0000000..f47215b --- /dev/null +++ b/tests/ref/fate/filter-refcmp-ssim-rgb @@ -0,0 +1,30 @@ +frame:0 pts:0 pts_time:0 +lavfi.ssim.R=0.68 +lavfi.ssim.G=0.77 +lavfi.ssim.B=0.80 +lavfi.ssim.All=0.75 +lavfi.ssim.dB=6.03 +frame:1 pts:1 pts_time:1 +lavfi.ssim.R=0.69 +lavfi.ssim.G=0.77 +lavfi.ssim.B=0.83 +lavfi.ssim.All=0.76 +lavfi.ssim.dB=6.27 +frame:2 pts:2 pts_time:2 +lavfi.ssim.R=0.69 +lavfi.ssim.G=0.78 +lavfi.ssim.B=0.83 +lavfi.ssim.All=0.77 +lavfi.ssim.dB=6.39 +frame:3 pts:3 pts_time:3 +lavfi.ssim.R=0.69 +lavfi.ssim.G=0.79 +lavfi.ssim.B=0.84 +lavfi.ssim.All=0.77 +lavfi.ssim.dB=6.44 +frame:4 pts:4 pts_time:4 +lavfi.ssim.R=0.68 +lavfi.ssim.G=0.80 +lavfi.ssim.B=0.82 +lavfi.ssim.All=0.77 +lavfi.ssim.dB=6.32 diff --git a/tests/ref/fate/filter-refcmp-ssim-yuv b/tests/ref/fate/filter-refcmp-ssim-yuv new file mode 100644 index 0000000..15b4dc2 --- /dev/null +++ b/tests/ref/fate/filter-refcmp-ssim-yuv @@ -0,0 +1,30 @@ +frame:0 pts:0 pts_time:0 +lavfi.ssim.Y=0.77 +lavfi.ssim.U=0.76 +lavfi.ssim.V=0.67 +lavfi.ssim.All=0.75 +lavfi.ssim.dB=5.94 +frame:1 pts:1 pts_time:1 +lavfi.ssim.Y=0.78 +lavfi.ssim.U=0.77 +lavfi.ssim.V=0.68 +lavfi.ssim.All=0.75 +lavfi.ssim.dB=6.10 +frame:2 pts:2 pts_time:2 +lavfi.ssim.Y=0.78 +lavfi.ssim.U=0.78 +lavfi.ssim.V=0.68 +lavfi.ssim.All=0.76 +lavfi.ssim.dB=6.11 +frame:3 pts:3 pts_time:3 +lavfi.ssim.Y=0.78 +lavfi.ssim.U=0.78 +lavfi.ssim.V=0.67 +lavfi.ssim.All=0.75 +lavfi.ssim.dB=6.09 +frame:4 pts:4 pts_time:4 +lavfi.ssim.Y=0.79 +lavfi.ssim.U=0.78 +lavfi.ssim.V=0.68 +lavfi.ssim.All=0.76 +lavfi.ssim.dB=6.20