From patchwork Wed Oct 9 14:47:11 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jun Zhao X-Patchwork-Id: 15636 Return-Path: X-Original-To: patchwork@ffaux-bg.ffmpeg.org Delivered-To: patchwork@ffaux-bg.ffmpeg.org Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by ffaux.localdomain (Postfix) with ESMTP id 20CBE4481A9 for ; Wed, 9 Oct 2019 17:47:26 +0300 (EEST) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id E50CA688144; Wed, 9 Oct 2019 17:47:25 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-pf1-f193.google.com (mail-pf1-f193.google.com [209.85.210.193]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 0E0AD688126 for ; Wed, 9 Oct 2019 17:47:20 +0300 (EEST) Received: by mail-pf1-f193.google.com with SMTP id q10so1793085pfl.0 for ; Wed, 09 Oct 2019 07:47:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id; bh=qOxkKB4CDToqjinEsDdNYRcls7pWD8XTdZvpXlE4LSg=; b=ZfwVaDX8JLtZy3KtX/jMOBQCkzScKBez8E6hJ1B91vvxIdkieJ7Ixo3d935l4mtUwQ OHLAJjxR0RqfO16Zc9I2/yunEu/5tWTtD2+Woyyg9WaxNPiHLEnEnMTaED9IEVCMYcxG NlB3UT2avx/qpadgZQIpJVBiChHTUTgYyMh+5Kq464edsHZbSs8E/M/7Dqlm+l9I+SWC vCGKA9NLMtWEOONGaiIwkOkbcBiRWRAmi0dCDfq60n8/SHnR57QVVPU0o70wgtT1x65R qvvtsBlfdiJpHzT5KwLz5XsNVwG4Lj14ptAdcZ2dfWg9oLFR6bTEbN7wSO1W6Awdd4K5 qhbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=qOxkKB4CDToqjinEsDdNYRcls7pWD8XTdZvpXlE4LSg=; b=WLmLIZUsxydWzaIsq8TAzblKGTx9HMQUvl8lgywcrguckrLBHWPNOiYY/nj4wJzVz1 OkAkNfQjiX21MsugwXW1Pwl1ZoU0CO2sLRcAqFe3Gu287ssVKYkBdQhK8+86cFqNbA7G DaOveU6npPORKNr5f4M3C5OQmFXvCPwfkv7OQ8DaVkA7PqbAqC3n4C86/MKAInjl0rwu Vg+TFxrtlSMQzPWAkSW37jcEk54g75R1O+NRXVySEce0JI2nT51b9TtI6INk9j8q/Qpq zZ4t/dSdW1qFnsMFBXxXDn2wt7CpyqJj4M8xIBMixK+L82Mbr995F7v7tbUHulBjsxEt jnOQ== X-Gm-Message-State: APjAAAX+/E7bP9Ylj6lLv+BCUvmdGhKiwvd61ULRfpnO4pm8aQHcCkZY ycU2UIIrFSF6a3zNRiZgshabpb4Q X-Google-Smtp-Source: APXvYqylCNHMWKdIKUafGis2JEe6XffPl4yKnoZFdWL8w3bDl6xaRTSmnhV6aiLikggm1fzK1KO0nw== X-Received: by 2002:a17:902:8342:: with SMTP id z2mr3449932pln.309.1570632437774; Wed, 09 Oct 2019 07:47:17 -0700 (PDT) Received: from localhost.localdomain ([47.90.47.25]) by smtp.gmail.com with ESMTPSA id z2sm2856645pfq.58.2019.10.09.07.47.16 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 09 Oct 2019 07:47:16 -0700 (PDT) From: Jun Zhao To: ffmpeg-devel@ffmpeg.org Date: Wed, 9 Oct 2019 22:47:11 +0800 Message-Id: <1570632431-16033-1-git-send-email-mypopydev@gmail.com> X-Mailer: git-send-email 1.7.1 Subject: [FFmpeg-devel] [PATCH V3] lavfi/hqdn3d: add slice thread optimization X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Jun Zhao MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" From: Jun Zhao Enabled one thread per planar, used the test command for 1080P video (YUV420P format) as follow: ffmpeg -i 1080p.mp4 -an -vf hqdn3d -f null /dev/nul This optimization improved the performance about 30% in 1080P YUV420P case (from 110fps to 143fps), also pass the framemd5 check and FATE. Signed-off-by: Jun Zhao --- libavfilter/vf_hqdn3d.c | 56 +++++++++++++++++++++++++++++++++------------- libavfilter/vf_hqdn3d.h | 2 +- 2 files changed, 41 insertions(+), 17 deletions(-) diff --git a/libavfilter/vf_hqdn3d.c b/libavfilter/vf_hqdn3d.c index d6c14bb..08cc03a 100644 --- a/libavfilter/vf_hqdn3d.c +++ b/libavfilter/vf_hqdn3d.c @@ -223,7 +223,9 @@ static av_cold void uninit(AVFilterContext *ctx) av_freep(&s->coefs[1]); av_freep(&s->coefs[2]); av_freep(&s->coefs[3]); - av_freep(&s->line); + av_freep(&s->line[0]); + av_freep(&s->line[1]); + av_freep(&s->line[2]); av_freep(&s->frame_prev[0]); av_freep(&s->frame_prev[1]); av_freep(&s->frame_prev[2]); @@ -271,9 +273,11 @@ static int config_input(AVFilterLink *inlink) s->vsub = desc->log2_chroma_h; s->depth = desc->comp[0].depth; - s->line = av_malloc_array(inlink->w, sizeof(*s->line)); - if (!s->line) - return AVERROR(ENOMEM); + for (i = 0; i < 3; i++) { + s->line[i] = av_malloc_array(inlink->w, sizeof(*s->line[i])); + if (!s->line[i]) + return AVERROR(ENOMEM); + } for (i = 0; i < 4; i++) { s->coefs[i] = precalc_coefs(s->strength[i], s->depth); @@ -287,14 +291,38 @@ static int config_input(AVFilterLink *inlink) return 0; } +typedef struct ThreadData { + AVFrame *in, *out; + int direct; +} ThreadData; + +static int do_denoise(AVFilterContext *ctx, void *data, int job_nr, int n_jobs) +{ + HQDN3DContext *s = ctx->priv; + const ThreadData *td = data; + AVFrame *out = td->out; + AVFrame *in = td->in; + int direct = td->direct; + + denoise(s, in->data[job_nr], out->data[job_nr], + s->line[job_nr], &s->frame_prev[job_nr], + AV_CEIL_RSHIFT(in->width, (!!job_nr * s->hsub)), + AV_CEIL_RSHIFT(in->height, (!!job_nr * s->vsub)), + in->linesize[job_nr], out->linesize[job_nr], + s->coefs[job_nr ? CHROMA_SPATIAL : LUMA_SPATIAL], + s->coefs[job_nr ? CHROMA_TMP : LUMA_TMP]); + + return 0; +} + static int filter_frame(AVFilterLink *inlink, AVFrame *in) { AVFilterContext *ctx = inlink->dst; - HQDN3DContext *s = ctx->priv; AVFilterLink *outlink = ctx->outputs[0]; AVFrame *out; - int c, direct = av_frame_is_writable(in) && !ctx->is_disabled; + int direct = av_frame_is_writable(in) && !ctx->is_disabled; + ThreadData td; if (direct) { out = in; @@ -308,15 +336,11 @@ static int filter_frame(AVFilterLink *inlink, AVFrame *in) av_frame_copy_props(out, in); } - for (c = 0; c < 3; c++) { - denoise(s, in->data[c], out->data[c], - s->line, &s->frame_prev[c], - AV_CEIL_RSHIFT(in->width, (!!c * s->hsub)), - AV_CEIL_RSHIFT(in->height, (!!c * s->vsub)), - in->linesize[c], out->linesize[c], - s->coefs[c ? CHROMA_SPATIAL : LUMA_SPATIAL], - s->coefs[c ? CHROMA_TMP : LUMA_TMP]); - } + td.in = in; + td.out = out; + td.direct = direct; + /* one thread per planar */ + ctx->internal->execute(ctx, do_denoise, &td, NULL, 3); if (ctx->is_disabled) { av_frame_free(&out); @@ -370,5 +394,5 @@ AVFilter ff_vf_hqdn3d = { .query_formats = query_formats, .inputs = avfilter_vf_hqdn3d_inputs, .outputs = avfilter_vf_hqdn3d_outputs, - .flags = AVFILTER_FLAG_SUPPORT_TIMELINE_INTERNAL, + .flags = AVFILTER_FLAG_SUPPORT_TIMELINE_INTERNAL | AVFILTER_FLAG_SLICE_THREADS, }; diff --git a/libavfilter/vf_hqdn3d.h b/libavfilter/vf_hqdn3d.h index 03a79a1..3279bbc 100644 --- a/libavfilter/vf_hqdn3d.h +++ b/libavfilter/vf_hqdn3d.h @@ -31,7 +31,7 @@ typedef struct HQDN3DContext { const AVClass *class; int16_t *coefs[4]; - uint16_t *line; + uint16_t *line[3]; uint16_t *frame_prev[3]; double strength[4]; int hsub, vsub;