From patchwork Sun Sep 12 20:19:28 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Paul B Mahol X-Patchwork-Id: 30199 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6602:2a4a:0:0:0:0 with SMTP id k10csp3422911iov; Sun, 12 Sep 2021 13:19:51 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyM1SRo7s18PSjWNqFFUuIoX4e9lN5U6kRNQAATh2R1Li7VLaeWChSCMmav4UL600eqwmbe X-Received: by 2002:aa7:d94a:: with SMTP id l10mr9507117eds.322.1631477991486; Sun, 12 Sep 2021 13:19:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1631477991; cv=none; d=google.com; s=arc-20160816; b=eCiWNqtsJmT/i7JPii3n2tDIqrJdJJCWGc8sUU+hM+Io0lRToEAJZMzNvK6n/nvbax nO9xwM0oCOhfIXMnbWZxoMVMVFB2a0z2fKF+rwCq/nyD3x7YtlMc6QsMw5jq2z/nOzwa EQpiT3sujL/O4x/qYY15kGJ3Zs9rqNE2WP3hTpzys1CDKJygOWzCLXjhLkB0X9j9E6oh aqZ2oyb9p/OoJ59yAUYszS3Ss17S9OTmVTTBaRSEw4ccAsbsl/XHD/GvB9ymTZYd12++ uS9Dnb7fqXSk43uURL1cgBPhybSNbWSiNW+Z2a1VF2SuQnv5nPu4by3e5n7mUl4MlwiU diww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:message-id:date:to:from:dkim-signature :delivered-to; bh=IfnP0gE0ilc1LYHnPd4XZC3QT66szG/1XOSYWQS5dss=; b=SqDr+uuowlLUXdqXe/sAkU4psmJmeEfo5HFj5VU4dyO9ze0fRs0T1nSjP8tZKnEWmZ Kc4TOxA2ocmj9n5jrQWwnXMsUXU2MD/HCyY2nef19GQZ+MD4PkDxpm78vEYjmxLSfFtl B/b5cj8v+3ag5tp/QuLkuf6th7aknqWiwhCj70dTPNxH3Po/XZHrpDhfKvpq8Q0bOZJd wiTIrFonBVoZSAivodG6d6PYrzZ7bG3MjTTwHTamDBAIQFCc0XWlZ3Siu4Kjc6bIAOdA vslSYMEVH9Y6mPxA+3Qo5sJP+MyTQHBB31gCtAgKXvmXAf/TL57gpslT3/M3l7gkFqBy J6KA== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b="AEf/bunn"; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id b27si3458667ejl.260.2021.09.12.13.19.51; Sun, 12 Sep 2021 13:19:51 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b="AEf/bunn"; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id D913C68A87F; Sun, 12 Sep 2021 23:19:47 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm1-f43.google.com (mail-wm1-f43.google.com [209.85.128.43]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 5085768A4C5 for ; Sun, 12 Sep 2021 23:19:41 +0300 (EEST) Received: by mail-wm1-f43.google.com with SMTP id 192-20020a1c04c9000000b002f7a4ab0a49so4084923wme.0 for ; Sun, 12 Sep 2021 13:19:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:subject:date:message-id; bh=zowVQwej3yG9FheF9TjVMQS0hyCcKTSjaz3ebS85ZSE=; b=AEf/bunnxnT7Z3cW8iSqjXr9L7m2KXildFUyBL4n3FSIm4uQ9nfSWDQ0U/HP4Mc4RS kenbeJq7KeUxR1MEuWwBqVGhwrVm587uLYKWeVtBb3heIiGJcBsy9iWdp3hdI4aXd+gG n/qT/d3Yb8GbZ6RROc/wvRi4hIRqL25ApETaI2PIo+JMUrBQDHLcHlQ+tlTUX9rfk6Df rQP5YHL/NoncYXtj16F/U4G/gsP0Fc+2lc+Vz0duGHmarwRkTpXj5ACkqYyGtwy41JeV bZ5Wr6F1qggWO5bnP0QkoMAnucwI4bMAIomNB+OFfy55Ttpf/mAghnV52Ek6A5jj6Qrr 9ptw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:subject:date:message-id; bh=zowVQwej3yG9FheF9TjVMQS0hyCcKTSjaz3ebS85ZSE=; b=TJnY3Ms/pQHgY7yRjvgIWQVfVYYX6HOeFNvNfX5HfYsTxLqsXU88fkN+JUsFftC/AA l+Y6O+QF70xKpK0Q657XSixB09w4omDScudDGZ1G3ESJUl+ULDPE/GvShOh2VAI48/iv XNqkJeGde+9OcAjRaZb2NO+hq+vHmfsVUqIYyE+7j6lw9F/VIh9K59qku0Jhe/1t3jJx 72HxTDmLI7BTcKqsHe01mer+xaaXF7NCtBKT0swpLE977ONd7e09XB/vbgyqzCYJnKAr TDHTAPQeN2I50L4uKOuEHWdjyzPPwDiE/0zJbYlr8w/IRPZkyfDluCWLFPdp0jSEuPYg 8viA== X-Gm-Message-State: AOAM532MYWml/rFNO1u6NE82jwYt0BRSesSdKtT/9/N5YlQ1yDBfUFUk W2kJFsrLt9uD4Ab4PymcBZGhGf5eQFY= X-Received: by 2002:a1c:228b:: with SMTP id i133mr8061786wmi.179.1631477980248; Sun, 12 Sep 2021 13:19:40 -0700 (PDT) Received: from localhost.localdomain ([212.15.177.26]) by smtp.gmail.com with ESMTPSA id t17sm5362920wra.95.2021.09.12.13.19.39 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 12 Sep 2021 13:19:39 -0700 (PDT) From: Paul B Mahol To: ffmpeg-devel@ffmpeg.org Date: Sun, 12 Sep 2021 22:19:28 +0200 Message-Id: <20210912201928.7693-1-onemda@gmail.com> X-Mailer: git-send-email 2.17.1 Subject: [FFmpeg-devel] [PATCH] avfilter: add audio signal to distortion ratio filter X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: GnYatmv4yqjO Signed-off-by: Paul B Mahol --- doc/filters.texi | 7 ++ libavfilter/Makefile | 1 + libavfilter/af_asdr.c | 197 +++++++++++++++++++++++++++++++++++++++ libavfilter/allfilters.c | 1 + 4 files changed, 206 insertions(+) create mode 100644 libavfilter/af_asdr.c diff --git a/doc/filters.texi b/doc/filters.texi index 8f20ccf8c6..6af7344820 100644 --- a/doc/filters.texi +++ b/doc/filters.texi @@ -2531,6 +2531,13 @@ noise removed from input signal. This filter supports the all above options as @ref{commands}. +@section asdr +Measure Audio Signal-to-Distortion Ratio. + +This filter takes two audio streams for input, and outputs first +audio stream. +Results are in dB per channel at end of either input. + @section asetnsamples Set the number of samples per each output audio frame. diff --git a/libavfilter/Makefile b/libavfilter/Makefile index 76c65c3f42..865252ef3f 100644 --- a/libavfilter/Makefile +++ b/libavfilter/Makefile @@ -82,6 +82,7 @@ OBJS-$(CONFIG_AREALTIME_FILTER) += f_realtime.o OBJS-$(CONFIG_ARESAMPLE_FILTER) += af_aresample.o OBJS-$(CONFIG_AREVERSE_FILTER) += f_reverse.o OBJS-$(CONFIG_ARNNDN_FILTER) += af_arnndn.o +OBJS-$(CONFIG_ASDR_FILTER) += af_asdr.o OBJS-$(CONFIG_ASEGMENT_FILTER) += f_segment.o OBJS-$(CONFIG_ASELECT_FILTER) += f_select.o OBJS-$(CONFIG_ASENDCMD_FILTER) += f_sendcmd.o diff --git a/libavfilter/af_asdr.c b/libavfilter/af_asdr.c new file mode 100644 index 0000000000..25032445cd --- /dev/null +++ b/libavfilter/af_asdr.c @@ -0,0 +1,197 @@ +/* + * Copyright (c) 2021 Paul B Mahol + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "libavutil/channel_layout.h" +#include "libavutil/common.h" +#include "libavutil/opt.h" + +#include "audio.h" +#include "avfilter.h" +#include "formats.h" +#include "filters.h" +#include "internal.h" + +typedef struct AudioSDRContext { + int channels; + int64_t pts; + double *sum_u; + double *sum_uv; + + AVFrame *cache[2]; +} AudioSDRContext; + +static int query_formats(AVFilterContext *ctx) +{ + static const enum AVSampleFormat sample_fmts[] = { + AV_SAMPLE_FMT_DBLP, + AV_SAMPLE_FMT_NONE + }; + int ret = ff_set_common_all_channel_counts(ctx); + if (ret < 0) + return ret; + + ret = ff_set_common_formats_from_list(ctx, sample_fmts); + if (ret < 0) + return ret; + + return ff_set_common_all_samplerates(ctx); +} + +static void sdr(AVFilterContext *ctx, const AVFrame *u, const AVFrame *v) +{ + AudioSDRContext *s = ctx->priv; + + for (int ch = 0; ch < u->channels; ch++) { + const double *const us = (double *)u->extended_data[ch]; + const double *const vs = (double *)v->extended_data[ch]; + double sum_uv = s->sum_uv[ch]; + double sum_u = s->sum_u[ch]; + + for (int n = 0; n < u->nb_samples; n++) { + sum_u += us[n] * us[n]; + sum_uv += (us[n] - vs[n]) * (us[n] - vs[n]); + } + + s->sum_uv[ch] = sum_uv; + s->sum_u[ch] = sum_u; + } +} + +static int activate(AVFilterContext *ctx) +{ + AudioSDRContext *s = ctx->priv; + int ret, status; + int available; + int64_t pts; + + FF_FILTER_FORWARD_STATUS_BACK_ALL(ctx->outputs[0], ctx); + + available = FFMIN(ff_inlink_queued_samples(ctx->inputs[0]), ff_inlink_queued_samples(ctx->inputs[1])); + if (available > 0) { + AVFrame *out; + + for (int i = 0; i < 2; i++) { + ret = ff_inlink_consume_samples(ctx->inputs[i], available, available, &s->cache[i]); + if (ret > 0) { + if (s->pts == AV_NOPTS_VALUE) + s->pts = s->cache[i]->pts; + } + } + + sdr(ctx, s->cache[0], s->cache[1]); + + av_frame_free(&s->cache[1]); + out = s->cache[0]; + out->nb_samples = available; + out->pts = s->pts; + s->pts += available; + s->cache[0] = NULL; + + return ff_filter_frame(ctx->outputs[0], out); + } + + for (int i = 0; i < 2; i++) { + if (ff_inlink_acknowledge_status(ctx->inputs[i], &status, &pts)) { + ff_outlink_set_status(ctx->outputs[0], status, pts); + return 0; + } + } + + if (ff_inlink_queued_samples(ctx->inputs[0]) > 0 && + ff_inlink_queued_samples(ctx->inputs[1]) > 0) { + ff_filter_set_ready(ctx, 10); + return 0; + } + + if (ff_outlink_frame_wanted(ctx->outputs[0])) { + for (int i = 0; i < 2; i++) { + if (ff_inlink_queued_samples(ctx->inputs[i]) > 0) + continue; + ff_inlink_request_frame(ctx->inputs[i]); + } + return 0; + } + + return FFERROR_NOT_READY; +} + +static int config_output(AVFilterLink *outlink) +{ + AVFilterContext *ctx = outlink->src; + AVFilterLink *inlink = ctx->inputs[0]; + AudioSDRContext *s = ctx->priv; + + s->pts = AV_NOPTS_VALUE; + + s->channels = inlink->channels; + outlink->format = inlink->format; + outlink->channels = inlink->channels; + + s->sum_u = av_calloc(outlink->channels, sizeof(*s->sum_u)); + s->sum_uv = av_calloc(outlink->channels, sizeof(*s->sum_uv)); + if (!s->sum_u || !s->sum_uv) + return AVERROR(ENOMEM); + + return 0; +} + +static av_cold void uninit(AVFilterContext *ctx) +{ + AudioSDRContext *s = ctx->priv; + + for (int ch = 0; ch < s->channels; ch++) + av_log(ctx, AV_LOG_INFO, "SDR ch%d: %g dB\n", ch, 20. * log10(s->sum_u[ch] / s->sum_uv[ch])); + + av_frame_free(&s->cache[0]); + av_frame_free(&s->cache[1]); + + av_freep(&s->sum_u); + av_freep(&s->sum_uv); +} + +static const AVFilterPad inputs[] = { + { + .name = "input0", + .type = AVMEDIA_TYPE_AUDIO, + }, + { + .name = "input1", + .type = AVMEDIA_TYPE_AUDIO, + }, +}; + +static const AVFilterPad outputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_AUDIO, + .config_props = config_output, + }, +}; + +const AVFilter ff_af_asdr = { + .name = "asdr", + .description = NULL_IF_CONFIG_SMALL("Measure Audio Signal-to-Distortion Ratio."), + .priv_size = sizeof(AudioSDRContext), + .query_formats = query_formats, + .activate = activate, + .uninit = uninit, + FILTER_INPUTS(inputs), + FILTER_OUTPUTS(outputs), +}; diff --git a/libavfilter/allfilters.c b/libavfilter/allfilters.c index 73a0bf9c44..7234ca6dbe 100644 --- a/libavfilter/allfilters.c +++ b/libavfilter/allfilters.c @@ -75,6 +75,7 @@ extern const AVFilter ff_af_arealtime; extern const AVFilter ff_af_aresample; extern const AVFilter ff_af_areverse; extern const AVFilter ff_af_arnndn; +extern const AVFilter ff_af_asdr; extern const AVFilter ff_af_asegment; extern const AVFilter ff_af_aselect; extern const AVFilter ff_af_asendcmd;