From patchwork Wed Sep 8 17:09:28 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Paul B Mahol X-Patchwork-Id: 30073 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6602:2a4a:0:0:0:0 with SMTP id k10csp621145iov; Wed, 8 Sep 2021 10:09:50 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxOC632uWs9hXckMi/YS3ALolrVANooqorrzprQF/48J+0TMuv6KB0/K9oCVqcD/YryoC94 X-Received: by 2002:a05:6402:34c5:: with SMTP id w5mr4655075edc.67.1631120990476; Wed, 08 Sep 2021 10:09:50 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1631120990; cv=none; d=google.com; s=arc-20160816; b=j8XBC24IWgl/k9D+2CwA+5IVRiclsZlPb69KIwqqFlYCrNlJOSoRSOOYIPX4neeKxd Y3AFX7sL34CZhCqjPSegyjXdMSRYkv0HrEj6rGfmm6Fvp8RvmBFlTOb8o1WSs3/EEXQk b26Y1eqYNiCfblThj9Fz1jenksjfAWRdDdIE6o7+2LNehAkWnCebRqxp5kfPg+/BCEFt u0sbJ0R4T3y0K066JQQIfdRuGeGpJ+6Jqja+phXhPw+XbE+8GJgNYCjokW4xZ/evhJTW nAXIQhsbEIGFbXVLGv17Q5vqU5WZt86eEcZ2tH5z7ojgUZZS/nYHPqMom9IjXOnHya2D WxBA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:message-id:date:to:from:dkim-signature :delivered-to; bh=uidEN6mzT9u4E77IFfiYhGUukiqGkuQAeu3wi6mXn2w=; b=UqGKGUU9Yg3ZcltGvUKGOBkrp/z4oAvxE6kNfpbFxL5GV1vqnvRJzMdK48FMMkR4Nz IjHBEuhp6QQ236/Q4RpnYLjVIhdxXEwn/BU3qAbFr/tOo+pwvP70FOEB+/XP58yTKXPz UaZ5RUOqdOrKl8R83a7NosEicCWHGRv/ZMOQIVhU/VfMDxRe2w8KAB46Oxh0A00qpxl9 bIvSGFK7mNu7/e+Zo3oaYftO43i1DcQxl8DXM+KLgPA6mE+3l61khUs5Oq99dPN7ABl9 UO8CFEQcR1kf4OuTzc2iYhw973Zazx6fi4FztXfGIdJKAdzBbfrOMbgWcqR7chkYCm+g LaZA== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=iRhFsjeG; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id l7si3587915edb.31.2021.09.08.10.09.48; Wed, 08 Sep 2021 10:09:50 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=iRhFsjeG; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 8828968A5FE; Wed, 8 Sep 2021 20:09:44 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-ed1-f44.google.com (mail-ed1-f44.google.com [209.85.208.44]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 60BCD689D1F for ; Wed, 8 Sep 2021 20:09:37 +0300 (EEST) Received: by mail-ed1-f44.google.com with SMTP id u19so3899293edb.3 for ; Wed, 08 Sep 2021 10:09:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:subject:date:message-id; bh=w4uoZdK4NdeYlh6BcAXy3C9RGYBN0rw9NG+StTI4BUA=; b=iRhFsjeGaNBd/VOjPziEFQqZz74ZE/0d/WUt1gwQkab192OnLOyL+1wymzTPtmzHic 3vu1hJH7KlAW/L6qdxA2bQHPLXb5Kup6q2kj0+/8f1WozCkR46cEAJ1ku3VKGgI0QEwT ApPQtFg6JZVSUaZc12+GAg2GA6j7JVCZJMtHxC0Uiqa84uw4VaQaciUOo58GsCjkzKYC kivOTyUh900ee7I39IN3LnzPlJzeBH0gJqk/M4wIc/mL8iphCyFSnazaf8IUiG+Lf7v9 +ok5I2yryjHWyBbq3aj3STq69hp8AYuj5jheRnZRjkUjqIwpvRrqSJ/Hmb5265CZL/BB KPYA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:subject:date:message-id; bh=w4uoZdK4NdeYlh6BcAXy3C9RGYBN0rw9NG+StTI4BUA=; b=VrvVO+DL9OP6Z8+WC13Ye/MN9nEMXu9YbJooOgpJV5nIy95XahvO0nrFrXSEvI3RC5 tqBd568lMKNf+Vy9NDw8hUjjHADFhPKo9A763lEiOyjkBHgGQfqjzA4QgyCPyH24nZ+H LrKFoHPtj+0wZUf45wP7lifNtggllSaE9Ib/ly1wPMSZaQrCDzE04nyOl9Il6Xglz8JJ ckyNVExJtksTu8P/I7YtisrkI1gl+anyec/MraSkqWsBEkaJtftyal6eMBETPMU6o4yM EtRMIWTabAZrVSW37xt2bQxB0l8qMiLFycZEu3carzqjZ0eZAJMgfyP6uhrCXLOqrBFp x/YQ== X-Gm-Message-State: AOAM531JHB9rUqYTWyMM8ratb38wL+UECqVurN5loj+2T7YVjQomMUGL G1B4MMe5cUdjutzD7ko+RiVc4EcEByg= X-Received: by 2002:a05:6402:c90:: with SMTP id cm16mr4908302edb.170.1631120976774; Wed, 08 Sep 2021 10:09:36 -0700 (PDT) Received: from localhost.localdomain ([95.168.120.0]) by smtp.gmail.com with ESMTPSA id mf2sm1321717ejb.76.2021.09.08.10.09.35 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 08 Sep 2021 10:09:36 -0700 (PDT) From: Paul B Mahol To: ffmpeg-devel@ffmpeg.org Date: Wed, 8 Sep 2021 19:09:28 +0200 Message-Id: <20210908170928.14975-1-onemda@gmail.com> X-Mailer: git-send-email 2.17.1 Subject: [FFmpeg-devel] [PATCH] avfilter: add (a)latency filters X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: W+XCb9Q9ouf5 Signed-off-by: Paul B Mahol --- libavfilter/Makefile | 2 + libavfilter/allfilters.c | 2 + libavfilter/f_latency.c | 171 +++++++++++++++++++++++++++++++++++++++ 3 files changed, 175 insertions(+) create mode 100644 libavfilter/f_latency.c diff --git a/libavfilter/Makefile b/libavfilter/Makefile index 8031f59af5..d12f7dc3a5 100644 --- a/libavfilter/Makefile +++ b/libavfilter/Makefile @@ -60,6 +60,7 @@ OBJS-$(CONFIG_AGATE_FILTER) += af_agate.o OBJS-$(CONFIG_AIIR_FILTER) += af_aiir.o OBJS-$(CONFIG_AINTEGRAL_FILTER) += af_aderivative.o OBJS-$(CONFIG_AINTERLEAVE_FILTER) += f_interleave.o +OBJS-$(CONFIG_ALATENCY_FILTER) += f_latency.o OBJS-$(CONFIG_ALIMITER_FILTER) += af_alimiter.o OBJS-$(CONFIG_ALLPASS_FILTER) += af_biquads.o OBJS-$(CONFIG_ALOOP_FILTER) += f_loop.o @@ -317,6 +318,7 @@ OBJS-$(CONFIG_INTERLEAVE_FILTER) += f_interleave.o OBJS-$(CONFIG_KERNDEINT_FILTER) += vf_kerndeint.o OBJS-$(CONFIG_KIRSCH_FILTER) += vf_convolution.o OBJS-$(CONFIG_LAGFUN_FILTER) += vf_lagfun.o +OBJS-$(CONFIG_LATENCY_FILTER) += f_latency.o OBJS-$(CONFIG_LENSCORRECTION_FILTER) += vf_lenscorrection.o OBJS-$(CONFIG_LENSFUN_FILTER) += vf_lensfun.o OBJS-$(CONFIG_LIBVMAF_FILTER) += vf_libvmaf.o framesync.o diff --git a/libavfilter/allfilters.c b/libavfilter/allfilters.c index e1e43726b5..e809d3b7c4 100644 --- a/libavfilter/allfilters.c +++ b/libavfilter/allfilters.c @@ -53,6 +53,7 @@ extern const AVFilter ff_af_agate; extern const AVFilter ff_af_aiir; extern const AVFilter ff_af_aintegral; extern const AVFilter ff_af_ainterleave; +extern const AVFilter ff_af_alatency; extern const AVFilter ff_af_alimiter; extern const AVFilter ff_af_allpass; extern const AVFilter ff_af_aloop; @@ -302,6 +303,7 @@ extern const AVFilter ff_vf_interleave; extern const AVFilter ff_vf_kerndeint; extern const AVFilter ff_vf_kirsch; extern const AVFilter ff_vf_lagfun; +extern const AVFilter ff_vf_latency; extern const AVFilter ff_vf_lenscorrection; extern const AVFilter ff_vf_lensfun; extern const AVFilter ff_vf_libvmaf; diff --git a/libavfilter/f_latency.c b/libavfilter/f_latency.c new file mode 100644 index 0000000000..324040922f --- /dev/null +++ b/libavfilter/f_latency.c @@ -0,0 +1,171 @@ +/* + * Copyright (c) 2021 Paul B Mahol + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "libavutil/opt.h" +#include "avfilter.h" +#include "filters.h" +#include "formats.h" +#include "internal.h" + +typedef struct LatencyContext { + const AVClass *class; + + int64_t min_latency; + int64_t max_latency; + int64_t sum; +} LatencyContext; + +#define OFFSET(x) offsetof(LatencyContext, x) +#define VF AV_OPT_FLAG_VIDEO_PARAM|AV_OPT_FLAG_FILTERING_PARAM + +static const AVOption latency_options[] = { + { NULL } +}; + +static av_cold int init(AVFilterContext *ctx) +{ + LatencyContext *s = ctx->priv; + + s->min_latency = INT64_MAX; + s->max_latency = INT64_MIN; + + return 0; +} + +static int activate(AVFilterContext *ctx) +{ + LatencyContext *s = ctx->priv; + AVFilterLink *inlink = ctx->inputs[0]; + AVFilterLink *outlink = ctx->outputs[0]; + + FF_FILTER_FORWARD_STATUS_BACK(outlink, inlink); + + if (ctx->inputs[0]->src && + ctx->inputs[0]->src->nb_inputs > 0) { + AVFilterLink *prevlink = ctx->inputs[0]->src->inputs[0]; + int64_t delta = 0; + + switch (prevlink->type) { + case AVMEDIA_TYPE_AUDIO: + delta = prevlink->sample_count_in - inlink->sample_count_out; + break; + case AVMEDIA_TYPE_VIDEO: + delta = prevlink->frame_count_in - inlink->frame_count_out; + break; + } + + if (delta > 0) { + s->min_latency = FFMIN(s->min_latency, delta); + s->max_latency = FFMAX(s->max_latency, delta); + } + } + + if (ff_inlink_queued_frames(inlink)) { + AVFrame *frame = NULL; + int ret; + + ret = ff_inlink_consume_frame(inlink, &frame); + if (ret < 0) + return ret; + if (ret > 0) + return ff_filter_frame(outlink, frame); + } + + FF_FILTER_FORWARD_STATUS(inlink, outlink); + FF_FILTER_FORWARD_WANTED(outlink, inlink); + + return FFERROR_NOT_READY; +} + +static av_cold void uninit(AVFilterContext *ctx) +{ + LatencyContext *s = ctx->priv; + + if (s->min_latency != INT64_MAX) + av_log(ctx, AV_LOG_INFO, "Min latency: %"PRId64"\n", s->min_latency); + if (s->max_latency != INT64_MIN) + av_log(ctx, AV_LOG_INFO, "Max latency: %"PRId64"\n", s->max_latency); +} + +#if CONFIG_LATENCY_FILTER + +AVFILTER_DEFINE_CLASS(latency); + +static const AVFilterPad latency_inputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + }, +}; + +static const AVFilterPad latency_outputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + }, +}; + +const AVFilter ff_vf_latency = { + .name = "latency", + .description = NULL_IF_CONFIG_SMALL("Report video filtering latency."), + .priv_size = sizeof(LatencyContext), + .priv_class = &latency_class, + .init = init, + .uninit = uninit, + .activate = activate, + .flags = AVFILTER_FLAG_SUPPORT_TIMELINE, + FILTER_INPUTS(latency_inputs), + FILTER_OUTPUTS(latency_outputs), +}; + +#endif // CONFIG_LATENCY_FILTER + +#if CONFIG_ALATENCY_FILTER + +#define alatency_options latency_options +AVFILTER_DEFINE_CLASS(alatency); + +static const AVFilterPad alatency_inputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_AUDIO, + }, +}; + +static const AVFilterPad alatency_outputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_AUDIO, + }, +}; + +const AVFilter ff_af_alatency = { + .name = "alatency", + .description = NULL_IF_CONFIG_SMALL("Report audio filtering latency."), + .priv_size = sizeof(LatencyContext), + .priv_class = &alatency_class, + .init = init, + .uninit = uninit, + .activate = activate, + .flags = AVFILTER_FLAG_SUPPORT_TIMELINE, + FILTER_INPUTS(alatency_inputs), + FILTER_OUTPUTS(alatency_outputs), +}; +#endif // CONFIG_ALATENCY_FILTER