From patchwork Thu Feb 4 16:50:11 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Paul B Mahol X-Patchwork-Id: 25391 Return-Path: X-Original-To: patchwork@ffaux-bg.ffmpeg.org Delivered-To: patchwork@ffaux-bg.ffmpeg.org Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by ffaux.localdomain (Postfix) with ESMTP id 9757844A385 for ; Thu, 4 Feb 2021 18:50:28 +0200 (EET) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 7262D687FD4; Thu, 4 Feb 2021 18:50:28 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-ej1-f47.google.com (mail-ej1-f47.google.com [209.85.218.47]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 8A737687F93 for ; Thu, 4 Feb 2021 18:50:21 +0200 (EET) Received: by mail-ej1-f47.google.com with SMTP id y9so6474305ejp.10 for ; Thu, 04 Feb 2021 08:50:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id; bh=3AAwMmYEiXLK1G6i3Qe9tlPzIgqmACuDUZlXBK3xajU=; b=EOOfW4OdMlrqpTORrQzoAfevnlXAwKoHxGOXjoUmTL/hYGLle02Ssnvi14QMkD2vw7 JckDDQihC0afqWz3ypTvZKWvp0R3TbVRP91OcvsdJ6ycmrwvKZRmt2dztbHaasgFYx0O EvS2wkVrXlxzzGuiDrntKIuPog7ZOMYaLxHZE1JhALCQ7gmwuHrjAXpTJQ9KLXIfccsd 0CFLKG5/GHEds5+dK+76+hK2tAa5EHO6btAh1uo57GeZtpMo4G/7PLV7SjpqIyCcoO/w RxyEwilzvMrg98OgMEC93bzKP0P+NRmja3JDConsSblS0aIP1HZkkMV+dm1fU9w4cEws BPeg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id; bh=3AAwMmYEiXLK1G6i3Qe9tlPzIgqmACuDUZlXBK3xajU=; b=cZQFWnwvTVzkduRBTcXxQEUiS6TJ2WmqRI1BtqxVofjKRZSo2vSQyfwqwbh7Z5/XYG K/krPKtnoIXugKuG8sKkNMrdzUBvbEnKNotMGsQPreTbJr6El3iLwsyNZesCwoo+6CXx crl/99aRTvqP+bXO0NLHpcLa86nJRIVcFVWsj686ItEdNNsvwjMc9CgNq45KSkJUwgEc XbZvljiWmOVhptMQsgaevt4/oMAxKNoMpv4EozENupYoEbAvyG/cD2TNjI9TJv1cPh5Z pUh5LfaocmqSvSU8ISKAUhtpjWcce5KAwrYaG1FkzElzWQlj1NwvhP6dwtju7Kof+hVw 1xnQ== X-Gm-Message-State: AOAM530+P0L4DDksHN5FUNQPK/ys9bbZaGInQRqqz8A+K/wTewSGILqH d+PUUwqFW4o+VBL16aPmxn1bFVLjFReUJQ== X-Google-Smtp-Source: ABdhPJySGDhsSkLDpcTHxEyo7CPKJ87XcdRmCyDWSDpwsQqq1wc4TXXRMk8hiKj8uZl/2l6/FRCVZQ== X-Received: by 2002:a17:906:7d09:: with SMTP id u9mr9857ejo.380.1612457420743; Thu, 04 Feb 2021 08:50:20 -0800 (PST) Received: from localhost.localdomain ([31.45.254.141]) by smtp.gmail.com with ESMTPSA id y9sm2717392edi.74.2021.02.04.08.50.19 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 04 Feb 2021 08:50:20 -0800 (PST) From: Paul B Mahol To: ffmpeg-devel@ffmpeg.org Date: Thu, 4 Feb 2021 17:50:11 +0100 Message-Id: <20210204165011.28970-1-onemda@gmail.com> X-Mailer: git-send-email 2.17.1 Subject: [FFmpeg-devel] [PATCH] avfilter: add colorize filter X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Signed-off-by: Paul B Mahol --- doc/filters.texi | 27 ++++ libavfilter/Makefile | 1 + libavfilter/allfilters.c | 1 + libavfilter/vf_colorize.c | 306 ++++++++++++++++++++++++++++++++++++++ 4 files changed, 335 insertions(+) create mode 100644 libavfilter/vf_colorize.c diff --git a/doc/filters.texi b/doc/filters.texi index 52bced3143..c4aa31a91c 100644 --- a/doc/filters.texi +++ b/doc/filters.texi @@ -8163,6 +8163,33 @@ colorchannelmixer=.393:.769:.189:0:.349:.686:.168:0:.272:.534:.131 This filter supports the all above options as @ref{commands}. +@section colorize +Overlay a solid color on the video stream. + +The filter accepts the following options: + +@table @option +@item hue +Set the color hue. Allowed range is from 0 to 360. +Default value is 0. + +@item saturation +Set the color saturation. Allowed range is from 0 to 1. +Default value is 0.5. + +@item lightness +Set the color lightness. Allowed range is from 0 to 1. +Default value is 0.5. + +@item mix +Set the mix of source lightness. By default is set to 1.0. +Allowed range is from 0.0 to 1.0. +@end table + +@subsection Commands + +This filter supports the all above options as @ref{commands}. + @section colorkey RGB colorspace color keying. diff --git a/libavfilter/Makefile b/libavfilter/Makefile index 68ff8e26d2..e26f181d21 100644 --- a/libavfilter/Makefile +++ b/libavfilter/Makefile @@ -198,6 +198,7 @@ OBJS-$(CONFIG_COLORBALANCE_FILTER) += vf_colorbalance.o OBJS-$(CONFIG_COLORCHANNELMIXER_FILTER) += vf_colorchannelmixer.o OBJS-$(CONFIG_COLORCONTRAST_FILTER) += vf_colorcontrast.o OBJS-$(CONFIG_COLORCORRECT_FILTER) += vf_colorcorrect.o +OBJS-$(CONFIG_COLORIZE_FILTER) += vf_colorize.o OBJS-$(CONFIG_COLORKEY_FILTER) += vf_colorkey.o OBJS-$(CONFIG_COLORKEY_OPENCL_FILTER) += vf_colorkey_opencl.o opencl.o \ opencl/colorkey.o diff --git a/libavfilter/allfilters.c b/libavfilter/allfilters.c index 3b4620a5d7..53d7063d54 100644 --- a/libavfilter/allfilters.c +++ b/libavfilter/allfilters.c @@ -188,6 +188,7 @@ extern AVFilter ff_vf_colorbalance; extern AVFilter ff_vf_colorchannelmixer; extern AVFilter ff_vf_colorcontrast; extern AVFilter ff_vf_colorcorrect; +extern AVFilter ff_vf_colorize; extern AVFilter ff_vf_colorkey; extern AVFilter ff_vf_colorkey_opencl; extern AVFilter ff_vf_colorhold; diff --git a/libavfilter/vf_colorize.c b/libavfilter/vf_colorize.c new file mode 100644 index 0000000000..e9d348201d --- /dev/null +++ b/libavfilter/vf_colorize.c @@ -0,0 +1,306 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "libavutil/opt.h" +#include "libavutil/imgutils.h" +#include "avfilter.h" +#include "formats.h" +#include "internal.h" +#include "video.h" + +typedef struct ColorizeContext { + const AVClass *class; + + float hue; + float saturation; + float lightness; + float mix; + + int depth; + int c[3]; + int planewidth[4]; + int planeheight[4]; + + int (*do_plane_slice[2])(AVFilterContext *s, void *arg, + int jobnr, int nb_jobs); +} ColorizeContext; + +static inline float lerpf(float v0, float v1, float f) +{ + return v0 + (v1 - v0) * f; +} + +static int colorizey_slice8(AVFilterContext *ctx, void *arg, int jobnr, int nb_jobs) +{ + ColorizeContext *s = ctx->priv; + AVFrame *frame = arg; + const int width = s->planewidth[0]; + const int height = s->planeheight[0]; + const int slice_start = (height * jobnr) / nb_jobs; + const int slice_end = (height * (jobnr + 1)) / nb_jobs; + const int ylinesize = frame->linesize[0]; + uint8_t *yptr = frame->data[0] + slice_start * ylinesize; + const int yv = s->c[0]; + const float mix = s->mix; + + for (int y = slice_start; y < slice_end; y++) { + for (int x = 0; x < width; x++) + yptr[x] = lerpf(yv, yptr[x], mix); + + yptr += ylinesize; + } + + return 0; +} + +static int colorizey_slice16(AVFilterContext *ctx, void *arg, int jobnr, int nb_jobs) +{ + ColorizeContext *s = ctx->priv; + AVFrame *frame = arg; + const int width = s->planewidth[0]; + const int height = s->planeheight[0]; + const int slice_start = (height * jobnr) / nb_jobs; + const int slice_end = (height * (jobnr + 1)) / nb_jobs; + const int ylinesize = frame->linesize[0] / 2; + uint16_t *yptr = (uint16_t *)frame->data[0] + slice_start * ylinesize; + const int yv = s->c[0]; + const float mix = s->mix; + + for (int y = slice_start; y < slice_end; y++) { + for (int x = 0; x < width; x++) + yptr[x] = lerpf(yv, yptr[x], mix); + + yptr += ylinesize; + } + + return 0; +} + +static int colorize_slice8(AVFilterContext *ctx, void *arg, int jobnr, int nb_jobs) +{ + ColorizeContext *s = ctx->priv; + AVFrame *frame = arg; + const int width = s->planewidth[1]; + const int height = s->planeheight[1]; + const int slice_start = (height * jobnr) / nb_jobs; + const int slice_end = (height * (jobnr + 1)) / nb_jobs; + const int ulinesize = frame->linesize[1]; + const int vlinesize = frame->linesize[2]; + uint8_t *uptr = frame->data[1] + slice_start * ulinesize; + uint8_t *vptr = frame->data[2] + slice_start * vlinesize; + const int u = s->c[1]; + const int v = s->c[2]; + + for (int y = slice_start; y < slice_end; y++) { + for (int x = 0; x < width; x++) { + uptr[x] = u; + vptr[x] = v; + } + + uptr += ulinesize; + vptr += vlinesize; + } + + return 0; +} + +static int colorize_slice16(AVFilterContext *ctx, void *arg, int jobnr, int nb_jobs) +{ + ColorizeContext *s = ctx->priv; + AVFrame *frame = arg; + const int width = s->planewidth[1]; + const int height = s->planeheight[1]; + const int slice_start = (height * jobnr) / nb_jobs; + const int slice_end = (height * (jobnr + 1)) / nb_jobs; + const int ulinesize = frame->linesize[1] / 2; + const int vlinesize = frame->linesize[2] / 2; + uint16_t *uptr = (uint16_t *)frame->data[1] + slice_start * ulinesize; + uint16_t *vptr = (uint16_t *)frame->data[2] + slice_start * vlinesize; + const int u = s->c[1]; + const int v = s->c[2]; + + for (int y = slice_start; y < slice_end; y++) { + for (int x = 0; x < width; x++) { + uptr[x] = u; + vptr[x] = v; + } + + uptr += ulinesize; + vptr += vlinesize; + } + + return 0; +} + +static int do_slice(AVFilterContext *ctx, void *arg, int jobnr, int nb_jobs) +{ + ColorizeContext *s = ctx->priv; + + s->do_plane_slice[0](ctx, arg, jobnr, nb_jobs); + s->do_plane_slice[1](ctx, arg, jobnr, nb_jobs); + + return 0; +} + +static float hue2rgb(float p, float q, float t) +{ + if (t < 0.f) t += 1.f; + if (t > 1.f) t -= 1.f; + if (t < 1.f/6.f) return p + (q - p) * 6.f * t; + if (t < 1.f/2.f) return q; + if (t < 2.f/3.f) return p + (q - p) * (2.f/3.f - t) * 6.f; + + return p; +} + +static void hsl2rgb(float h, float s, float l, float *r, float *g, float *b) +{ + h /= 360.f; + + if (s == 0.f) { + *r = *g = *b = l; + } else { + const float q = l < 0.5f ? l * (1.f + s) : l + s - l * s; + const float p = 2.f * l - q; + + *r = hue2rgb(p, q, h + 1.f / 3.f); + *g = hue2rgb(p, q, h); + *b = hue2rgb(p, q, h - 1.f / 3.f); + } +} + +static void rgb2yuv(float r, float g, float b, int *y, int *u, int *v, int depth) +{ + *y = ((0.21260*219.0/255.0) * r + (0.71520*219.0/255.0) * g + + (0.07220*219.0/255.0) * b) * ((1 << depth) - 1); + *u = (-(0.11457*224.0/255.0) * r - (0.38543*224.0/255.0) * g + + (0.50000*224.0/255.0) * b + 0.5) * ((1 << depth) - 1); + *v = ((0.50000*224.0/255.0) * r - (0.45415*224.0/255.0) * g - + (0.04585*224.0/255.0) * b + 0.5) * ((1 << depth) - 1); +} + +static int filter_frame(AVFilterLink *inlink, AVFrame *frame) +{ + AVFilterContext *ctx = inlink->dst; + ColorizeContext *s = ctx->priv; + float c[3]; + + hsl2rgb(s->hue, s->saturation, s->lightness, &c[0], &c[1], &c[2]); + rgb2yuv(c[0], c[1], c[2], &s->c[0], &s->c[1], &s->c[2], s->depth); + + ctx->internal->execute(ctx, do_slice, frame, NULL, + FFMIN(s->planeheight[1], ff_filter_get_nb_threads(ctx))); + + return ff_filter_frame(ctx->outputs[0], frame); +} + +static av_cold int query_formats(AVFilterContext *ctx) +{ + static const enum AVPixelFormat pixel_fmts[] = { + AV_PIX_FMT_YUV410P, AV_PIX_FMT_YUV411P, + AV_PIX_FMT_YUV420P, AV_PIX_FMT_YUV422P, + AV_PIX_FMT_YUV440P, AV_PIX_FMT_YUV444P, + AV_PIX_FMT_YUVJ420P, AV_PIX_FMT_YUVJ422P, + AV_PIX_FMT_YUVJ440P, AV_PIX_FMT_YUVJ444P, + AV_PIX_FMT_YUVJ411P, + AV_PIX_FMT_YUV420P9, AV_PIX_FMT_YUV422P9, AV_PIX_FMT_YUV444P9, + AV_PIX_FMT_YUV420P10, AV_PIX_FMT_YUV422P10, AV_PIX_FMT_YUV444P10, + AV_PIX_FMT_YUV440P10, + AV_PIX_FMT_YUV444P12, AV_PIX_FMT_YUV422P12, AV_PIX_FMT_YUV420P12, + AV_PIX_FMT_YUV440P12, + AV_PIX_FMT_YUV444P14, AV_PIX_FMT_YUV422P14, AV_PIX_FMT_YUV420P14, + AV_PIX_FMT_YUV420P16, AV_PIX_FMT_YUV422P16, AV_PIX_FMT_YUV444P16, + AV_PIX_FMT_YUVA420P, AV_PIX_FMT_YUVA422P, AV_PIX_FMT_YUVA444P, + AV_PIX_FMT_YUVA444P9, AV_PIX_FMT_YUVA444P10, AV_PIX_FMT_YUVA444P12, AV_PIX_FMT_YUVA444P16, + AV_PIX_FMT_YUVA422P9, AV_PIX_FMT_YUVA422P10, AV_PIX_FMT_YUVA422P12, AV_PIX_FMT_YUVA422P16, + AV_PIX_FMT_YUVA420P9, AV_PIX_FMT_YUVA420P10, AV_PIX_FMT_YUVA420P16, + AV_PIX_FMT_NONE + }; + + AVFilterFormats *formats = NULL; + + formats = ff_make_format_list(pixel_fmts); + if (!formats) + return AVERROR(ENOMEM); + + return ff_set_common_formats(ctx, formats); +} + +static av_cold int config_input(AVFilterLink *inlink) +{ + AVFilterContext *ctx = inlink->dst; + ColorizeContext *s = ctx->priv; + const AVPixFmtDescriptor *desc = av_pix_fmt_desc_get(inlink->format); + int depth; + + s->depth = depth = desc->comp[0].depth; + + s->planewidth[1] = s->planewidth[2] = AV_CEIL_RSHIFT(inlink->w, desc->log2_chroma_w); + s->planewidth[0] = s->planewidth[3] = inlink->w; + s->planeheight[1] = s->planeheight[2] = AV_CEIL_RSHIFT(inlink->h, desc->log2_chroma_h); + s->planeheight[0] = s->planeheight[3] = inlink->h; + + s->do_plane_slice[0] = depth <= 8 ? colorizey_slice8 : colorizey_slice16; + s->do_plane_slice[1] = depth <= 8 ? colorize_slice8 : colorize_slice16; + + return 0; +} + +static const AVFilterPad colorize_inputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + .needs_writable = 1, + .filter_frame = filter_frame, + .config_props = config_input, + }, + { NULL } +}; + +static const AVFilterPad colorize_outputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + }, + { NULL } +}; + +#define OFFSET(x) offsetof(ColorizeContext, x) +#define VF AV_OPT_FLAG_FILTERING_PARAM|AV_OPT_FLAG_VIDEO_PARAM|AV_OPT_FLAG_RUNTIME_PARAM + +static const AVOption colorize_options[] = { + { "hue", "set the hue", OFFSET(hue), AV_OPT_TYPE_FLOAT, {.dbl=0}, 0, 360, VF }, + { "saturation", "set the saturation", OFFSET(saturation), AV_OPT_TYPE_FLOAT, {.dbl=0.5},0, 1, VF }, + { "lightness", "set the lightness", OFFSET(lightness), AV_OPT_TYPE_FLOAT, {.dbl=0.5},0, 1, VF }, + { "mix", "set the mix of source lightness", OFFSET(mix), AV_OPT_TYPE_FLOAT, {.dbl=1}, 0, 1, VF }, + { NULL } +}; + +AVFILTER_DEFINE_CLASS(colorize); + +AVFilter ff_vf_colorize = { + .name = "colorize", + .description = NULL_IF_CONFIG_SMALL("Overlay a solid color on the video stream."), + .priv_size = sizeof(ColorizeContext), + .priv_class = &colorize_class, + .query_formats = query_formats, + .inputs = colorize_inputs, + .outputs = colorize_outputs, + .flags = AVFILTER_FLAG_SUPPORT_TIMELINE_GENERIC | AVFILTER_FLAG_SLICE_THREADS, + .process_command = ff_filter_process_command, +};