From patchwork Tue Apr 9 12:57:29 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Niklas Haas X-Patchwork-Id: 47981 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:9c8d:b0:1a7:a0dc:8de5 with SMTP id mj13csp333772pzb; Tue, 9 Apr 2024 06:01:29 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCWDNzyd6s67LPH+1QQduV4/fzbG3Naw1YGO7oTeCKT3aaI2eNNcb9soS2XE0N5NTNHefoFepvubDr53i9QStRL7C1RlbL3UlG8zBg== X-Google-Smtp-Source: AGHT+IEkD4JPQS94BH+mnMZotLbTr1dF0LU6VgVdLJLAsJJriUhii0Uqj5JXPcePW62CsNR78qHI X-Received: by 2002:a17:907:1b29:b0:a51:da1d:c0e1 with SMTP id mp41-20020a1709071b2900b00a51da1dc0e1mr4104194ejc.50.1712667689479; Tue, 09 Apr 2024 06:01:29 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1712667689; cv=none; d=google.com; s=arc-20160816; b=uqL6bi1h1+n3fNMeWjHzzWoKwLSHA6SO1N7QHLFr683GbxOdMgPQY5phBD1M6KGSaK 12rAW6DKbEI0TfbIAzWcJTS+PZ9a+n1MlfGL1+vaTMFP7tcmcYZEKiEJGUQLK6VgB+rj Bw5FZ4oP9oYVycWbEaMVvrtLULFsC889/CAa93HKEaOrl4LyPLFz90VYIrJ5a7GAu5UA /z5TyyZqbB/sYB3ZwZ5b+yaPD3quXm23IBHUIFpCs6ihremhhkn9hzKJ1VedSXQM9eMV 49Ak/30wLdV5GCks6GbNsOtHWpxvcgNR1EzNDxkghJ3RhknsUVMHm3k/6E2ziWXzfDyI eB5g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:delivered-to; bh=pdyVCtNf+UBvyze1d0kOtYJNOPSrDcNiE/kwiiNon6k=; fh=xmAeKtysnShNOmkhiJmYkS30uw4Fu2hvBJ7qlIwukxQ=; b=Ac0d/inkLDfUDILe4Wv8Ej456xNAQdMvU7PM+mMfAyGJx+CtgkvrZ3Z97TNL6jVNDN qF1eWfQrm4nnZHHEEYLuHeJe+6fChWcpItlpnWHys/dgCRZqvZka+4SMbjf54zuAPi0o 8N8YlAE/18XTyjISU7etTHmJRvMq0egkb3QW/8d37WVVmBN/H9HZfcJ8ugSeHmJ4CkOm +pt6dBMlqIc2+l/G8jT7yfwPXff1NL1Tj4R0HJlIgbz6pvU8DQSrfEQbJ67tpBQB3hF2 8qTjXweGmGf6I0Agdyx2CDXRxlnN8i/IbA8VU33eHOE3XBeeS+kootinJ2wr/8tHhRRT a6TA==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@haasn.xyz header.s=mail header.b=DYl04w+1; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id j19-20020a170906255300b00a519d6027a0si4611314ejb.542.2024.04.09.06.01.24; Tue, 09 Apr 2024 06:01:29 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@haasn.xyz header.s=mail header.b=DYl04w+1; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id B583F68D1FC; Tue, 9 Apr 2024 15:59:33 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from haasn.dev (haasn.dev [78.46.187.166]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 473D468D188 for ; Tue, 9 Apr 2024 15:59:22 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=haasn.xyz; s=mail; t=1712667558; bh=SwkEC+YozGgsU3YLXl+zkKSjhor7Vl+YO1BAPz1Deb8=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=DYl04w+1lfLiVzzVl0j91w4Jbum8sANZMIRGwYm/sE6PmiJPPqYC1TvMm8eOZcvxT 61JbQz6hM831ahp5nDa5FaRcgWA5TvCByzH7SiV5N8j48DBDHhethPguIfzn/mArht VwpHnKjckMIhhbEbtmfGbhc2FDXW2kmLk+fHRBnQ= Received: from haasn.dev (unknown [10.30.0.2]) by haasn.dev (Postfix) with ESMTP id 544AD433CD; Tue, 9 Apr 2024 14:59:18 +0200 (CEST) From: Niklas Haas To: ffmpeg-devel@ffmpeg.org Date: Tue, 9 Apr 2024 14:57:29 +0200 Message-ID: <20240409125914.61149-10-ffmpeg@haasn.xyz> X-Mailer: git-send-email 2.44.0 In-Reply-To: <20240409125914.61149-1-ffmpeg@haasn.xyz> References: <20240409125914.61149-1-ffmpeg@haasn.xyz> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v2 09/11] avcodec/libaomenc: implement dolby vision coding X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Niklas Haas Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: TLhogeJgKIaH From: Niklas Haas --- libavcodec/libaomenc.c | 28 ++++++++++++++++++++++++++++ 1 file changed, 28 insertions(+) diff --git a/libavcodec/libaomenc.c b/libavcodec/libaomenc.c index 4a71bba9c9c..b43a902a384 100644 --- a/libavcodec/libaomenc.c +++ b/libavcodec/libaomenc.c @@ -43,6 +43,7 @@ #include "avcodec.h" #include "bsf.h" #include "codec_internal.h" +#include "dovi_rpu.h" #include "encode.h" #include "internal.h" #include "libaom.h" @@ -70,6 +71,7 @@ struct FrameListData { typedef struct AOMEncoderContext { AVClass *class; AVBSFContext *bsf; + DOVIContext dovi; struct aom_codec_ctx encoder; struct aom_image rawimg; struct aom_fixed_buf twopass_stats; @@ -421,6 +423,7 @@ static av_cold int aom_free(AVCodecContext *avctx) av_freep(&avctx->stats_out); free_frame_list(ctx->coded_frame_list); av_bsf_free(&ctx->bsf); + ff_dovi_ctx_unref(&ctx->dovi); return 0; } @@ -989,6 +992,10 @@ static av_cold int aom_init(AVCodecContext *avctx, if (!cpb_props) return AVERROR(ENOMEM); + ctx->dovi.logctx = avctx; + if ((res = ff_dovi_configure(&ctx->dovi, avctx)) < 0) + return res; + if (avctx->flags & AV_CODEC_FLAG_GLOBAL_HEADER) { const AVBitStreamFilter *filter = av_bsf_get_by_name("extract_extradata"); int ret; @@ -1242,6 +1249,7 @@ static int aom_encode(AVCodecContext *avctx, AVPacket *pkt, unsigned long duration = 0; int res, coded_size; aom_enc_frame_flags_t flags = 0; + AVFrameSideData *sd; if (frame) { rawimg = &ctx->rawimg; @@ -1279,6 +1287,24 @@ FF_ENABLE_DEPRECATION_WARNINGS break; } + sd = av_frame_get_side_data(frame, AV_FRAME_DATA_DOVI_METADATA); + if (ctx->dovi.cfg.dv_profile && sd) { + const AVDOVIMetadata *metadata = (const AVDOVIMetadata *)sd->data; + uint8_t *t35; + int size; + if ((res = ff_dovi_rpu_generate(&ctx->dovi, metadata, &t35, &size)) < 0) + return res; + res = aom_img_add_metadata(rawimg, OBU_METADATA_TYPE_ITUT_T35, + t35, size, AOM_MIF_ANY_FRAME); + av_free(t35); + if (res != AOM_CODEC_OK) + return AVERROR(ENOMEM); + } else if (ctx->dovi.cfg.dv_profile) { + av_log(avctx, AV_LOG_ERROR, "Dolby Vision enabled, but received frame " + "without AV_FRAME_DATA_DOVI_METADATA\n"); + return AVERROR_INVALIDDATA; + } + if (frame->pict_type == AV_PICTURE_TYPE_I) flags |= AOM_EFLAG_FORCE_KF; } @@ -1459,6 +1485,8 @@ static const AVOption options[] = { { "ssim", NULL, 0, AV_OPT_TYPE_CONST, {.i64 = AOM_TUNE_SSIM}, 0, 0, VE, .unit = "tune"}, FF_AV1_PROFILE_OPTS { "still-picture", "Encode in single frame mode (typically used for still AVIF images).", OFFSET(still_picture), AV_OPT_TYPE_BOOL, {.i64 = 0}, -1, 1, VE }, + { "dolbyvision", "Enable Dolby Vision RPU coding", OFFSET(dovi.enable), AV_OPT_TYPE_BOOL, {.i64 = FF_DOVI_AUTOMATIC }, -1, 1, VE, .unit = "dovi" }, + { "auto", NULL, 0, AV_OPT_TYPE_CONST, {.i64 = FF_DOVI_AUTOMATIC}, .flags = VE, .unit = "dovi" }, { "enable-rect-partitions", "Enable rectangular partitions", OFFSET(enable_rect_partitions), AV_OPT_TYPE_BOOL, {.i64 = -1}, -1, 1, VE}, { "enable-1to4-partitions", "Enable 1:4/4:1 partitions", OFFSET(enable_1to4_partitions), AV_OPT_TYPE_BOOL, {.i64 = -1}, -1, 1, VE}, { "enable-ab-partitions", "Enable ab shape partitions", OFFSET(enable_ab_partitions), AV_OPT_TYPE_BOOL, {.i64 = -1}, -1, 1, VE},