From patchwork Wed Jan 19 13:40:43 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anton Khirnov X-Patchwork-Id: 33658 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a6b:cd86:0:0:0:0:0 with SMTP id d128csp4796935iog; Wed, 19 Jan 2022 05:41:54 -0800 (PST) X-Google-Smtp-Source: ABdhPJz0wp9BAg5oRtei8rFpHJpAFxmUmFgJ2UkQ9OgM8uW02Tr24Sm+fwioUc5xASUAPB+nbnbE X-Received: by 2002:a17:907:1b0d:: with SMTP id mp13mr24047656ejc.29.1642599714558; Wed, 19 Jan 2022 05:41:54 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1642599714; cv=none; d=google.com; s=arc-20160816; b=SZL7JrhqAuGbKkvQ2TmOXT4AB1ACrBn7HZ7pn4Xoy/KCkne4E8JjNKo7Hnao2ixZLe E2gQtfoNT/6Po/MLdnJsL7kVwv78SEoTnvgRdDyD24mKK8Rbe8LCq3YE7yllLZ1vGc3y nlXbk9gf69F2r5OsQBUgX+JhwXsiCY9M51MzP7t8siXe8xerNp/fa5+aIJJFKEouQM4D VA1OdPk0RxwshCnUAtcHfB9w/de+BVHCah7vNY6i50OGRVEeSfgdkytVf2IVev+3gjlE 34vJxheN0dhzZ0rGb00rS2V7LM8cVOkjkM3/pPP7uuR9Zh54ZkhZ4ABPYkp+inUs9ykg Qslg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:reply-to:list-subscribe :list-help:list-post:list-archive:list-unsubscribe:list-id :precedence:subject:mime-version:references:in-reply-to:message-id :date:to:from:delivered-to; bh=io8O74izxaJw0pPGnxHgU47m+rrHuHNelbXoMiDjvH0=; b=sfjVcPMh5roT1/HjN4W/mIiFtqeqWlyI1CCNzqj+IXcvr1C+q0xG9UpKWBR/O+v6YQ lev4QKIpnndGYWQA4GNDYxNQQbChtP8EL0nGhMN5/Y+n2fbLIAjKokHUofPNMWNP2doW weMGOvtGYUr7Df8HO8h4rGXxAH0NHXaAfY0Kih72HdMF3lk0M46jcnIx/Ho4JhIh3npP sxuK57rQTf12jhz3+q9bhaF1mJHftqg9beq6fAk0hJr6nHQIAkfWiLJ3KdQzE5e23c1S TEkCQX70l/TK9sT57U3QnCposn55XynNMuVDjvwecwDsIuhlnWliRns/ID5F8hXqzrqU MBDg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id m18si2077412edd.21.2022.01.19.05.41.54; Wed, 19 Jan 2022 05:41:54 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id E7EC368B0BB; Wed, 19 Jan 2022 15:41:38 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail0.khirnov.net (red.khirnov.net [176.97.15.12]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id D545F68B0B1 for ; Wed, 19 Jan 2022 15:41:31 +0200 (EET) Received: from localhost (localhost [IPv6:::1]) by mail0.khirnov.net (Postfix) with ESMTP id 7247424017E for ; Wed, 19 Jan 2022 14:41:31 +0100 (CET) Received: from mail0.khirnov.net ([IPv6:::1]) by localhost (mail0.khirnov.net [IPv6:::1]) (amavisd-new, port 10024) with ESMTP id OulUdPRXgnSY for ; Wed, 19 Jan 2022 14:41:30 +0100 (CET) Received: from libav.khirnov.net (libav.khirnov.net [IPv6:2a00:c500:561:201::7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "libav.khirnov.net", Issuer "smtp.khirnov.net SMTP CA" (verified OK)) by mail0.khirnov.net (Postfix) with ESMTPS id DC47E240179 for ; Wed, 19 Jan 2022 14:41:30 +0100 (CET) Received: by libav.khirnov.net (Postfix, from userid 1000) id C42FB3A067C; Wed, 19 Jan 2022 14:41:30 +0100 (CET) From: Anton Khirnov To: ffmpeg-devel@ffmpeg.org Date: Wed, 19 Jan 2022 14:40:43 +0100 Message-Id: <20220119134040.774-3-anton@khirnov.net> X-Mailer: git-send-email 2.33.0 In-Reply-To: <20220119134040.774-1-anton@khirnov.net> References: <20220119134040.774-1-anton@khirnov.net> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH 3/3] lavu/hwcontext: clarify behavior on av_hwframe_map() failure X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: e5hlDUCUgxAJ Clear anything that av_hwframe_map() might have done to the destination frame, but leave caller-provided fields unchanged. --- libavutil/hwcontext.c | 23 +++++++++++++++++++++-- libavutil/hwcontext.h | 4 ++++ 2 files changed, 25 insertions(+), 2 deletions(-) diff --git a/libavutil/hwcontext.c b/libavutil/hwcontext.c index 31c7840dba..ae33da1262 100644 --- a/libavutil/hwcontext.c +++ b/libavutil/hwcontext.c @@ -18,6 +18,7 @@ #include "config.h" +#include "avassert.h" #include "buffer.h" #include "common.h" #include "hwcontext.h" @@ -788,6 +789,8 @@ fail: int av_hwframe_map(AVFrame *dst, const AVFrame *src, int flags) { + AVBufferRef *orig_dst_frames = dst->hw_frames_ctx; + enum AVPixelFormat orig_dst_fmt = dst->format; AVHWFramesContext *src_frames, *dst_frames; HWMapDescriptor *hwmap; int ret; @@ -825,7 +828,7 @@ int av_hwframe_map(AVFrame *dst, const AVFrame *src, int flags) ret = src_frames->internal->hw_type->map_from(src_frames, dst, src, flags); if (ret != AVERROR(ENOSYS)) - return ret; + goto fail; } } @@ -837,11 +840,27 @@ int av_hwframe_map(AVFrame *dst, const AVFrame *src, int flags) ret = dst_frames->internal->hw_type->map_to(dst_frames, dst, src, flags); if (ret != AVERROR(ENOSYS)) - return ret; + goto fail; } } return AVERROR(ENOSYS); + +fail: + // if the caller provided dst frames context, it should be preserved + // by this function + av_assert0(orig_dst_frames == NULL || + orig_dst_frames == dst->hw_frames_ctx); + + // preserve user-provided dst frame fields, but clean + // anything we might have set + dst->hw_frames_ctx = NULL; + av_frame_unref(dst); + + dst->hw_frames_ctx = orig_dst_frames; + dst->format = orig_dst_fmt; + + return ret; } int av_hwframe_ctx_create_derived(AVBufferRef **derived_frame_ctx, diff --git a/libavutil/hwcontext.h b/libavutil/hwcontext.h index 04d19d89c2..c18b7e1e8b 100644 --- a/libavutil/hwcontext.h +++ b/libavutil/hwcontext.h @@ -571,6 +571,10 @@ enum { * possible with the given arguments and hwframe setup, while other return * values indicate that it failed somehow. * + * On failure, the destination frame will be left blank, except for the + * hw_frames_ctx/format fields thay may have been set by the caller - those will + * be preserved as they were. + * * @param dst Destination frame, to contain the mapping. * @param src Source frame, to be mapped. * @param flags Some combination of AV_HWFRAME_MAP_* flags.