From patchwork Sun Sep 17 00:10:46 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Andreas Rheinhardt X-Patchwork-Id: 43755 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:bca2:b0:149:dfde:5c0a with SMTP id fx34csp1160118pzb; Sat, 16 Sep 2023 17:09:51 -0700 (PDT) X-Google-Smtp-Source: AGHT+IEtWh657mqo5VKRnUU1g3yj2DntIC6d9pvDlrb15JHVP6wdVGBYLM6BKm8SRObEaJZWu6Cw X-Received: by 2002:a17:906:5a47:b0:9a5:d16b:6631 with SMTP id my7-20020a1709065a4700b009a5d16b6631mr4421898ejc.70.1694909391070; Sat, 16 Sep 2023 17:09:51 -0700 (PDT) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id jw16-20020a17090776b000b009a210885fadsi5767027ejc.24.2023.09.16.17.09.50; Sat, 16 Sep 2023 17:09:51 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@outlook.com header.s=selector1 header.b=lEDVasmI; arc=fail (body hash mismatch); spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=outlook.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 2BF9868C805; Sun, 17 Sep 2023 03:09:48 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from EUR03-DBA-obe.outbound.protection.outlook.com (mail-dbaeur03olkn2034.outbound.protection.outlook.com [40.92.58.34]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id BE07268C534 for ; Sun, 17 Sep 2023 03:09:41 +0300 (EEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oO8ucAOsYgtyqUyzwI5XdFuHs8gkOIo1k1ReQ+loUxXUUB9vJzJ/i2tZgkPEt752L1bYEsmGAg7yc833fnsblQ5JliDW6VShQgKpOzaFJQfj0vSorR96+PTdf0WaM2Zv2PMa3bUNQF4Az09hdGXYkurEVSKswbXNNeiJORJAgUPGvWnTIr25pZMEAmAz8okz8G7OMevR65/bLQwniMdyZJ8F2WIQNrLMQfk3qs+LmMY8YfEM3t2Kb6mhW07Dz+kRt97FjZFlzW5BU+ddYvCNml7Q7tlVjS1mXyJxzoB4KpNpkApKYyyglxsaA31NnNchwS3bAMyFbnlhXXD9INXUAg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=HOMc1PxGAT4Ao+aA7n4sHN/fifHBT/CF+umx/yWDkmE=; b=I/wBIPaFhs3mv4DRNj2Qztpksyo/fSWsyDquroKB2iCPvH7pwZoRH33j9UdLUXlb8A9yfCcJoAhO9iSu0WXofl9kXJmlseBsVsx1we7HcQm3YGDJTFviY7gMUqTMYF602UJXXHHJyW4CQXU+slryDvCi4j1iScu/78+bpKtPc8ye3JmAF4LfRxUmnABFXFi1hp5d6LXf1yRs4Y3NC3+cHFRneKRNHzN6cpVMQ+E+61jolA9WCiv8+dh5pYiXy8vLm/ajFydZExcb7wJRoXCOgrOPogABXDLc+fKF+6tqmhZFxPtFhHPOsmok2mmH8NmKVO/jg1rZKwrWQUndP+1fEQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=HOMc1PxGAT4Ao+aA7n4sHN/fifHBT/CF+umx/yWDkmE=; b=lEDVasmII0zxtYMkn0TqlTQSqOuDGts+QyTsnv5tV6lN5LnYNbCIk4FS4NtuiCkbSg3ZZEVGerSWf0xZQzICEWnJd3LEvkWaFaTFSQ4x0AFAHBKFsmrMMX0XowqybGlWlk0Zgnk8UQE+c0+5aHEukm1jRC/Tqu87Z/C2v9PS9i/jANg+v0xMCC6tuuJ/vOtPotTeyYi2sLf46KHNehSGAT31gaZjrcVHheJEIpFjr+iGnJj9HvGsbEUdbQF2aAZn7O+b+fhHgTuRlnjsY0xMEvsdD1xj8b2yMNe+zGsre+Ble3o5XkXcPB5LerlIcZdOQKeDUhma3wezxVa7uaOcJw== Received: from GV1P250MB0737.EURP250.PROD.OUTLOOK.COM (2603:10a6:150:8e::17) by PR3P250MB0049.EURP250.PROD.OUTLOOK.COM (2603:10a6:102:14c::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6792.24; Sun, 17 Sep 2023 00:09:40 +0000 Received: from GV1P250MB0737.EURP250.PROD.OUTLOOK.COM ([fe80::3fff:eb7b:b8e2:4dba]) by GV1P250MB0737.EURP250.PROD.OUTLOOK.COM ([fe80::3fff:eb7b:b8e2:4dba%4]) with mapi id 15.20.6792.023; Sun, 17 Sep 2023 00:09:40 +0000 From: Andreas Rheinhardt To: ffmpeg-devel@ffmpeg.org Date: Sun, 17 Sep 2023 02:10:46 +0200 Message-ID: X-Mailer: git-send-email 2.34.1 X-TMN: [bn1fB5vkWMXGgmCb6Q2OTsPfRM/LmRTH] X-ClientProxiedBy: ZR0P278CA0035.CHEP278.PROD.OUTLOOK.COM (2603:10a6:910:1c::22) To GV1P250MB0737.EURP250.PROD.OUTLOOK.COM (2603:10a6:150:8e::17) X-Microsoft-Original-Message-ID: <20230917001047.1472369-1-andreas.rheinhardt@outlook.com> MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: GV1P250MB0737:EE_|PR3P250MB0049:EE_ X-MS-Office365-Filtering-Correlation-Id: e8384ca2-c440-48be-8ed3-08dbb71262c7 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: fU+NEU/VrFUE9fOS2r/zUSzGsQWHPjf+z2qBr4DJL0iyJ+YpWV0znXMyMJwzi8VR9ZDSkuaB8pWreCxLuI9Rim+pX0Glg4PV4ANMlQUKHWTVmCR7dTxdcv2Bj3jiHOHUKY5Rwzf2AvsJULkw2knKvTMLfL+ZfBq74KVIARuCoMaQAU+tr5IbwNzd2zc3xmURoV3JnUANFNLGS0cjUWNv3gP5+RYZ6WzEAaS0wp/jOMOmCC4QU2wFAQJjq9Rwe34J5CxobpPq4P4KqftrzMbnSmtk7hyvqOoOXMTuKm/7R3Znm3jUvtOMCutD04B8ytedLQQrC5CxT3TwjPFUCwUnhkAtRXKX9LNEUguQ1MfR00xwFy+TArTg63iqnsRBhQl8g9RZnQryDaIlJZUyGeKL630kgsvyhJI1ltVPn8aEQQzYC2DqDFjt6tvimTmWynHCyILxLOhDgDycMM75U6YhJoBNjuNlKvPoYRLmDR82Hg4q4oN66MQ1d/kHjc5EYyDmNg8Iu9tJQ3i728xIGuqApSP+A6o8PgMRxTH6Sjd994ilsYCu8v0C6TXMx6YXMKUX6eqX/rTVhvlwCWUl68OZMLrvU8/bK63q6iy8Sd80/IHsVZ1NDdlszoO2+t6vrLso X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: N2GKm8jsBXpSjX7UBLf16wej8/9BofQZBkL8+a0acBHNqgKs8QnqtvnbqjljoR9CPIYLuZUZINl8+Pm7nB3eU7GRztUm0b0oZtht62WCfdA/9rNs9nVOYBRTVJa1s+o7mKKLzRkhSeiYsDT9SuLHERx5uNQOM5Xu6FyBkRu9z/IPCoxzI+YYSTZGSJsNhzHXzrSaH1bItiO1tOT1MbxN0pbWakUcaweRcAgQpYxMFw7fMITCCcAWfDsDajy40A9j33Qx1cG6IN2a/1WvQ6ELxYWUFdemdcMsdf115pRc9hx8dmBI269ruAiYrh1CXGUL99sTaNvjlZ58U7tFoe+vVHifZi5+ILfW16r246Y1X19AmuRX8+UGPM8PEKDrVdD79c/OnvJv6L82KoQ6qeLQr3dUKesY7rtX5MllXrJN5dXHlsEh+iHRVpYRUynuirKCBogmOzF69Lf1VPTnhGA+DfjK2Qk7eFgFDYmW502p93VKiDUtbh9WZCxicr2BYiJJSwHZqNtx09G5L6QWgX6aC4rvhKoYrUP1uz0wDVmOrR0Du/z1d/HsmUqYNvRSmo4uMik2Rsyp+NPJD/MnUwsX8J9Or5p4rWppMmJKJ12TyQkPB6x9vTLEzbTEDQDUwjAJuERGsZlX95A0s403XSTKTtEmRNmXUV5y7MEOocOMN+bmmsAMyMtkgImePtj1W0bcZVPUYBfZxYKhSDjmTGhJJ9fYXa0HOu+BPYjXAenfUI+WpkxOR6YOnVnm7a4ZIsmGLu5/M0jsjh1Pypup5dj7bqNxIsQYedYxwHCWZOCGPUZMNjl2C9lrIKyJRMubI7mR40criU8Ct01CurIxoRCYkwusKQP1TSZbSImH8kfh1G0e38EH6iCovqmraSaVuDNjDFNWz0oh9MLpjyw53NZQAqfgfzs/Sad+0Pip5xNMEAagUTqMkP2VJ7qPlcnITedqZtg/HElKmORXXe0ri6CorwZ55dsLRpF1ihJ0RemiYm2HoIpXPM8xrxKzeZGqXzRNPfokDCwSPmZRsJqD2lAN9GH1AjXeDeWawc+HFqrbykDG1EF/DaCOzpP/rz9/F/z8vxiqPPIMzeWVNg2ZqwBBZg== X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: e8384ca2-c440-48be-8ed3-08dbb71262c7 X-MS-Exchange-CrossTenant-AuthSource: GV1P250MB0737.EURP250.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Sep 2023 00:09:40.0865 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: PR3P250MB0049 Subject: [FFmpeg-devel] [PATCH 1/2] avcodec/hevcdec: Check early whether film grain is supported, fix race X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Andreas Rheinhardt Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: GrjXzeo2Q5XX Applying film grain happens after ff_thread_finish_setup(), so the parameters synced in hevc_update_thread_context() must not be modified. But this is exactly what happens in case applying film grain fails. (The likely result is that in case of frame threading an uninitialized frame is output.) Given that it is actually very easy to know in advance whether ff_h274_apply_film_grain() supports a given set of parameters, one can check for this before ff_thread_finish_setup() and avoid allocating an unused buffer lateron. Signed-off-by: Andreas Rheinhardt --- libavcodec/h274.h | 15 +++++++++++++++ libavcodec/hevcdec.c | 19 ++++++++++++------- libavcodec/hevcdec.h | 2 ++ 3 files changed, 29 insertions(+), 7 deletions(-) diff --git a/libavcodec/h274.h b/libavcodec/h274.h index 920f6991fb..27a07e4a91 100644 --- a/libavcodec/h274.h +++ b/libavcodec/h274.h @@ -40,11 +40,26 @@ typedef struct H274FilmGrainDatabase { int16_t slice_tmp[64][64]; } H274FilmGrainDatabase; +/** + * Check whether ff_h274_apply_film_grain() supports the given parameter combination. + * + * @param model_id model_id from AVFilmGrainParams to be supplied + * @param pix_fmt pixel format of the frames to be supplied + */ +static inline int ff_h274_film_grain_params_supported(int model_id, enum AVPixelFormat pix_fmt) +{ + return model_id == 1 && pix_fmt == AV_PIX_FMT_YUV420P; +} + // Synthesizes film grain on top of `in` and stores the result to `out`. `out` // must already have been allocated and set to the same size and format as // `in`. // // Returns a negative error code on error, such as invalid params. +// If ff_h274_film_grain_params_supported() indicated that the parameters +// are supported, no error will be returned if the arguments given to +// ff_h274_film_grain_params_supported() coincide with actual values +// from the frames and params. int ff_h274_apply_film_grain(AVFrame *out, const AVFrame *in, H274FilmGrainDatabase *db, const AVFilmGrainParams *params); diff --git a/libavcodec/hevcdec.c b/libavcodec/hevcdec.c index 81b9c5e089..2be62ddfb2 100644 --- a/libavcodec/hevcdec.c +++ b/libavcodec/hevcdec.c @@ -2884,6 +2884,14 @@ static int hevc_frame_start(HEVCContext *s) !(s->avctx->export_side_data & AV_CODEC_EXPORT_DATA_FILM_GRAIN) && !s->avctx->hwaccel; + if (s->ref->needs_fg && + !ff_h274_film_grain_params_supported(s->sei.common.film_grain_characteristics.model_id, + s->ref->frame->format)) { + av_log_once(s->avctx, AV_LOG_WARNING, AV_LOG_DEBUG, &s->film_grain_warning_shown, + "Unsupported film grain parameters. Ignoring film grain.\n"); + s->ref->needs_fg = 0; + } + if (s->ref->needs_fg) { s->ref->frame_grain->format = s->ref->frame->format; s->ref->frame_grain->width = s->ref->frame->width; @@ -2922,19 +2930,14 @@ static int hevc_frame_end(HEVCContext *s) { HEVCFrame *out = s->ref; const AVFrameSideData *sd; - int ret; + av_unused int ret; if (out->needs_fg) { sd = av_frame_get_side_data(out->frame, AV_FRAME_DATA_FILM_GRAIN_PARAMS); av_assert0(out->frame_grain->buf[0] && sd); ret = ff_h274_apply_film_grain(out->frame_grain, out->frame, &s->h274db, (AVFilmGrainParams *) sd->data); - - if (ret < 0) { - av_log(s->avctx, AV_LOG_WARNING, "Failed synthesizing film " - "grain, ignoring: %s\n", av_err2str(ret)); - out->needs_fg = 0; - } + av_assert1(ret >= 0); } return 0; @@ -3574,6 +3577,8 @@ static int hevc_update_thread_context(AVCodecContext *dst, s->threads_number = s0->threads_number; s->threads_type = s0->threads_type; + s->film_grain_warning_shown = s0->film_grain_warning_shown; + if (s0->eos) { s->seq_decode = (s->seq_decode + 1) & HEVC_SEQUENCE_COUNTER_MASK; s->max_ra = INT_MAX; diff --git a/libavcodec/hevcdec.h b/libavcodec/hevcdec.h index 94609e4699..9b232df68c 100644 --- a/libavcodec/hevcdec.h +++ b/libavcodec/hevcdec.h @@ -596,6 +596,8 @@ typedef struct HEVCContext { int nal_length_size; ///< Number of bytes used for nal length (1, 2 or 4) int nuh_layer_id; + int film_grain_warning_shown; + AVBufferRef *rpu_buf; ///< 0 or 1 Dolby Vision RPUs. DOVIContext dovi_ctx; ///< Dolby Vision decoding context } HEVCContext;