From patchwork Thu Dec 1 08:14:02 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Fei Wang X-Patchwork-Id: 39555 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a21:999a:b0:a4:2148:650a with SMTP id ve26csp196281pzb; Thu, 1 Dec 2022 00:15:49 -0800 (PST) X-Google-Smtp-Source: AA0mqf5FZZsnsMhEuvaE7swAw1hKg8QvGa2NchkZUq21p9fm4LnS/gMg1Qm5etac7lUJe9yLc/Xi X-Received: by 2002:a17:906:ad8e:b0:7c0:a247:357f with SMTP id la14-20020a170906ad8e00b007c0a247357fmr4865009ejb.159.1669882549113; Thu, 01 Dec 2022 00:15:49 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1669882549; cv=none; d=google.com; s=arc-20160816; b=06GG976qrn+q6TglKL61vgdGnoe1BffbWEygh0jfw934mH2+DPhMd1nX44fT1kpe9N MFxmwZg9Wwh7kmnYnwUE6P/M49yVYsrJPLjdS81r9KnZhRi8uQwQleNWLwEE2ZfYTyoO DShmgEJMgN2f8ZjwiXqQNzr0QWoZbRQ78NEQy3FcQfJ/ZccHy3FfoRLxaNuYxViwzcLm dMwmjSTrPFccCSmGhnSwQPl3neVL8oD87/fEnQIs79IBKhRjjitp0ht3znVH7fohQ1WM mhtg60inTii4kULuvz8aXPhwKrWVqyyVLPqgD/x/tVFmEcYBghYk2qD3JHbmc4K5UiGF AF9g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:delivered-to; bh=qx/VutW42/8fP9B5GdisNiYtoarNEiiGXE2L8VmycEQ=; b=M2QsYuos86T+MbkKYCzI7NJXBxWCJcNqZ5i5S3zXMbpED/iuEBh8GxLnC3I8ljW3mh wfxgVdadEzOT45zvzB1WBtd2mJFPISednWUe+167Dr3rN4Fei3EKubQdzAyoHSvj4vj5 n04EcAc03KzuKflRD56HtNtAsI/IRQ95jdbaDzDYhpift1l51ZkhI/MAPWrP23oRDe0e QOdb8bECuub8oam3X+zrZzW20GNRiGa27VCldrJI5um3inlQm6rZ4lCFazC+Tqdkb1CQ af5qSmcdgJ0XyTqiiJnBPqiFXAGQGocOuW73/WH4JgvUWKyqptxtBdbVDegst69yQGW7 /HVQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=nXaF5oB5; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id hc44-20020a17090716ac00b00741a18d4a5asi3546427ejc.994.2022.12.01.00.15.48; Thu, 01 Dec 2022 00:15:49 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=nXaF5oB5; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 11D4B68BA82; Thu, 1 Dec 2022 10:15:02 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mga18.intel.com (mga18.intel.com [134.134.136.126]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 56C2468B834 for ; Thu, 1 Dec 2022 10:14:54 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1669882499; x=1701418499; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=9/PFuSvmZ5ES+MZ7+Zk//0gUVv1sHKHPp9bwYPZsP1g=; b=nXaF5oB50r26i10SW4vGZiW1weaFqzHd7VejQ7lUrbWU4O4bPGuk5n/c W4H3BFoDeSVLi+IXDfeCxF9zsHlRg880F4+UvP1pi+05FI7L9cEjf2N38 /vYmGqST9z9AogCYhr+H/UyXtN+5hXJAD15Zo51PUwOO7k12erUTH7Awm wye7fVA8zZVefPptmsBxY4Jg2mdpq8cp4e5tMGsTN7mHh7C+ExqclCvos mHyWXKCh8nKNJoHiTQr2UvHIriCmaE1UaXHNp2rpKrlTzpN3jHbajxMEC YaXSs0uOV+tXd2lS3puUEctEvl7sJBNyoSPFRCIGA5Ci4g2H6sAkFLgEm Q==; X-IronPort-AV: E=McAfee;i="6500,9779,10547"; a="298989844" X-IronPort-AV: E=Sophos;i="5.96,207,1665471600"; d="scan'208";a="298989844" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Dec 2022 00:14:50 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10547"; a="675341759" X-IronPort-AV: E=Sophos;i="5.96,207,1665471600"; d="scan'208";a="675341759" Received: from t.sh.intel.com ([10.239.159.159]) by orsmga008.jf.intel.com with ESMTP; 01 Dec 2022 00:14:49 -0800 From: Fei Wang To: ffmpeg-devel@ffmpeg.org Date: Thu, 1 Dec 2022 16:14:02 +0800 Message-Id: <20221201081408.2194579-7-fei.w.wang@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20221201081408.2194579-1-fei.w.wang@intel.com> References: <20221201081408.2194579-1-fei.w.wang@intel.com> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v1 07/13] lavc/hevc: Update reference list for SCC X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Linjie Fu , Fei Wang , Linjie Fu Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: N/zSJQSFB6Z1 From: Linjie Fu Screen Content Coding allows non-intra slice in an IRAP frame which can reference the frame itself, and would mark the current decoded picture as "used for long-term reference", no matter TwoVersionsOfCurrDecPicFlag(8.1.3), hence some previous restricts are not suitable any more. Constructe RefPicListTemp and RefPicList according to 8-8/9/10. Disable slice decoding for SCC profile to avoid unexpected error in hevc native decoder and patch welcome. Signed-off-by: Linjie Fu Signed-off-by: Fei Wang --- libavcodec/hevc_refs.c | 21 ++++++++++++++++++++- libavcodec/hevcdec.c | 10 +++++++++- 2 files changed, 29 insertions(+), 2 deletions(-) diff --git a/libavcodec/hevc_refs.c b/libavcodec/hevc_refs.c index 811e8feff8..96153a2459 100644 --- a/libavcodec/hevc_refs.c +++ b/libavcodec/hevc_refs.c @@ -322,7 +322,7 @@ int ff_hevc_slice_rpl(HEVCContext *s) return ret; if (!(s->rps[ST_CURR_BEF].nb_refs + s->rps[ST_CURR_AFT].nb_refs + - s->rps[LT_CURR].nb_refs)) { + s->rps[LT_CURR].nb_refs) && !s->ps.pps->pps_curr_pic_ref_enabled_flag) { av_log(s->avctx, AV_LOG_ERROR, "Zero refs in the frame RPS.\n"); return AVERROR_INVALIDDATA; } @@ -349,6 +349,13 @@ int ff_hevc_slice_rpl(HEVCContext *s) rpl_tmp.nb_refs++; } } + // Construct RefPicList0, RefPicList1 (8-8, 8-10) + if (s->ps.pps->pps_curr_pic_ref_enabled_flag) { + rpl_tmp.list[rpl_tmp.nb_refs] = s->ref->poc; + rpl_tmp.ref[rpl_tmp.nb_refs] = s->ref; + rpl_tmp.isLongTerm[rpl_tmp.nb_refs] = 1; + rpl_tmp.nb_refs++; + } } /* reorder the references if necessary */ @@ -371,6 +378,14 @@ int ff_hevc_slice_rpl(HEVCContext *s) rpl->nb_refs = FFMIN(rpl->nb_refs, sh->nb_refs[list_idx]); } + // 8-9 + if (s->ps.pps->pps_curr_pic_ref_enabled_flag && + !sh->rpl_modification_flag[list_idx] && + rpl_tmp.nb_refs > sh->nb_refs[L0]) { + rpl->list[sh->nb_refs[L0] - 1] = s->ref->poc; + rpl->ref[sh->nb_refs[L0] - 1] = s->ref; + } + if (sh->collocated_list == list_idx && sh->collocated_ref_idx < rpl->nb_refs) s->ref->collocated_ref = rpl->ref[sh->collocated_ref_idx]; @@ -541,5 +556,9 @@ int ff_hevc_frame_nb_refs(const HEVCContext *s) for (i = 0; i < long_rps->nb_refs; i++) ret += !!long_rps->used[i]; } + + if (s->ps.pps->pps_curr_pic_ref_enabled_flag) + ret++; + return ret; } diff --git a/libavcodec/hevcdec.c b/libavcodec/hevcdec.c index 50e7fd4465..bd8199d1dd 100644 --- a/libavcodec/hevcdec.c +++ b/libavcodec/hevcdec.c @@ -669,7 +669,8 @@ static int hls_slice_header(HEVCContext *s) sh->slice_type); return AVERROR_INVALIDDATA; } - if (IS_IRAP(s) && sh->slice_type != HEVC_SLICE_I) { + if (IS_IRAP(s) && sh->slice_type != HEVC_SLICE_I && + !s->ps.pps->pps_curr_pic_ref_enabled_flag) { av_log(s->avctx, AV_LOG_ERROR, "Inter slices in an IRAP frame.\n"); return AVERROR_INVALIDDATA; } @@ -3256,6 +3257,13 @@ static int decode_nal_unit(HEVCContext *s, const H2645NAL *nal) if (ret < 0) goto fail; } else { + if (s->avctx->profile == FF_PROFILE_HEVC_SCC) { + av_log(s->avctx, AV_LOG_ERROR, + "SCC profile is not yet implemented in hevc native decoder.\n"); + ret = AVERROR_PATCHWELCOME; + goto fail; + } + if (s->threads_number > 1 && s->sh.num_entry_point_offsets > 0) ctb_addr_ts = hls_slice_data_wpp(s, nal); else