From patchwork Tue Nov 15 10:36:15 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Thomas Siedel X-Patchwork-Id: 39281 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a21:999a:b0:a4:2148:650a with SMTP id ve26csp2990617pzb; Tue, 15 Nov 2022 02:37:20 -0800 (PST) X-Google-Smtp-Source: AA0mqf6bmUx3pzQy9CKnWZhj+e3qiFK9XimJHrSTNzyUS3789eeiRrfQqfCu/CjTfs1V7a4SiQ9h X-Received: by 2002:a50:f60b:0:b0:461:8fbf:f607 with SMTP id c11-20020a50f60b000000b004618fbff607mr14081463edn.235.1668508639934; Tue, 15 Nov 2022 02:37:19 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1668508639; cv=none; d=google.com; s=arc-20160816; b=N7h7LWmAG8Gb9YmFWqpl3k2ZGe4yK+4f44gTMrVDjVFNA4mt8+eB19u5PpzDNphezr qoLMB82Xg4Sd7W3VjKTxf98Q9u3bC9AUwrA8dsUmwFflq3TEYh5Nf6hF8trhekHJug9W vjLG8xmr7vpqJlx17QUx9tAiYlacQh3xdgkt11WjH5kqNVN1VqICva5ecuprXXXq5xFg cjy2IlX1FFYfJ+B3EMp6AI8wYhqhz0qw/kxJ/d+F6aCLA4dnzFsoTLbODkfWV3jehl8e 2CKROAmu+9GAjPhwFPnUIh0LEAcguR/j03OApc/o0SoCkk4pQ7i8rda+rq4vocGTa00I ouJA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:delivered-to; bh=uk1OVuZcZqLWgLg+Y/Wcw1GdEGPd61XQq61GFArtwQs=; b=UwDIgV4NbFgxgXjCOikb71+Cm5wkpVi5zwXCi1EuTQ0dOObefQ5bjpyU81mIE1+s5c 5bYrXgMyyqx4OJZ06Kyl/LCLUnsznxlVgbnPmedwP8Lajz7W0NNKbtEV88Q1yqfhdnI1 kTS3I55HCHPiQDyqg3JNt55WDFuq7qBiXA9aJn3nxRsyEitc697GHjacDePDpnAMteLP Hsmshn8Q9zoTno53FT7EXIlcYRLITU1PJKf6asQLIMqNHit2XurPX9ZjNJgCp8JZ34ad pbQ0FHXH5NoVCSjBz+DQY6+kL/+hJFJ+XBJGFKkB8jwfFQM6zfw+mkEngnwCGCcvGJ7u xftg== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@spin-digital-com.20210112.gappssmtp.com header.s=20210112 header.b=sdkyDirh; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id d25-20020a05640208d900b0046360343debsi10298561edz.153.2022.11.15.02.37.19; Tue, 15 Nov 2022 02:37:19 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@spin-digital-com.20210112.gappssmtp.com header.s=20210112 header.b=sdkyDirh; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id BC6E9689B11; Tue, 15 Nov 2022 12:37:05 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 50E4C68924F for ; Tue, 15 Nov 2022 12:36:58 +0200 (EET) Received: by mail-wm1-f52.google.com with SMTP id l39-20020a05600c1d2700b003cf93c8156dso9926342wms.4 for ; Tue, 15 Nov 2022 02:36:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=spin-digital-com.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=CVXOEbdzXl9c9TlG5UQJKJ7IUZtjW0yVA+zgQz74Lzo=; b=sdkyDirheaQhKh8dHminsNBKanZlp2mdBVe7154iEBqEN8uFHVumuSOF4bxCMufGC5 TiId8ghlAjhdcgeHmWtk4uuuZawRixdKLUG4awaoSt00WG2asAx/C7pk/KtO+ya6iO6z CUTDNZ4dv3oQ6XWDBTSDMLDVU/CCIijGHAl/qy3ln4eZFsaxM1+YETsyhkGp0KI4LLID e8araXNVvRSw2twhCb82oV8HgIQzbvA5wyoohipXjSqUhitTw836Zx/GKB/lDt5ueeSD fjoZGzYurWRsVtcHej8j5/uc+U3h+TWHWd6HC8AD0xBI53TFsxgR7BXbanwxUdYzFna2 7OAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=CVXOEbdzXl9c9TlG5UQJKJ7IUZtjW0yVA+zgQz74Lzo=; b=KAlshhuQsFdBgdFQToaD0Ky69YzPv7w9iTQEGcrub2ol+2THzequkoxjDUR0kYWRxy wTzucmkMepTkbsy5tcBiUssL0OI9B254KrHbXPn5PeISC1fTqhkkOvo4D2cJsJwDTKYv zc6Pgc1vwKu63fEBX+bhtT2zpt4xTsyVDztKJoSDFCew9aSH/QBum4UwWar+JKz99aa7 RGzznrbofR1LflrSg2co4MfBBnkWLU1tGyyvFwWHZkAEB89sFjqGf9kXVAHxKa+5oa8T Q/BO1SrKuxE9XsYYxnj4dz2zYicZTe7OVypLXWNpucv2B4pUCbgh8RhYERA9c1JwGbCm YBEg== X-Gm-Message-State: ANoB5pmN3K21aexkXXxmVEsVUfUM1NEWHY7TSsf2qtBnoiTL9qG+/NV0 HmHGurtwzG3ALWArM/9sNO+Okrrm481MHw== X-Received: by 2002:a1c:5441:0:b0:3cf:88d3:5685 with SMTP id p1-20020a1c5441000000b003cf88d35685mr979960wmi.38.1668508617209; Tue, 15 Nov 2022 02:36:57 -0800 (PST) Received: from thomas-win.localdomain ([213.138.44.237]) by smtp.gmail.com with ESMTPSA id e8-20020adffc48000000b00236863c02f5sm11764882wrs.96.2022.11.15.02.36.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 15 Nov 2022 02:36:56 -0800 (PST) From: Thomas Siedel To: ffmpeg-devel@ffmpeg.org Date: Tue, 15 Nov 2022 11:36:15 +0100 Message-Id: <20221115103624.48778-2-thomas.ff@spin-digital.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20221115103624.48778-1-thomas.ff@spin-digital.com> References: <20221115103624.48778-1-thomas.ff@spin-digital.com> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v4 01/10] avcodec: add enum types for H266/VVC X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Thomas Siedel Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: 4YxRe3nBqiBn Add types as nal unit types, slice types and vvc typedefs needed for parsing vvc high-level syntax. Signed-off-by: Thomas Siedel --- libavcodec/vvc.h | 142 +++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 142 insertions(+) create mode 100644 libavcodec/vvc.h diff --git a/libavcodec/vvc.h b/libavcodec/vvc.h new file mode 100644 index 0000000000..586934a7bf --- /dev/null +++ b/libavcodec/vvc.h @@ -0,0 +1,142 @@ +/* + * VVC shared code + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#ifndef AVCODEC_VVC_H +#define AVCODEC_VVC_H + +/** + * Table 5 – NAL unit type codes and NAL unit type classes + * in T-REC-H.266-202008 + */ +enum VVCNALUnitType { + VVC_TRAIL_NUT = 0, + VVC_STSA_NUT = 1, + VVC_RADL_NUT = 2, + VVC_RASL_NUT = 3, + VVC_RSV_VCL_4 = 4, + VVC_RSV_VCL_5 = 5, + VVC_RSV_VCL_6 = 6, + VVC_IDR_W_RADL = 7, + VVC_IDR_N_LP = 8, + VVC_CRA_NUT = 9, + VVC_GDR_NUT = 10, + VVC_RSV_IRAP_11 = 11, + VVC_OPI_NUT = 12, + VVC_DCI_NUT = 13, + VVC_VPS_NUT = 14, + VVC_SPS_NUT = 15, + VVC_PPS_NUT = 16, + VVC_PREFIX_APS_NUT = 17, + VVC_SUFFIX_APS_NUT = 18, + VVC_PH_NUT = 19, + VVC_AUD_NUT = 20, + VVC_EOS_NUT = 21, + VVC_EOB_NUT = 22, + VVC_PREFIX_SEI_NUT = 23, + VVC_SUFFIX_SEI_NUT = 24, + VVC_FD_NUT = 25, + VVC_RSV_NVCL_26 = 26, + VVC_RSV_NVCL_27 = 27, + VVC_UNSPEC_28 = 28, + VVC_UNSPEC_29 = 29, + VVC_UNSPEC_30 = 30, + VVC_UNSPEC_31 = 31, +}; + +enum VVCSliceType { + VVC_SLICE_TYPE_B = 0, + VVC_SLICE_TYPE_P = 1, + VVC_SLICE_TYPE_I = 2, +}; + +enum { + //6.2 we can have 3 sample arrays + VVC_MAX_SAMPLE_ARRAYS = 3, + + //7.4.3.3 vps_max_layers_minus1 is u(6) + VVC_MAX_LAYERS = 64, + + //7.4.3.3 The value of vps_max_sublayers_minus1 shall be in the range of 0 to 6, inclusive + VVC_MAX_SUBLAYERS = 7, + + //7.4.3.3 vps_num_ptls_minus1 is u(8) + VVC_MAX_PTLS = 256, + + //7.4.3.3 vps_num_output_layer_sets_minus2 is u(8) + VVC_MAX_TOTAL_NUM_OLSS = 257, + + // 7.3.2.3: vps_video_parameter_set_id is u(4). + VVC_MAX_VPS_COUNT = 16, + // 7.3.2.4: sps_seq_parameter_set_id is u(4) + VVC_MAX_SPS_COUNT = 16, + // 7.3.2.5: pps_pic_parameter_set_id is u(6) + VVC_MAX_PPS_COUNT = 64, + + // 7.4.4.1: ptl_num_sub_profiles is u(8) + VVC_MAX_SUB_PROFILES = 256, + + // A.4.2: according to (1577), MaxDpbSize is bounded above by 2 * maxDpbPicBuf(8) + VVC_MAX_DPB_SIZE = 16, + + //7.4.3.4 sps_num_ref_pic_lists in range [0, 64] + VVC_MAX_REF_PIC_LISTS = 64, + + //7.4.11 num_ref_entries in range [0, MaxDpbSize + 13] + VVC_MAX_REF_ENTRIES = VVC_MAX_DPB_SIZE + 13, + + //7.4.3.3 sps_num_points_in_qp_table_minus1[i] in range [0, 36 − sps_qp_table_start_minus26[i]], + //sps_qp_table_start_minus26[i] in range [sps_qp_table_start_minus26[i] −26 − QpBdOffset, 36] + //for 10 bitsQpBdOffset is 12, so sps_num_points_in_qp_table_minus1[i] in range [0, 74] + VVC_MAX_POINTS_IN_QP_TABLE = 75, + + // 7.4.6.1: hrd_cpb_cnt_minus1 is in [0, 31]. + VVC_MAX_CPB_CNT = 32, + + // A.4.1: the highest level allows a MaxLumaPs of 35 651 584. + VVC_MAX_LUMA_PS = 35651584, + + // A.4.1: pic_width_in_luma_samples and pic_height_in_luma_samples are + // constrained to be not greater than sqrt(MaxLumaPs * 8). Hence height/ + // width are bounded above by sqrt(8 * 35651584) = 16888.2 samples. + VVC_MAX_WIDTH = 16888, + VVC_MAX_HEIGHT = 16888, + + // A.4.1: table A.1 allows at most 440 tiles per au for any level. + VVC_MAX_TILES_PER_AU = 440, + // A.4.1: table A.1 did not define max tile rows. + // in worest a case, we can have 1x440 tiles picture. + VVC_MAX_TILE_ROWS = VVC_MAX_TILES_PER_AU, + // A.4.1: table A.1 allows at most 20 tile columns for any level. + VVC_MAX_TILE_COLUMNS = 20, + + // A.4.1 table A.1 allows at most 600 slice for any level. + VVC_MAX_SLICES = 600, + + // 7.4.8: in the worst case (!pps_no_pic_partition_flag and + // sps_entropy_coding_sync_enabled_flag are both true), entry points can be + // placed at the beginning of every Ctb row in every tile, giving an + // upper bound of (num_tile_columns_minus1 + 1) * PicHeightInCtbsY - 1. + // Only a stream with very high resolution and perverse parameters could + // get near that, though, so set a lower limit here with the maximum + // possible value for 8K video (at most 135 32x32 Ctb rows). + VVC_MAX_ENTRY_POINTS = VVC_MAX_TILE_COLUMNS * 135, +}; + +#endif /* AVCODEC_VVC_H */