From patchwork Tue Nov 15 10:36:14 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Thomas Siedel X-Patchwork-Id: 34859 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a21:999a:b0:a4:2148:650a with SMTP id ve26csp2990531pzb; Tue, 15 Nov 2022 02:37:08 -0800 (PST) X-Google-Smtp-Source: AA0mqf6qKiQYU3f1r8tCQnj/6EcvXID3RP6wYtuGmDQe2Pa+re/Hn68O7jJyp93vs3Butefox7KL X-Received: by 2002:a17:906:5a86:b0:78d:422b:8156 with SMTP id l6-20020a1709065a8600b0078d422b8156mr13458040ejq.589.1668508628150; Tue, 15 Nov 2022 02:37:08 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1668508628; cv=none; d=google.com; s=arc-20160816; b=DJwWfMwFRPxcDDoz9cJPkVUsgnZ60P71S+aP4+4aw2BxCehlmSf14Vaipzihfi62iy LEPV/aHAb1D6b1vdk9fe8dnp6TGpkvQj93jzN1jIK6SgV/Hi2UtUKcYETj59/El13CjM GlCATcqcyKzGfCPeB+i+wCE38auo+qfXYXGs0c9Y28JaezTc+pxyeB4ZfLqFpjBwtsvt elhJi6PXs7KtXDy3hdfDy8zQxGHe+nmI9pgxk6b2uSaYjY2RZEa6KhXWmv1O6iD5uLrI Za0MiLBr0pdvQI55HdDN9Kd4vWuJRJuHktHblP5j32nK/3dgsBjDzqLnmx6rMRu66GeR 7l5g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:mime-version:message-id:date:to:from :dkim-signature:delivered-to; bh=pcTBnT8zmOX0QU9z7n603LBtRDmbUPORGWu+E3+Lk6Y=; b=Ek7CRnfzZBAHZIP1nNh5ZrZ0UulBORwkPAFkAq+7YEGxZMobyHDrqPkrpPAD8Ir/he MYMLoqS9K/ZAW4FkhzxnLSglrFXICPdSQctlmw8dOT5ngWatuT7klAW5i32qh/DV1VD5 dGk1a6TyQ+ulEz4kjKiXoCOXC5Id/K9H9t7UDxcqBgU7Im091ROzBM1x0hQNxn2iSFGT YmqRe9rxeDmsyRJAH0ddcDPYJPnHE2g9WGWNmUUHwU48K1ttEpqsPxYlmKT8kErRi/hM X/77l7sm5KoBkqv7/CDxACfcY9Lcr3dn35MOKzB8xNgc/MJGVc7y44JDvq+kZ+qelG7F GwFQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@spin-digital-com.20210112.gappssmtp.com header.s=20210112 header.b=bwCWuPk5; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id j7-20020a170906254700b0077d26491a9csi8542822ejb.141.2022.11.15.02.37.07; Tue, 15 Nov 2022 02:37:08 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@spin-digital-com.20210112.gappssmtp.com header.s=20210112 header.b=bwCWuPk5; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id AF27B68A2DE; Tue, 15 Nov 2022 12:37:03 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm1-f53.google.com (mail-wm1-f53.google.com [209.85.128.53]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id BF21268B96F for ; Tue, 15 Nov 2022 12:36:57 +0200 (EET) Received: by mail-wm1-f53.google.com with SMTP id ja4-20020a05600c556400b003cf6e77f89cso971313wmb.0 for ; Tue, 15 Nov 2022 02:36:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=spin-digital-com.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=Zpmwmp0xZhBIlQXMWime54+UXrtfkGvTBK6li71mS9s=; b=bwCWuPk51JH50403Oz7ca/0dkR4Hd0oa5KPxn+aI/Z38o3jhxB2A+jimXXWpNrdWjw j7ClQh8cblO93JBX5p4O1RnirA1yavRFMTybOlpD/LtGA+xF9CaDpNs7lMinmRD2aWJl /eXcnDFGPdrcMRHNsotxvag4ipTrPBgkMh1rIU7CRr8CG5i/6PWXIPC3IQb9R19rx4O2 PdK0Wec4CsynLBACQqqIh76n134boXfh/nKuHV6JUJmZT8aoiOsM2Mpf5w7se22/x66j 9TqUtEECx3PoMlOIRtgyiyot34bAwRQeGdh69hIgN9QMXARN+nSTBhb2+gYZ8u74lQac al1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Zpmwmp0xZhBIlQXMWime54+UXrtfkGvTBK6li71mS9s=; b=HhMhLi9ZeYwKm/IKoHGOAfRNQet5+kCOGNPu/pIwTnNkVy1SoRJxaO669m1OTbkBaB Sf/D63B8a+T88gaiLeTjy9jT5Q8gNlZX97/See/3xdXVvVuwOIulClq92jtuRIE5YfcZ eRIpx4DtRFBeD5opF4aMIdqItoZ7yqFa+M9CrWQLH7ByYNiWEVc7mu52kaHhgECnAY53 20CmflvRuL6On5+JTk0f7i4YldSuLfifrTns/h1c1fY5Cesvs+bAKpJaoA9jm/SXpum9 HlorHPG/KSEjljs5NgZYSqKVmirYVi4s9QnfEd1boZO1A9K5aOEOnkG6tT9uMBxujoKw aPZg== X-Gm-Message-State: ANoB5pl421cInhPLL5O17jfamEU6UVH2Q0UrSGZv66kRT+nRejR3JYaP HyE4gRZ8fG3nptkwjZ+Wv+2YhxRfWmAZYg== X-Received: by 2002:a05:600c:4148:b0:3cf:88cf:1f8e with SMTP id h8-20020a05600c414800b003cf88cf1f8emr39315wmm.9.1668508616179; Tue, 15 Nov 2022 02:36:56 -0800 (PST) Received: from thomas-win.localdomain ([213.138.44.237]) by smtp.gmail.com with ESMTPSA id e8-20020adffc48000000b00236863c02f5sm11764882wrs.96.2022.11.15.02.36.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 15 Nov 2022 02:36:55 -0800 (PST) From: Thomas Siedel To: ffmpeg-devel@ffmpeg.org Date: Tue, 15 Nov 2022 11:36:14 +0100 Message-Id: <20221115103624.48778-1-thomas.ff@spin-digital.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v4 00/10] Add support for H266/VVC X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Thomas Siedel Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: YW4DnMEp3zbi This patch set adds H266/VVC support. This includes parsing, muxing, demuxing, decoding and encoding. Decoding is done using the external library VVdeC (https://github.com/fraunhoferhhi/vvdec.git) and can be enabled with --enable-libvvdec. Encoding is done using the external library VVenC (https://github.com/fraunhoferhhi/vvenc.git) and can be enabled with --enable-libvvenc. Changes since v3: PATCH 01-09/10: - code formating/indent: 'indent -i4 -kr -nut -l80' - cleanup auto formated files PATCH 07/10 libavcodec/libvvdec.c - replacing FFCodec.p.longname with macro CODEC_LONG_NAME PATCH 08/10 libavcodec/libvvenc.c - replacing FFCodec.p.longname with macro CODEC_LONG_NAME Thomas Siedel (10): avcodec: add enum types for H266/VVC avcodec: add cbs for H266/VVC avcodec: add bitstream parser for H266/VVC avcodec: add MP4 to annexb support for H266/VVC avformat: add demuxer and probe support for H266/VVC avformat: add muxer support for H266/VVC avcodec: add external decoder libvvdec for H266/VVC avcodec: add external encoder libvvenc for H266/VVC avformat: add ts stream types for H266/VVC avcodec: increase minor version for H266/VVC configure | 16 +- libavcodec/Makefile | 6 + libavcodec/allcodecs.c | 2 + libavcodec/bitstream_filters.c | 2 + libavcodec/cbs.c | 6 + libavcodec/cbs_h2645.c | 373 ++- libavcodec/cbs_h266.h | 791 +++++++ libavcodec/cbs_h266_syntax_template.c | 3095 +++++++++++++++++++++++++ libavcodec/cbs_internal.h | 1 + libavcodec/cbs_sei.c | 29 + libavcodec/h2645_parse.c | 71 +- libavcodec/h266_metadata_bsf.c | 146 ++ libavcodec/libvvdec.c | 544 +++++ libavcodec/libvvenc.c | 469 ++++ libavcodec/parsers.c | 1 + libavcodec/version.h | 2 +- libavcodec/vvc.h | 142 ++ libavcodec/vvc_mp4toannexb_bsf.c | 329 +++ libavcodec/vvc_paramset.c | 1005 ++++++++ libavcodec/vvc_paramset.h | 429 ++++ libavcodec/vvc_parse_extradata.c | 249 ++ libavcodec/vvc_parse_extradata.h | 36 + libavcodec/vvc_parser.c | 601 +++++ libavformat/Makefile | 8 +- libavformat/allformats.c | 2 + libavformat/demux.c | 7 +- libavformat/isom.c | 1 + libavformat/isom_tags.c | 3 + libavformat/mov.c | 6 + libavformat/movenc.c | 41 +- libavformat/mpeg.c | 3 + libavformat/mpeg.h | 1 + libavformat/mpegts.c | 2 + libavformat/mpegts.h | 1 + libavformat/mpegtsenc.c | 65 + libavformat/rawenc.c | 23 + libavformat/vvc.c | 984 ++++++++ libavformat/vvc.h | 99 + libavformat/vvcdec.c | 61 + 39 files changed, 9641 insertions(+), 11 deletions(-) create mode 100644 libavcodec/cbs_h266.h create mode 100644 libavcodec/cbs_h266_syntax_template.c create mode 100644 libavcodec/h266_metadata_bsf.c create mode 100644 libavcodec/libvvdec.c create mode 100644 libavcodec/libvvenc.c create mode 100644 libavcodec/vvc.h create mode 100644 libavcodec/vvc_mp4toannexb_bsf.c create mode 100644 libavcodec/vvc_paramset.c create mode 100644 libavcodec/vvc_paramset.h create mode 100644 libavcodec/vvc_parse_extradata.c create mode 100644 libavcodec/vvc_parse_extradata.h create mode 100644 libavcodec/vvc_parser.c create mode 100644 libavformat/vvc.c create mode 100644 libavformat/vvc.h create mode 100644 libavformat/vvcdec.c