From patchwork Tue May 23 07:19:48 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Dai, Jianhui J" X-Patchwork-Id: 41791 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:c51c:b0:10c:5e6f:955f with SMTP id gm28csp364961pzb; Tue, 23 May 2023 00:20:24 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ79xIZblVUNTNr9KDz0xD/8EnyGXatsmHmtzcsL3s6x97SFIoXDX4zKMPFtqszIwv2g4FFg X-Received: by 2002:a05:6402:5246:b0:4ea:a9b0:a518 with SMTP id t6-20020a056402524600b004eaa9b0a518mr18495205edd.17.1684826424108; Tue, 23 May 2023 00:20:24 -0700 (PDT) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id n9-20020a056402514900b0050bf8815a35si4899118edd.495.2023.05.23.00.20.23; Tue, 23 May 2023 00:20:24 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=EoihrFdx; arc=fail (body hash mismatch); spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 3CCD968C0B8; Tue, 23 May 2023 10:20:19 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 40BB768A1DD for ; Tue, 23 May 2023 10:20:11 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1684826416; x=1716362416; h=from:to:subject:date:message-id: content-transfer-encoding:mime-version; bh=fO2Ppvzqhev9yzMB18AKgZAVhoMuZCCKhyCtERI67nY=; b=EoihrFdxcHKWrijNkciW/WZ78UA9ngq8xfF+gO3TjWwfpEBTefTu3v6w /MwOgBcutJqurLu4Fk+ZlSSYuAH5eSe4pOpAS8TXJFxbEpUnr+EPtey1a nYSjNJKigO2fBvQsrrLHLn6hvMPGZoWOjc0OsLvfyytaTekyarI5cxXG/ vYAS6sID0TcGbJnTZqrTAprfaEhRC8QbCsdnQ2IwyEgUembiM+VKEts7l SIHyxKhS6hJrD82m6hnYiFmBP22WdxAnZiRnm3/v+gLfU+/6J4MEYQjJs NFCw0vA+H8PX7y6230xR5WL8LdSN9DI+kjEh1etaUzAuRKYrCCKCQ5BTJ g==; X-IronPort-AV: E=McAfee;i="6600,9927,10718"; a="350667515" X-IronPort-AV: E=Sophos;i="6.00,185,1681196400"; d="scan'208";a="350667515" Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 23 May 2023 00:19:53 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10718"; a="654257389" X-IronPort-AV: E=Sophos;i="6.00,185,1681196400"; d="scan'208";a="654257389" Received: from fmsmsx603.amr.corp.intel.com ([10.18.126.83]) by orsmga003.jf.intel.com with ESMTP; 23 May 2023 00:19:53 -0700 Received: from fmsmsx601.amr.corp.intel.com (10.18.126.81) by fmsmsx603.amr.corp.intel.com (10.18.126.83) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23; Tue, 23 May 2023 00:19:52 -0700 Received: from fmsedg602.ED.cps.intel.com (10.1.192.136) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23 via Frontend Transport; Tue, 23 May 2023 00:19:52 -0700 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (104.47.70.106) by edgegateway.intel.com (192.55.55.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.23; Tue, 23 May 2023 00:19:52 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=IN9tHdNDHyy002ZXvlhtkjAlLIWmvctern/Tc7ClPaAQ+Stm2RDwVQVTEO6XV6NXO4eZBsBW/Vmn9SbZcdQqxxliHcSHEF0Qu6RpB5d4GE9riEKZpgVSxwOJW91aZF/Wwr6BU+MRqhYGoXPHFhHagH+8LjJPyLM/DFlmi8ASXLGRG1jtMtgl4r+5ohBHfK5iMeWMn6HuRmkfYL4UN6cxT3p56tT7YaGnYMsDESvDI4rh44rXAROIyMxjmWMguIkmauW6SaP+5vuzYi6HV/Z0dSiHAcnG1P7dgQRwx25rV01Fscx0KoZxp+yHJBNF9Itl47ADIx8ZwTvKknuMGMGbSw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=itNEBj0qIfHllpncxObo1W+z5+f0GSBf6M9gLxOppb0=; b=ZOYXvPWUDyU6VcMhGiSQrZRNDA8ftikST03XyG1kYrmJhsuCDJhUf0y6ywD3pIZDeLHK78kMwjUsRXLaXMQfouAzpyrYYj0woD+kj+n2hhk7d+T+2o1V2aQQ+ZsHtlcmQKutpFM8YPHCxeLhmbhltmOKheDO7gbjlL9HuhWQKcXBY5yDsWsSVqfrebrtBFGP5GPBWeTjl1uVD0Gr25q7O96UjQpwXnMTf22GEGnnrnxGPAoigItHfO3rERlGxxQH/QR9ezmjbA5kfK0yZBg4dIiqkRdVMKhPNJdSwXXcSq47xG5FCDPR6AbhNNVQhEWZdyDLgOvuzVZ+oLdKaGZMWg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from DM6PR11MB2681.namprd11.prod.outlook.com (2603:10b6:5:bd::33) by MN2PR11MB4517.namprd11.prod.outlook.com (2603:10b6:208:24e::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6411.28; Tue, 23 May 2023 07:19:49 +0000 Received: from DM6PR11MB2681.namprd11.prod.outlook.com ([fe80::c994:98fe:fd3a:ffcb]) by DM6PR11MB2681.namprd11.prod.outlook.com ([fe80::c994:98fe:fd3a:ffcb%5]) with mapi id 15.20.6411.028; Tue, 23 May 2023 07:19:48 +0000 From: "Dai, Jianhui J" To: "ffmpeg-devel@ffmpeg.org" Thread-Topic: [PATCH v2] avcodec/cbs_vp8: Add support for VP8 codec bitstream READ methods Thread-Index: AdmG0tDkUjaRRiQuT3a/crrFYYeedg== Date: Tue, 23 May 2023 07:19:48 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-exchange-messagesentrepresentingtype: 1 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DM6PR11MB2681:EE_|MN2PR11MB4517:EE_ x-ms-office365-filtering-correlation-id: 13f413ff-cda7-4f9f-a3ee-08db5b5e178b x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: CefDe/JLskPWJs7E2Pv5Te0U7B/mBjr2zcDpVV7dumXyDqw87TLirUpMNrgElpj25hv9cmTGs4QjHvXNg46TFkkwd5GxPisQ7PMzSPX+DLqW5t+zUZFQr+B6rXYL+wua4yvbcBeVVnNiUYCqWMg9mmBxCmgH7SdzU/eWjDhfYh2MTLPdcgbooIaQ9zRBNuY+oMMV3xrLarwUmF8mU0qFZK0U3T0wlXNE2YTVRSizxE5l8nGfQALuTNfy1t/sx/L1t4BCBd11eSXE5PN7+FXo9XhGgmuDibSJd6am7YdKadyByb/KKE5bv9iuq1Lwx4kk5LYdGbAnqor/Lnv6eYHKv4yKHj/yNRRsa+0QH7ZfUs3oT8wjicPmqPHMCTCgrnxFf7Z1g5Qlh8leVKDu2jumGktwsqgkMTm84E7f1eUaNvH+UGvosOzByzyIJT6m4a4hx8Skv1YZPK9S0D/CsvgaxWxbUQduqTpqu5S5ZOWmQ5JadyNH6LQEwvl5H7b42+L11WjAyIHxiGL8/nj193kMMUChgDJ2XndL7q2lFnXSwi9rpsvxIu9eoRejgnmVf6ANNpX7INRNuK4YFAUqiZ3WdOH0hUrHo2hHfwN41Ug24Iyh6d6Es11PE2s8v8NuGdASLJan+Hnz8vdNVDxOs8pUuw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR11MB2681.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(346002)(366004)(376002)(396003)(136003)(39860400002)(451199021)(8936002)(8676002)(52536014)(5660300002)(83380400001)(186003)(122000001)(6506007)(9686003)(82960400001)(26005)(86362001)(38100700002)(38070700005)(41300700001)(71200400001)(33656002)(55016003)(7696005)(478600001)(66946007)(66556008)(6916009)(64756008)(66446008)(66476007)(76116006)(316002)(19627235002)(2906002)(30864003)(66899021)(2004002)(559001)(579004); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: vOVHdLWcLw03ogcYHnzzhyH5llac+NiuJRY5fTGKZr1fJ/fZ0CBv1icURlFjWiSRGALtxZK+3bAg5dlCvIOTYXdZLu/DMZPILL8cwcgm+qJ+yTsigoTioavxSFLL9li32S3rJpFtZvy6fLhLYr3ZbEaITjwZVIFxbjFF5/sUG5rBXiCn1nqPqPq5xpqKJkS0hMoGau3pD50VDtqQlbZ/fc9D/bs9u8A5yd8k6k++fXgH4W+d40/Qx33eruloWp0OCr+Xp1t72XA3e4dNdm8t6kYe3B0xjglQsmctpcGEmDnyA4IsqbRFp4jGEmP3VBk7sh05yRVd+WOR3Z1pT/BzHNSyyDrp2bD9zMf+6GQWO0I14JeEJHacI1V4ZGm9B4Yg+absLINK7OFOnlDdIr/ftcLGv+ZyBpT4x5XM7IoFJO07gdZ0nU7scTBO/NOKrsPgxxZn+23xaxyklawbCvDnfs3NewQtZO4LDTW1Am2504LqqPDfAAAkQ3elFMYkzo8HOClOuuqd1o5ta97JVJQEbJKf+OSQTHpRm7KQBshV9yhVHlaiPh3s7AZ5vS69/TET3DGeb6aCUjfRHJid8xhpISpkkU5M5u2KQaJDULMgG2im+cQuoAHfRKLU+6fL7VmCxPypUeKUtqzyDTQkI9VsmeYLbOMBQC74d/zQi79mjq75y2flGPQJFeudNzRfGVFPerZU3UC++vthKsO/5OFo/eI7McSB1axBsFAlO3wXaOATq9AgvKlvnMdMT8CYSmdC8ae75BAaIBZEwLvU9B7q/RlsCCJs403TF3G0JcGzyuRjxz7aJHZWNzvvHNhxzS7cMrG/llndhsmZXq0NH48Z25JvAE5WtcQeLQmUGRJBKb3M4obvBGuly8aq86I77bept6sHQfZjbT/K1eTxr3XLO2vaPr0xmgH2g0nzl4Tucqb/Cb/sJ6euw+PqsEcs2agKgGgpRWnEFCRzTQAnlGyQSx5M6sR3OKctFPZ5a0FbGZSXxWIK0q7+q5JKi/oWYUnh7V8VzrgUU8AmkXhQal/mONtOU/zwRGpIBfHHDLRjWjBheyZ3BSzQf0DyHm/S2w4uJg9uElUREPA5BX9g8ZqpznaoSaioz6aOnWvFx9hwjiKkixzfOiZPGYDTCRh//ImE+I27YZ33/NpFr+qlJEAhVRbyKqnxYpXctNeizctQuUBP60zzkdXzdkyNURaBENRJsuLfb5gSghYff/O4GywlPxQS/ZS5ZcNfFKQxhTltphk8ZeWwFzsZyZixglpdBim0orecEOCtlG9gyAQbFExx0Y3nNS3gH4Waou71qhwsTknvmivCZ8MjJ9mUdgvu1ncqPTnDh4zy8+lDx/Ut5eG8F/wujy0N4+cm46bwImWZZyKfM8aJCSKgBaSLFibN99//92iyWlvWG2suAigAkAkChEgRA2jSHlWNZ5guoey4dFMiOUVIlvwMC1utxQQSfw64dyVJqY9WY1JK8OfDapHS2aOVAvAeW+AubZSW7J44tagkDMaRKdenadNmQkm4rnTrjOBoZjSDQ2cDRr8YooRx2CYVK8aQ22vaPyfetwAe4XwLeIa5xMX/382rNpzWKoNU MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM6PR11MB2681.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 13f413ff-cda7-4f9f-a3ee-08db5b5e178b X-MS-Exchange-CrossTenant-originalarrivaltime: 23 May 2023 07:19:48.2883 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Oa5ZQO/6EWV+S52jr41O30dMCyFPHOrI45nJXvDWDVC+qM19b3CCU/DsaSMuxs7LUylNbpKJfM6HkvP+Do6LHA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR11MB4517 X-OriginatorOrg: intel.com Subject: [FFmpeg-devel] [PATCH v2] avcodec/cbs_vp8: Add support for VP8 codec bitstream READ methods X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: 4zG6Ovi775+W This commit adds VP8 into cbs supported codec list, and enables the `trace_headers` bitstream filters to support VP8, besides existing AV1, H.264, H.265 and VP9. It can be useful to debug VP8 stream issues. Only the READ methods `read_unit` and `split_fragment` are implemented, the WRITE methods `write_unit` and `assemble_fragment` return `AVERROR_PATCHWELCOME` error code. It is because the CBS VP8 WRITE is unlikely used by any applications at the moment. The WRITE methods can be added later if there are real requirments. TESTS: ffmpeg -i fate-suite/vp8/frame_size_change.webm -vcodec copy -bsf:v trace_headers -f null - Signed-off-by: Jianhui Dai --- configure | 4 +- libavcodec/Makefile | 1 + libavcodec/cbs.c | 6 + libavcodec/cbs_internal.h | 1 + libavcodec/cbs_vp8.c | 360 +++++++++++++++++++++++++++ libavcodec/cbs_vp8.h | 116 +++++++++ libavcodec/cbs_vp8_syntax_template.c | 224 +++++++++++++++++ 7 files changed, 711 insertions(+), 1 deletion(-) create mode 100644 libavcodec/cbs_vp8.c create mode 100644 libavcodec/cbs_vp8.h create mode 100644 libavcodec/cbs_vp8_syntax_template.c diff --git a/configure b/configure index bb7be67676..b8960d2639 100755 --- a/configure +++ b/configure @@ -2432,6 +2432,7 @@ CONFIG_EXTRA=" cbs_h265 cbs_jpeg cbs_mpeg2 + cbs_vp8 cbs_vp9 deflate_wrapper dirac_parse @@ -2713,6 +2714,7 @@ cbs_h264_select="cbs" cbs_h265_select="cbs" cbs_jpeg_select="cbs" cbs_mpeg2_select="cbs" +cbs_vp8_select="cbs" cbs_vp9_select="cbs" dct_select="rdft" deflate_wrapper_deps="zlib" @@ -3284,7 +3286,7 @@ h264_redundant_pps_bsf_select="cbs_h264" hevc_metadata_bsf_select="cbs_h265" mjpeg2jpeg_bsf_select="jpegtables" mpeg2_metadata_bsf_select="cbs_mpeg2" -trace_headers_bsf_select="cbs" +trace_headers_bsf_select="cbs cbs_vp8" vp9_metadata_bsf_select="cbs_vp9" # external libraries diff --git a/libavcodec/Makefile b/libavcodec/Makefile index 3cf4444b7e..1c4f0da1d2 100644 --- a/libavcodec/Makefile +++ b/libavcodec/Makefile @@ -78,6 +78,7 @@ OBJS-$(CONFIG_CBS_H264) += cbs_h2645.o cbs_sei.o h2645_parse.o OBJS-$(CONFIG_CBS_H265) += cbs_h2645.o cbs_sei.o h2645_parse.o OBJS-$(CONFIG_CBS_JPEG) += cbs_jpeg.o OBJS-$(CONFIG_CBS_MPEG2) += cbs_mpeg2.o +OBJS-$(CONFIG_CBS_VP8) += cbs_vp8.o vpx_rac.o OBJS-$(CONFIG_CBS_VP9) += cbs_vp9.o OBJS-$(CONFIG_CRYSTALHD) += crystalhd.o OBJS-$(CONFIG_DCT) += dct.o dct32_fixed.o dct32_float.o diff --git a/libavcodec/cbs.c b/libavcodec/cbs.c index 504197e06d..c77110abb1 100644 --- a/libavcodec/cbs.c +++ b/libavcodec/cbs.c @@ -46,6 +46,9 @@ static const CodedBitstreamType *const cbs_type_table[] = { #if CONFIG_CBS_MPEG2 &ff_cbs_type_mpeg2, #endif +#if CONFIG_CBS_VP8 + &ff_cbs_type_vp8, +#endif #if CONFIG_CBS_VP9 &ff_cbs_type_vp9, #endif @@ -67,6 +70,9 @@ const enum AVCodecID ff_cbs_all_codec_ids[] = { #if CONFIG_CBS_MPEG2 AV_CODEC_ID_MPEG2VIDEO, #endif +#if CONFIG_CBS_VP8 + AV_CODEC_ID_VP8, +#endif #if CONFIG_CBS_VP9 AV_CODEC_ID_VP9, #endif diff --git a/libavcodec/cbs_internal.h b/libavcodec/cbs_internal.h index e585c77934..beaf8505d1 100644 --- a/libavcodec/cbs_internal.h +++ b/libavcodec/cbs_internal.h @@ -247,6 +247,7 @@ extern const CodedBitstreamType ff_cbs_type_h264; extern const CodedBitstreamType ff_cbs_type_h265; extern const CodedBitstreamType ff_cbs_type_jpeg; extern const CodedBitstreamType ff_cbs_type_mpeg2; +extern const CodedBitstreamType ff_cbs_type_vp8; extern const CodedBitstreamType ff_cbs_type_vp9; diff --git a/libavcodec/cbs_vp8.c b/libavcodec/cbs_vp8.c new file mode 100644 index 0000000000..a890590cd9 --- /dev/null +++ b/libavcodec/cbs_vp8.c @@ -0,0 +1,360 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "libavutil/avassert.h" + +#include "cbs.h" +#include "cbs_internal.h" +#include "cbs_vp8.h" + +#include "vp8data.h" + +// Wrap of VPXRangeCoder to support size check. +typedef struct CBSVP8RangeCoder { + VPXRangeCoder c; + const uint8_t *buffer; + int buffer_size; +} CBSVP8RangeCoder; + +static int cbs_vp8_read_unsigned(CodedBitstreamContext *ctx, GetBitContext *gbc, + int width, const char *name, + const int *subscripts, uint32_t *write_to) +{ + int pos; + uint32_t value; + + av_assert0(width > 0 && width <= 24); + + if (get_bits_left(gbc) < width) { + av_log(ctx->log_ctx, AV_LOG_ERROR, "Invalid value: bitstream ended.\n"); + return AVERROR_INVALIDDATA; + } + + pos = get_bits_count(gbc); + value = get_bits_le(gbc, width); + + if (ctx->trace_enable) { + int i; + char bits[33]; + for (i = 0; i < width; i++) + bits[i] = value >> (width - i - 1) & 1 ? '1' : '0'; + bits[i] = 0; + + ff_cbs_trace_syntax_element(ctx, pos, name, subscripts, bits, value); + } + + *write_to = value; + return 0; +} + +static int cbs_vp8_init_range_decoder(CBSVP8RangeCoder *rac, const uint8_t *buf, + int buf_size) +{ + int err; + + err = ff_vpx_init_range_decoder(&rac->c, buf, buf_size); + if (err < 0) + return err; + + rac->buffer = buf; + rac->buffer_size = buf_size; + return 0; +} + +static av_unused int cbs_vp8_rac_get(CBSVP8RangeCoder *rac, int width) +{ + int value = 0; + + while (width--) + value = (value << 1) | vpx_rac_get_prob(&rac->c, 128); + + return value; +} + +static int cbs_vp8_rac_get_prob_branchy(CBSVP8RangeCoder *rac, int prob) +{ + return vpx_rac_get_prob_branchy(&rac->c, prob); +} + +static int cbs_vp8_rac_get_bits_count(CBSVP8RangeCoder *rac) +{ + int bits_count = (rac->c.buffer - rac->buffer) * 8; + bits_count += rac->c.bits; + return bits_count; +} + +static int cbs_vp8_rac_read_unsigned(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, int width, + const char *name, const int *subscripts, + uint32_t *write_to) +{ + CodedBitstreamVP8Context *vp8 = ctx->priv_data; + uint32_t value; + int pos; + + av_assert0(width >= 0 && width <= 8); + + if (vpx_rac_is_end(&rac->c)) { + av_log(ctx->log_ctx, AV_LOG_ERROR, + "Invalid value at " + "%s: bitstream ended.\n", + name); + return AVERROR_INVALIDDATA; + } + + pos = cbs_vp8_rac_get_bits_count(rac); + if (pos > rac->buffer_size * 8) { + av_log(ctx->log_ctx, AV_LOG_ERROR, + "Invalid value at " + "%s: bitstream ended.\n", + name); + return AVERROR_INVALIDDATA; + } + + pos += vp8->uncompressed_header_size * 8; + + value = cbs_vp8_rac_get(rac, width); + + if (ctx->trace_enable) { + char bits[33] = "-"; + ff_cbs_trace_syntax_element(ctx, pos, name, subscripts, bits, value); + } + + *write_to = value; + return 0; +} + +static int cbs_vp8_rac_read_signed(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, int width, + const char *name, const int *subscripts, + int32_t *write_to) +{ + CodedBitstreamVP8Context *vp8 = ctx->priv_data; + int32_t value; + int pos; + + av_assert0(width >= 0 && width <= 8); + + if (vpx_rac_is_end(&rac->c)) { + av_log(ctx->log_ctx, AV_LOG_ERROR, + "Invalid value at " + "%s: bitstream ended.\n", + name); + return AVERROR_INVALIDDATA; + } + + pos = cbs_vp8_rac_get_bits_count(rac); + if (pos > rac->buffer_size * 8) { + av_log(ctx->log_ctx, AV_LOG_ERROR, + "Invalid value at " + "%s: bitstream ended.\n", + name); + return AVERROR_INVALIDDATA; + } + + pos += vp8->uncompressed_header_size * 8; + + value = cbs_vp8_rac_get(rac, width); + if (cbs_vp8_rac_get(rac, 1)) + value = -value; + + if (ctx->trace_enable) { + char bits[33] = "-"; + ff_cbs_trace_syntax_element(ctx, pos, name, subscripts, bits, value); + } + + *write_to = value; + return 0; +} + +#define HEADER(name) \ + do { \ + ff_cbs_trace_header(ctx, name); \ + } while (0) + +#define CHECK(call) \ + do { \ + int err = (call); \ + if (err < 0) \ + return err; \ + } while (0) + +#define FUNC_NAME(rw, codec, name) cbs_##codec##_##rw##_##name +#define FUNC_VP8(rw, name) FUNC_NAME(rw, vp8, name) +#define FUNC(name) FUNC_VP8(READWRITE, name) + +#define SUBSCRIPTS(subs, ...) \ + (subs > 0 ? ((int[subs + 1]){subs, __VA_ARGS__}) : NULL) + +#define f(width, name) xf(width, name, 0) + +#define rac_f(width, name) rac_unsigned_subs(width, name, 0) +#define rac_s(width, name) rac_signed_subs(width, name, 0) +#define rac_fs(width, name, subs, ...) \ + rac_unsigned_subs(width, name, subs, __VA_ARGS__) +#define rac_ss(width, name, subs, ...) \ + rac_signed_subs(width, name, subs, __VA_ARGS__) + +#define READ +#define READWRITE read +#define RWContext GetBitContext + +#define xf(width, name, subs, ...) \ + do { \ + uint32_t value; \ + CHECK(cbs_vp8_read_unsigned(ctx, rw, width, #name, \ + SUBSCRIPTS(subs, __VA_ARGS__), &value)); \ + current->name = value; \ + } while (0) + +#define fixed(width, name, value) \ + do { \ + av_unused uint32_t fixed_value; \ + CHECK(ff_cbs_read_unsigned(ctx, rw, width, #name, 0, &fixed_value, \ + value, value)); \ + } while (0) + +#define rac_unsigned_subs(width, name, subs, ...) \ + do { \ + uint32_t value; \ + CHECK(cbs_vp8_rac_read_unsigned( \ + ctx, rac, width, #name, SUBSCRIPTS(subs, __VA_ARGS__), &value)); \ + current->name = value; \ + } while (0) + +#define rac_signed_subs(width, name, subs, ...) \ + do { \ + int32_t value; \ + CHECK(cbs_vp8_rac_read_signed(ctx, rac, width, #name, \ + SUBSCRIPTS(subs, __VA_ARGS__), &value)); \ + current->name = value; \ + } while (0) + +#include "cbs_vp8_syntax_template.c" + +static int cbs_vp8_split_fragment(CodedBitstreamContext *ctx, + CodedBitstreamFragment *frag, int header) +{ + int err; + + if (frag->data_size == 0) + return AVERROR_INVALIDDATA; + + err = ff_cbs_append_unit_data(frag, 0, frag->data, frag->data_size, + frag->data_ref); + if (err < 0) + return err; + + return 0; +} + +static int cbs_vp8_read_unit(CodedBitstreamContext *ctx, + CodedBitstreamUnit *unit) +{ + CodedBitstreamVP8Context *vp8 = ctx->priv_data; + VP8RawFrame *frame; + GetBitContext gbc; + CBSVP8RangeCoder rac; + int err, pos; + + err = ff_cbs_alloc_unit_content(ctx, unit); + if (err < 0) + return err; + frame = unit->content; + + // Create GetBitContext for uncompressed header. + err = init_get_bits8_le(&gbc, unit->data, 8 * unit->data_size); + if (err < 0) + return err; + + err = cbs_vp8_read_uncompressed_header(ctx, &gbc, frame); + if (err < 0) + return err; + + pos = get_bits_count(&gbc); + av_assert0(pos % 8 == 0); + pos /= 8; + av_assert0(pos <= unit->data_size); + + if (pos == unit->data_size) + return AVERROR_INVALIDDATA; + + vp8->uncompressed_header_size = pos; + + // Create range decoder for compressed header. + err = cbs_vp8_init_range_decoder( + &rac, unit->data + pos, frame->header.first_partition_length_in_bytes); + if (err < 0) + return err; + + err = cbs_vp8_read_compressed_header(ctx, &rac, frame); + if (err < 0) + return err; + + pos = cbs_vp8_rac_get_bits_count(&rac); + if (pos > rac.buffer_size * 8) + return AVERROR_INVALIDDATA; + + frame->data_ref = av_buffer_ref(unit->data_ref); + if (!frame->data_ref) + return AVERROR(ENOMEM); + + frame->data = unit->data + pos; + frame->data_size = unit->data_size - pos; + + return 0; +} + +static int cbs_vp8_write_unit(CodedBitstreamContext *ctx, + CodedBitstreamUnit *unit, PutBitContext *pbc) +{ + return AVERROR_PATCHWELCOME; +} + +static int cbs_vp8_assemble_fragment(CodedBitstreamContext *ctx, + CodedBitstreamFragment *frag) +{ + return AVERROR_PATCHWELCOME; +} + +static void cbs_vp8_flush(CodedBitstreamContext *ctx) +{ + CodedBitstreamVP8Context *vp8 = ctx->priv_data; + + vp8->uncompressed_header_size = 0; +} + +static const CodedBitstreamUnitTypeDescriptor cbs_vp8_unit_types[] = { + CBS_UNIT_TYPE_INTERNAL_REF(0, VP8RawFrame, data), + CBS_UNIT_TYPE_END_OF_LIST}; + +const CodedBitstreamType ff_cbs_type_vp8 = { + .codec_id = AV_CODEC_ID_VP8, + + .priv_data_size = sizeof(CodedBitstreamVP8Context), + + .unit_types = cbs_vp8_unit_types, + + .split_fragment = &cbs_vp8_split_fragment, + .read_unit = &cbs_vp8_read_unit, + .write_unit = &cbs_vp8_write_unit, + + .flush = &cbs_vp8_flush, + + .assemble_fragment = &cbs_vp8_assemble_fragment, +}; diff --git a/libavcodec/cbs_vp8.h b/libavcodec/cbs_vp8.h new file mode 100644 index 0000000000..4ce0e1deda --- /dev/null +++ b/libavcodec/cbs_vp8.h @@ -0,0 +1,116 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#ifndef AVCODEC_CBS_VP8_H +#define AVCODEC_CBS_VP8_H + +#include +#include + +#include "cbs.h" +#include "vpx_rac.h" + +enum { + VP8_START_CODE_0 = 0x9D, + VP8_START_CODE_1 = 0x01, + VP8_START_CODE_2 = 0x2A, +}; + +enum { + VP8_KEY_FRAME = 0, + VP8_NON_KEY_FRAME = 1, +}; + +typedef struct VP8RawFrameHeader { + // frame tag + uint8_t frame_type; + uint8_t profile; + uint8_t show_frame; + uint32_t first_partition_length_in_bytes; + + uint32_t start_code_0; + uint32_t start_code_1; + uint32_t start_code_2; + + uint16_t width; + uint16_t horizontal_scale; + uint16_t height; + uint16_t vertical_scale; + + // frame header + uint8_t color_space; + uint8_t clamping_type; + + // segmentation + uint8_t segmentation_enabled; + uint8_t update_segment_map; + uint8_t update_segment_feature_data; + uint8_t segment_feature_mode; + int8_t segment_update_qp[4]; + int8_t segment_update_loop_filter_level[4]; + uint8_t segment_update_probs[3]; + + // loop filter + uint8_t loop_filter_type; + uint8_t loop_filter_level; + uint8_t loop_filter_sharpness; + uint8_t mode_ref_lf_delta_enabled; + int8_t ref_lf_deltas[4]; + int8_t mode_lf_deltas[4]; + + uint8_t log2_token_partitions; + + // qp + uint8_t base_qindex; + int8_t y1dc_delta_q; + int8_t y2dc_delta_q; + int8_t y2ac_delta_q; + int8_t uvdc_delta_q; + int8_t uvac_delta_q; + + // ref + uint8_t refresh_golden_frame; + uint8_t refresh_alternate_frame; + uint8_t ref_frame_sign_bias_golden; + uint8_t ref_frame_sign_bias_alternate; + uint8_t refresh_last_frame; + + // token probs + uint8_t refresh_entropy_probs; + + uint8_t mb_no_skip_coeff; + uint8_t prob_skip_false; + + uint8_t prob_intra; + uint8_t prob_last; + uint8_t prob_golden; +} VP8RawFrameHeader; + +typedef struct VP8RawFrame { + VP8RawFrameHeader header; + + uint8_t *data; + AVBufferRef *data_ref; + size_t data_size; +} VP8RawFrame; + +typedef struct CodedBitstreamVP8Context { + uint32_t uncompressed_header_size; +} CodedBitstreamVP8Context; + +#endif /* AVCODEC_CBS_VP8_H */ diff --git a/libavcodec/cbs_vp8_syntax_template.c b/libavcodec/cbs_vp8_syntax_template.c new file mode 100644 index 0000000000..5ab034a164 --- /dev/null +++ b/libavcodec/cbs_vp8_syntax_template.c @@ -0,0 +1,224 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +static int FUNC(update_segmentation)(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, + VP8RawFrameHeader *current) +{ + rac_f(1, update_segment_map); + rac_f(1, update_segment_feature_data); + + if (current->update_segment_feature_data) { + rac_f(1, segment_feature_mode); + // quantizer + for (int i = 0; i < 4; i++) + if (cbs_vp8_rac_get(rac, 1)) + rac_ss(7, segment_update_qp[i], 1, i); + // loop filter + for (int i = 0; i < 4; i++) + if (cbs_vp8_rac_get(rac, 1)) + rac_ss(6, segment_update_loop_filter_level[i], 1, i); + } + + if (current->update_segment_map) { + for (int i = 0; i < 3; i++) + if (cbs_vp8_rac_get(rac, 1)) + rac_fs(8, segment_update_probs[i], 1, i); + } + + return 0; +} + +static int FUNC(mode_ref_lf_deltas)(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, + VP8RawFrameHeader *current) +{ + rac_f(1, mode_ref_lf_delta_enabled); + if (current->mode_ref_lf_delta_enabled) { + if (cbs_vp8_rac_get(rac, 1)) { + // ref_lf_deltas + for (int i = 0; i < 4; i++) + if (cbs_vp8_rac_get(rac, 1)) + rac_ss(6, ref_lf_deltas[i], 1, i); + // mode_lf_deltas + for (int i = 0; i < 4; i++) + if (cbs_vp8_rac_get(rac, 1)) + rac_ss(6, mode_lf_deltas[i], 1, i); + } + } + + return 0; +} + +static int FUNC(quantization_params)(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, + VP8RawFrameHeader *current) +{ + rac_f(7, base_qindex); + + if (cbs_vp8_rac_get(rac, 1)) + rac_s(4, y1dc_delta_q); + + if (cbs_vp8_rac_get(rac, 1)) + rac_s(4, y2dc_delta_q); + + if (cbs_vp8_rac_get(rac, 1)) + rac_s(4, y2ac_delta_q); + + if (cbs_vp8_rac_get(rac, 1)) + rac_s(4, uvdc_delta_q); + + if (cbs_vp8_rac_get(rac, 1)) + rac_s(4, uvac_delta_q); + + return 0; +} + +static int FUNC(update_token_probs)(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, + VP8RawFrameHeader *current) +{ + for (int i = 0; i < 4; ++i) { + for (int j = 0; j < 8; ++j) { + for (int k = 0; k < 3; ++k) { + for (int l = 0; l < 11; ++l) + if (cbs_vp8_rac_get_prob_branchy( + rac, vp8_token_update_probs[i][j][k][l])) + cbs_vp8_rac_get(rac, 8); + } + } + } + + return 0; +} + +static int FUNC(update_mv_probs)(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, + VP8RawFrameHeader *current) +{ + for (int i = 0; i < 2; ++i) { + for (int j = 0; j < 19; ++j) + if (cbs_vp8_rac_get(rac, 1)) + cbs_vp8_rac_get(rac, 7); + } + + return 0; +} + +static int FUNC(frame_tag)(CodedBitstreamContext *ctx, RWContext *rw, + VP8RawFrameHeader *current) +{ + f(1, frame_type); + f(3, profile); + f(1, show_frame); + f(19, first_partition_length_in_bytes); + + if (current->frame_type == VP8_KEY_FRAME) { + fixed(8, start_code_0, VP8_START_CODE_0); + fixed(8, start_code_1, VP8_START_CODE_1); + fixed(8, start_code_2, VP8_START_CODE_2); + + f(14, width); + f(2, horizontal_scale); + f(14, height); + f(2, vertical_scale); + } + + return 0; +} + +static int FUNC(frame_header)(CodedBitstreamContext *ctx, CBSVP8RangeCoder *rac, + VP8RawFrameHeader *current) +{ + if (current->frame_type == VP8_KEY_FRAME) { + rac_f(1, color_space); + rac_f(1, clamping_type); + } + + rac_f(1, segmentation_enabled); + if (current->segmentation_enabled) + CHECK(FUNC(update_segmentation)(ctx, rac, current)); + + rac_f(1, loop_filter_type); + rac_f(6, loop_filter_level); + rac_f(3, loop_filter_sharpness); + + CHECK(FUNC(mode_ref_lf_deltas)(ctx, rac, current)); + + rac_f(2, log2_token_partitions); + + CHECK(FUNC(quantization_params)(ctx, rac, current)); + + if (current->frame_type != VP8_KEY_FRAME) { + rac_f(1, refresh_golden_frame); + rac_f(1, refresh_alternate_frame); + if (!current->refresh_golden_frame) + cbs_vp8_rac_get(rac, 2); + if (!current->refresh_alternate_frame) + cbs_vp8_rac_get(rac, 2); + rac_f(1, ref_frame_sign_bias_golden); + rac_f(1, ref_frame_sign_bias_alternate); + } + rac_f(1, refresh_entropy_probs); + if (current->frame_type != VP8_KEY_FRAME) + rac_f(1, refresh_last_frame); + + CHECK(FUNC(update_token_probs)(ctx, rac, current)); + + rac_f(1, mb_no_skip_coeff); + if (current->mb_no_skip_coeff) + rac_f(8, prob_skip_false); + + if (current->frame_type != VP8_KEY_FRAME) { + rac_f(8, prob_intra); + rac_f(8, prob_last); + rac_f(8, prob_golden); + + // intra_16x16_prob + if (cbs_vp8_rac_get(rac, 1)) + for (int i = 0; i < 4; i++) + cbs_vp8_rac_get(rac, 8); + + // intra_chroma_prob + if (cbs_vp8_rac_get(rac, 1)) + for (int i = 0; i < 4; i++) + cbs_vp8_rac_get(rac, 8); + + CHECK(FUNC(update_mv_probs)(ctx, rac, current)); + } + + return 0; +} + +static int FUNC(uncompressed_header)(CodedBitstreamContext *ctx, RWContext *rw, + VP8RawFrame *current) +{ + HEADER("Frame"); + + CHECK(FUNC(frame_tag)(ctx, rw, ¤t->header)); + + return 0; +} + +static int FUNC(compressed_header)(CodedBitstreamContext *ctx, + CBSVP8RangeCoder *rac, VP8RawFrame *current) +{ + CHECK(FUNC(frame_header)(ctx, rac, ¤t->header)); + + return 0; +}