From patchwork Wed May 22 01:26:14 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Wu, Tong1" X-Patchwork-Id: 49116 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a21:9214:b0:1af:fc2d:ff5a with SMTP id tl20csp81764pzb; Tue, 21 May 2024 18:28:13 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCUkEo7F8hmhtUnGPrRjiY1JRrzNLbjEFcZkFHpHh07SlMH9ptiJiNU8jnzgvIr6wLPKG6lsrjtLiH3SbLUjizfvY0x3AHSfFf1cuQ== X-Google-Smtp-Source: AGHT+IF2AhfcuVGMk0BZVSPPC0ylElD9AY85DUnmTbqKMWywk0ZbdURBJwib674CyPFiKvAmxQO3 X-Received: by 2002:a17:906:d9c7:b0:a5a:580f:8e74 with SMTP id a640c23a62f3a-a6228178b07mr24484866b.5.1716341293435; Tue, 21 May 2024 18:28:13 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1716341293; cv=none; d=google.com; s=arc-20160816; b=RckVTGbaQ6hYMqmtEjEjlTw4CqV33tf57npToN4GxJ0X7S7DU9SCx7SOLQLM+qV6D5 HGeiq0dP4noiWrfIBjF63/bhniTkTOWU9KwzqAU7BDhUZsobdggtQufGN2vs6dYF3bZ+ JkTskJ0HcsDyzo33jVBgEeeK8kQ8nOcbW15OGQwc2e3i6zMo3yViPQfmDm6cqEU/zoth szG8RYGqDSmJNQDtymCWY7xdWz5Z79ssDG16y4JFq6MVqWqB/a6Yj4WtWP1t5D9tw2Sj 4npAajtLWk9kTDghrhwmrgIqfUPGDQQYwDLzvvtDzSpfh8P+GE81kv8/wplEAu5tjpGm TjbA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:mime-version:message-id:date:to:from :dkim-signature:delivered-to; bh=wsJ3TJuX1NfALfWGavJ3p9g3UvnVOe/26HSaQtWVUjs=; fh=CX/m9qTuMDwrotqtm4RkAOJT6yXlKL2vcfWDitFPXZs=; b=er22nxvHWLL9HxHMiABmAGpuXKUoZ6gYbjNbT2yHXwRgi/z+EpK5DqhCBGQzOecTBi UpTXSfStw5N9Q23WTlyxNEVhnuUNF5mTqrXlw9l5AEECNEFkmYrb+WuANlQTSg75gl6n ev/zuTLScnev/cX/ZqaCgcTZmmfvI8retgeJl5OTMIIuh9k/BtQjVHVolcZ7qbt017WN gKMyfDd4bWrgue1fbAx0ifTfajYntCsz+p/P6dwmfM+nOKwG9COxb03brt0V6o0GoYs+ JlURKvfQ29cYCLsl+69b8vV2LjLqFI42vlJ5PZ7OHKY2CgsOHHCWZaOYkKOs5SzNa2WC 3ZHA==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=W58OHG6A; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id a640c23a62f3a-a5a17b2187esi1568850966b.475.2024.05.21.18.28.12; Tue, 21 May 2024 18:28:13 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=W58OHG6A; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id E25AF68A7ED; Wed, 22 May 2024 04:28:09 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.14]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 9229668A7ED for ; Wed, 22 May 2024 04:28:02 +0300 (EEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1716341288; x=1747877288; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=x7XrFxP5LibwB3DN39MXwR2Z3n8fd79D2curPjW9Dv4=; b=W58OHG6A+F+52tGsGXDZS+lUyZAmH2ThUzeZgoOmgHJdy140pvVT4TJN NPWw041MARa7x+jzP5H+SXAWZDAAfzqGhJaLgmQiQqe2sCsUEnxxUAITh SjDGnYAFXSmAY3pxbpyF/BoLIKaSlND7emDTl+WQ5JqNSlvZmIXNF1VXx zyzcaaMOZpbtoa6UUH4fkqWt+AteQtxTiEPAka4v76jm+IFThSkWGzbCb KyLD/0Ia4YoZsLW7o8wJ+s/F5BaRVcFQ3Zl4ItTLzhsZbUXYVYHCvY4Hi YSZkgx13vDY4dVAEFl7x/16RzTcP0kdee66IUgBTnPCgmjJnJo1wkGKkO w==; X-CSE-ConnectionGUID: 2/7z7C7/Rmy22gU/LqWsWA== X-CSE-MsgGUID: P5oi9/dQS5Kv672B1zBbMQ== X-IronPort-AV: E=McAfee;i="6600,9927,11079"; a="12797184" X-IronPort-AV: E=Sophos;i="6.08,179,1712646000"; d="scan'208";a="12797184" Received: from orviesa006.jf.intel.com ([10.64.159.146]) by fmvoesa108.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 May 2024 18:28:01 -0700 X-CSE-ConnectionGUID: PJiNXxZtRy+FATZpkGXYgg== X-CSE-MsgGUID: KsyO8j1DSKmG3LO9YSGXAA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.08,179,1712646000"; d="scan'208";a="33537417" Received: from unknown (HELO localhost.localdomain) ([10.239.160.66]) by orviesa006.jf.intel.com with ESMTP; 21 May 2024 18:27:59 -0700 From: tong1.wu-at-intel.com@ffmpeg.org To: ffmpeg-devel@ffmpeg.org Date: Wed, 22 May 2024 09:26:14 +0800 Message-ID: <20240522012627.1386-1-tong1.wu@intel.com> X-Mailer: git-send-email 2.41.0.windows.1 MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v10 01/13] avcodec/vaapi_encode: introduce a base layer for vaapi encode X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Tong Wu Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: OsV83dF7loJ7 From: Tong Wu Since VAAPI and future D3D12VA implementation may share some common parameters, a base layer encode context is introduced as vaapi context's base. Signed-off-by: Tong Wu --- libavcodec/hw_base_encode.h | 56 +++++++++++++++++++++++++++++++++++++ libavcodec/vaapi_encode.h | 39 +++++--------------------- 2 files changed, 63 insertions(+), 32 deletions(-) create mode 100644 libavcodec/hw_base_encode.h diff --git a/libavcodec/hw_base_encode.h b/libavcodec/hw_base_encode.h new file mode 100644 index 0000000000..1996179456 --- /dev/null +++ b/libavcodec/hw_base_encode.h @@ -0,0 +1,56 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#ifndef AVCODEC_HW_BASE_ENCODE_H +#define AVCODEC_HW_BASE_ENCODE_H + +#define MAX_DPB_SIZE 16 +#define MAX_PICTURE_REFERENCES 2 +#define MAX_REORDER_DELAY 16 +#define MAX_ASYNC_DEPTH 64 +#define MAX_REFERENCE_LIST_NUM 2 + +enum { + PICTURE_TYPE_IDR = 0, + PICTURE_TYPE_I = 1, + PICTURE_TYPE_P = 2, + PICTURE_TYPE_B = 3, +}; + +enum { + // Codec supports controlling the subdivision of pictures into slices. + FLAG_SLICE_CONTROL = 1 << 0, + // Codec only supports constant quality (no rate control). + FLAG_CONSTANT_QUALITY_ONLY = 1 << 1, + // Codec is intra-only. + FLAG_INTRA_ONLY = 1 << 2, + // Codec supports B-pictures. + FLAG_B_PICTURES = 1 << 3, + // Codec supports referencing B-pictures. + FLAG_B_PICTURE_REFERENCES = 1 << 4, + // Codec supports non-IDR key pictures (that is, key pictures do + // not necessarily empty the DPB). + FLAG_NON_IDR_KEY_PICTURES = 1 << 5, +}; + +typedef struct HWBaseEncodeContext { + const AVClass *class; +} HWBaseEncodeContext; + +#endif /* AVCODEC_HW_BASE_ENCODE_H */ + diff --git a/libavcodec/vaapi_encode.h b/libavcodec/vaapi_encode.h index 0eed9691ca..f5c9be8973 100644 --- a/libavcodec/vaapi_encode.h +++ b/libavcodec/vaapi_encode.h @@ -33,34 +33,27 @@ #include "avcodec.h" #include "hwconfig.h" +#include "hw_base_encode.h" struct VAAPIEncodeType; struct VAAPIEncodePicture; +// Codec output packet without timestamp delay, which means the +// output packet has same PTS and DTS. +#define FLAG_TIMESTAMP_NO_DELAY 1 << 6 + enum { MAX_CONFIG_ATTRIBUTES = 4, MAX_GLOBAL_PARAMS = 4, - MAX_DPB_SIZE = 16, - MAX_PICTURE_REFERENCES = 2, - MAX_REORDER_DELAY = 16, MAX_PARAM_BUFFER_SIZE = 1024, // A.4.1: table A.6 allows at most 22 tile rows for any level. MAX_TILE_ROWS = 22, // A.4.1: table A.6 allows at most 20 tile columns for any level. MAX_TILE_COLS = 20, - MAX_ASYNC_DEPTH = 64, - MAX_REFERENCE_LIST_NUM = 2, }; extern const AVCodecHWConfigInternal *const ff_vaapi_encode_hw_configs[]; -enum { - PICTURE_TYPE_IDR = 0, - PICTURE_TYPE_I = 1, - PICTURE_TYPE_P = 2, - PICTURE_TYPE_B = 3, -}; - typedef struct VAAPIEncodeSlice { int index; int row_start; @@ -193,7 +186,8 @@ typedef struct VAAPIEncodeRCMode { } VAAPIEncodeRCMode; typedef struct VAAPIEncodeContext { - const AVClass *class; + // Base context. + HWBaseEncodeContext base; // Codec-specific hooks. const struct VAAPIEncodeType *codec; @@ -397,25 +391,6 @@ typedef struct VAAPIEncodeContext { AVPacket *tail_pkt; } VAAPIEncodeContext; -enum { - // Codec supports controlling the subdivision of pictures into slices. - FLAG_SLICE_CONTROL = 1 << 0, - // Codec only supports constant quality (no rate control). - FLAG_CONSTANT_QUALITY_ONLY = 1 << 1, - // Codec is intra-only. - FLAG_INTRA_ONLY = 1 << 2, - // Codec supports B-pictures. - FLAG_B_PICTURES = 1 << 3, - // Codec supports referencing B-pictures. - FLAG_B_PICTURE_REFERENCES = 1 << 4, - // Codec supports non-IDR key pictures (that is, key pictures do - // not necessarily empty the DPB). - FLAG_NON_IDR_KEY_PICTURES = 1 << 5, - // Codec output packet without timestamp delay, which means the - // output packet has same PTS and DTS. - FLAG_TIMESTAMP_NO_DELAY = 1 << 6, -}; - typedef struct VAAPIEncodeType { // List of supported profiles and corresponding VAAPI profiles. // (Must end with AV_PROFILE_UNKNOWN.)