From patchwork Fri Jan 19 13:38:17 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Wu Jianhua X-Patchwork-Id: 45663 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:968f:b0:199:de12:6fa6 with SMTP id hp15csp942937pzc; Fri, 19 Jan 2024 05:40:00 -0800 (PST) X-Google-Smtp-Source: AGHT+IGyZ3nnGj01lk0tfUJyxWk9gBBBK9i819e/j3VyJ5qTYId0kp1i4/eAhXzLC/KRmbNGjMAt X-Received: by 2002:aa7:d748:0:b0:559:ce36:5b19 with SMTP id a8-20020aa7d748000000b00559ce365b19mr1488227eds.79.1705671600209; Fri, 19 Jan 2024 05:40:00 -0800 (PST) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id d1-20020a50f681000000b0055a70f6e504si255267edn.120.2024.01.19.05.39.59; Fri, 19 Jan 2024 05:40:00 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@outlook.com header.s=selector1 header.b=KbKbJaRn; arc=fail (body hash mismatch); spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=outlook.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id CCC7E68D0AD; Fri, 19 Jan 2024 15:39:30 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from JPN01-OS0-obe.outbound.protection.outlook.com (mail-os0jpn01olkn2102.outbound.protection.outlook.com [40.92.98.102]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id F03BF68CB22 for ; Fri, 19 Jan 2024 15:39:27 +0200 (EET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LxjrOGDLk23fyQTbNsfP2VG8mGH0ms/hCPpY66/ybjKSfwKVrS6h7cHypP+brbnKEXmRdxhBc0kmU+6re+/nXgWs0WYubnMfA4ejWVyR2rrR7UGILmfaFb83sJ61Pb93hhPxoNN/8WVc2619CFSMY28zA1ncW8X00rVdves+bV3SPlqSf35Npm17G7xHUTPUtYx8mO4iSDrR5WKBwPK4wrxQpu8MbYIWaLh/MpjXVEMCIvBCzm2PpbAHfToCZq9h9goNabzQ2/tkUIcLajxlG9XF9nkLusj9pG5o8eDwSuAQc3QFD9IVZ6iSpvUFU9Zpi2yRBLtIQO26mRXrZ7rAtw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=KcIMgBFyu8ErRgoqm8Wlx2gTR2EPZpHErXlpYlPSIGE=; b=Fd+jrRLn+ZszYlV3hIumX9UkvrjVl1m923tyPb2sQNwD/u2eo8wB1KmPSOFiMrZTzgsBuSsZu1ylrY+RJYHadRUz6DiEy/u97OeH/zIoc8EBl8bjqxuCCokzhpbsKgY5rdXO+c/h665mVMcGWnhhErHV/QFmqaIwgxEgAbgfEGIqt0hLQZ+EJGDNVOZklol+qsmj7B0OdCkAiDwp4JJgjjRMCGuA/ARkHBkI5yZW1RYUimPd4yRA7oIKHQcI9rHycH9n+qH3Iw9a+NtKYInfZfHnuyj5Lqv8zBxYQui4fTB77GVnJ9gX2k5vOlfbymm0FM39jAtYtXy8sB+VQ1GNlQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KcIMgBFyu8ErRgoqm8Wlx2gTR2EPZpHErXlpYlPSIGE=; b=KbKbJaRnM9qHdvisR6ACMdXMU0uxsMZUWRRVPygsVps0HkVx3099BT/C6kkoujCzzDR6G42PUtKnUPmByA9EsUXUc1Udpfh/ZnVF8ObnfiXsYvbhKrvG/uvvs7+Lk/K/sjAdW5zJ0FwJt6CTnEXKWFgrZcgeqKxLbM12K55e59QOWYX6P5xqGrcawXsoSMG74sD8mfifB4GKREMIRbf/5IwOnoXMrLCbbePbVbVvXIatAXOcJsJTVTaUCSsJCjoDBMy5GGMQF1cJbF30JNuLx1xV2cWLV8GImpe4W2E1QeePS3Iu8r3PsoDuDCXVNU2Z1zWUdyFKyNUjEkET8oLvDw== Received: from OSZP286MB2173.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:186::5) by OS3P286MB2523.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:1ef::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7202.24; Fri, 19 Jan 2024 13:39:23 +0000 Received: from OSZP286MB2173.JPNP286.PROD.OUTLOOK.COM ([fe80::1bbf:406b:216:f56e]) by OSZP286MB2173.JPNP286.PROD.OUTLOOK.COM ([fe80::1bbf:406b:216:f56e%7]) with mapi id 15.20.7202.024; Fri, 19 Jan 2024 13:39:23 +0000 From: toqsxw@outlook.com To: ffmpeg-devel@ffmpeg.org Date: Fri, 19 Jan 2024 21:38:17 +0800 Message-ID: X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240119133820.1048730-1-toqsxw@outlook.com> References: <20240119133820.1048730-1-toqsxw@outlook.com> X-TMN: [rMePoxxBT/xYpz9OKrvHeV03J7r/ELGx] X-ClientProxiedBy: SG2PR02CA0137.apcprd02.prod.outlook.com (2603:1096:4:188::17) To OSZP286MB2173.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:186::5) X-Microsoft-Original-Message-ID: <20240119133820.1048730-5-toqsxw@outlook.com> MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: OSZP286MB2173:EE_|OS3P286MB2523:EE_ X-MS-Office365-Filtering-Correlation-Id: ab1702bc-faa6-4c26-c160-08dc18f40b86 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: TXMlbiRbohwlx+vpIhKnYKsfSUKZzd6aRB0U5YqvLcVmHOP2cJYUjta6zAAEDh+VwqkP2C7taoG6R03NRjZgj4IT0qZZMJY01/dRkJRFhzTg34t5XyZepXIsJEv6yV7STzi9JDx1VHhe6lDQU2OVHpATnvl2bqTDJPGp3+T92cDA1md5nxnebo0g+Uao5joI7kIyriRmGqgfP3EDVVBQr8NuCjGbXW85ZCowwdfIjUfa+GbFG8zgDXG/uiSD3RgWpWXB4BhaWnfdH4Qp9+1DSqrUSuWJhbX8LXi4luHBW+8dQfRFrgMtfv3ukShTwqH9aUgPNvLf73RRQOVRMuSvpAb6wfko7powhTVAprTxhaprb4WhA7fgToil/j3p3zlV2YrJDIh0raXfZ/jMRUXwjNHbp5psSMm8XhbdoELUC/JtcOQW8+NwspZUSvaxEOvlNfd5Tow4GjhHvdSB1cfrtJCeODsWiHqJk/4QXBCWVjp5zq2h0EWkAhPHa641vKLVwjTrCJcf5zYNiekpSl73P73avPYpVjaRo0hkqpjWXQ1IvQ9PqrMN/DlbYKC9TEkcdteT/i3cD8R9Ot75NV0O6TpouM4ISijQCRCMB1xDmuv2Uv9fEKtlGneTByDKr/Lr X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: kP8uzko1ah/0moBymW0Ow3IHvxbF/MbeCUsQClSydteGIToucwKpxlWZTCAUnVRuLqIYC9lwT72oM3Yg2yMPnm06gjYUXtzABpKD+/CkfVNbjFeHovlSvtqMoo8bWnlwQzmTzScfKYFAEe1gp5WqhX5yPNod3RxiJZfBFPH9t3mARbm7qu0osjR0I/0LlfuKMmQAIoxWD+eWNNTZPyjxL69Y5GuRGa+eQ/C1AldIJOqVDpo8C4dJFqEgB/5R7e8DomroMcwMwuDl5d9w1wFSFNteaHidwAy/kVSvcVpHvlV68980LXiVXViEPQpePZFATNXFkpTOsD8fzcagurAoKzgyyFQXwtFtCdD+DKoqDmdPR8QW4uc8JeKSYBG6MjppQGS5gmIIXAA5y42GWWq9FXPQAZJWJtrbsbN9POO4AKgSb3VKeGQ2mmAnWcqG3oleZHwrl0czvjjCJYdIOn8qVFracAsA7lNeDUPQgJT5Y8Pxc30dDb3FpavRGPnQ2h5hGLqlWrOD8na7tP9gRfDuMvow6PcUV4o/KMqzPxIUsa1cl2PXYnfvnToFc8nOcY8+RvzCgVgXidm5A7MroQlH1HnNwOokFSjMjEho6rFsVq0mdJ2FL2NA7Z6ut2Z/L6eeOsclbdm/DrfR3osRv0DuJUO17AfcB9vV2zwQc4CcWnG8xW0rYx1lrOB/4g538HPlB8bNCXn7jku9VLcOPpZvWzY0USBeaB+v7XnfLh+3qmjt7DazsjfdJcB48MCgQK2EDj/j9B9eiCjWyY+sSMf9xVzCBI3w2ZnA74DQBe9kL34fkPS+tvz5BxQgXwuQgf8N9YHA6nYuD+60l2QXCAmbib3vtzNw+Q4rkBv4hm46LUrihMevoGDNG95rVJZQv4bXBCMhXCJf2Tj98hZ3qzosSinKKW0WAe1f1G00DFd4yfkXYkEtoIC00MwxW+VcWsQe1lEjyYzs+t/J+Kudnr6d0i3EqPNXEK/Gh6w6vo+hSrcsTD5MR/a5sfe2WynWRTl4DdkgKaqJn+ZjvGCnMfKHodx0jDlMGniXCsVNJA7ClVG1xQntSYXObMXLS+MDU1+CmZWBRiddLJu5oN3O8KYgfryZ4nEIZH7ML7R15vQPIePBTew6Yua2+j0plLem3k6oClHPpurH5ajM7vcZrH6CUUcSPl6ootYvj03K3DkU/ti/AaVI49a+uJ8poU79w+QADt0JdPgRIA0L32HFo6tVHnlR9b3ehdo/7r6UVvfdHhY= X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: ab1702bc-faa6-4c26-c160-08dc18f40b86 X-MS-Exchange-CrossTenant-AuthSource: OSZP286MB2173.JPNP286.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Jan 2024 13:39:23.0759 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: OS3P286MB2523 Subject: [FFmpeg-devel] [PATCH v2 5/8] avcodec/vvcdec: reuse h26x/2656_inter.asm to enable x86 optimizations X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Wu Jianhua Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: hnEyLM8sqwCt From: Wu Jianhua Signed-off-by: Wu Jianhua --- libavcodec/Makefile | 1 + libavcodec/vvc/vvcdsp.c | 4 + libavcodec/vvc/vvcdsp.h | 2 + libavcodec/x86/vvc/Makefile | 6 + libavcodec/x86/vvc/vvcdsp_init.c | 202 +++++++++++++++++++++++++++++++ 5 files changed, 215 insertions(+) create mode 100644 libavcodec/x86/vvc/Makefile create mode 100644 libavcodec/x86/vvc/vvcdsp_init.c diff --git a/libavcodec/Makefile b/libavcodec/Makefile index bb42095165..ce33631b60 100644 --- a/libavcodec/Makefile +++ b/libavcodec/Makefile @@ -65,6 +65,7 @@ OBJS = ac3_parser.o \ # subsystems include $(SRC_PATH)/libavcodec/vvc/Makefile +include $(SRC_PATH)/libavcodec/x86/vvc/Makefile OBJS-$(CONFIG_AANDCTTABLES) += aandcttab.o OBJS-$(CONFIG_AC3DSP) += ac3dsp.o ac3.o ac3tab.o OBJS-$(CONFIG_ADTS_HEADER) += adts_header.o mpeg4audio_sample_rates.o diff --git a/libavcodec/vvc/vvcdsp.c b/libavcodec/vvc/vvcdsp.c index c82ea7be30..c542be5258 100644 --- a/libavcodec/vvc/vvcdsp.c +++ b/libavcodec/vvc/vvcdsp.c @@ -138,4 +138,8 @@ void ff_vvc_dsp_init(VVCDSPContext *vvcdsp, int bit_depth) VVC_DSP(8); break; } + +#if ARCH_X86 + ff_vvc_dsp_init_x86(vvcdsp, bit_depth); +#endif } diff --git a/libavcodec/vvc/vvcdsp.h b/libavcodec/vvc/vvcdsp.h index b5a63c5833..6f59e73654 100644 --- a/libavcodec/vvc/vvcdsp.h +++ b/libavcodec/vvc/vvcdsp.h @@ -167,4 +167,6 @@ typedef struct VVCDSPContext { void ff_vvc_dsp_init(VVCDSPContext *hpc, int bit_depth); +void ff_vvc_dsp_init_x86(VVCDSPContext *hpc, const int bit_depth); + #endif /* AVCODEC_VVC_VVCDSP_H */ diff --git a/libavcodec/x86/vvc/Makefile b/libavcodec/x86/vvc/Makefile new file mode 100644 index 0000000000..b4acc22501 --- /dev/null +++ b/libavcodec/x86/vvc/Makefile @@ -0,0 +1,6 @@ +clean:: + $(RM) $(CLEANSUFFIXES:%=libavcodec/x86/vvc/%) + +OBJS-$(CONFIG_VVC_DECODER) += x86/vvc/vvcdsp_init.o +X86ASM-OBJS-$(CONFIG_VVC_DECODER) += x86/h26x/h2656dsp.o \ + x86/h26x/h2656_inter.o diff --git a/libavcodec/x86/vvc/vvcdsp_init.c b/libavcodec/x86/vvc/vvcdsp_init.c new file mode 100644 index 0000000000..c197cdb4cc --- /dev/null +++ b/libavcodec/x86/vvc/vvcdsp_init.c @@ -0,0 +1,202 @@ +/* + * VVC DSP init for x86 + * + * Copyright (C) 2022-2024 Nuo Mi + * Copyright (c) 2023-2024 Wu Jianhua + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "config.h" + +#include "libavutil/cpu.h" +#include "libavutil/x86/asm.h" +#include "libavutil/x86/cpu.h" +#include "libavcodec/vvc/vvcdec.h" +#include "libavcodec/vvc/vvc_ctu.h" +#include "libavcodec/vvc/vvcdsp.h" +#include "libavcodec/x86/h26x/h2656dsp.h" + +#define FW_PUT(name, depth, opt) \ +static void ff_vvc_put_ ## name ## _ ## depth ## _##opt(int16_t *dst, const uint8_t *src, ptrdiff_t srcstride, \ + int height, const int8_t *hf, const int8_t *vf, int width) \ +{ \ + ff_h2656_put_## name ## _ ## depth ## _##opt(dst, 2 * MAX_PB_SIZE, src, srcstride, height, hf, vf, width); \ +} + +#define FW_PUT_TAP(fname, bitd, opt ) \ + FW_PUT(fname##4, bitd, opt ); \ + FW_PUT(fname##8, bitd, opt ); \ + FW_PUT(fname##16, bitd, opt ); \ + FW_PUT(fname##32, bitd, opt ); \ + FW_PUT(fname##64, bitd, opt ); \ + FW_PUT(fname##128, bitd, opt ); \ + +#define FW_PUT_4TAP(fname, bitd, opt) \ + FW_PUT(fname ## 2, bitd, opt) \ + FW_PUT_TAP(fname, bitd, opt) + +#define FW_PUT_4TAP_SSE4(bitd) \ + FW_PUT_4TAP(pixels, bitd, sse4) \ + FW_PUT_4TAP(4tap_h, bitd, sse4) \ + FW_PUT_4TAP(4tap_v, bitd, sse4) \ + FW_PUT_4TAP(4tap_hv, bitd, sse4) + +#define FW_PUT_8TAP_SSE4(bitd) \ + FW_PUT_TAP(8tap_h, bitd, sse4) \ + FW_PUT_TAP(8tap_v, bitd, sse4) \ + FW_PUT_TAP(8tap_hv, bitd, sse4) + +#define FW_PUT_SSE4(bitd) \ + FW_PUT_4TAP_SSE4(bitd) \ + FW_PUT_8TAP_SSE4(bitd) + +FW_PUT_SSE4( 8); +FW_PUT_SSE4(10); +FW_PUT_SSE4(12); + +#define FW_PUT_TAP_AVX2(n, bitd) \ + FW_PUT(n ## tap_h32, bitd, avx2) \ + FW_PUT(n ## tap_h64, bitd, avx2) \ + FW_PUT(n ## tap_h128, bitd, avx2) \ + FW_PUT(n ## tap_v32, bitd, avx2) \ + FW_PUT(n ## tap_v64, bitd, avx2) \ + FW_PUT(n ## tap_v128, bitd, avx2) + +#define FW_PUT_AVX2(bitd) \ + FW_PUT(pixels32, bitd, avx2) \ + FW_PUT(pixels64, bitd, avx2) \ + FW_PUT(pixels128, bitd, avx2) \ + FW_PUT_TAP_AVX2(4, bitd) \ + FW_PUT_TAP_AVX2(8, bitd) \ + +FW_PUT_AVX2( 8) +FW_PUT_AVX2(10) +FW_PUT_AVX2(12) + +#define FW_PUT_TAP_16BPC_AVX2(n, bitd) \ + FW_PUT(n ## tap_h16, bitd, avx2) \ + FW_PUT(n ## tap_v16, bitd, avx2) \ + FW_PUT(n ## tap_hv16, bitd, avx2) \ + FW_PUT(n ## tap_hv32, bitd, avx2) \ + FW_PUT(n ## tap_hv64, bitd, avx2) \ + FW_PUT(n ## tap_hv128, bitd, avx2) + +#define FW_PUT_16BPC_AVX2(bitd) \ + FW_PUT(pixels16, bitd, avx2) \ + FW_PUT_TAP_16BPC_AVX2(4, bitd) \ + FW_PUT_TAP_16BPC_AVX2(8, bitd); + +FW_PUT_16BPC_AVX2(10); +FW_PUT_16BPC_AVX2(12); + +#define PEL_LINK(dst, C, W, idx1, idx2, name, D, opt) \ + dst[C][W][idx1][idx2] = ff_vvc_put_## name ## _ ## D ## _##opt; \ + dst ## _uni[C][W][idx1][idx2] = ff_h2656_put_uni_ ## name ## _ ## D ## _##opt; \ + +#define MC_TAP_LINKS(pointer, C, my, mx, fname, bitd, opt ) \ + PEL_LINK(pointer, C, 1, my , mx , fname##4 , bitd, opt ); \ + PEL_LINK(pointer, C, 2, my , mx , fname##8 , bitd, opt ); \ + PEL_LINK(pointer, C, 3, my , mx , fname##16, bitd, opt ); \ + PEL_LINK(pointer, C, 4, my , mx , fname##32, bitd, opt ); \ + PEL_LINK(pointer, C, 5, my , mx , fname##64, bitd, opt ); \ + PEL_LINK(pointer, C, 6, my , mx , fname##128, bitd, opt ); + +#define MC_8TAP_LINKS(pointer, my, mx, fname, bitd, opt) \ + MC_TAP_LINKS(pointer, LUMA, my, mx, fname, bitd, opt) + +#define MC_8TAP_LINKS_SSE4(bd) \ + MC_8TAP_LINKS(c->inter.put, 0, 0, pixels, bd, sse4); \ + MC_8TAP_LINKS(c->inter.put, 0, 1, 8tap_h, bd, sse4); \ + MC_8TAP_LINKS(c->inter.put, 1, 0, 8tap_v, bd, sse4); \ + MC_8TAP_LINKS(c->inter.put, 1, 1, 8tap_hv, bd, sse4) + +#define MC_4TAP_LINKS(pointer, my, mx, fname, bitd, opt) \ + PEL_LINK(pointer, CHROMA, 0, my , mx , fname##2 , bitd, opt ); \ + MC_TAP_LINKS(pointer, CHROMA, my, mx, fname, bitd, opt) \ + +#define MC_4TAP_LINKS_SSE4(bd) \ + MC_4TAP_LINKS(c->inter.put, 0, 0, pixels, bd, sse4); \ + MC_4TAP_LINKS(c->inter.put, 0, 1, 4tap_h, bd, sse4); \ + MC_4TAP_LINKS(c->inter.put, 1, 0, 4tap_v, bd, sse4); \ + MC_4TAP_LINKS(c->inter.put, 1, 1, 4tap_hv, bd, sse4) + +#define MC_LINK_SSE4(bd) \ + MC_4TAP_LINKS_SSE4(bd) \ + MC_8TAP_LINKS_SSE4(bd) + +#define MC_TAP_LINKS_AVX2(C,tap,bd) do { \ + PEL_LINK(c->inter.put, C, 4, 0, 0, pixels32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 0, 0, pixels64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 0, 0, pixels128, bd, avx2) \ + PEL_LINK(c->inter.put, C, 4, 0, 1, tap##tap_h32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 0, 1, tap##tap_h64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 0, 1, tap##tap_h128, bd, avx2) \ + PEL_LINK(c->inter.put, C, 4, 1, 0, tap##tap_v32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 1, 0, tap##tap_v64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 1, 0, tap##tap_v128, bd, avx2) \ + } while (0) + +#define MC_LINKS_AVX2(bd) \ + MC_TAP_LINKS_AVX2(LUMA, 8, bd); \ + MC_TAP_LINKS_AVX2(CHROMA, 4, bd); + +#define MC_TAP_LINKS_16BPC_AVX2(C, tap, bd) do { \ + PEL_LINK(c->inter.put, C, 3, 0, 0, pixels16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 3, 0, 1, tap##tap_h16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 3, 1, 0, tap##tap_v16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 3, 1, 1, tap##tap_hv16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 4, 1, 1, tap##tap_hv32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 1, 1, tap##tap_hv64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 1, 1, tap##tap_hv128, bd, avx2) \ + } while (0) + +#define MC_LINKS_16BPC_AVX2(bd) \ + MC_TAP_LINKS_16BPC_AVX2(LUMA, 8, bd); \ + MC_TAP_LINKS_16BPC_AVX2(CHROMA, 4, bd); + +void ff_vvc_dsp_init_x86(VVCDSPContext *const c, const int bd) +{ + const int cpu_flags = av_get_cpu_flags(); + + if (ARCH_X86_64) { + if (bd == 8) { + if (EXTERNAL_SSE4(cpu_flags)) { + MC_LINK_SSE4(8); + } + if (EXTERNAL_AVX2_FAST(cpu_flags)) { + MC_LINKS_AVX2(8); + } + } else if (bd == 10) { + if (EXTERNAL_SSE4(cpu_flags)) { + MC_LINK_SSE4(10); + } + if (EXTERNAL_AVX2_FAST(cpu_flags)) { + MC_LINKS_AVX2(10); + MC_LINKS_16BPC_AVX2(10); + } + } else if (bd == 12) { + if (EXTERNAL_SSE4(cpu_flags)) { + MC_LINK_SSE4(12); + } + if (EXTERNAL_AVX2_FAST(cpu_flags)) { + MC_LINKS_AVX2(12); + MC_LINKS_16BPC_AVX2(12); + } + } + } +}