From patchwork Tue Jan 23 18:17:08 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Wu Jianhua X-Patchwork-Id: 45750 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:120f:b0:199:de12:6fa6 with SMTP id v15csp801758pzf; Tue, 23 Jan 2024 10:18:17 -0800 (PST) X-Google-Smtp-Source: AGHT+IHAtjTGgztwIQcFwTVwdkKIXrxz+HGhoO0XI6LsEydB1gVaO3hngwY6ONIPmCQXnyrXwDpa X-Received: by 2002:a05:6402:40d6:b0:55c:826b:70c3 with SMTP id z22-20020a05640240d600b0055c826b70c3mr705938edb.39.1706033897537; Tue, 23 Jan 2024 10:18:17 -0800 (PST) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id ee4-20020a056402290400b0055c47bd0dabsi2066938edb.146.2024.01.23.10.18.15; Tue, 23 Jan 2024 10:18:17 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@outlook.com header.s=selector1 header.b=s5DtMcfv; arc=fail (body hash mismatch); spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=outlook.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 28D2968D0C8; Tue, 23 Jan 2024 20:17:47 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from JPN01-TYC-obe.outbound.protection.outlook.com (mail-tycjpn01olkn2040.outbound.protection.outlook.com [40.92.99.40]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 5459E68D0CE for ; Tue, 23 Jan 2024 20:17:39 +0200 (EET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Xgyho3IKLcHC1XPATtW+6T39l7r/rJ+vWOsZ4iPruxh8VC76LzvJZskLo3tOilE1UwDr9nlbnGj+WhjpZ8IlRw3GVvShjWXurb2YIDJm68f8jE/bWI/1fGXE706TZ5qw2fG1NlR2B46eiyYVW0zsFbuG0KVSrVeOSihqv2QUTtWmFjXgbrbsPY6Yy9LLZGbV2ICqd0FStX2UzfCf6lxoOMmCvFcSn5XGy592zByiY+IR2r64ZhUcB9GQDUekt8zDlNxS2I55KQy1C5agpjVUKqolLp4dF09PCU4JqXJ+glYiJrtVlzYs62dIo+yDlJnZ5+/1dOHe5AJxNaSgyvALaA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=KcIMgBFyu8ErRgoqm8Wlx2gTR2EPZpHErXlpYlPSIGE=; b=Hnp51NCKgmU091WxvrKOlNQW2CBEoPUXcxoNmHZZ8PLxHGyifnhCSExqDZjABldh0t7+5i4PyOXKc8ylq91D9WZUD6oxU+B2wclk4ihgcuRDreanxtYaz9/i91km66b9MT0VLsnD9/BJA/NmIhJ/UWgGjMT40/6uHgNQnc+OFAxlMSNX6gVu7aDgn4gnsaRujqPyTO8MtxODA2vct7D4Gx+7NhgBhFWCalMItiDlm+OCLjAauwuXT+Kp1yMh5ggLflq2z3RtvTY+nVOLisYTr+uCsVnLtboket8RerlNOZYXwLkqkw71Wfja/HmFS1883G7xB+CMT5V4vdKmgAbutw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KcIMgBFyu8ErRgoqm8Wlx2gTR2EPZpHErXlpYlPSIGE=; b=s5DtMcfvDF2upwO1s0819zEifZzpHC3WpXhZB9iygeFqVlQ8wwuF4zBsZytxrvohgjOIRKgcHQ0Om2Y5LQU+uKp7Ov6F4+s93HeipIoM5YZrc07Pl4/bVUeJuvAIi36N7Y5H8DxCsp1B+TkRT6f4bsHPRI6kfQkEOjrGc13nxPMMNDPp33uO8tH9SziJ5qnrq0iMfEbWK8BdM2UUyyhYmDAgjosvvlfn6X2TUD2dHrVXP2pvYdeza8LwV2NX4MiB/5v9Nm0uOLh64vAgfylWu9l0OtkKvJFRAxeHOdy3KYtX4FFZ6PNsvs9tXfMWxhMlt6ZRrFu0bdZguIxhVQCQbw== Received: from TYWP286MB2172.JPNP286.PROD.OUTLOOK.COM (2603:1096:400:173::5) by TYWP286MB3822.JPNP286.PROD.OUTLOOK.COM (2603:1096:400:447::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7202.36; Tue, 23 Jan 2024 18:17:24 +0000 Received: from TYWP286MB2172.JPNP286.PROD.OUTLOOK.COM ([fe80::2fb1:781b:3f26:a080]) by TYWP286MB2172.JPNP286.PROD.OUTLOOK.COM ([fe80::2fb1:781b:3f26:a080%3]) with mapi id 15.20.7228.022; Tue, 23 Jan 2024 18:17:24 +0000 From: toqsxw@outlook.com To: ffmpeg-devel@ffmpeg.org Date: Wed, 24 Jan 2024 02:17:08 +0800 Message-ID: X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240123181711.402946-1-toqsxw@outlook.com> References: <20240123181711.402946-1-toqsxw@outlook.com> X-TMN: [N23HyXE+nsi3/tzjeczROnvr9lrxJqhY] X-ClientProxiedBy: SI2P153CA0030.APCP153.PROD.OUTLOOK.COM (2603:1096:4:190::15) To TYWP286MB2172.JPNP286.PROD.OUTLOOK.COM (2603:1096:400:173::5) X-Microsoft-Original-Message-ID: <20240123181711.402946-5-toqsxw@outlook.com> MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: TYWP286MB2172:EE_|TYWP286MB3822:EE_ X-MS-Office365-Filtering-Correlation-Id: 6748e59b-974e-447b-1e8b-08dc1c3f8c4a X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: WjPJXw8L/1Ul/cB8L73hml0ZUWB9nT2VfbCw/gzaEOBRTD28l/km/t6da0NVj0oPSTI140YJ7A9YXzEh8uMsnot5U5ehkXFY5kP/qx9m+mIE6SROhasObsydSVSmAOhAZtxKihQbgIHb+3/ReEovS1ci5KZ3AqohRHJB5hgABNZStsJXmCNetFhl0i2ihAIJE4c1/BqNIIQR9Td93DIEFlA28tRxWIqnKno/dzFZ7wb8uuJ3UcyQZ7AtdlQ2vcYXfnel0hucJOZwNfTTZ4sbqzk4v5RCBI2LQ8GK4DGP5fjBEC6/AX+9cy1tp1YoYyoFQMnQAxC5m/HUohpzvuGxnOfBtDLCdMRlFn0xATr592a+m/xDSnV7HVmircsmQO3uFRkoy9oUZp5HpSlSHtErjZZcdumLOhxiJzwYYtMi+ksIcNoiru8hkr3Bwa0GHXHjSppD1S7zxA+3B9CoxevDx0VVrMJGbhPs0Om7QAUbc9r1NDHp8MmCYr574UN8q/tUzubiZXVJ4+EIWywsAAyPTev8mhwmfqR+gZ+N7otYuCMatxLu0Rhfl3v18ZMSZQYIwEitapT8X4joudDJ0c0GP4eRTNqN15q2/V25J9AqTgIbgo7TFIjoFw5dHOx3kMIj X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: E0KLO7oe0XI5uWgeRWjQAxfcHH7hsscKQ9AjDCPcNZvJXFHuJGpxvDoRZHaLrKTuFmKYnF41vdLbRzh1EY8rh0vyL1tkgArsbiBV4Ka1I5amVoCBvznO8CplKd2bA1ZNH9JXG9kxF3D5vkNPvlWx8ilrNu73GXVTvzSvwLUDaYLlWOvFKBPerJqfAxbqQ6dwPHAB6LSA56fcNUSY0XSj5Tg3oCDMwpMzfcu7G+XSwrGA50Jz3oB7wQNN9zWUAMCbR/4L7FteYfoUAbOPcI9zcJ9GMR/aj/XxlVN7BYO6iXl29+lJuCfE/Um1UbnO2XJk8HdnI2uXJVCTvmB3DxNskNztb9XO5wNFLeegneAgicrodn9OxN9+ZbsALii+xbnFD1/zhZtsQJerNsFDCej2TtUOsiEj/bMVuYg7RQBVY5f7g77e2vTmw64n6P9q56tg8MgOTj+JFkdHnwJeb+6QPp4IVVGSinUTR7UqG8atYXUS+Pa4u5UWiDsgtkH2y8OCiAUmr90q1BOn5VGppL6OqYkDtabP6IBD7LBv2JQDfurTVViNw+WDrLSHDR6zhhRLZ34ifvI4Zjgvr6Chmk1tG0ImfZk9hUKYQd/wqVHFxzna6KMo8JAYDsYVFdGHgDCIgb/FMGtbKaqFHeGK0DEsVLKuzU8Du2rGgAIpD1zne6SGVlSBrm0wRkLflFkvPQdZHoEGcPvWf4YmkcRJExWFhTkoQGj3CPMiAdSN/BPfsdSQea/ej4gpw+aqAUBXBp7Fby7g3iFVXhT7/9MYZJ0ztzt2Dm/bW4mRV3esQWoSlHA3z4E+88rxR61o9FIVeiqhYsemNSWUijXBP0nv0MNtLY09x2REO+pWfaKcXZCqKloZiYREK1VBsSpNMrF4k59YHzxVSQ9Dpz48bjdFzaV4g89oxxFOVB3Yes50Z7Gc+AWYchHHriO6RbsKfBAuHiLE8x6EiRbedEBKrhQWqJ9yVIX5llwisiSslGJ9m+8UXe1TZl+7SlDp5aQtZSwYreFSJXb3nnEaExcpxak0VV+5BdhhXj8ZwvTgntFHtyw8D6KRzB1LzGiBcxYpjyEtpTajpy09jhvMuA9zVaYDa+RgMfXL67ICBdsQhHY7r7CsxXmICBHyv9RKOmfYsN1AgSbJz7C9GGWWRVCE79opuag/94IWJpdrqsfkhUwpjG8DAQcyNxyNGUETGecjlnZ1rCYJL/pEW80AIjLgIGSOmMbT/0BAUoA/8vDSI7/ogi/+Rig= X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 6748e59b-974e-447b-1e8b-08dc1c3f8c4a X-MS-Exchange-CrossTenant-AuthSource: TYWP286MB2172.JPNP286.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Jan 2024 18:17:24.3781 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYWP286MB3822 Subject: [FFmpeg-devel] [PATCH v4 5/8] avcodec/vvcdec: reuse h26x/2656_inter.asm to enable x86 optimizations X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Wu Jianhua Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: qEZ45hij/nt7 From: Wu Jianhua Signed-off-by: Wu Jianhua --- libavcodec/Makefile | 1 + libavcodec/vvc/vvcdsp.c | 4 + libavcodec/vvc/vvcdsp.h | 2 + libavcodec/x86/vvc/Makefile | 6 + libavcodec/x86/vvc/vvcdsp_init.c | 202 +++++++++++++++++++++++++++++++ 5 files changed, 215 insertions(+) create mode 100644 libavcodec/x86/vvc/Makefile create mode 100644 libavcodec/x86/vvc/vvcdsp_init.c diff --git a/libavcodec/Makefile b/libavcodec/Makefile index bb42095165..ce33631b60 100644 --- a/libavcodec/Makefile +++ b/libavcodec/Makefile @@ -65,6 +65,7 @@ OBJS = ac3_parser.o \ # subsystems include $(SRC_PATH)/libavcodec/vvc/Makefile +include $(SRC_PATH)/libavcodec/x86/vvc/Makefile OBJS-$(CONFIG_AANDCTTABLES) += aandcttab.o OBJS-$(CONFIG_AC3DSP) += ac3dsp.o ac3.o ac3tab.o OBJS-$(CONFIG_ADTS_HEADER) += adts_header.o mpeg4audio_sample_rates.o diff --git a/libavcodec/vvc/vvcdsp.c b/libavcodec/vvc/vvcdsp.c index c82ea7be30..c542be5258 100644 --- a/libavcodec/vvc/vvcdsp.c +++ b/libavcodec/vvc/vvcdsp.c @@ -138,4 +138,8 @@ void ff_vvc_dsp_init(VVCDSPContext *vvcdsp, int bit_depth) VVC_DSP(8); break; } + +#if ARCH_X86 + ff_vvc_dsp_init_x86(vvcdsp, bit_depth); +#endif } diff --git a/libavcodec/vvc/vvcdsp.h b/libavcodec/vvc/vvcdsp.h index b5a63c5833..6f59e73654 100644 --- a/libavcodec/vvc/vvcdsp.h +++ b/libavcodec/vvc/vvcdsp.h @@ -167,4 +167,6 @@ typedef struct VVCDSPContext { void ff_vvc_dsp_init(VVCDSPContext *hpc, int bit_depth); +void ff_vvc_dsp_init_x86(VVCDSPContext *hpc, const int bit_depth); + #endif /* AVCODEC_VVC_VVCDSP_H */ diff --git a/libavcodec/x86/vvc/Makefile b/libavcodec/x86/vvc/Makefile new file mode 100644 index 0000000000..b4acc22501 --- /dev/null +++ b/libavcodec/x86/vvc/Makefile @@ -0,0 +1,6 @@ +clean:: + $(RM) $(CLEANSUFFIXES:%=libavcodec/x86/vvc/%) + +OBJS-$(CONFIG_VVC_DECODER) += x86/vvc/vvcdsp_init.o +X86ASM-OBJS-$(CONFIG_VVC_DECODER) += x86/h26x/h2656dsp.o \ + x86/h26x/h2656_inter.o diff --git a/libavcodec/x86/vvc/vvcdsp_init.c b/libavcodec/x86/vvc/vvcdsp_init.c new file mode 100644 index 0000000000..c197cdb4cc --- /dev/null +++ b/libavcodec/x86/vvc/vvcdsp_init.c @@ -0,0 +1,202 @@ +/* + * VVC DSP init for x86 + * + * Copyright (C) 2022-2024 Nuo Mi + * Copyright (c) 2023-2024 Wu Jianhua + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "config.h" + +#include "libavutil/cpu.h" +#include "libavutil/x86/asm.h" +#include "libavutil/x86/cpu.h" +#include "libavcodec/vvc/vvcdec.h" +#include "libavcodec/vvc/vvc_ctu.h" +#include "libavcodec/vvc/vvcdsp.h" +#include "libavcodec/x86/h26x/h2656dsp.h" + +#define FW_PUT(name, depth, opt) \ +static void ff_vvc_put_ ## name ## _ ## depth ## _##opt(int16_t *dst, const uint8_t *src, ptrdiff_t srcstride, \ + int height, const int8_t *hf, const int8_t *vf, int width) \ +{ \ + ff_h2656_put_## name ## _ ## depth ## _##opt(dst, 2 * MAX_PB_SIZE, src, srcstride, height, hf, vf, width); \ +} + +#define FW_PUT_TAP(fname, bitd, opt ) \ + FW_PUT(fname##4, bitd, opt ); \ + FW_PUT(fname##8, bitd, opt ); \ + FW_PUT(fname##16, bitd, opt ); \ + FW_PUT(fname##32, bitd, opt ); \ + FW_PUT(fname##64, bitd, opt ); \ + FW_PUT(fname##128, bitd, opt ); \ + +#define FW_PUT_4TAP(fname, bitd, opt) \ + FW_PUT(fname ## 2, bitd, opt) \ + FW_PUT_TAP(fname, bitd, opt) + +#define FW_PUT_4TAP_SSE4(bitd) \ + FW_PUT_4TAP(pixels, bitd, sse4) \ + FW_PUT_4TAP(4tap_h, bitd, sse4) \ + FW_PUT_4TAP(4tap_v, bitd, sse4) \ + FW_PUT_4TAP(4tap_hv, bitd, sse4) + +#define FW_PUT_8TAP_SSE4(bitd) \ + FW_PUT_TAP(8tap_h, bitd, sse4) \ + FW_PUT_TAP(8tap_v, bitd, sse4) \ + FW_PUT_TAP(8tap_hv, bitd, sse4) + +#define FW_PUT_SSE4(bitd) \ + FW_PUT_4TAP_SSE4(bitd) \ + FW_PUT_8TAP_SSE4(bitd) + +FW_PUT_SSE4( 8); +FW_PUT_SSE4(10); +FW_PUT_SSE4(12); + +#define FW_PUT_TAP_AVX2(n, bitd) \ + FW_PUT(n ## tap_h32, bitd, avx2) \ + FW_PUT(n ## tap_h64, bitd, avx2) \ + FW_PUT(n ## tap_h128, bitd, avx2) \ + FW_PUT(n ## tap_v32, bitd, avx2) \ + FW_PUT(n ## tap_v64, bitd, avx2) \ + FW_PUT(n ## tap_v128, bitd, avx2) + +#define FW_PUT_AVX2(bitd) \ + FW_PUT(pixels32, bitd, avx2) \ + FW_PUT(pixels64, bitd, avx2) \ + FW_PUT(pixels128, bitd, avx2) \ + FW_PUT_TAP_AVX2(4, bitd) \ + FW_PUT_TAP_AVX2(8, bitd) \ + +FW_PUT_AVX2( 8) +FW_PUT_AVX2(10) +FW_PUT_AVX2(12) + +#define FW_PUT_TAP_16BPC_AVX2(n, bitd) \ + FW_PUT(n ## tap_h16, bitd, avx2) \ + FW_PUT(n ## tap_v16, bitd, avx2) \ + FW_PUT(n ## tap_hv16, bitd, avx2) \ + FW_PUT(n ## tap_hv32, bitd, avx2) \ + FW_PUT(n ## tap_hv64, bitd, avx2) \ + FW_PUT(n ## tap_hv128, bitd, avx2) + +#define FW_PUT_16BPC_AVX2(bitd) \ + FW_PUT(pixels16, bitd, avx2) \ + FW_PUT_TAP_16BPC_AVX2(4, bitd) \ + FW_PUT_TAP_16BPC_AVX2(8, bitd); + +FW_PUT_16BPC_AVX2(10); +FW_PUT_16BPC_AVX2(12); + +#define PEL_LINK(dst, C, W, idx1, idx2, name, D, opt) \ + dst[C][W][idx1][idx2] = ff_vvc_put_## name ## _ ## D ## _##opt; \ + dst ## _uni[C][W][idx1][idx2] = ff_h2656_put_uni_ ## name ## _ ## D ## _##opt; \ + +#define MC_TAP_LINKS(pointer, C, my, mx, fname, bitd, opt ) \ + PEL_LINK(pointer, C, 1, my , mx , fname##4 , bitd, opt ); \ + PEL_LINK(pointer, C, 2, my , mx , fname##8 , bitd, opt ); \ + PEL_LINK(pointer, C, 3, my , mx , fname##16, bitd, opt ); \ + PEL_LINK(pointer, C, 4, my , mx , fname##32, bitd, opt ); \ + PEL_LINK(pointer, C, 5, my , mx , fname##64, bitd, opt ); \ + PEL_LINK(pointer, C, 6, my , mx , fname##128, bitd, opt ); + +#define MC_8TAP_LINKS(pointer, my, mx, fname, bitd, opt) \ + MC_TAP_LINKS(pointer, LUMA, my, mx, fname, bitd, opt) + +#define MC_8TAP_LINKS_SSE4(bd) \ + MC_8TAP_LINKS(c->inter.put, 0, 0, pixels, bd, sse4); \ + MC_8TAP_LINKS(c->inter.put, 0, 1, 8tap_h, bd, sse4); \ + MC_8TAP_LINKS(c->inter.put, 1, 0, 8tap_v, bd, sse4); \ + MC_8TAP_LINKS(c->inter.put, 1, 1, 8tap_hv, bd, sse4) + +#define MC_4TAP_LINKS(pointer, my, mx, fname, bitd, opt) \ + PEL_LINK(pointer, CHROMA, 0, my , mx , fname##2 , bitd, opt ); \ + MC_TAP_LINKS(pointer, CHROMA, my, mx, fname, bitd, opt) \ + +#define MC_4TAP_LINKS_SSE4(bd) \ + MC_4TAP_LINKS(c->inter.put, 0, 0, pixels, bd, sse4); \ + MC_4TAP_LINKS(c->inter.put, 0, 1, 4tap_h, bd, sse4); \ + MC_4TAP_LINKS(c->inter.put, 1, 0, 4tap_v, bd, sse4); \ + MC_4TAP_LINKS(c->inter.put, 1, 1, 4tap_hv, bd, sse4) + +#define MC_LINK_SSE4(bd) \ + MC_4TAP_LINKS_SSE4(bd) \ + MC_8TAP_LINKS_SSE4(bd) + +#define MC_TAP_LINKS_AVX2(C,tap,bd) do { \ + PEL_LINK(c->inter.put, C, 4, 0, 0, pixels32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 0, 0, pixels64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 0, 0, pixels128, bd, avx2) \ + PEL_LINK(c->inter.put, C, 4, 0, 1, tap##tap_h32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 0, 1, tap##tap_h64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 0, 1, tap##tap_h128, bd, avx2) \ + PEL_LINK(c->inter.put, C, 4, 1, 0, tap##tap_v32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 1, 0, tap##tap_v64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 1, 0, tap##tap_v128, bd, avx2) \ + } while (0) + +#define MC_LINKS_AVX2(bd) \ + MC_TAP_LINKS_AVX2(LUMA, 8, bd); \ + MC_TAP_LINKS_AVX2(CHROMA, 4, bd); + +#define MC_TAP_LINKS_16BPC_AVX2(C, tap, bd) do { \ + PEL_LINK(c->inter.put, C, 3, 0, 0, pixels16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 3, 0, 1, tap##tap_h16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 3, 1, 0, tap##tap_v16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 3, 1, 1, tap##tap_hv16, bd, avx2) \ + PEL_LINK(c->inter.put, C, 4, 1, 1, tap##tap_hv32, bd, avx2) \ + PEL_LINK(c->inter.put, C, 5, 1, 1, tap##tap_hv64, bd, avx2) \ + PEL_LINK(c->inter.put, C, 6, 1, 1, tap##tap_hv128, bd, avx2) \ + } while (0) + +#define MC_LINKS_16BPC_AVX2(bd) \ + MC_TAP_LINKS_16BPC_AVX2(LUMA, 8, bd); \ + MC_TAP_LINKS_16BPC_AVX2(CHROMA, 4, bd); + +void ff_vvc_dsp_init_x86(VVCDSPContext *const c, const int bd) +{ + const int cpu_flags = av_get_cpu_flags(); + + if (ARCH_X86_64) { + if (bd == 8) { + if (EXTERNAL_SSE4(cpu_flags)) { + MC_LINK_SSE4(8); + } + if (EXTERNAL_AVX2_FAST(cpu_flags)) { + MC_LINKS_AVX2(8); + } + } else if (bd == 10) { + if (EXTERNAL_SSE4(cpu_flags)) { + MC_LINK_SSE4(10); + } + if (EXTERNAL_AVX2_FAST(cpu_flags)) { + MC_LINKS_AVX2(10); + MC_LINKS_16BPC_AVX2(10); + } + } else if (bd == 12) { + if (EXTERNAL_SSE4(cpu_flags)) { + MC_LINK_SSE4(12); + } + if (EXTERNAL_AVX2_FAST(cpu_flags)) { + MC_LINKS_AVX2(12); + MC_LINKS_16BPC_AVX2(12); + } + } + } +}