From patchwork Fri Apr 20 04:30:10 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Rostislav Pehlivanov X-Patchwork-Id: 8521 Delivered-To: ffmpegpatchwork@gmail.com Received: by 2002:a02:155:0:0:0:0:0 with SMTP id c82-v6csp228729jad; Thu, 19 Apr 2018 21:31:40 -0700 (PDT) X-Google-Smtp-Source: AIpwx4/KpnuKg2NfGPERL1A4ZXkAeF9izglObw/MNYHRvwyMGlu+BaP9auCmG5jgymygRL0bTMCM X-Received: by 2002:adf:ea8a:: with SMTP id s10-v6mr56487wrm.223.1524198700136; Thu, 19 Apr 2018 21:31:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1524198700; cv=none; d=google.com; s=arc-20160816; b=vR4gZfFr996NDoiM6RWrOuSV68Oj9dNVQDk8xKYkN4uD2XyiK0SLeNVL9qO1DNkQjt MSCRIeP4lPGaLbDRKdNF48iCTvB2WPu2eoxpusUCpKTz+BldggcLX4zaR9YPgWBAusci mEH/7nA4dR71AcMJzKLJ7IZl5XYaqjr3RwfeWqy1O5um+FgYqokn8rKuqNfAjqzUwA6k 9LapBIGLVkZh8LW4fZY8+rS/WSrkaYD3pOiRPJ9umSuiLtZq59fJ/qixaAC6yzUk9I+R DWMb9irk1/aRnzejVryFui6lNn5DZXces6BoL9FemHT2sQ8YectR9UZnX2GBdgQ+B1le ccBA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:references:in-reply-to:message-id:date :to:from:dkim-signature:delivered-to:arc-authentication-results; bh=wVDnAhGjjFRt93azjnpTHGwEsGoUiSOhyjR6fNiSxK4=; b=lrdspSig9uhVHSjt28qfFSsyC1xywIi+NDvGmZsW2knzGBkAOe76rmH49va+zBfDdd QyG1f6opwNshi3WnjCreVhQ6md6LKEndgZYv0t0RvoroKp9YnKRg4YS5l+0HQ4kgVYDU Ptet8mhGWu3PLMZCftirnednTWbTcuusXs5bLewfb5nXJKfoJSfahzmmma0oh5Vfd8Ru P0kgUb1J1t7zqG07YVkcaWsTW4fa9UD/KTmpRSivE1fXMyYBl9iW/dR2HworYc031h5H xHpc5VM/AtR9Tc9WfJCx3rhfSYFK5613mpm9qCLFtBYGT/zXQ2jREpVhNfC/PsBSwLFG VdNA== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=vG6R+0Ad; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id z12-v6si3896984wrg.326.2018.04.19.21.31.39; Thu, 19 Apr 2018 21:31:40 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=vG6R+0Ad; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id D23F368A1CA; Fri, 20 Apr 2018 07:30:32 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wr0-f195.google.com (mail-wr0-f195.google.com [209.85.128.195]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 5FE2768A129 for ; Fri, 20 Apr 2018 07:30:25 +0300 (EEST) Received: by mail-wr0-f195.google.com with SMTP id v24-v6so19268847wra.8 for ; Thu, 19 Apr 2018 21:30:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=3BfAc2Toe2WpJqwizWiK4U22W3QU7WKYQse74ZeKFsw=; b=vG6R+0AduWc70ItkKUaLUGTn7wl54NODxAxyiIcNby0F039hfHfpQYMnqRsAjnsHx5 bPQqOe1ms5gFqzSzMu7XjliEY3RCEdEjaZzT2CqP/efSYpwRaT8hTrYk4vh6ZjytUVW/ 1Cj/KTu1K9HMn6kOyX29+73E54XGVBUcPJaSZOGC3kxledVxXo9VSWrBMn13tanAF8l3 EYXTeFLOuKkM+ZNZ9kh93LCpFhMm5/klXlfHr+QJegJJnPBi9K0tq+WfXhV4xeUWbilh N62XcsBqd5Vo1eOK59ONeoQzD8gpkLmg9+nigTrdroeS4NJLNE6HUz0vDgiT6blUHC8R PR7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=3BfAc2Toe2WpJqwizWiK4U22W3QU7WKYQse74ZeKFsw=; b=YHYWuVBDHwJNeu3GJTvJabbDQVyA+fjaSBE5QcYfQzajdMGrW5XUcKBrtvdNGdQ1Qs Il0GfgzPLtnGMGVAjytPJrmFNOTpKWKssMNicRn1A2zEuxEKhjm/kbj6LAL/l5Y1XzUC m7ZbScGA0Val1/IXKf566BUzZwWTlL5G2rU/y/CREjoToUhYCdxDwzhuD91BrxbLUQ5e HZzhYAQjlPnOO5NT0Dp6BmLOCshJj90mWoC5+xo8tQWW6eLXPg5QldFM2tfDy3YhQF+V rzDA2DhaOGK9ZjkeA7Gu5W7aDiWl/ulTkNCuR6oIIi/OqI91pQEieda5RoMQx5z9LrCa Lhlw== X-Gm-Message-State: ALQs6tDaVhfng9sWYtQfkmvx0//qRUsRmwMxMEsULupfdgSKnKXe5zP/ JfI8+VEa8hnOvdyTurkylmsLBGFZ X-Received: by 2002:adf:9dc5:: with SMTP id q5-v6mr6200910wre.74.1524198652495; Thu, 19 Apr 2018 21:30:52 -0700 (PDT) Received: from moonbase.pars.ee ([2a00:23c4:7c88:af00:4c9e:9728:c86:66cf]) by smtp.gmail.com with ESMTPSA id 80sm935304wml.44.2018.04.19.21.30.51 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 19 Apr 2018 21:30:51 -0700 (PDT) From: Rostislav Pehlivanov To: ffmpeg-devel@ffmpeg.org Date: Fri, 20 Apr 2018 05:30:10 +0100 Message-Id: <20180420043010.3709-9-atomnuker@gmail.com> X-Mailer: git-send-email 2.17.0 In-Reply-To: <20180420043010.3709-1-atomnuker@gmail.com> References: <20180420043010.3709-1-atomnuker@gmail.com> Subject: [FFmpeg-devel] [PATCH 8/8] lavfi: add a Vulkan scale filter X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Rostislav Pehlivanov MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Can convert to RGB using very fast fixed-function conversions. Signed-off-by: Rostislav Pehlivanov --- configure | 1 + libavfilter/Makefile | 1 + libavfilter/allfilters.c | 1 + libavfilter/vf_scale_vulkan.c | 386 ++++++++++++++++++++++++++++++++++ 4 files changed, 389 insertions(+) create mode 100644 libavfilter/vf_scale_vulkan.c diff --git a/configure b/configure index 6c7b225099..90d574bac3 100755 --- a/configure +++ b/configure @@ -3411,6 +3411,7 @@ zmq_filter_deps="libzmq" zoompan_filter_deps="swscale" zscale_filter_deps="libzimg const_nan" scale_vaapi_filter_deps="vaapi VAProcPipelineParameterBuffer" +scale_vulkan_filter_deps="vulkan libshaderc" vpp_qsv_filter_deps="libmfx" vpp_qsv_filter_select="qsvvpp" diff --git a/libavfilter/Makefile b/libavfilter/Makefile index 0e825412cb..a6aab47ddf 100644 --- a/libavfilter/Makefile +++ b/libavfilter/Makefile @@ -309,6 +309,7 @@ OBJS-$(CONFIG_SCALE_CUDA_FILTER) += vf_scale_cuda.o vf_scale_cuda.pt OBJS-$(CONFIG_SCALE_NPP_FILTER) += vf_scale_npp.o scale.o OBJS-$(CONFIG_SCALE_QSV_FILTER) += vf_scale_qsv.o OBJS-$(CONFIG_SCALE_VAAPI_FILTER) += vf_scale_vaapi.o scale.o vaapi_vpp.o +OBJS-$(CONFIG_SCALE_VULKAN_FILTER) += vf_scale_vulkan.o scale.o vulkan.o OBJS-$(CONFIG_SCALE2REF_FILTER) += vf_scale.o scale.o OBJS-$(CONFIG_SELECT_FILTER) += f_select.o OBJS-$(CONFIG_SELECTIVECOLOR_FILTER) += vf_selectivecolor.o diff --git a/libavfilter/allfilters.c b/libavfilter/allfilters.c index cbaeb0c3a0..293d5e3e6e 100644 --- a/libavfilter/allfilters.c +++ b/libavfilter/allfilters.c @@ -300,6 +300,7 @@ extern AVFilter ff_vf_scale_cuda; extern AVFilter ff_vf_scale_npp; extern AVFilter ff_vf_scale_qsv; extern AVFilter ff_vf_scale_vaapi; +extern AVFilter ff_vf_scale_vulkan; extern AVFilter ff_vf_scale2ref; extern AVFilter ff_vf_select; extern AVFilter ff_vf_selectivecolor; diff --git a/libavfilter/vf_scale_vulkan.c b/libavfilter/vf_scale_vulkan.c new file mode 100644 index 0000000000..5bcdc0b3d8 --- /dev/null +++ b/libavfilter/vf_scale_vulkan.c @@ -0,0 +1,386 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "libavutil/opt.h" +#include "vulkan.h" +#include "scale.h" +#include "internal.h" + +enum ScalerFunc { + F_BILINEAR = 0, + F_NEAREST, + + F_NB, +}; + +typedef struct ScaleVulkanContext { + VulkanFilterContext vkctx; + + int initialized; + FFVkExecContext exec; + const VulkanSampler *sampler; + + /* Shader updators, must be in the main filter struct */ + VkDescriptorImageInfo input_images[3]; + VkDescriptorImageInfo output_images[3]; + + enum ScalerFunc scaler; + char *output_format_string; + char *w_expr; + char *h_expr; +} ScaleVulkanContext; + +static const char scale_bilinear[] = { + C(0, void scale_bilinear(int idx, ivec2 pos) ) + C(0, { ) + C(1, const vec2 npos = (vec2(pos) + 0.5f) / imageSize(output_img[idx]);) + C(1, imageStore(output_img[idx], pos, texture(input_img[idx], npos)); ) + C(0, } ) +}; + +static av_cold int init_filter(AVFilterContext *ctx, AVFrame *in) +{ + int err; + ScaleVulkanContext *s = ctx->priv; + const int conv = s->vkctx.input_format != s->vkctx.output_format; + VkFilter sampler_mode; + + switch (s->scaler) { + case F_NEAREST: + sampler_mode = VK_FILTER_NEAREST; + break; + case F_BILINEAR: + sampler_mode = VK_FILTER_LINEAR; + break; + }; + + /* Create a sampler */ + s->sampler = ff_vk_init_sampler(ctx, conv ? in : NULL, 0, sampler_mode); + if (!s->sampler) + return AVERROR_EXTERNAL; + + { /* Create the shader */ + SPIRVShader *shd = ff_vk_init_shader(ctx, "scale_compute", + VK_SHADER_STAGE_COMPUTE_BIT); + ff_vk_set_compute_shader_sizes(ctx, shd, (int [3]){ 16, 16, 1 }); + + VulkanDescriptorSetBinding desc_i[2] = { + { + .name = "input_img", + .type = VK_DESCRIPTOR_TYPE_COMBINED_IMAGE_SAMPLER, + .dimensions = 2, + .elems = conv ? 1 : + av_pix_fmt_count_planes(s->vkctx.input_format), + .stages = VK_SHADER_STAGE_COMPUTE_BIT, + .updater = s->input_images, + .samplers = DUP_SAMPLER_ARRAY4(s->sampler->sampler), + }, + { + .name = "output_img", + .type = VK_DESCRIPTOR_TYPE_STORAGE_IMAGE, + .mem_layout = "rgba8", + .mem_quali = "writeonly", + .dimensions = 2, + .elems = av_pix_fmt_count_planes(s->vkctx.output_format), + .stages = VK_SHADER_STAGE_COMPUTE_BIT, + .updater = s->output_images, + }, + }; + + RET(ff_vk_add_descriptor_set(ctx, shd, desc_i, 2, 0)); /* set 0 */ + + GLSLD( scale_bilinear ); + GLSLC(0, void main() ); + GLSLC(0, { ); + GLSLF(1, for (int i = 0; i < %i; i++) ,desc_i[1].elems); + + switch (s->scaler) { + case F_NEAREST: + case F_BILINEAR: + GLSLC(2, scale_bilinear(i, ivec2(gl_GlobalInvocationID.xy)); ); + break; + }; + + GLSLC(0, } ); + + RET(ff_vk_compile_shader(ctx, shd, "main")); + } + + RET(ff_vk_init_pipeline_layout(ctx)); + + /* Execution context */ + RET(ff_vk_create_exec_ctx(ctx, &s->exec, + s->vkctx.hwctx->queue_family_comp_index)); + + /* The pipeline */ + RET(ff_vk_init_compute_pipeline(ctx)); + + s->initialized = 1; + + return 0; + +fail: + return err; +} + +static int process_frames(AVFilterContext *avctx, AVVkFrame *out, AVVkFrame *in) +{ + int i, err; + ScaleVulkanContext *s = avctx->priv; + int planes = av_pix_fmt_count_planes(s->vkctx.output_format); + + VkCommandBufferBeginInfo cmd_start = { + .sType = VK_STRUCTURE_TYPE_COMMAND_BUFFER_BEGIN_INFO, + .flags = VK_COMMAND_BUFFER_USAGE_ONE_TIME_SUBMIT_BIT, + }; + + VkComponentMapping null_map = { + .r = VK_COMPONENT_SWIZZLE_IDENTITY, + .g = VK_COMPONENT_SWIZZLE_IDENTITY, + .b = VK_COMPONENT_SWIZZLE_IDENTITY, + .a = VK_COMPONENT_SWIZZLE_IDENTITY, + }; + + if (s->sampler->converting) { /* RGB */ + RET(ff_vk_create_imageview(avctx, &s->input_images[0].imageView, in, + av_vkfmt_from_pixfmt(s->vkctx.input_format), + VK_IMAGE_ASPECT_COLOR_BIT, + null_map, &s->sampler->yuv_conv)); + s->input_images[0].imageLayout = VK_IMAGE_LAYOUT_SHADER_READ_ONLY_OPTIMAL; + } else { + for (i = 0; i < av_pix_fmt_count_planes(s->vkctx.input_format); i++) + RET(ff_vk_create_imageview(avctx, &s->input_images[i].imageView, in, + ff_vk_plane_rep_fmt(s->vkctx.input_format, i), + ff_vk_aspect_flags(s->vkctx.input_format, i), + null_map, NULL)); + s->input_images[i].imageLayout = VK_IMAGE_LAYOUT_SHADER_READ_ONLY_OPTIMAL; + } + + for (i = 0; i < av_pix_fmt_count_planes(s->vkctx.output_format); i++) { + RET(ff_vk_create_imageview(avctx, &s->output_images[i].imageView, out, + ff_vk_plane_rep_fmt(s->vkctx.output_format, i), + ff_vk_aspect_flags(s->vkctx.output_format, i), + null_map, NULL)); + s->output_images[i].imageLayout = VK_IMAGE_LAYOUT_GENERAL; + } + + ff_vk_update_descriptor_set(avctx, 0); + + vkBeginCommandBuffer(s->exec.buf, &cmd_start); + + { + VkImageMemoryBarrier bar[2] = { + { + .sType = VK_STRUCTURE_TYPE_IMAGE_MEMORY_BARRIER, + .srcAccessMask = 0, + .dstAccessMask = VK_ACCESS_SHADER_READ_BIT, + .oldLayout = in->layout, + .newLayout = VK_IMAGE_LAYOUT_SHADER_READ_ONLY_OPTIMAL, + .srcQueueFamilyIndex = VK_QUEUE_FAMILY_IGNORED, + .dstQueueFamilyIndex = VK_QUEUE_FAMILY_IGNORED, + .image = in->img, + .subresourceRange.aspectMask = ff_vk_aspect_flags(s->vkctx.input_format, -1), + .subresourceRange.levelCount = 1, + .subresourceRange.layerCount = 1, + }, + { + .sType = VK_STRUCTURE_TYPE_IMAGE_MEMORY_BARRIER, + .srcAccessMask = 0, + .dstAccessMask = VK_ACCESS_SHADER_WRITE_BIT, + .oldLayout = out->layout, + .newLayout = VK_IMAGE_LAYOUT_GENERAL, + .srcQueueFamilyIndex = VK_QUEUE_FAMILY_IGNORED, + .dstQueueFamilyIndex = VK_QUEUE_FAMILY_IGNORED, + .image = out->img, + .subresourceRange.aspectMask = ff_vk_aspect_flags(s->vkctx.input_format, -1), + .subresourceRange.levelCount = 1, + .subresourceRange.layerCount = 1, + }, + }; + + vkCmdPipelineBarrier(s->exec.buf, VK_PIPELINE_STAGE_TOP_OF_PIPE_BIT, + VK_PIPELINE_STAGE_COMPUTE_SHADER_BIT, 0, + 0, NULL, 0, NULL, 2, bar); + + in->layout = bar[0].newLayout; + in->access = bar[0].dstAccessMask; + + out->layout = bar[1].newLayout; + out->access = bar[1].dstAccessMask; + } + + vkCmdBindPipeline(s->exec.buf, VK_PIPELINE_BIND_POINT_COMPUTE, s->vkctx.pipeline); + vkCmdBindDescriptorSets(s->exec.buf, VK_PIPELINE_BIND_POINT_COMPUTE, s->vkctx.pipeline_layout, 0, s->vkctx.descriptor_sets_num, s->vkctx.desc_set, 0, 0); + vkCmdDispatch(s->exec.buf, + FFALIGN(s->vkctx.output_width, s->vkctx.shaders[0].local_size[0])/s->vkctx.shaders[0].local_size[0], + FFALIGN(s->vkctx.output_height, s->vkctx.shaders[0].local_size[1])/s->vkctx.shaders[0].local_size[1], 1); + + vkEndCommandBuffer(s->exec.buf); + + VkSubmitInfo s_info = { + .sType = VK_STRUCTURE_TYPE_SUBMIT_INFO, + .commandBufferCount = 1, + .pCommandBuffers = &s->exec.buf, + }; + + VkResult ret = vkQueueSubmit(s->exec.queue, 1, &s_info, s->exec.fence); + if (ret != VK_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Unable to submit command buffer: %s\n", + ff_vk_ret2str(ret)); + return AVERROR_EXTERNAL; + } else { + vkWaitForFences(s->vkctx.hwctx->act_dev, 1, &s->exec.fence, VK_TRUE, UINT64_MAX); + vkResetFences(s->vkctx.hwctx->act_dev, 1, &s->exec.fence); + } + +fail: + + for (i = 0; i < planes; i++) { + ff_vk_destroy_imageview(avctx, s->input_images[i].imageView); + ff_vk_destroy_imageview(avctx, s->output_images[i].imageView); + } + + return err; +} + +static int scale_vulkan_filter_frame(AVFilterLink *link, AVFrame *in) +{ + int err; + AVFilterContext *ctx = link->dst; + ScaleVulkanContext *s = ctx->priv; + AVFilterLink *outlink = ctx->outputs[0]; + + AVFrame *out = ff_get_video_buffer(outlink, outlink->w, outlink->h); + if (!out) { + err = AVERROR(ENOMEM); + goto fail; + } + + if (!s->initialized) + RET(init_filter(ctx, in)); + + RET(process_frames(ctx, (AVVkFrame *)out->data[0], + (AVVkFrame *) in->data[0])); + + err = av_frame_copy_props(out, in); + if (err < 0) + goto fail; + + av_frame_free(&in); + + return ff_filter_frame(outlink, out); + +fail: + av_frame_free(&in); + av_frame_free(&out); + return err; +} + +static int scale_vulkan_config_output(AVFilterLink *outlink) +{ + int err; + AVFilterContext *avctx = outlink->src; + ScaleVulkanContext *s = avctx->priv; + AVFilterLink *inlink = outlink->src->inputs[0]; + + err = ff_scale_eval_dimensions(s, s->w_expr, s->h_expr, inlink, outlink, + &s->vkctx.output_width, + &s->vkctx.output_height); + if (err < 0) + return err; + + if (s->output_format_string) + s->vkctx.output_format = av_get_pix_fmt(s->output_format_string); + + if ((s->vkctx.input_format != s->vkctx.output_format) && + (s->vkctx.output_format != AV_PIX_FMT_RGBA)) { + av_log(avctx, AV_LOG_WARNING, "Unsupported conversion %s -> %s! " + "Currently input format must match output format or output " + "format must be \"rgba\"!\n", + av_get_pix_fmt_name(s->vkctx.input_format), + av_get_pix_fmt_name(s->vkctx.output_format)); + return AVERROR(EINVAL); + } + + err = ff_vk_filter_config_output(outlink); + if (err < 0) + return err; + + if (inlink->sample_aspect_ratio.num) + outlink->sample_aspect_ratio = av_mul_q((AVRational){outlink->h * inlink->w, outlink->w * inlink->h}, inlink->sample_aspect_ratio); + else + outlink->sample_aspect_ratio = inlink->sample_aspect_ratio; + + return 0; +} + +static void scale_vulkan_uninit(AVFilterContext *avctx) +{ + ScaleVulkanContext *s = avctx->priv; + + ff_vk_free_exec_ctx(avctx, &s->exec); + ff_vk_filter_uninit(avctx); + + s->initialized = 0; +} + +#define OFFSET(x) offsetof(ScaleVulkanContext, x) +#define FLAGS (AV_OPT_FLAG_FILTERING_PARAM | AV_OPT_FLAG_VIDEO_PARAM) +static const AVOption scale_vulkan_options[] = { + { "w", "Output video width", OFFSET(w_expr), AV_OPT_TYPE_STRING, {.str = "iw"}, .flags = FLAGS }, + { "h", "Output video height", OFFSET(h_expr), AV_OPT_TYPE_STRING, {.str = "ih"}, .flags = FLAGS }, + { "scaler", "Scaler function", OFFSET(scaler), AV_OPT_TYPE_INT, {.i64 = F_BILINEAR}, 0, F_NB, .flags = FLAGS, "scaler" }, + { "bilinear", "Bilinear interpolation (fastest)", 0, AV_OPT_TYPE_CONST, {.i64 = F_BILINEAR}, 0, 0, .flags = FLAGS, "scaler" }, + { "nearest", "Nearest (useful for pixel art)", 0, AV_OPT_TYPE_CONST, {.i64 = F_NEAREST}, 0, 0, .flags = FLAGS, "scaler" }, + { "format", "Output video format (software format of hardware frames)", OFFSET(output_format_string), AV_OPT_TYPE_STRING, .flags = FLAGS }, + { NULL }, +}; + +AVFILTER_DEFINE_CLASS(scale_vulkan); + +static const AVFilterPad scale_vulkan_inputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + .filter_frame = &scale_vulkan_filter_frame, + .config_props = &ff_vk_filter_config_input, + }, + { NULL } +}; + +static const AVFilterPad scale_vulkan_outputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + .config_props = &scale_vulkan_config_output, + }, + { NULL } +}; + +AVFilter ff_vf_scale_vulkan = { + .name = "scale_vulkan", + .description = NULL_IF_CONFIG_SMALL("Scale Vulkan frames"), + .priv_size = sizeof(ScaleVulkanContext), + .init = &ff_vk_filter_init, + .uninit = &scale_vulkan_uninit, + .query_formats = &ff_vk_filter_query_formats, + .inputs = scale_vulkan_inputs, + .outputs = scale_vulkan_outputs, + .priv_class = &scale_vulkan_class, + .flags_internal = FF_FILTER_FLAG_HWFRAME_AWARE, +};