From patchwork Sun Feb 19 17:23:07 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Thompson X-Patchwork-Id: 2608 Delivered-To: ffmpegpatchwork@gmail.com Received: by 10.103.89.22 with SMTP id n22csp520090vsb; Sun, 19 Feb 2017 09:24:05 -0800 (PST) X-Received: by 10.28.206.136 with SMTP id e130mr14584058wmg.121.1487525045019; Sun, 19 Feb 2017 09:24:05 -0800 (PST) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id w25si9047334wrw.67.2017.02.19.09.24.04; Sun, 19 Feb 2017 09:24:04 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@jkqxz-net.20150623.gappssmtp.com; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id DCFD7689A33; Sun, 19 Feb 2017 19:23:25 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wr0-f180.google.com (mail-wr0-f180.google.com [209.85.128.180]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 94527680CFC for ; Sun, 19 Feb 2017 19:23:18 +0200 (EET) Received: by mail-wr0-f180.google.com with SMTP id 35so12443893wrw.0 for ; Sun, 19 Feb 2017 09:23:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jkqxz-net.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=JRBm9lwCvKrNxul3lhIpcw6NadzK1/+RZkkFtV4KVd0=; b=COrCjePmSOwBwVCzrip7R4ac3Qb4u7OGvngsiNW292CL4aqUEdVNHcNBsjIRq3ER4k PtuqR26moVG+jBWR+iDM+PtDsrsgyW0afkF7bgyNFrNrFE1+0lbA5MNVRTagPMrK0bu3 mQLfkcGHIdTnFZTCvoGTO1JEPq+A9IUDmkTUYOT/4HojwhR9ilFWd40ekmSpXo0MSu/i +Gh4K48Yipf09uBeLqECG9bjg8otSlHPXe2FULWQj6Nhm1vnoR4IPdtb+yMLCs7cnLB7 Jvk1jJT73Gxt2rDbMRNdA8oKD7T9vYc7IByhGRG/OqgbU2KCnnyBiXdjnZZtZ1vjIyNp mbDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=JRBm9lwCvKrNxul3lhIpcw6NadzK1/+RZkkFtV4KVd0=; b=KQUTScuiqnlront6x3KxdeTYW+gYv0GcmRjQ8XJzMTZAMNyGYNx5RRZtJhrmFKA1o8 FM/YnGM6nDSimUIewiT8rcpGQBZJ2qhXtjWCTZNNDjFmIDYdSaBD1UpxDA9xx4/OzIa+ YFlsWM8UEzwZOwhKRUI6Dn5zBgQ49J4nDaJYD+niXSrEtD9I/pafcGa7uBsm9P7qVgk7 5SbcLiUX94UGIcoXpib2vNyjPj+lqO0BBO60zcCu8dD8k3RJlp6nk36sUdzXiJVn6rM+ 4kCKj4RZtv8ZjXBa3Ze7TuEhX+z1MXM70sFYstM5cPlYt6lgrtZaIDP0GTsjng6ofTUk Yvew== X-Gm-Message-State: AMke39mV3ROnBsMsbd/rlWCKYz7xZ//PF21sgQuYvlWUG3UjheRKpJCYNlz+LK61R2EFcw== X-Received: by 10.223.150.178 with SMTP id u47mr9863339wrb.200.1487525005227; Sun, 19 Feb 2017 09:23:25 -0800 (PST) Received: from rywe.jkqxz.net (cpc91242-cmbg18-2-0-cust650.5-4.cable.virginm.net. [82.8.130.139]) by smtp.gmail.com with ESMTPSA id 36sm21480626wrz.8.2017.02.19.09.23.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 19 Feb 2017 09:23:24 -0800 (PST) From: Mark Thompson To: ffmpeg-devel@ffmpeg.org Date: Sun, 19 Feb 2017 17:23:07 +0000 Message-Id: <20170219172307.27012-5-sw@jkqxz.net> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20170219172307.27012-1-sw@jkqxz.net> References: <20170219172307.27012-1-sw@jkqxz.net> Subject: [FFmpeg-devel] [PATCH 4/4] lavfi: Add VAAPI deinterlacer X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Mark Thompson MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" (cherry picked from commit ade370a4d7eab1866b6023c91c135d27c77ca465) (cherry picked from commit 2d518aec4c781316092be65893b47922c8f71b67) --- configure | 1 + libavfilter/Makefile | 1 + libavfilter/allfilters.c | 1 + libavfilter/version.h | 2 +- libavfilter/vf_deinterlace_vaapi.c | 634 +++++++++++++++++++++++++++++++++++++ 5 files changed, 638 insertions(+), 1 deletion(-) create mode 100644 libavfilter/vf_deinterlace_vaapi.c diff --git a/configure b/configure index b1ef0c0a48..9589d8397c 100755 --- a/configure +++ b/configure @@ -3086,6 +3086,7 @@ bs2b_filter_deps="libbs2b" colormatrix_filter_deps="gpl" cover_rect_filter_deps="avcodec avformat gpl" cropdetect_filter_deps="gpl" +deinterlace_vaapi_filter_deps="vaapi" delogo_filter_deps="gpl" deshake_filter_select="pixelutils" drawtext_filter_deps="libfreetype" diff --git a/libavfilter/Makefile b/libavfilter/Makefile index 695167c9f6..0ba1c74a26 100644 --- a/libavfilter/Makefile +++ b/libavfilter/Makefile @@ -156,6 +156,7 @@ OBJS-$(CONFIG_DCTDNOIZ_FILTER) += vf_dctdnoiz.o OBJS-$(CONFIG_DEBAND_FILTER) += vf_deband.o OBJS-$(CONFIG_DECIMATE_FILTER) += vf_decimate.o OBJS-$(CONFIG_DEFLATE_FILTER) += vf_neighbor.o +OBJS-$(CONFIG_DEINTERLACE_VAAPI_FILTER) += vf_deinterlace_vaapi.o OBJS-$(CONFIG_DEJUDDER_FILTER) += vf_dejudder.o OBJS-$(CONFIG_DELOGO_FILTER) += vf_delogo.o OBJS-$(CONFIG_DESHAKE_FILTER) += vf_deshake.o diff --git a/libavfilter/allfilters.c b/libavfilter/allfilters.c index 40cf0f434a..15a74c4eed 100644 --- a/libavfilter/allfilters.c +++ b/libavfilter/allfilters.c @@ -172,6 +172,7 @@ void avfilter_register_all(void) REGISTER_FILTER(DEBAND, deband, vf); REGISTER_FILTER(DECIMATE, decimate, vf); REGISTER_FILTER(DEFLATE, deflate, vf); + REGISTER_FILTER(DEINTERLACE_VAAPI, deinterlace_vaapi, vf); REGISTER_FILTER(DEJUDDER, dejudder, vf); REGISTER_FILTER(DELOGO, delogo, vf); REGISTER_FILTER(DESHAKE, deshake, vf); diff --git a/libavfilter/version.h b/libavfilter/version.h index 0be3f9ea73..11db8d5513 100644 --- a/libavfilter/version.h +++ b/libavfilter/version.h @@ -30,7 +30,7 @@ #include "libavutil/version.h" #define LIBAVFILTER_VERSION_MAJOR 6 -#define LIBAVFILTER_VERSION_MINOR 73 +#define LIBAVFILTER_VERSION_MINOR 74 #define LIBAVFILTER_VERSION_MICRO 100 #define LIBAVFILTER_VERSION_INT AV_VERSION_INT(LIBAVFILTER_VERSION_MAJOR, \ diff --git a/libavfilter/vf_deinterlace_vaapi.c b/libavfilter/vf_deinterlace_vaapi.c new file mode 100644 index 0000000000..032e65b225 --- /dev/null +++ b/libavfilter/vf_deinterlace_vaapi.c @@ -0,0 +1,634 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include + +#include +#include + +#include "libavutil/avassert.h" +#include "libavutil/hwcontext.h" +#include "libavutil/hwcontext_vaapi.h" +#include "libavutil/mem.h" +#include "libavutil/opt.h" +#include "libavutil/pixdesc.h" + +#include "avfilter.h" +#include "formats.h" +#include "internal.h" +#include "video.h" + +#define MAX_REFERENCES 8 + +typedef struct DeintVAAPIContext { + const AVClass *class; + + AVVAAPIDeviceContext *hwctx; + AVBufferRef *device_ref; + + int mode; + + int valid_ids; + VAConfigID va_config; + VAContextID va_context; + + AVBufferRef *input_frames_ref; + AVHWFramesContext *input_frames; + + AVBufferRef *output_frames_ref; + AVHWFramesContext *output_frames; + int output_height; + int output_width; + + VAProcFilterCapDeinterlacing + deint_caps[VAProcDeinterlacingCount]; + int nb_deint_caps; + VAProcPipelineCaps pipeline_caps; + + int queue_depth; + int queue_count; + AVFrame *frame_queue[MAX_REFERENCES]; + + VABufferID filter_buffer; +} DeintVAAPIContext; + +static const char *deint_vaapi_mode_name(int mode) +{ + switch (mode) { +#define D(name) case VAProcDeinterlacing ## name: return #name + D(Bob); + D(Weave); + D(MotionAdaptive); + D(MotionCompensated); +#undef D + default: + return "Invalid"; + } +} + +static int deint_vaapi_query_formats(AVFilterContext *avctx) +{ + enum AVPixelFormat pix_fmts[] = { + AV_PIX_FMT_VAAPI, AV_PIX_FMT_NONE, + }; + int err; + + if ((err = ff_formats_ref(ff_make_format_list(pix_fmts), + &avctx->inputs[0]->out_formats)) < 0) + return err; + if ((err = ff_formats_ref(ff_make_format_list(pix_fmts), + &avctx->outputs[0]->in_formats)) < 0) + return err; + + return 0; +} + +static int deint_vaapi_pipeline_uninit(AVFilterContext *avctx) +{ + DeintVAAPIContext *ctx = avctx->priv; + int i; + + for (i = 0; i < ctx->queue_count; i++) + av_frame_free(&ctx->frame_queue[i]); + ctx->queue_count = 0; + + if (ctx->filter_buffer != VA_INVALID_ID) { + vaDestroyBuffer(ctx->hwctx->display, ctx->filter_buffer); + ctx->filter_buffer = VA_INVALID_ID; + } + + if (ctx->va_context != VA_INVALID_ID) { + vaDestroyContext(ctx->hwctx->display, ctx->va_context); + ctx->va_context = VA_INVALID_ID; + } + + if (ctx->va_config != VA_INVALID_ID) { + vaDestroyConfig(ctx->hwctx->display, ctx->va_config); + ctx->va_config = VA_INVALID_ID; + } + + av_buffer_unref(&ctx->device_ref); + ctx->hwctx = NULL; + + return 0; +} + +static int deint_vaapi_config_input(AVFilterLink *inlink) +{ + AVFilterContext *avctx = inlink->dst; + DeintVAAPIContext *ctx = avctx->priv; + + deint_vaapi_pipeline_uninit(avctx); + + if (!inlink->hw_frames_ctx) { + av_log(avctx, AV_LOG_ERROR, "A hardware frames reference is " + "required to associate the processing device.\n"); + return AVERROR(EINVAL); + } + + ctx->input_frames_ref = av_buffer_ref(inlink->hw_frames_ctx); + ctx->input_frames = (AVHWFramesContext*)ctx->input_frames_ref->data; + + return 0; +} + +static int deint_vaapi_build_filter_params(AVFilterContext *avctx) +{ + DeintVAAPIContext *ctx = avctx->priv; + VAStatus vas; + VAProcFilterParameterBufferDeinterlacing params; + int i; + + ctx->nb_deint_caps = VAProcDeinterlacingCount; + vas = vaQueryVideoProcFilterCaps(ctx->hwctx->display, + ctx->va_context, + VAProcFilterDeinterlacing, + &ctx->deint_caps, + &ctx->nb_deint_caps); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to query deinterlacing " + "caps: %d (%s).\n", vas, vaErrorStr(vas)); + return AVERROR(EIO); + } + + if (ctx->mode == VAProcDeinterlacingNone) { + for (i = 0; i < ctx->nb_deint_caps; i++) { + if (ctx->deint_caps[i].type > ctx->mode) + ctx->mode = ctx->deint_caps[i].type; + } + av_log(avctx, AV_LOG_VERBOSE, "Picking %d (%s) as default " + "deinterlacing mode.\n", ctx->mode, + deint_vaapi_mode_name(ctx->mode)); + } else { + for (i = 0; i < ctx->nb_deint_caps; i++) { + if (ctx->deint_caps[i].type == ctx->mode) + break; + } + if (i >= ctx->nb_deint_caps) { + av_log(avctx, AV_LOG_ERROR, "Deinterlacing mode %d (%s) is " + "not supported.\n", ctx->mode, + deint_vaapi_mode_name(ctx->mode)); + } + } + + params.type = VAProcFilterDeinterlacing; + params.algorithm = ctx->mode; + params.flags = 0; + + av_assert0(ctx->filter_buffer == VA_INVALID_ID); + vas = vaCreateBuffer(ctx->hwctx->display, ctx->va_context, + VAProcFilterParameterBufferType, + sizeof(params), 1, ¶ms, + &ctx->filter_buffer); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to create deinterlace " + "parameter buffer: %d (%s).\n", vas, vaErrorStr(vas)); + return AVERROR(EIO); + } + + vas = vaQueryVideoProcPipelineCaps(ctx->hwctx->display, + ctx->va_context, + &ctx->filter_buffer, 1, + &ctx->pipeline_caps); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to query pipeline " + "caps: %d (%s).\n", vas, vaErrorStr(vas)); + return AVERROR(EIO); + } + + ctx->queue_depth = ctx->pipeline_caps.num_backward_references + + ctx->pipeline_caps.num_forward_references + 1; + if (ctx->queue_depth > MAX_REFERENCES) { + av_log(avctx, AV_LOG_ERROR, "Pipeline requires too many " + "references (%u forward, %u back).\n", + ctx->pipeline_caps.num_forward_references, + ctx->pipeline_caps.num_backward_references); + return AVERROR(ENOSYS); + } + + return 0; +} + +static int deint_vaapi_config_output(AVFilterLink *outlink) +{ + AVFilterContext *avctx = outlink->src; + DeintVAAPIContext *ctx = avctx->priv; + AVVAAPIHWConfig *hwconfig = NULL; + AVHWFramesConstraints *constraints = NULL; + AVVAAPIFramesContext *va_frames; + VAStatus vas; + int err; + + deint_vaapi_pipeline_uninit(avctx); + + av_assert0(ctx->input_frames); + ctx->device_ref = av_buffer_ref(ctx->input_frames->device_ref); + ctx->hwctx = ((AVHWDeviceContext*)ctx->device_ref->data)->hwctx; + + ctx->output_width = ctx->input_frames->width; + ctx->output_height = ctx->input_frames->height; + + av_assert0(ctx->va_config == VA_INVALID_ID); + vas = vaCreateConfig(ctx->hwctx->display, VAProfileNone, + VAEntrypointVideoProc, 0, 0, &ctx->va_config); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to create processing pipeline " + "config: %d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail; + } + + hwconfig = av_hwdevice_hwconfig_alloc(ctx->device_ref); + if (!hwconfig) { + err = AVERROR(ENOMEM); + goto fail; + } + hwconfig->config_id = ctx->va_config; + + constraints = av_hwdevice_get_hwframe_constraints(ctx->device_ref, + hwconfig); + if (!constraints) { + err = AVERROR(ENOMEM); + goto fail; + } + + if (ctx->output_width < constraints->min_width || + ctx->output_height < constraints->min_height || + ctx->output_width > constraints->max_width || + ctx->output_height > constraints->max_height) { + av_log(avctx, AV_LOG_ERROR, "Hardware does not support " + "deinterlacing to size %dx%d " + "(constraints: width %d-%d height %d-%d).\n", + ctx->output_width, ctx->output_height, + constraints->min_width, constraints->max_width, + constraints->min_height, constraints->max_height); + err = AVERROR(EINVAL); + goto fail; + } + + ctx->output_frames_ref = av_hwframe_ctx_alloc(ctx->device_ref); + if (!ctx->output_frames_ref) { + av_log(avctx, AV_LOG_ERROR, "Failed to create HW frame context " + "for output.\n"); + err = AVERROR(ENOMEM); + goto fail; + } + + ctx->output_frames = (AVHWFramesContext*)ctx->output_frames_ref->data; + + ctx->output_frames->format = AV_PIX_FMT_VAAPI; + ctx->output_frames->sw_format = ctx->input_frames->sw_format; + ctx->output_frames->width = ctx->output_width; + ctx->output_frames->height = ctx->output_height; + + // The number of output frames we need is determined by what follows + // the filter. If it's an encoder with complex frame reference + // structures then this could be very high. + ctx->output_frames->initial_pool_size = 10; + + err = av_hwframe_ctx_init(ctx->output_frames_ref); + if (err < 0) { + av_log(avctx, AV_LOG_ERROR, "Failed to initialise VAAPI frame " + "context for output: %d\n", err); + goto fail; + } + + va_frames = ctx->output_frames->hwctx; + + av_assert0(ctx->va_context == VA_INVALID_ID); + vas = vaCreateContext(ctx->hwctx->display, ctx->va_config, + ctx->output_width, ctx->output_height, 0, + va_frames->surface_ids, va_frames->nb_surfaces, + &ctx->va_context); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to create processing pipeline " + "context: %d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail; + } + + err = deint_vaapi_build_filter_params(avctx); + if (err < 0) + goto fail; + + outlink->w = ctx->output_width; + outlink->h = ctx->output_height; + + outlink->hw_frames_ctx = av_buffer_ref(ctx->output_frames_ref); + if (!outlink->hw_frames_ctx) { + err = AVERROR(ENOMEM); + goto fail; + } + + av_freep(&hwconfig); + av_hwframe_constraints_free(&constraints); + return 0; + +fail: + av_buffer_unref(&ctx->output_frames_ref); + av_freep(&hwconfig); + av_hwframe_constraints_free(&constraints); + return err; +} + +static int vaapi_proc_colour_standard(enum AVColorSpace av_cs) +{ + switch(av_cs) { +#define CS(av, va) case AVCOL_SPC_ ## av: return VAProcColorStandard ## va; + CS(BT709, BT709); + CS(BT470BG, BT470BG); + CS(SMPTE170M, SMPTE170M); + CS(SMPTE240M, SMPTE240M); +#undef CS + default: + return VAProcColorStandardNone; + } +} + +static int deint_vaapi_filter_frame(AVFilterLink *inlink, AVFrame *input_frame) +{ + AVFilterContext *avctx = inlink->dst; + AVFilterLink *outlink = avctx->outputs[0]; + DeintVAAPIContext *ctx = avctx->priv; + AVFrame *output_frame = NULL; + VASurfaceID input_surface, output_surface; + VASurfaceID backward_references[MAX_REFERENCES]; + VASurfaceID forward_references[MAX_REFERENCES]; + VAProcPipelineParameterBuffer params; + VAProcFilterParameterBufferDeinterlacing *filter_params; + VARectangle input_region; + VABufferID params_id; + VAStatus vas; + void *filter_params_addr = NULL; + int err, i; + + av_log(avctx, AV_LOG_DEBUG, "Filter input: %s, %ux%u (%"PRId64").\n", + av_get_pix_fmt_name(input_frame->format), + input_frame->width, input_frame->height, input_frame->pts); + + if (ctx->queue_count < ctx->queue_depth) { + ctx->frame_queue[ctx->queue_count++] = input_frame; + if (ctx->queue_count < ctx->queue_depth) { + // Need more reference surfaces before we can continue. + return 0; + } + } else { + av_frame_free(&ctx->frame_queue[0]); + for (i = 0; i + 1 < ctx->queue_count; i++) + ctx->frame_queue[i] = ctx->frame_queue[i + 1]; + ctx->frame_queue[i] = input_frame; + } + + input_frame = + ctx->frame_queue[ctx->pipeline_caps.num_backward_references]; + input_surface = (VASurfaceID)(uintptr_t)input_frame->data[3]; + for (i = 0; i < ctx->pipeline_caps.num_backward_references; i++) + backward_references[i] = (VASurfaceID)(uintptr_t) + ctx->frame_queue[ctx->pipeline_caps.num_backward_references - + i - 1]->data[3]; + for (i = 0; i < ctx->pipeline_caps.num_forward_references; i++) + forward_references[i] = (VASurfaceID)(uintptr_t) + ctx->frame_queue[ctx->pipeline_caps.num_backward_references + + i + 1]->data[3]; + + av_log(avctx, AV_LOG_DEBUG, "Using surface %#x for " + "deinterlace input.\n", input_surface); + av_log(avctx, AV_LOG_DEBUG, "Backward references:"); + for (i = 0; i < ctx->pipeline_caps.num_backward_references; i++) + av_log(avctx, AV_LOG_DEBUG, " %#x", backward_references[i]); + av_log(avctx, AV_LOG_DEBUG, "\n"); + av_log(avctx, AV_LOG_DEBUG, "Forward references:"); + for (i = 0; i < ctx->pipeline_caps.num_forward_references; i++) + av_log(avctx, AV_LOG_DEBUG, " %#x", forward_references[i]); + av_log(avctx, AV_LOG_DEBUG, "\n"); + + output_frame = av_frame_alloc(); + if (!output_frame) { + err = AVERROR(ENOMEM); + goto fail; + } + + err = av_hwframe_get_buffer(ctx->output_frames_ref, + output_frame, 0); + if (err < 0) { + err = AVERROR(ENOMEM); + goto fail; + } + + output_surface = (VASurfaceID)(uintptr_t)output_frame->data[3]; + av_log(avctx, AV_LOG_DEBUG, "Using surface %#x for " + "deinterlace output.\n", output_surface); + + memset(¶ms, 0, sizeof(params)); + + input_region = (VARectangle) { + .x = 0, + .y = 0, + .width = input_frame->width, + .height = input_frame->height, + }; + + params.surface = input_surface; + params.surface_region = &input_region; + params.surface_color_standard = vaapi_proc_colour_standard( + av_frame_get_colorspace(input_frame)); + + params.output_region = NULL; + params.output_background_color = 0xff000000; + params.output_color_standard = params.surface_color_standard; + + params.pipeline_flags = 0; + params.filter_flags = VA_FRAME_PICTURE; + + vas = vaMapBuffer(ctx->hwctx->display, ctx->filter_buffer, + &filter_params_addr); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to map filter parameter " + "buffer: %d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail; + } + filter_params = filter_params_addr; + filter_params->flags = 0; + if (input_frame->interlaced_frame && !input_frame->top_field_first) + filter_params->flags |= VA_DEINTERLACING_BOTTOM_FIELD_FIRST; + filter_params_addr = NULL; + vas = vaUnmapBuffer(ctx->hwctx->display, ctx->filter_buffer); + if (vas != VA_STATUS_SUCCESS) + av_log(avctx, AV_LOG_ERROR, "Failed to unmap filter parameter " + "buffer: %d (%s).\n", vas, vaErrorStr(vas)); + + params.filters = &ctx->filter_buffer; + params.num_filters = 1; + + params.forward_references = forward_references; + params.num_forward_references = + ctx->pipeline_caps.num_forward_references; + params.backward_references = backward_references; + params.num_backward_references = + ctx->pipeline_caps.num_backward_references; + + vas = vaBeginPicture(ctx->hwctx->display, + ctx->va_context, output_surface); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to attach new picture: " + "%d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail; + } + + vas = vaCreateBuffer(ctx->hwctx->display, ctx->va_context, + VAProcPipelineParameterBufferType, + sizeof(params), 1, ¶ms, ¶ms_id); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to create parameter buffer: " + "%d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail_after_begin; + } + av_log(avctx, AV_LOG_DEBUG, "Pipeline parameter buffer is %#x.\n", + params_id); + + vas = vaRenderPicture(ctx->hwctx->display, ctx->va_context, + ¶ms_id, 1); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to render parameter buffer: " + "%d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail_after_begin; + } + + vas = vaEndPicture(ctx->hwctx->display, ctx->va_context); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to start picture processing: " + "%d (%s).\n", vas, vaErrorStr(vas)); + err = AVERROR(EIO); + goto fail_after_render; + } + + if (ctx->hwctx->driver_quirks & + AV_VAAPI_DRIVER_QUIRK_RENDER_PARAM_BUFFERS) { + vas = vaDestroyBuffer(ctx->hwctx->display, params_id); + if (vas != VA_STATUS_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to free parameter buffer: " + "%d (%s).\n", vas, vaErrorStr(vas)); + // And ignore. + } + } + + err = av_frame_copy_props(output_frame, input_frame); + if (err < 0) + goto fail; + + av_log(avctx, AV_LOG_DEBUG, "Filter output: %s, %ux%u (%"PRId64").\n", + av_get_pix_fmt_name(output_frame->format), + output_frame->width, output_frame->height, output_frame->pts); + + return ff_filter_frame(outlink, output_frame); + +fail_after_begin: + vaRenderPicture(ctx->hwctx->display, ctx->va_context, ¶ms_id, 1); +fail_after_render: + vaEndPicture(ctx->hwctx->display, ctx->va_context); +fail: + if (filter_params_addr) + vaUnmapBuffer(ctx->hwctx->display, ctx->filter_buffer); + av_frame_free(&output_frame); + return err; +} + +static av_cold int deint_vaapi_init(AVFilterContext *avctx) +{ + DeintVAAPIContext *ctx = avctx->priv; + + ctx->va_config = VA_INVALID_ID; + ctx->va_context = VA_INVALID_ID; + ctx->filter_buffer = VA_INVALID_ID; + ctx->valid_ids = 1; + + return 0; +} + +static av_cold void deint_vaapi_uninit(AVFilterContext *avctx) +{ + DeintVAAPIContext *ctx = avctx->priv; + + if (ctx->valid_ids) + deint_vaapi_pipeline_uninit(avctx); + + av_buffer_unref(&ctx->input_frames_ref); + av_buffer_unref(&ctx->output_frames_ref); + av_buffer_unref(&ctx->device_ref); +} + +#define OFFSET(x) offsetof(DeintVAAPIContext, x) +#define FLAGS (AV_OPT_FLAG_FILTERING_PARAM|AV_OPT_FLAG_VIDEO_PARAM) +static const AVOption deint_vaapi_options[] = { + { "mode", "Deinterlacing mode", + OFFSET(mode), AV_OPT_TYPE_INT, { .i64 = VAProcDeinterlacingNone }, + VAProcDeinterlacingNone, VAProcDeinterlacingCount - 1, FLAGS, "mode" }, + { "default", "Use the highest-numbered (and therefore possibly most advanced) deinterlacing algorithm", + 0, AV_OPT_TYPE_CONST, { .i64 = VAProcDeinterlacingNone }, .unit = "mode" }, + { "bob", "Use the bob deinterlacing algorithm", + 0, AV_OPT_TYPE_CONST, { .i64 = VAProcDeinterlacingBob }, .unit = "mode" }, + { "weave", "Use the weave deinterlacing algorithm", + 0, AV_OPT_TYPE_CONST, { .i64 = VAProcDeinterlacingWeave }, .unit = "mode" }, + { "motion_adaptive", "Use the motion adaptive deinterlacing algorithm", + 0, AV_OPT_TYPE_CONST, { .i64 = VAProcDeinterlacingMotionAdaptive }, .unit = "mode" }, + { "motion_compensated", "Use the motion compensated deinterlacing algorithm", + 0, AV_OPT_TYPE_CONST, { .i64 = VAProcDeinterlacingMotionCompensated }, .unit = "mode" }, + { NULL }, +}; + +static const AVClass deint_vaapi_class = { + .class_name = "deinterlace_vaapi", + .item_name = av_default_item_name, + .option = deint_vaapi_options, + .version = LIBAVUTIL_VERSION_INT, +}; + +static const AVFilterPad deint_vaapi_inputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + .filter_frame = &deint_vaapi_filter_frame, + .config_props = &deint_vaapi_config_input, + }, + { NULL } +}; + +static const AVFilterPad deint_vaapi_outputs[] = { + { + .name = "default", + .type = AVMEDIA_TYPE_VIDEO, + .config_props = &deint_vaapi_config_output, + }, + { NULL } +}; + +AVFilter ff_vf_deinterlace_vaapi = { + .name = "deinterlace_vaapi", + .description = NULL_IF_CONFIG_SMALL("Deinterlacing of VAAPI surfaces"), + .priv_size = sizeof(DeintVAAPIContext), + .init = &deint_vaapi_init, + .uninit = &deint_vaapi_uninit, + .query_formats = &deint_vaapi_query_formats, + .inputs = deint_vaapi_inputs, + .outputs = deint_vaapi_outputs, + .priv_class = &deint_vaapi_class, +};