From patchwork Sun Sep 10 20:53:33 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Thompson X-Patchwork-Id: 5089 Delivered-To: ffmpegpatchwork@gmail.com Received: by 10.2.36.26 with SMTP id f26csp2357581jaa; Sun, 10 Sep 2017 13:55:09 -0700 (PDT) X-Received: by 10.223.172.228 with SMTP id o91mr6596522wrc.259.1505076909479; Sun, 10 Sep 2017 13:55:09 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1505076909; cv=none; d=google.com; s=arc-20160816; b=eRNCMsA2n78fxOIZY7zJRWR8E2ck0tWpqDni8WUl+l2khlPrBWRnVBDX+eXagWpama mfrHTGbPLPRezsDTYdHxpK2msPlUSXYzAENt92jRWi8+fnXuUicuFscvxnkdgygEUwH6 ePQ6SKrtOAbZH3wJUWQ66WPIk475V45KhxGxGSJGW/ShGC+UtVEQhIWBxkE8w6OjhVRn Ak9jlynnyctqXyqnbqfSlfCw4OnJPLI7d6/sEvfERDCcm1QD6uVxBhUiOgEMIvmUA7hZ N/CRvPtZdElqGea+fFs7ZtphcDqTXLzGjCDgWWM+IGdk2+krGwid9EJ3eQENFo6Bf4BL YxXw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:references:in-reply-to:message-id:date :to:from:dkim-signature:delivered-to:arc-authentication-results; bh=i/SgJAB5TPuoUVkt9NTkTBnrdOrgk/2GAOCBYROfHSI=; b=ZDD2RLvJXMT1K2uun1CHuDHd4Wek+fTF0o48wh5k9PcVty6GP7QGva2V+tj2dI9JmQ SmG1Wf1YBKKKGsNaJvX+5h1rxdqPwTt51xYnGFvCxlDwPrSVXVdLExocGGzRIekkzBpI NHa8TOM+q9zhew49JBE9SffNHmLfv4YA6iIZfPVllpWcISoPzuVXGClxeFoVRllAg5BI zpfGrhNNlN/Z5vTOvTYpx+WiMfjzBq60TGNIXa9MF5GYTnFtdkH+LU/Y8FOrwMRUOP8z Y64UMpWRAacV0tkYYTY6g+T2IWrQV+rIrqrPgocN6mdxoAQ1HRh2saT5e7yyQViRDGbG GXRw== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@jkqxz-net.20150623.gappssmtp.com header.s=20150623 header.b=JEYNSnWC; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id f21si5624152wmd.185.2017.09.10.13.55.09; Sun, 10 Sep 2017 13:55:09 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@jkqxz-net.20150623.gappssmtp.com header.s=20150623 header.b=JEYNSnWC; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 51114689D53; Sun, 10 Sep 2017 23:53:53 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm0-f52.google.com (mail-wm0-f52.google.com [74.125.82.52]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id CFD5F689CF1 for ; Sun, 10 Sep 2017 23:53:50 +0300 (EEST) Received: by mail-wm0-f52.google.com with SMTP id i189so27651756wmf.1 for ; Sun, 10 Sep 2017 13:53:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jkqxz-net.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:in-reply-to:references; bh=QNmgpPieRxYk+D7jFk0eKB3eXcUMqQaEEpOwc7Io6oM=; b=JEYNSnWCABWh0E6MB4vMmtCtJU60VGkMLlrbVSeE4xVIsQ+MEo5soCkM4Ys6WOjl57 l+8xhm/JxQVvv6z9XDofa0VE8D6RyD34fzAnwxRDBsdhLFrc+MRi2Bq+v/bjjVG+QtSW OvpBu1K9PvA9Om3X8uz21O0N2BwXIb78tRKpKvBTgkIBmkrLFCBFm/C75/qULQMK/HnA z0fIybx/yDBhHofEjzcBeUO46F9IETP7x4T4h+/LbHbN/a6X8S/yHWCDkkNVxaPZFEMZ At21NxQkr3lAvswYW5JIPbtAU35AdP7TEF2CnCC/vquWpeGx3afq5jrlez/58MjPYCzQ c/Zw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:in-reply-to :references; bh=QNmgpPieRxYk+D7jFk0eKB3eXcUMqQaEEpOwc7Io6oM=; b=ap0gdNVWlYsztTC6FE5jn0231MrJJvgGDk6IWXfnvvmB92P6AOgwznRJfZah1Yzhd/ bT1n5CUCqwpotolXNWLEZxxih6NTtEulV54lmRqjEeTOoEPuhjeQwfQLfWqXaQmw3S/X RYLzd+ru9Y5h1aCGKZgx+PZ2hN+qfSGh3EILNtrKBLI5Mj8IT6A17I4xVvS/DSyfHQIl uwXfg5FSXqzEUfznPzlWcsafpQ91rm5tpyouuHvR4I0YxQVsmCb2/PlsOANDnFVhxU8l Kvkw3xpSxaYLqgeldkRkWGzislab64ABH15T5KEu1Er7356u9IRXDZm1c3xNoyV6CNIZ wiPA== X-Gm-Message-State: AHPjjUjJF/Qjhrom+9yC5n+QEzGnyxkww3e5joMhurG24ZXeCADbKupe KaHdSrnU6zU9XacOKhQ= X-Google-Smtp-Source: AOwi7QBY1qEXJtFH2Fej0ODw7VYCyOvhk0O9JDXPnUjyCbgtfM/WDR3xdNrW3Ga+N5oVwMqeQXkg8Q== X-Received: by 10.28.217.73 with SMTP id q70mr6190256wmg.9.1505076835091; Sun, 10 Sep 2017 13:53:55 -0700 (PDT) Received: from rywe.jkqxz.net (cpc91242-cmbg18-2-0-cust650.5-4.cable.virginm.net. [82.8.130.139]) by smtp.gmail.com with ESMTPSA id z51sm8742868wrz.80.2017.09.10.13.53.54 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 10 Sep 2017 13:53:54 -0700 (PDT) From: Mark Thompson To: ffmpeg-devel@ffmpeg.org Date: Sun, 10 Sep 2017 21:53:33 +0100 Message-Id: <20170910205338.29687-10-sw@jkqxz.net> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20170910205338.29687-1-sw@jkqxz.net> References: <20170910205338.29687-1-sw@jkqxz.net> Subject: [FFmpeg-devel] [PATCH 09/14] lavfi: Add some common code for OpenCL filtering X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" --- Just some setup code (making output frames and compiling shaders) which will be needed in every filter. libavfilter/opencl.c | 244 +++++++++++++++++++++++++++++++++++++++++++++++++++ libavfilter/opencl.h | 87 ++++++++++++++++++ 2 files changed, 331 insertions(+) create mode 100644 libavfilter/opencl.c create mode 100644 libavfilter/opencl.h diff --git a/libavfilter/opencl.c b/libavfilter/opencl.c new file mode 100644 index 0000000000..824a6b15ed --- /dev/null +++ b/libavfilter/opencl.c @@ -0,0 +1,244 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include +#include + +#include "libavutil/hwcontext.h" +#include "libavutil/hwcontext_opencl.h" +#include "libavutil/mem.h" + +#include "avfilter.h" +#include "formats.h" +#include "opencl.h" + +int ff_opencl_filter_query_formats(AVFilterContext *avctx) +{ + const static enum AVPixelFormat pix_fmts[] = { + AV_PIX_FMT_OPENCL, + AV_PIX_FMT_NONE, + }; + AVFilterFormats *formats; + + formats = ff_make_format_list(pix_fmts); + if (!formats) + return AVERROR(ENOMEM); + + ff_set_common_formats(avctx, formats); + + return 0; +} + +int ff_opencl_filter_config_input(AVFilterLink *inlink) +{ + AVFilterContext *avctx = inlink->dst; + OpenCLFilterContext *ctx = avctx->priv; + AVHWFramesContext *input_frames; + + if (!inlink->hw_frames_ctx) { + av_log(avctx, AV_LOG_ERROR, "OpenCL filtering requires a " + "hardware frames context on the input.\n"); + return AVERROR(EINVAL); + } + + // Extract the device and default output format from the first input. + if (avctx->inputs[0] != inlink) + return 0; + + input_frames = (AVHWFramesContext*)inlink->hw_frames_ctx->data; + + if (input_frames->format != AV_PIX_FMT_OPENCL) + return AVERROR(EINVAL); + + ctx->device_ref = av_buffer_ref(input_frames->device_ref); + if (!ctx->device_ref) + return AVERROR(ENOMEM); + ctx->device = input_frames->device_ctx; + ctx->hwctx = ctx->device->hwctx; + + // Default output parameters match input parameters. + if (ctx->output_format == AV_PIX_FMT_NONE) + ctx->output_format = input_frames->sw_format; + if (!ctx->output_width) + ctx->output_width = inlink->w; + if (!ctx->output_height) + ctx->output_height = inlink->h; + + return 0; +} + +int ff_opencl_filter_config_output(AVFilterLink *outlink) +{ + AVFilterContext *avctx = outlink->src; + OpenCLFilterContext *ctx = avctx->priv; + AVBufferRef *output_frames_ref = NULL; + AVHWFramesContext *output_frames; + int err; + + av_buffer_unref(&outlink->hw_frames_ctx); + + output_frames_ref = av_hwframe_ctx_alloc(ctx->device_ref); + if (!output_frames_ref) { + err = AVERROR(ENOMEM); + goto fail; + } + output_frames = (AVHWFramesContext*)output_frames_ref->data; + + output_frames->format = AV_PIX_FMT_OPENCL; + output_frames->sw_format = ctx->output_format; + output_frames->width = ctx->output_width; + output_frames->height = ctx->output_height; + + err = av_hwframe_ctx_init(output_frames_ref); + if (err < 0) { + av_log(avctx, AV_LOG_ERROR, "Failed to initialise output " + "frames: %d.\n", err); + goto fail; + } + + outlink->hw_frames_ctx = output_frames_ref; + outlink->w = ctx->output_width; + outlink->h = ctx->output_height; + + return 0; +fail: + av_buffer_unref(&output_frames_ref); + return err; +} + +int ff_opencl_filter_init(AVFilterContext *avctx) +{ + OpenCLFilterContext *ctx = avctx->priv; + + ctx->output_format = AV_PIX_FMT_NONE; + + return 0; +} + +void ff_opencl_filter_uninit(AVFilterContext *avctx) +{ + OpenCLFilterContext *ctx = avctx->priv; + cl_int cle; + + if (ctx->program) { + cle = clReleaseProgram(ctx->program); + if (cle != CL_SUCCESS) + av_log(avctx, AV_LOG_ERROR, "Failed to release " + "program: %d.\n", cle); + } + + av_buffer_unref(&ctx->device_ref); +} + +static int opencl_filter_load_program(AVFilterContext *avctx, + const char **program_source_array, + int nb_strings) +{ + OpenCLFilterContext *ctx = avctx->priv; + cl_int cle; + + ctx->program = clCreateProgramWithSource(ctx->hwctx->context, nb_strings, + program_source_array, + NULL, &cle); + if (!ctx->program) { + av_log(avctx, AV_LOG_ERROR, "Failed to create program: %d.\n", cle); + return AVERROR(EIO); + } + + cle = clBuildProgram(ctx->program, 1, &ctx->hwctx->device_id, + NULL, NULL, NULL); + if (cle != CL_SUCCESS) { + av_log(avctx, AV_LOG_ERROR, "Failed to build program: %d.\n", cle); + + if (cle == CL_BUILD_PROGRAM_FAILURE) { + char *log; + size_t log_length; + + clGetProgramBuildInfo(ctx->program, ctx->hwctx->device_id, + CL_PROGRAM_BUILD_LOG, 0, NULL, &log_length); + + log = av_malloc(log_length); + if (log) { + cle = clGetProgramBuildInfo(ctx->program, + ctx->hwctx->device_id, + CL_PROGRAM_BUILD_LOG, + log_length, log, NULL); + if (cle == CL_SUCCESS) + av_log(avctx, AV_LOG_ERROR, "Build log:\n%s\n", log); + } + + av_free(log); + } + + clReleaseProgram(ctx->program); + return AVERROR(EIO); + } + + return 0; +} + +int ff_opencl_filter_load_program(AVFilterContext *avctx, + const char **program_source_array, + int nb_strings) +{ + return opencl_filter_load_program(avctx, program_source_array, + nb_strings); +} + +int ff_opencl_filter_load_program_from_file(AVFilterContext *avctx, + const char *filename) +{ + FILE *file; + char *src = NULL; + size_t pos, len, rb; + const char *src_const; + int err; + + file = fopen(filename, "r"); + if (!file) { + av_log(avctx, AV_LOG_ERROR, "Unable to open program " + "source file \"%s\".\n", filename); + return AVERROR(ENOENT); + } + + len = 1 << 16; + pos = 0; + while (1) { + err = av_reallocp(&src, len); + if (err < 0) + goto fail; + rb = fread(src + pos, 1, len - pos - 1, file); + if (rb == 0 && ferror(file)) { + err = AVERROR(EIO); + goto fail; + } + pos += rb; + if (pos < len) + break; + len <<= 1; + } + src[pos] = 0; + + src_const = src; + + err = opencl_filter_load_program(avctx, &src_const, 1); +fail: + fclose(file); + av_freep(&src); + return err; +} diff --git a/libavfilter/opencl.h b/libavfilter/opencl.h new file mode 100644 index 0000000000..4d740c18ab --- /dev/null +++ b/libavfilter/opencl.h @@ -0,0 +1,87 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#ifndef AVFILTER_OPENCL_H +#define AVFILTER_OPENCL_H + +#include "libavutil/buffer.h" +#include "libavutil/hwcontext.h" +#include "libavutil/hwcontext_opencl.h" +#include "libavutil/pixfmt.h" + +#include "avfilter.h" + +typedef struct OpenCLFilterContext { + const AVClass *class; + + AVBufferRef *device_ref; + AVHWDeviceContext *device; + AVOpenCLDeviceContext *hwctx; + + cl_program program; + + enum AVPixelFormat output_format; + int output_width; + int output_height; +} OpenCLFilterContext; + +/** + * Return that all inputs and outputs support only AV_PIX_FMT_OPENCL. + */ +int ff_opencl_filter_query_formats(AVFilterContext *avctx); + +/** + * Check that the input link contains a suitable hardware frames + * context and extract the device from it. + */ +int ff_opencl_filter_config_input(AVFilterLink *inlink); + +/** + * Create a suitable hardware frames context for the output. + */ +int ff_opencl_filter_config_output(AVFilterLink *outlink); + +/** + * Initialise an OpenCL filter context. + */ +int ff_opencl_filter_init(AVFilterContext *avctx); + +/** + * Uninitialise an OpenCL filter context. + */ +void ff_opencl_filter_uninit(AVFilterContext *avctx); + +/** + * Load a new OpenCL program from strings in memory. + * + * Creates a new program and compiles it for the current device. + * Will log any build errors if compilation fails. + */ +int ff_opencl_filter_load_program(AVFilterContext *avctx, + const char **program_source_array, + int nb_strings); + +/** + * Load a new OpenCL program from a file. + * + * Same as ff_opencl_filter_load_program(), but from a file. + */ +int ff_opencl_filter_load_program_from_file(AVFilterContext *avctx, + const char *filename); + +#endif /* AVFILTER_OPENCL_H */