From patchwork Sun Oct 8 20:01:43 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Thompson X-Patchwork-Id: 5465 Delivered-To: ffmpegpatchwork@gmail.com Received: by 10.2.161.90 with SMTP id m26csp1905162jah; Sun, 8 Oct 2017 13:03:00 -0700 (PDT) X-Received: by 10.223.136.246 with SMTP id g51mr7014372wrg.226.1507492980764; Sun, 08 Oct 2017 13:03:00 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1507492980; cv=none; d=google.com; s=arc-20160816; b=lezioeWWcidJwbrOKCM079XSQ4JshdyQd92B5+1KTl2XKqmglYP0V9iS+zut5sUZel SE3I2VxkDUNf0F04ixBwbrj0I8qK0EJ2Fuul8gJHPpXsNqdSMLgLqV7HfTpc7QY+yxwX 6KFp5PaWtxzrvFaGoIp4wYO+ezSFeUv3gc4Nt+WvLCJQCB8EyqFIAYEuASTkwQLhgM/B ksCnA9/kB1MMXkyfVxoR9kVmAYRcvXsqxMBMV9zXzvHsK1uAzW2LNqsrnjNHfeBAGX33 fCCJ2oAQLPeMcEHoLWe2b8e+F1Rw5+XD2B+3E37ccJopFchMLnbij3SQmnMEVFQ4Wi4M /QQw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:references:in-reply-to:message-id:date :to:from:dkim-signature:delivered-to:arc-authentication-results; bh=nS+EFoUD5gTWo8B7M8UqlzQMDL/jSuv3PvtT4x41B6I=; b=j3YLF1aP4LlIwBZEHk1UxGbq1oZW/VD4NGwL9E/5EOXXPo5jgwBBaCi0aAXoMMRBHv o2SScKA2y5dl/OmrTeK7703a1syDjHYoIR5wUcCvCevGhyHd5IsJt7sUBnY+hXV90iF1 kLf330A2G7l420Q03SRbLyotG2xCX7ghr1lm83BNxWN62zACDneMCfZayUBgQO+w59Xy 7wlxRBrTFWVeUZawaXanFOco1H34/3ttT3Z+qODj+uqWUqDVkJ+54L76WRBbC/Z25OL/ nmyJH0JSUKPFWy3z2tK+kbwj8CCqwaBe6L/yk2Z6wUgpG5fVFm/rPduYRsXZuZzNoDGW UJNQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@jkqxz-net.20150623.gappssmtp.com header.s=20150623 header.b=buAN2N6Y; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id 7si5478297wro.169.2017.10.08.13.03.00; Sun, 08 Oct 2017 13:03:00 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@jkqxz-net.20150623.gappssmtp.com header.s=20150623 header.b=buAN2N6Y; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 09BA2689DAC; Sun, 8 Oct 2017 23:02:08 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm0-f52.google.com (mail-wm0-f52.google.com [74.125.82.52]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 543CB689D93 for ; Sun, 8 Oct 2017 23:02:06 +0300 (EEST) Received: by mail-wm0-f52.google.com with SMTP id b189so17613649wmd.4 for ; Sun, 08 Oct 2017 13:02:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jkqxz-net.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:in-reply-to:references; bh=fm+mUBcR3yWWkH4yMubh238QYigdzoAV1VtGnnyF6o4=; b=buAN2N6YVbmvFofp80xjLKjFOfsp/nqTSYgXCMwxCZOVwIBMpNRsWiFz71SC0ku8Rg xrVvDlww+6NQyAoouYTWEaJg5YkGb8eTyPDpl4gEBTlMLBRP0ggohP6rO2huRWSm4qS8 DfIzfBeY0alzjlVmktrfcqy6oZHGaCYWNhXAfl92xJqsmxF9rJP7isdzLntNz6tvlRPD Hz6wzA22m76LftSsB44RBAnY6cmvpcaL9KboAVR9PI2VbIVCIbTwIxJ/Cu6594DwM15O X+gFHdn+TDvHXB3rRcSlTTd3yOF01gFza9uZY2K+OHCR8oiyJ6W64bQ+VX3gG2q9xEbt lAYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:in-reply-to :references; bh=fm+mUBcR3yWWkH4yMubh238QYigdzoAV1VtGnnyF6o4=; b=ji5okcjqXu+AgDbU0ciePfrpMvSPuS56Ynbvv1TR5o9kQdZ8OjNM0O/K/rAjxfM6Yz PPDmc/NUuxyBNj66OSb6SOq4FbexK+6alwNKQvYmnHmnfQg9kEvjxTHc3+zDY3m0dbhN LpUCLVgiDaHbctKjR9m33PzSM6P0Nrrsaf+gGnq/y2rnf9fnHUZMkm9lSVzpStktE+Cv qojO2kBTczQi4t6LQX9MdrkZw4Sy1vr+2MpeIiJiMuIWQY3YJsyF005/3/fzF4JshuuC rByw390QKy0J8s5PUpycpWycRLUw/5X3tnPPzhmLaQ09IpQ127mPEovxbbG398BPKfuk mDZw== X-Gm-Message-State: AMCzsaX1nYopLZ1Q6iuv6cuF7Y9AM9YqBP4dBDTD719e2PTPrWtbXyaq 4H1zAFavcz2DEmUjMJo5oK07CKEh X-Google-Smtp-Source: AOwi7QDfHjc5GoPh62tCtaTQk79iKXnOtWfni6gg7VrqWo+4R2gVYYaH7TeQojP1zpnDoecf9uCu8A== X-Received: by 10.223.175.56 with SMTP id z53mr8486995wrc.177.1507492927195; Sun, 08 Oct 2017 13:02:07 -0700 (PDT) Received: from rywe.jkqxz.net (cpc91242-cmbg18-2-0-cust650.5-4.cable.virginm.net. [82.8.130.139]) by smtp.gmail.com with ESMTPSA id x49sm2897856wrb.25.2017.10.08.13.02.06 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 08 Oct 2017 13:02:06 -0700 (PDT) From: Mark Thompson To: ffmpeg-devel@ffmpeg.org Date: Sun, 8 Oct 2017 21:01:43 +0100 Message-Id: <20171008200154.4873-10-sw@jkqxz.net> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20171008200154.4873-1-sw@jkqxz.net> References: <20171008200154.4873-1-sw@jkqxz.net> Subject: [FFmpeg-devel] [PATCH 09/20] lavc: Add h264_redundant_pps bitstream filter X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" This applies a specific fixup to some Bluray streams which contain redundant PPSs modifying irrelevant parameters of the stream which confuse other transformations which require correct extradata. A new single global PPS is created, and all of the redundant PPSs within the stream are removed. (cherry picked from commit e6874bc3af2f09af39b5d91b9c5f9ded67459696) --- configure | 1 + doc/bitstream_filters.texi | 9 ++ libavcodec/Makefile | 1 + libavcodec/bitstream_filters.c | 1 + libavcodec/h264_redundant_pps_bsf.c | 178 ++++++++++++++++++++++++++++++++++++ 5 files changed, 190 insertions(+) create mode 100644 libavcodec/h264_redundant_pps_bsf.c diff --git a/configure b/configure index 93a3e44230..fd2b11611b 100755 --- a/configure +++ b/configure @@ -2906,6 +2906,7 @@ vc1_parser_select="vc1dsp" # bitstream_filters h264_metadata_bsf_select="cbs_h264" +h264_redundant_pps_bsf_select="cbs_h264" mjpeg2jpeg_bsf_select="jpegtables" trace_headers_bsf_select="cbs_h264 cbs_h265 cbs_mpeg2" diff --git a/doc/bitstream_filters.texi b/doc/bitstream_filters.texi index f7dfa1f753..f9d17dc1b1 100644 --- a/doc/bitstream_filters.texi +++ b/doc/bitstream_filters.texi @@ -174,6 +174,15 @@ ffmpeg -i INPUT.mp4 -codec copy -bsf:v h264_mp4toannexb OUTPUT.ts Please note that this filter is auto-inserted for MPEG-TS (muxer @code{mpegts}) and raw H.264 (muxer @code{h264}) output formats. +@section h264_redundant_pps + +This applies a specific fixup to some Bluray streams which contain +redundant PPSs modifying irrelevant parameters of the stream which +confuse other transformations which require correct extradata. + +A new single global PPS is created, and all of the redundant PPSs +within the stream are removed. + @section hevc_mp4toannexb Convert an HEVC/H.265 bitstream from length prefixed mode to start code diff --git a/libavcodec/Makefile b/libavcodec/Makefile index 25ad785dbe..a5b2b17cf3 100644 --- a/libavcodec/Makefile +++ b/libavcodec/Makefile @@ -1017,6 +1017,7 @@ OBJS-$(CONFIG_EXTRACT_EXTRADATA_BSF) += extract_extradata_bsf.o \ h2645_parse.o OBJS-$(CONFIG_H264_METADATA_BSF) += h264_metadata_bsf.o OBJS-$(CONFIG_H264_MP4TOANNEXB_BSF) += h264_mp4toannexb_bsf.o +OBJS-$(CONFIG_H264_REDUNDANT_PPS_BSF) += h264_redundant_pps_bsf.o OBJS-$(CONFIG_HEVC_MP4TOANNEXB_BSF) += hevc_mp4toannexb_bsf.o OBJS-$(CONFIG_IMX_DUMP_HEADER_BSF) += imx_dump_header_bsf.o OBJS-$(CONFIG_MJPEG2JPEG_BSF) += mjpeg2jpeg_bsf.o diff --git a/libavcodec/bitstream_filters.c b/libavcodec/bitstream_filters.c index 0e133b9036..5ab4f14642 100644 --- a/libavcodec/bitstream_filters.c +++ b/libavcodec/bitstream_filters.c @@ -31,6 +31,7 @@ extern const AVBitStreamFilter ff_dca_core_bsf; extern const AVBitStreamFilter ff_extract_extradata_bsf; extern const AVBitStreamFilter ff_h264_metadata_bsf; extern const AVBitStreamFilter ff_h264_mp4toannexb_bsf; +extern const AVBitStreamFilter ff_h264_redundant_pps_bsf; extern const AVBitStreamFilter ff_hevc_mp4toannexb_bsf; extern const AVBitStreamFilter ff_imx_dump_header_bsf; extern const AVBitStreamFilter ff_mjpeg2jpeg_bsf; diff --git a/libavcodec/h264_redundant_pps_bsf.c b/libavcodec/h264_redundant_pps_bsf.c new file mode 100644 index 0000000000..26baca84e3 --- /dev/null +++ b/libavcodec/h264_redundant_pps_bsf.c @@ -0,0 +1,178 @@ +/* + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include + +#include "libavutil/common.h" +#include "libavutil/mem.h" + +#include "bsf.h" +#include "cbs.h" +#include "cbs_h264.h" +#include "h264.h" + + +typedef struct H264RedundantPPSContext { + CodedBitstreamContext *input; + CodedBitstreamContext *output; + + CodedBitstreamFragment access_unit; + + int global_pic_init_qp; + int current_pic_init_qp; +} H264RedundantPPSContext; + + +static int h264_redundant_pps_fixup_pps(H264RedundantPPSContext *ctx, + H264RawPPS *pps) +{ + // Record the current value of pic_init_qp in order to fix up + // following slices, then overwrite with the global value. + ctx->current_pic_init_qp = pps->pic_init_qp_minus26 + 26; + pps->pic_init_qp_minus26 = ctx->global_pic_init_qp - 26; + + // Some PPSs have this set, so it must be set in all of them. + // (Slices which do not use such a PPS on input will still have + // *_weight_l*flag as zero and therefore write equivalently.) + pps->weighted_pred_flag = 1; + + return 0; +} + +static int h264_redundant_pps_fixup_slice(H264RedundantPPSContext *ctx, + H264RawSliceHeader *slice) +{ + int qp; + + qp = ctx->current_pic_init_qp + slice->slice_qp_delta; + slice->slice_qp_delta = qp - ctx->global_pic_init_qp; + + return 0; +} + +static int h264_redundant_pps_filter(AVBSFContext *bsf, AVPacket *out) +{ + H264RedundantPPSContext *ctx = bsf->priv_data; + AVPacket *in; + CodedBitstreamFragment *au = &ctx->access_unit; + int au_has_sps; + int err, i; + + err = ff_bsf_get_packet(bsf, &in); + if (err < 0) + return err; + + err = ff_cbs_read_packet(ctx->input, au, in); + if (err < 0) + return err; + + au_has_sps = 0; + for (i = 0; i < au->nb_units; i++) { + CodedBitstreamUnit *nal = &au->units[i]; + + if (nal->type == H264_NAL_SPS) + au_has_sps = 1; + if (nal->type == H264_NAL_PPS) { + h264_redundant_pps_fixup_pps(ctx, nal->content); + if (!au_has_sps) { + av_log(ctx, AV_LOG_VERBOSE, "Deleting redundant PPS " + "at %"PRId64".\n", in->pts); + ff_cbs_delete_unit(ctx->input, au, i); + } + } + if (nal->type == H264_NAL_SLICE || + nal->type == H264_NAL_IDR_SLICE) { + H264RawSlice *slice = nal->content; + h264_redundant_pps_fixup_slice(ctx, &slice->header); + } + } + + err = ff_cbs_write_packet(ctx->output, out, au); + if (err < 0) + return err; + + ff_cbs_fragment_uninit(ctx->output, au); + + err = av_packet_copy_props(out, in); + if (err < 0) + return err; + + av_packet_free(&in); + + return 0; +} + +static int h264_redundant_pps_init(AVBSFContext *bsf) +{ + H264RedundantPPSContext *ctx = bsf->priv_data; + CodedBitstreamFragment *au = &ctx->access_unit; + int err, i; + + err = ff_cbs_init(&ctx->input, AV_CODEC_ID_H264, bsf); + if (err < 0) + return err; + + err = ff_cbs_init(&ctx->output, AV_CODEC_ID_H264, bsf); + if (err < 0) + return err; + + ctx->global_pic_init_qp = 26; + + if (bsf->par_in->extradata) { + err = ff_cbs_read_extradata(ctx->input, au, bsf->par_in); + if (err < 0) { + av_log(bsf, AV_LOG_ERROR, "Failed to read extradata.\n"); + return err; + } + + for (i = 0; i < au->nb_units; i++) { + if (au->units[i].type == H264_NAL_PPS) + h264_redundant_pps_fixup_pps(ctx, au->units[i].content); + } + + err = ff_cbs_write_extradata(ctx->output, bsf->par_out, au); + if (err < 0) { + av_log(bsf, AV_LOG_ERROR, "Failed to write extradata.\n"); + return err; + } + + ff_cbs_fragment_uninit(ctx->output, au); + } + + return 0; +} + +static void h264_redundant_pps_close(AVBSFContext *bsf) +{ + H264RedundantPPSContext *ctx = bsf->priv_data; + ff_cbs_close(&ctx->input); + ff_cbs_close(&ctx->output); +} + +static const enum AVCodecID h264_redundant_pps_codec_ids[] = { + AV_CODEC_ID_H264, AV_CODEC_ID_NONE, +}; + +const AVBitStreamFilter ff_h264_redundant_pps_bsf = { + .name = "h264_redundant_pps", + .priv_data_size = sizeof(H264RedundantPPSContext), + .init = &h264_redundant_pps_init, + .close = &h264_redundant_pps_close, + .filter = &h264_redundant_pps_filter, + .codec_ids = h264_redundant_pps_codec_ids, +};