From patchwork Fri Jan 28 02:29:09 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Christopher Snowhill X-Patchwork-Id: 33890 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6602:2c4e:0:0:0:0 with SMTP id x14csp42531iov; Thu, 27 Jan 2022 18:29:24 -0800 (PST) X-Google-Smtp-Source: ABdhPJxi99AO84by/2MaBSIiqzHT1d/JUiL/FjRK5CAn23Plm0rKi54AGgtoxYwA/pr7fiZVmU8E X-Received: by 2002:a17:907:97c7:: with SMTP id js7mr4923992ejc.367.1643336963794; Thu, 27 Jan 2022 18:29:23 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1643336963; cv=none; d=google.com; s=arc-20160816; b=v1+ZiC6K9RJgpvF+Ej4iiHIKK4DTg2nISEqqL5uGD/sQUDJPmhhV5sgc+zGMsKWo+F 2IuLKu+dfvgXNVsEP3ubI8VlEfGIli3gO73rzWpHQPiJ0Fa+H/ceHmHhCX7k/u7F14pv lRVGgEVysPdAwkP5l+xCw5lSO1mg1MQgIJZjKJNiSTXuVlZOo0PYwblhl0gMcufasuN0 S8TXcCbwTShodeG6Y8JrcE8MB3NkO/PgK95MaBaurepkC4I+YFSoRX+0yTa1y3e46maQ eGfxrKkOSQbHtlV1ztcM7zemostHYKrDD0UCHpxDHtLGuhyyFYYdho4xZmGmD5ieexKN MeQA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:reply-to:list-subscribe :list-help:list-post:list-archive:list-unsubscribe:list-id :precedence:subject:content-disposition:mime-version:message-id:to :from:date:dkim-signature:delivered-to; bh=4IelA3v5j+nser/E6ab8P5a/lUTEs9KEjc2JPFsDEbc=; b=N9lkGO8Y5Z3C8vsEh+k3qOcxfMqxZTgacwYHTr4ZW0hrjsdZCGRJZ23oCe6LP1Qhd4 Fs6RuXrvAj58GI1wfcGH64aAyxZzmV7zPyftlpEcFNtHpSJyUEqSKj+AEpZOb3aywr3a rKFUoK90Kv6l73E/1V66b3QpZ8VyQeP24auRphOgRbUN0mT0jlu6RpY8qsgq9/XypuJP SqJvz1v1mP56He1GHZ6AWhqZPWEDXdnfCPShjzsKF/oxpcQO1+38g4Rv/whbem5vyMU8 lKS5HxAk41ol7Z8xGgzP8/ZB65OP64ZtmvMHc43M6H/VxEWXj0/pKF4SzgmTKMrbx/Lw xEHA== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=nrdlM00Q; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id v27si2187209ejk.579.2022.01.27.18.29.23; Thu, 27 Jan 2022 18:29:23 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=nrdlM00Q; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id A195D68B208; Fri, 28 Jan 2022 04:29:19 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-pf1-f177.google.com (mail-pf1-f177.google.com [209.85.210.177]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 3654668B06C for ; Fri, 28 Jan 2022 04:29:13 +0200 (EET) Received: by mail-pf1-f177.google.com with SMTP id i186so2299548pfe.0 for ; Thu, 27 Jan 2022 18:29:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=date:from:to:message-id:subject:mime-version; bh=Gg4CCDBibFpoGl4f4LPsYwDIzLz9mI4isLUotySNwjw=; b=nrdlM00QAHNGpiAd7vc5N3cFaZSOPrV8HfkpmaZQYSzWsOejtU4lY3r+0i7dbLRElS UNAiAjijM1jB52DodAicd1VXrV5Krq4ZbCu7cycrd9HX44U4B7z8EmA4pp7KPuV9ZWAl neuC97gw48jjDLILJNJb6tLSEMPxyyYXyMP8Q+IXtPAh8UKGA92+FUopXzdXdp/bTMSC PxRv4m+7j2RZ0gpzTBSf763oaKt2ACRkMGtxw3SChTh6j+PQ/0qKpQpM0P0xBqi2CCCV 3HXliXo1pTecJHD49TEEYRwX9auCTdiP6ibXK1016ogiZgpOc6+oSvFlr5hh7jS9+GOM EKqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:message-id:subject:mime-version; bh=Gg4CCDBibFpoGl4f4LPsYwDIzLz9mI4isLUotySNwjw=; b=tthB9mMNf+kQr3rcYBLB8HxSCrQpiL7HMuWfNhaYQ+94YO7/95fEELa1Kbe91Ilnxj 3fAXndtXPQPnqHc2g0e1bPP7HBZGkN05hMrNoqK0LtN5EaLsjffo9Gn22vovAJyaBvoW Ut77L9k2OUBZe7BKkWTaRNe0wmqprx9Ek4AJjDqNn7LT0cCO7LjwmxUrIER3q7ONIW3I VeSPRVvZZIymQutVhebq0Hg3BZm5hi5WTOGah/qo46zV2/2dFzu7+DdNLXsaeuerVkRA AyLsNNe+LpiQJj9r1gdgwtZ2P5NAKzatSEofFEP44Ei0SJRf9CxQPIb6sWDfKtXW8jiq Pm+A== X-Gm-Message-State: AOAM5320um9lPFrlHW6Jd5ijH+PG04CIYeX39ZgaXK/Tv4Tmh+TSO6JT s13Wr0LLjLDcC+U6abBwkg/+G1hNWarTRA== X-Received: by 2002:a63:804a:: with SMTP id j71mr4836501pgd.252.1643336950751; Thu, 27 Jan 2022 18:29:10 -0800 (PST) Received: from [2600:6c51:4c3f:8ead:100::] ([2600:6c51:4c3f:8ead:58c9:5b59:3706:8f0c]) by smtp.gmail.com with ESMTPSA id lb3sm569377pjb.47.2022.01.27.18.29.09 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 27 Jan 2022 18:29:10 -0800 (PST) Date: Thu, 27 Jan 2022 18:29:09 -0800 From: Christopher Snowhill To: ffmpeg-devel@ffmpeg.org Message-ID: MIME-Version: 1.0 Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: [FFmpeg-devel] [PATCH] avformat/mp3dec: Parse iTunes gapless info X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: HJt9hIjMVV1A Parse the ID3v2 iTunSMPB comment tag containing gapless decoding info, and also add the expected test results for the implementation. Signed-off-by: Christopher Snowhill --- libavformat/mp3dec.c | 86 ++++++++++++++++++++++++++++++- tests/fate/gapless.mak | 3 ++ tests/ref/fate/gapless-mp3-itunes | 5 ++ 3 files changed, 93 insertions(+), 1 deletion(-) create mode 100644 tests/ref/fate/gapless-mp3-itunes -- 2.34.1 diff --git a/libavformat/mp3dec.c b/libavformat/mp3dec.c index f617348b2e..d03174db03 100644 --- a/libavformat/mp3dec.c +++ b/libavformat/mp3dec.c @@ -313,6 +313,75 @@ static void mp3_parse_vbri_tag(AVFormatContext *s, AVStream *st, int64_t base) } } +static void mp3_parse_itunes_tag(AVFormatContext *s, AVStream *st, MPADecodeHeader *c, int64_t base, int vbrtag_size, unsigned int *size, uint64_t *duration, uint32_t spf) +{ + uint32_t v; + AVDictionaryEntry *de; + FFStream *const sti = ffstream(st); + MP3DecContext *mp3 = s->priv_data; + size_t length; + uint32_t zero, start_pad, end_pad; + uint64_t last_eight_frames_offset; + int64_t temp_duration, file_size; + int i; + + if (!s->metadata || !(de = av_dict_get(s->metadata, "iTunSMPB", NULL, 0))) + return; + + length = strlen(de->value); + + /* Minimum length is one digit per field plus the whitespace, maximum length should depend on field type + * There are four fields we need in the first six, the rest are currently zero padding */ + if (length < (12 + 11) || length > (10 * 8 + 2 * 16 + 11)) + return; + + file_size = avio_size(s->pb); + if (file_size < 0) + file_size = 0; + + if (sscanf(de->value, "%"PRIx32" %"PRIx32" %"PRIx32" %"PRIx64" %"PRIx32" %"PRIx64, &zero, &start_pad, &end_pad, &temp_duration, &zero, &last_eight_frames_offset) < 6 || + temp_duration < 0 || + start_pad > (576 * 2 * 32) || + end_pad > (576 * 2 * 64) || + (file_size && (last_eight_frames_offset >= (file_size - base - vbrtag_size)))) { + *duration = 0; + return; + } + + *duration = temp_duration; + + if (end_pad >= 528 + 1) { + mp3->start_pad = start_pad; + mp3->end_pad = end_pad - (528 + 1); + sti->start_skip_samples = mp3->start_pad + 528 + 1; + if (mp3->frames) { + sti->first_discard_sample = -mp3->end_pad + 528 + 1 + mp3->frames * (int64_t)spf; + sti->last_discard_sample = mp3->frames * (int64_t)spf; + } + if (!st->start_time) + st->start_time = av_rescale_q(sti->start_skip_samples, + (AVRational){1, c->sample_rate}, + st->time_base); + av_log(s, AV_LOG_DEBUG, "pad %d %d\n", mp3->start_pad, mp3-> end_pad); + } + if (!s->pb->seekable) + return; + + *size = (unsigned int) last_eight_frames_offset; + if (avio_seek(s->pb, base + vbrtag_size + last_eight_frames_offset, SEEK_SET) < 0) + return; + + for (i = 0; i < 8; i++) { + v = avio_rb32(s->pb); + if (ff_mpa_check_header(v) < 0) + return; + if (avpriv_mpegaudio_decode_header(c, v) != 0) + break; + *size += c->frame_size; + avio_skip(s->pb, c->frame_size - 4); + } +} + /** * Try to find Xing/Info/VBRI tags and compute duration from info therein */ @@ -321,8 +390,10 @@ static int mp3_parse_vbr_tags(AVFormatContext *s, AVStream *st, int64_t base) uint32_t v, spf; MPADecodeHeader c; int vbrtag_size = 0; + unsigned int size = 0; MP3DecContext *mp3 = s->priv_data; int ret; + uint64_t duration = 0; ffio_init_checksum(s->pb, ff_crcA001_update, 0); @@ -345,16 +416,29 @@ static int mp3_parse_vbr_tags(AVFormatContext *s, AVStream *st, int64_t base) mp3_parse_vbri_tag(s, st, base); if (!mp3->frames && !mp3->header_filesize) + vbrtag_size = 0; + + mp3_parse_itunes_tag(s, st, &c, base, vbrtag_size, &size, &duration, spf); + + if (!mp3->frames && !size && !duration) return -1; /* Skip the vbr tag frame */ avio_seek(s->pb, base + vbrtag_size, SEEK_SET); - if (mp3->frames) + if (duration) + st->duration = av_rescale_q(duration, (AVRational){1, c.sample_rate}, st->time_base); + else if (mp3->frames) st->duration = av_rescale_q(mp3->frames, (AVRational){spf, c.sample_rate}, st->time_base); if (mp3->header_filesize && mp3->frames && !mp3->is_cbr) st->codecpar->bit_rate = av_rescale(mp3->header_filesize, 8 * c.sample_rate, mp3->frames * (int64_t)spf); + if (size) { + if (duration) + st->codecpar->bit_rate = av_rescale(size, 8 * c.sample_rate, duration); + else if (mp3->frames) + st->codecpar->bit_rate = av_rescale(size, 8 * c.sample_rate, mp3->frames * (int64_t)spf); + } return 0; } diff --git a/tests/fate/gapless.mak b/tests/fate/gapless.mak index 68a396e187..b8c93b984c 100644 --- a/tests/fate/gapless.mak +++ b/tests/fate/gapless.mak @@ -1,6 +1,9 @@ FATE_GAPLESS-$(CONFIG_MP3_DEMUXER) += fate-gapless-mp3 fate-gapless-mp3: CMD = gapless $(TARGET_SAMPLES)/gapless/gapless.mp3 "-c:a mp3" +FATE_GAPLESS-$(CONFIG_MP3_DEMUXER) += fate-gapless-mp3-itunes +fate-gapless-mp3-itunes: CMD = gapless $(TARGET_SAMPLES)/gapless/gapless-itunes.mp3 "-c:a mp3" + FATE_GAPLESSINFO_PROBE-$(CONFIG_MP3_DEMUXER) += fate-gapless-mp3-side-data fate-gapless-mp3-side-data: CMD = ffprobe_demux $(TARGET_SAMPLES)/gapless/gapless.mp3 diff --git a/tests/ref/fate/gapless-mp3-itunes b/tests/ref/fate/gapless-mp3-itunes new file mode 100644 index 0000000000..f3295e2652 --- /dev/null +++ b/tests/ref/fate/gapless-mp3-itunes @@ -0,0 +1,5 @@ +1e285368a8a176bc729712b06f724f21 *tests/data/fate/gapless-mp3-itunes.out-1 +cde648358dcd59911c4990ed59bf7d40 +4a39c54de9687ea8f66ea8204133c5c0 *tests/data/fate/gapless-mp3-itunes.out-2 +cde648358dcd59911c4990ed59bf7d40 +c8cd71407ac5bbfadf5ccf7b5a64430c *tests/data/fate/gapless-mp3-itunes.out-3