From patchwork Fri Jan 28 05:21:07 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Christopher Snowhill X-Patchwork-Id: 33895 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6602:2c4e:0:0:0:0 with SMTP id x14csp129261iov; Thu, 27 Jan 2022 21:21:55 -0800 (PST) X-Google-Smtp-Source: ABdhPJwShexlDTyIGpps6baNI54uTVYmOY7mhu4EYyLndshV+1C5Adwtz7bWguGnXEvna7du9wYJ X-Received: by 2002:a05:6402:12cf:: with SMTP id k15mr6564468edx.299.1643347315788; Thu, 27 Jan 2022 21:21:55 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1643347315; cv=none; d=google.com; s=arc-20160816; b=k7ZZvGUkk+kh9ihKs4s2Y+az7e55KVSgQA/tDnItnJAskXhmZsnrbxr2Ntngl7rUKI Exn8we/PACpVvSRh2xQWlFKjR5Ig6KjcW7kZMIFCCHo3aof1IFWyFMmtP008cifVM1OR wqa6o6pMe6KItvac+KIadhAAQxJjXcoj8FObze/NXL/GFrCVmZSN8l4nUZH+Welv2Hs8 jgnDmcB2t4uEmo+hdOi8nN/WltGhSV0kcfIMQHUB9fVgZCZsQ8bZtTULssqip7wPZxX5 NucUQDM2s61QfRwrUYdM/w6UtIPCWkEVklAaYJ+5JQ2vYKSHeVvF3GXuTfTLm8nQwvAi mMjA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:mime-version:message-id:date:to:from :dkim-signature:delivered-to; bh=7buOtHIIxExcSCdkhp8H77NNUb5DVrEtfATmDEfBns8=; b=DjtR35gb6I79dUuCBJKffdkzVUD6sxB42rlU63xaDL/beQV3Qg/MR8+SlKg8mbelk+ mDS/up2Oyj1xJ7oXeZ38LbdiRqjnnn7PSZikZeonLOdE9bttwCkwuLCq0TGQ6Z2Cc6V2 Hhwyzwz/yFFKkHs2t7W7SNxyFfOQky2dS6b5J5PTZO5xG606z6DbBIm3HnVDj2iFN7tk zXg0oz+Lo/b2raL924eVZdBiCjnh22dvhULn0Ji2n/UZT68wbC/Wo3GPgZDSOinTLJvX oE4zXifsIPaDVbmKnPDe7nboxH0itNjMPjHuss2Y9AykP23dNSUUjbxINMWzmL5Z8W/g l1+w== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=m5Z+E5ev; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id 4si2278847ejr.136.2022.01.27.21.21.25; Thu, 27 Jan 2022 21:21:55 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=m5Z+E5ev; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 592D968B241; Fri, 28 Jan 2022 07:21:23 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-pl1-f173.google.com (mail-pl1-f173.google.com [209.85.214.173]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id B23AA68B203 for ; Fri, 28 Jan 2022 07:21:16 +0200 (EET) Received: by mail-pl1-f173.google.com with SMTP id z5so4862459plg.8 for ; Thu, 27 Jan 2022 21:21:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=2XxuoQPC0Z+jLh/qOfvPTtNj/FhZiwCUIL6liPgIdLE=; b=m5Z+E5evA4xbWvVb37IbktBfpjdCa0wSq7mEHoCMr8/f4XhxYcosSeO8dz1MdDU+kd jq5vGIGVsYhPpFCNdNSWyrdil05fZ8OxJrb5N5+8RIs6nBIO6COoZnW7jcChshSXoEsi 4nBXIR4+sp9DuiYr4Bl0Zo8Pp5to56iDQvgEzicht3/+wGgzl0MqCaG3gYWr4gYaYbl5 Gc84KYTlKnTSMVD1RzryzFZ8ATqcSxZbT9/6xquSKu6lNkFQbKjn9s6JCGAjF6P0bJCc zNd4N9G8TtxtxVuzj0Oa/o02B9z3vQQly7w/j7yfzdXHrOzvaDALq4t4ZzyApa6XI2US JsHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=2XxuoQPC0Z+jLh/qOfvPTtNj/FhZiwCUIL6liPgIdLE=; b=q5E74hoB21l9SHy8E48VSVViDfY4r/pKB1pysVqbpbNNs37SR7q+N7gmTDXOADJ2Qv T2fBt0cfKA+6BLgB0E4si/F7l5deSdRbwKcUFXrLn+ZCOPNjFzgFHNIeXjf4POjFDAGx HW80wvkDidmj98rJqWcrcEhU5Wf0KXRaEt0WwCLvnIzE6u1djdnxP78vDnaRVmQAwe+F hroeN+RHtSicCnFkxLQXATnonYSIvoOvz/RF73+x4R/tDmq6v7Tne9kH2kD80Dv8pXyP nzJmR6WXk8K6mP4w/BJNjFM/DPkTxakbPX1oONfptlM38ICijl5YNFPVcidyL+sWCc0f UNcA== X-Gm-Message-State: AOAM533xoxZ5IuS1H4gTu0lZ+xG/FJqgniw59rJhkMSPN0lD1gQ4MsMS tc8M6TVrzo2T6suJtqVvGNDEkByXErVEWQ== X-Received: by 2002:a17:902:8d91:: with SMTP id v17mr6834768plo.154.1643347274212; Thu, 27 Jan 2022 21:21:14 -0800 (PST) Received: from umaro.tuatara-tone.ts.net ([2600:6c51:4c3f:8ead:21f:d0ff:fed4:3eae]) by smtp.gmail.com with ESMTPSA id b6sm7638577pfl.126.2022.01.27.21.21.13 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 27 Jan 2022 21:21:13 -0800 (PST) From: Christopher Snowhill To: ffmpeg-devel@ffmpeg.org Date: Thu, 27 Jan 2022 21:21:07 -0800 Message-Id: <20220128052107.1678032-1-kode54@gmail.com> X-Mailer: git-send-email 2.35.0 MIME-Version: 1.0 X-Unsent: 1 Subject: [FFmpeg-devel] [PATCH] avformat/mp3dec: Parse iTunes gapless info X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Christopher Snowhill Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: sIGmBnxe3CdO Parse the ID3v2 iTunSMPB comment tag containing gapless decoding info, and also add the expected test results for the implementation. Signed-off-by: Christopher Snowhill --- Curses, Apple Mail is broken, too. Using git imap-send instead. libavformat/mp3dec.c | 86 ++++++++++++++++++++++++++++++- tests/fate/gapless.mak | 3 ++ tests/ref/fate/gapless-mp3-itunes | 5 ++ 3 files changed, 93 insertions(+), 1 deletion(-) create mode 100644 tests/ref/fate/gapless-mp3-itunes diff --git a/libavformat/mp3dec.c b/libavformat/mp3dec.c index f617348b2e..d03174db03 100644 --- a/libavformat/mp3dec.c +++ b/libavformat/mp3dec.c @@ -313,6 +313,75 @@ static void mp3_parse_vbri_tag(AVFormatContext *s, AVStream *st, int64_t base) } } +static void mp3_parse_itunes_tag(AVFormatContext *s, AVStream *st, MPADecodeHeader *c, int64_t base, int vbrtag_size, unsigned int *size, uint64_t *duration, uint32_t spf) +{ + uint32_t v; + AVDictionaryEntry *de; + FFStream *const sti = ffstream(st); + MP3DecContext *mp3 = s->priv_data; + size_t length; + uint32_t zero, start_pad, end_pad; + uint64_t last_eight_frames_offset; + int64_t temp_duration, file_size; + int i; + + if (!s->metadata || !(de = av_dict_get(s->metadata, "iTunSMPB", NULL, 0))) + return; + + length = strlen(de->value); + + /* Minimum length is one digit per field plus the whitespace, maximum length should depend on field type + * There are four fields we need in the first six, the rest are currently zero padding */ + if (length < (12 + 11) || length > (10 * 8 + 2 * 16 + 11)) + return; + + file_size = avio_size(s->pb); + if (file_size < 0) + file_size = 0; + + if (sscanf(de->value, "%"PRIx32" %"PRIx32" %"PRIx32" %"PRIx64" %"PRIx32" %"PRIx64, &zero, &start_pad, &end_pad, &temp_duration, &zero, &last_eight_frames_offset) < 6 || + temp_duration < 0 || + start_pad > (576 * 2 * 32) || + end_pad > (576 * 2 * 64) || + (file_size && (last_eight_frames_offset >= (file_size - base - vbrtag_size)))) { + *duration = 0; + return; + } + + *duration = temp_duration; + + if (end_pad >= 528 + 1) { + mp3->start_pad = start_pad; + mp3->end_pad = end_pad - (528 + 1); + sti->start_skip_samples = mp3->start_pad + 528 + 1; + if (mp3->frames) { + sti->first_discard_sample = -mp3->end_pad + 528 + 1 + mp3->frames * (int64_t)spf; + sti->last_discard_sample = mp3->frames * (int64_t)spf; + } + if (!st->start_time) + st->start_time = av_rescale_q(sti->start_skip_samples, + (AVRational){1, c->sample_rate}, + st->time_base); + av_log(s, AV_LOG_DEBUG, "pad %d %d\n", mp3->start_pad, mp3-> end_pad); + } + if (!s->pb->seekable) + return; + + *size = (unsigned int) last_eight_frames_offset; + if (avio_seek(s->pb, base + vbrtag_size + last_eight_frames_offset, SEEK_SET) < 0) + return; + + for (i = 0; i < 8; i++) { + v = avio_rb32(s->pb); + if (ff_mpa_check_header(v) < 0) + return; + if (avpriv_mpegaudio_decode_header(c, v) != 0) + break; + *size += c->frame_size; + avio_skip(s->pb, c->frame_size - 4); + } +} + /** * Try to find Xing/Info/VBRI tags and compute duration from info therein */ @@ -321,8 +390,10 @@ static int mp3_parse_vbr_tags(AVFormatContext *s, AVStream *st, int64_t base) uint32_t v, spf; MPADecodeHeader c; int vbrtag_size = 0; + unsigned int size = 0; MP3DecContext *mp3 = s->priv_data; int ret; + uint64_t duration = 0; ffio_init_checksum(s->pb, ff_crcA001_update, 0); @@ -345,16 +416,29 @@ static int mp3_parse_vbr_tags(AVFormatContext *s, AVStream *st, int64_t base) mp3_parse_vbri_tag(s, st, base); if (!mp3->frames && !mp3->header_filesize) + vbrtag_size = 0; + + mp3_parse_itunes_tag(s, st, &c, base, vbrtag_size, &size, &duration, spf); + + if (!mp3->frames && !size && !duration) return -1; /* Skip the vbr tag frame */ avio_seek(s->pb, base + vbrtag_size, SEEK_SET); - if (mp3->frames) + if (duration) + st->duration = av_rescale_q(duration, (AVRational){1, c.sample_rate}, st->time_base); + else if (mp3->frames) st->duration = av_rescale_q(mp3->frames, (AVRational){spf, c.sample_rate}, st->time_base); if (mp3->header_filesize && mp3->frames && !mp3->is_cbr) st->codecpar->bit_rate = av_rescale(mp3->header_filesize, 8 * c.sample_rate, mp3->frames * (int64_t)spf); + if (size) { + if (duration) + st->codecpar->bit_rate = av_rescale(size, 8 * c.sample_rate, duration); + else if (mp3->frames) + st->codecpar->bit_rate = av_rescale(size, 8 * c.sample_rate, mp3->frames * (int64_t)spf); + } return 0; } diff --git a/tests/fate/gapless.mak b/tests/fate/gapless.mak index 68a396e187..b8c93b984c 100644 --- a/tests/fate/gapless.mak +++ b/tests/fate/gapless.mak @@ -1,6 +1,9 @@ FATE_GAPLESS-$(CONFIG_MP3_DEMUXER) += fate-gapless-mp3 fate-gapless-mp3: CMD = gapless $(TARGET_SAMPLES)/gapless/gapless.mp3 "-c:a mp3" +FATE_GAPLESS-$(CONFIG_MP3_DEMUXER) += fate-gapless-mp3-itunes +fate-gapless-mp3-itunes: CMD = gapless $(TARGET_SAMPLES)/gapless/gapless-itunes.mp3 "-c:a mp3" + FATE_GAPLESSINFO_PROBE-$(CONFIG_MP3_DEMUXER) += fate-gapless-mp3-side-data fate-gapless-mp3-side-data: CMD = ffprobe_demux $(TARGET_SAMPLES)/gapless/gapless.mp3 diff --git a/tests/ref/fate/gapless-mp3-itunes b/tests/ref/fate/gapless-mp3-itunes new file mode 100644 index 0000000000..f3295e2652 --- /dev/null +++ b/tests/ref/fate/gapless-mp3-itunes @@ -0,0 +1,5 @@ +1e285368a8a176bc729712b06f724f21 *tests/data/fate/gapless-mp3-itunes.out-1 +cde648358dcd59911c4990ed59bf7d40 +4a39c54de9687ea8f66ea8204133c5c0 *tests/data/fate/gapless-mp3-itunes.out-2 +cde648358dcd59911c4990ed59bf7d40 +c8cd71407ac5bbfadf5ccf7b5a64430c *tests/data/fate/gapless-mp3-itunes.out-3