From patchwork Thu Apr 25 14:23:29 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Derek Buitenhuis X-Patchwork-Id: 48258 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a21:2d06:b0:1a9:af23:56c1 with SMTP id tw6csp1418352pzb; Thu, 25 Apr 2024 07:24:02 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCXBnnZRjUr9HAhFfF4Wuw9xXWWoqRliemtlCqFJPUmLul0RBJXBopTDqujYbwyLI4AAoc/gnJa89XWpWtrrkgel6ykYb+TRLgivUg== X-Google-Smtp-Source: AGHT+IGkJcMwBDQd4C2lJ+LTFGJv1FkufJao2AUrxYHDFg5pNCp/SjXth3jV4o7vuAOttq5diSYP X-Received: by 2002:a05:6402:22cd:b0:572:4b64:918c with SMTP id dm13-20020a05640222cd00b005724b64918cmr508916edb.1.1714055041942; Thu, 25 Apr 2024 07:24:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1714055041; cv=none; d=google.com; s=arc-20160816; b=DpCrJxEFkJPzGJ02zZQ4TiyNfW3uI6z8oc3vVI2h+XG6JP8MBk4cex8nfIscLxaUhH AkjsiovBh0ReojgxXM0dvsm/ApwLJ1QDSYQHGLqm4kjUi4ePEUIyTxFxOi4WBK4J3hM5 D0GyGMkg5Tcj1FrdgXTUG/mdiKi/YsISh9PMbZbq/cldsuArqTXcx+Rr3KA+q7h9rDeO R8EBx30cNjH+LrMlVIXDEMsscwG1FhN4LDcefHTls4Psuj7M5+CjE5Z8kKagWpFYxCFe h0k0liJYCG2oSUBxBre4P2W2C3jlnnF2kD3orbqBpOzBjefOu81XwtugTwxrXKpMLS4w NhKA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:reply-to:list-subscribe :list-help:list-post:list-archive:list-unsubscribe:list-id :precedence:subject:mime-version:references:in-reply-to:message-id :date:to:from:dkim-signature:delivered-to; bh=44D68o2dqDf4QP4DQedv9a/bRC+o5vjW3c/pu1O7EgU=; fh=YOA8vD9MJZuwZ71F/05pj6KdCjf6jQRmzLS+CATXUQk=; b=RzJYPF0Cnd2yMToJ625VsIGbfkfu2g5FBvlBeNWkgej/UUfNQCHNVRfEYhPkNR5xpT etaE5nZevyJF7VxekiF9JYZao/p50ewmIKJw/kQw+toLDXpd4kn0geZsozoRdTspG3iJ 3Ekk29GOLPuePs9/FI6Lfd9249FlnjtSt2lZJ4yd0GouKmKcICvk/XIJ+D0Fx/RYNZS8 dMJHHXpQn51WEf1HjMgYXe8BsN5fxNJ5IyyZfXcobLe8DrHfrE6BulzJ3JvkVsYB33rd VBue3ijORQ3bbvo6ad0wRJqdor9jRRSDHVKXSmETAm48D8LkBGTCurTRK38OH9b32fUg 2zHQ==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20230601 header.b=nGcamYnq; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id v1-20020a509541000000b00571e26e1552si8069764eda.33.2024.04.25.07.24.01; Thu, 25 Apr 2024 07:24:01 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20230601 header.b=nGcamYnq; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id CD97168D366; Thu, 25 Apr 2024 17:23:50 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 0134568CD6B for ; Thu, 25 Apr 2024 17:23:43 +0300 (EEST) Received: by mail-wm1-f52.google.com with SMTP id 5b1f17b1804b1-41b51ee24f9so3511445e9.1 for ; Thu, 25 Apr 2024 07:23:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1714055022; x=1714659822; darn=ffmpeg.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=eaOag0BmhQ1HXj5JcI3JvsdcEBCJp2i5uSJb0z9CKkw=; b=nGcamYnq9T43+P2986i19MQVZdnKQGXpYJ5qGAl9UiYYMhNbKOi2W3H+9E2oG23D2t 1ZuhXU4YKRB3wzR6dkpR+eNBiXWhoUpo0Z4LN4BH8AB594fNJDjff5OVhjrD36LcGMEg j9ME1utT50dlx+5fIn1CserfUUEgjkM47VU2psljlhu6fDcshmiTCxMMjWcs7sMaDqNU ozkvQmTKFNI6qszJOgfmjnwPh3RjeClQzf/UwIHUoapixyLeA92oDB2GQn0Yejd0oSXl SRO16l9lBhYmOd1gjYu8ZcuGyUWsJfYwbJOVCiAoJVA6ybNsuo3EwTHZOndFitJQh8NG 4aGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1714055022; x=1714659822; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=eaOag0BmhQ1HXj5JcI3JvsdcEBCJp2i5uSJb0z9CKkw=; b=kOAsaihnOh/u+J1J5NPZSR+AG/TJXv5+974uuBTjv1z5UZmUJmU4rTNLSFX5BmOEyO wAfodExA/k6OX8ILvSsczYB2JpqEhI7C0MdYo5W0W+lTaXPIc6PKlmvEZe/g/h+Eux/O biwLadFROpF32cTXm6Hwn/bk+N1QfCVq0tq6woZPqlhnvoLz8pVpgT7zVgqIp9y2dUsP DmqkZnVHHkijhzOaxxvJcf3xJHuPiohZz5mMYumvOWSGZm2U2iikX3zM4SCRFcP9L24F D4xMwVls/Ey+A8q89/6Eb+3nV6ceq1GQwSE+9l9y7cyeLn8JrIObAUiuXWxLHBSclLso mt1A== X-Gm-Message-State: AOJu0Yy0JydhNM5pCaWtFLijVpFN7lpXlXuCC9rsedDxzfkuZYvc1Ace 90pC9nBj3dkHmjRKx+fiPTNIJ2JyVeZddcPo+60INXBvpEcBQ3lHgIuLsA== X-Received: by 2002:a05:600c:1906:b0:418:9bd6:be2c with SMTP id j6-20020a05600c190600b004189bd6be2cmr2406831wmq.2.1714055022202; Thu, 25 Apr 2024 07:23:42 -0700 (PDT) Received: from localhost.localdomain (33bf0029.skybroadband.com. [51.191.0.41]) by smtp.gmail.com with ESMTPSA id o12-20020a5d684c000000b0034aa1e534c2sm14582018wrw.96.2024.04.25.07.23.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 25 Apr 2024 07:23:41 -0700 (PDT) From: Derek Buitenhuis To: ffmpeg-devel@ffmpeg.org Date: Thu, 25 Apr 2024 15:23:29 +0100 Message-ID: <20240425142330.288815-2-derek.buitenhuis@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240425142330.288815-1-derek.buitenhuis@gmail.com> References: <20240425142330.288815-1-derek.buitenhuis@gmail.com> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v3 1/2] avformat/http: Rename parse_set_cookie_expiry_time to parse_http_date X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: S8rWDS20DHTa That is what it actually does, and it will be needed for more than the Expiry header soon. Signed-off-by: Derek Buitenhuis --- libavformat/http.c | 38 +++++++++++++++++++------------------- 1 file changed, 19 insertions(+), 19 deletions(-) diff --git a/libavformat/http.c b/libavformat/http.c index eecc4fd357..d324674e97 100644 --- a/libavformat/http.c +++ b/libavformat/http.c @@ -56,7 +56,7 @@ #define MAX_CACHED_REDIRECTS 32 #define HTTP_SINGLE 1 #define HTTP_MUTLI 2 -#define MAX_EXPIRY 19 +#define MAX_DATE_LEN 19 #define WHITESPACES " \n\t\r" typedef enum { LOWER_PROTO, @@ -913,29 +913,29 @@ static int parse_icy(HTTPContext *s, const char *tag, const char *p) return 0; } -static int parse_set_cookie_expiry_time(const char *exp_str, struct tm *buf) +static int parse_http_date(const char *date_str, struct tm *buf) { - char exp_buf[MAX_EXPIRY]; - int i, j, exp_buf_len = MAX_EXPIRY-1; - char *expiry; + char date_buf[MAX_DATE_LEN]; + int i, j, date_buf_len = MAX_DATE_LEN-1; + char *date; // strip off any punctuation or whitespace - for (i = 0, j = 0; exp_str[i] != '\0' && j < exp_buf_len; i++) { - if ((exp_str[i] >= '0' && exp_str[i] <= '9') || - (exp_str[i] >= 'A' && exp_str[i] <= 'Z') || - (exp_str[i] >= 'a' && exp_str[i] <= 'z')) { - exp_buf[j] = exp_str[i]; + for (i = 0, j = 0; date_str[i] != '\0' && j < date_buf_len; i++) { + if ((date_str[i] >= '0' && date_str[i] <= '9') || + (date_str[i] >= 'A' && date_str[i] <= 'Z') || + (date_str[i] >= 'a' && date_str[i] <= 'z')) { + date_buf[j] = date_str[i]; j++; } } - exp_buf[j] = '\0'; - expiry = exp_buf; + date_buf[j] = '\0'; + date = date_buf; // move the string beyond the day of week - while ((*expiry < '0' || *expiry > '9') && *expiry != '\0') - expiry++; + while ((*date < '0' || *date > '9') && *date != '\0') + date++; - return av_small_strptime(expiry, "%d%b%Y%H%M%S", buf) ? 0 : AVERROR(EINVAL); + return av_small_strptime(date, "%d%b%Y%H%M%S", buf) ? 0 : AVERROR(EINVAL); } static int parse_set_cookie(const char *set_cookie, AVDictionary **dict) @@ -995,7 +995,7 @@ static int parse_cookie(HTTPContext *s, const char *p, AVDictionary **cookies) // ensure the cookie is not expired or older than an existing value if ((e = av_dict_get(new_params, "expires", NULL, 0)) && e->value) { struct tm new_tm = {0}; - if (!parse_set_cookie_expiry_time(e->value, &new_tm)) { + if (!parse_http_date(e->value, &new_tm)) { AVDictionaryEntry *e2; // if the cookie has already expired ignore it @@ -1012,7 +1012,7 @@ static int parse_cookie(HTTPContext *s, const char *p, AVDictionary **cookies) e2 = av_dict_get(old_params, "expires", NULL, 0); if (e2 && e2->value) { struct tm old_tm = {0}; - if (!parse_set_cookie_expiry_time(e->value, &old_tm)) { + if (!parse_http_date(e->value, &old_tm)) { if (av_timegm(&new_tm) < av_timegm(&old_tm)) { av_dict_free(&new_params); av_dict_free(&old_params); @@ -1064,7 +1064,7 @@ static void parse_expires(HTTPContext *s, const char *p) { struct tm tm; - if (!parse_set_cookie_expiry_time(p, &tm)) { + if (!parse_http_date(p, &tm)) { s->expires = av_timegm(&tm); } } @@ -1295,7 +1295,7 @@ static int get_cookies(HTTPContext *s, char **cookies, const char *path, // if the cookie has expired, don't add it if ((e = av_dict_get(cookie_params, "expires", NULL, 0)) && e->value) { struct tm tm_buf = {0}; - if (!parse_set_cookie_expiry_time(e->value, &tm_buf)) { + if (!parse_http_date(e->value, &tm_buf)) { if (av_timegm(&tm_buf) < av_gettime() / 1000000) goto skip_cookie; } From patchwork Thu Apr 25 14:23:30 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Derek Buitenhuis X-Patchwork-Id: 48259 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a21:2d06:b0:1a9:af23:56c1 with SMTP id tw6csp1418462pzb; Thu, 25 Apr 2024 07:24:12 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCUrCfudUhbhMq1jQN4dwSpWR2caKz3SRgjSbR+VQsng3u8QGonuMhYY0WrTghJtnDeTTxtZ8w5xKdxTXQQhlhBZXbIfgeChwHfKYQ== X-Google-Smtp-Source: AGHT+IH8WfGXIOM5ErcsXKjPfZV5mh4dmXd4O22h4lkK+GpDrXoLSm4m3LPU2NynNJN9LWLil+Xn X-Received: by 2002:a05:6512:6b:b0:51c:7a01:6ea2 with SMTP id i11-20020a056512006b00b0051c7a016ea2mr598305lfo.6.1714055052541; Thu, 25 Apr 2024 07:24:12 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1714055052; cv=none; d=google.com; s=arc-20160816; b=mSzil1sWEGFJzQp+iy34KPvw/TJS+CGwuOsB8PwQwkRmPHtPLBtemUcJFuZu9VCc/O oL1lZh3QgiSinAbpHFOitaDL393O9M5khDSLmvVOWCteU67R+wdDEFDRwluZUMO3iIe8 cjnCDMHO8ASMrBexc12irsjrQ6zp0QJtpMYmLYzkF0RLvhSMweiGbzJwTn3WCJZGDR50 i6ySmuFs4qsPzvth6b90h1NGda2msyGWnZPL72J4qXlrSb0TJVYYGPK/+HYqtmwQw3lZ FtE+cSOkwaUawd78wi/dFjN72C4qaVPIQZRW6r+3DYoDPwIJX7/2yKZ4oPMrqk0mZL1P LRHA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:reply-to:list-subscribe :list-help:list-post:list-archive:list-unsubscribe:list-id :precedence:subject:mime-version:references:in-reply-to:message-id :date:to:from:dkim-signature:delivered-to; bh=rQIgFwhAOjZw3mHHe7SrQ+d1IBE896wv9A2wRPy9dws=; fh=YOA8vD9MJZuwZ71F/05pj6KdCjf6jQRmzLS+CATXUQk=; b=ancSbl38bVF1Mzf2+XFoPZvd9KeNYriJ8vVBqiM9/0z4qm/jXroFzCa2SlbRE1fC14 3AfdQ0yFyOkBf9ateIDHn7dA2auoZURKIV+zgFNOmSSQay995wP/vlLSAgkcgprO7RIb 2iRiusNDp1+kosvYNC21Qh6BUnsCBQ4KAX2rOw9hEZIUGUsVN2PlPuzHW/FDx4EFb6f5 5ocwsHshQWqQNS8zrE+YZCp+OePppMfEfqRBwnVvEd4rzQTpPXQpmxuZzo5VcjVgQuz+ pB9sYu5tCYuyRoMxW+TvsSQl0s7IgoFTTrZezLe7ERZ0JDGqOQfApHQDQGKoS7VPcgDj CmCw==; dara=google.com ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20230601 header.b=mcHrt5n4; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id d15-20020a05651233cf00b00516ce08e5bfsi5781506lfg.21.2024.04.25.07.24.12; Thu, 25 Apr 2024 07:24:12 -0700 (PDT) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20230601 header.b=mcHrt5n4; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 060C368D3EE; Thu, 25 Apr 2024 17:23:52 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 6A3CE68D366 for ; Thu, 25 Apr 2024 17:23:44 +0300 (EEST) Received: by mail-wm1-f52.google.com with SMTP id 5b1f17b1804b1-41b5e74f7d1so3103935e9.3 for ; Thu, 25 Apr 2024 07:23:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1714055023; x=1714659823; darn=ffmpeg.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=Sq+g+lqKiHDbd3m1Vw8FaI3/y6hUf8a+XoJQl6FkjB4=; b=mcHrt5n4vibOSp54rkpOlYHqLfhFN7MsoCajm2KHF47KCiiP0fKuroRFxOES856HR7 HHlIZx2dykAI26OXH+aX6Gx6jgz65fX/G7iFoRW4ywlGzttRQEMSA5ZwLue/s5nqHx+k fFTEmsa/XcPOMaTAbYCR/y5J97FsZhU0ShH4C731fkX+WC2rwARrTXYpqUM/5tykjSiZ L+uBAZCC9Mpy+WTEzTqi9iDRiqtwOlE+P+mJ6jKPvQFE1ckyNIvlPelAC4wYdQmxqREp cb1qLt7GLZ4p4qBQanAbY1hL4A1mPMB2xgF23LUQMZCbso5GKM0050dz80ZDwKbzZVdz shKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1714055023; x=1714659823; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Sq+g+lqKiHDbd3m1Vw8FaI3/y6hUf8a+XoJQl6FkjB4=; b=UkD801jLqSdI2qnBJbd6leNhBVlyZE+kvCd+jtOyNul8Kz9olseBlPGDpKcNJ+3o3a n000vXwh+Wvgh4HFWJgPzNzrv4l5Em1gCY5YiIx8B8AREA8n5gREknT615RjGDvQaOuG UpwfcGRlxnaiSHeBLI/o+4bI+SADevKuOUxNWA9OOCVAkqIy8kOrdkuh37d6oNg1Srcw MF3oYcDGcVpqx5Od4eFrjG15HVdSReHCCxHL+oonma46PVMpY0EX3iNMGxFBqNGccP2+ +Ytyluk6CECH9L47JYBgRAIaDR6JgRt+I0/OSaxkbuKaleRaUswQ6u7Z2FBR8dzP0w/+ F3Og== X-Gm-Message-State: AOJu0YyEO4eYErhucImdFpRe4V0iA7gfJWyipnqV9br20/G3Xfcuhz/P tARHuHVTct3oHqFmBzhtM51kt3kMOdM1UopsD2SBFUMfMdwXi6fDdRdOXQ== X-Received: by 2002:a05:600c:1c16:b0:416:2a95:6e8b with SMTP id j22-20020a05600c1c1600b004162a956e8bmr4583283wms.26.1714055023158; Thu, 25 Apr 2024 07:23:43 -0700 (PDT) Received: from localhost.localdomain (33bf0029.skybroadband.com. [51.191.0.41]) by smtp.gmail.com with ESMTPSA id o12-20020a5d684c000000b0034aa1e534c2sm14582018wrw.96.2024.04.25.07.23.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 25 Apr 2024 07:23:42 -0700 (PDT) From: Derek Buitenhuis To: ffmpeg-devel@ffmpeg.org Date: Thu, 25 Apr 2024 15:23:30 +0100 Message-ID: <20240425142330.288815-3-derek.buitenhuis@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240425142330.288815-1-derek.buitenhuis@gmail.com> References: <20240425142330.288815-1-derek.buitenhuis@gmail.com> MIME-Version: 1.0 Subject: [FFmpeg-devel] [PATCH v3 2/2] avformat/http: Add support for Retry-After header X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: YTHL5w1Id7zR 429 and 503 codes can, and often do (e.g. all Google Cloud Storage URLs can), return a Retry-After header with the error, indicating how long to wait, asd either a date, or in seconds, before retrying again. If it is not respected by, for example, using our default backoff stratetgy instead, chances of success are very unlikely. Some references: * https://datatracker.ietf.org/doc/html/rfc6585 * https://datatracker.ietf.org/doc/html/rfc7231#section-7.1.3 This adds an AVOption to respect that header. Signed-off-by: Derek Buitenhuis --- doc/protocols.texi | 5 +++++ libavformat/http.c | 24 ++++++++++++++++++++++++ libavformat/version.h | 2 +- 3 files changed, 30 insertions(+), 1 deletion(-) diff --git a/doc/protocols.texi b/doc/protocols.texi index 571d78ec43..ed70af4b33 100644 --- a/doc/protocols.texi +++ b/doc/protocols.texi @@ -569,6 +569,11 @@ Set the maximum number of times to retry a connection. Default unset. @item reconnect_delay_total_max Set the maximum total delay in seconds after which to give up reconnecting. +@item respect_retry_after +If enabled, and a Retry-After header is encountered, its requested reconnection +delay will be honored, rather than using exponential backoff. Useful for 429 and +503 errors. Default enabled. + @item listen If set to 1 enables experimental HTTP server. This can be used to send data when used as an output option, or read data from a client with HTTP POST when used as diff --git a/libavformat/http.c b/libavformat/http.c index d324674e97..1a67068a44 100644 --- a/libavformat/http.c +++ b/libavformat/http.c @@ -31,6 +31,7 @@ #include "libavutil/avstring.h" #include "libavutil/bprint.h" #include "libavutil/getenv_utf8.h" +#include "libavutil/macros.h" #include "libavutil/mem.h" #include "libavutil/opt.h" #include "libavutil/time.h" @@ -138,6 +139,8 @@ typedef struct HTTPContext { char *new_location; AVDictionary *redirect_cache; uint64_t filesize_from_content_range; + int respect_retry_after; + unsigned int retry_after; int reconnect_max_retries; int reconnect_delay_total_max; } HTTPContext; @@ -180,6 +183,7 @@ static const AVOption options[] = { { "reconnect_delay_max", "max reconnect delay in seconds after which to give up", OFFSET(reconnect_delay_max), AV_OPT_TYPE_INT, { .i64 = 120 }, 0, UINT_MAX/1000/1000, D }, { "reconnect_max_retries", "the max number of times to retry a connection", OFFSET(reconnect_max_retries), AV_OPT_TYPE_INT, { .i64 = -1 }, -1, INT_MAX, D }, { "reconnect_delay_total_max", "max total reconnect delay in seconds after which to give up", OFFSET(reconnect_delay_total_max), AV_OPT_TYPE_INT, { .i64 = 256 }, 0, UINT_MAX/1000/1000, D }, + { "respect_retry_after", "respect the Retry-After header when retrying connections", OFFSET(respect_retry_after), AV_OPT_TYPE_BOOL, { .i64 = 1 }, 0, 1, D }, { "listen", "listen on HTTP", OFFSET(listen), AV_OPT_TYPE_INT, { .i64 = 0 }, 0, 2, D | E }, { "resource", "The resource requested by a client", OFFSET(resource), AV_OPT_TYPE_STRING, { .str = NULL }, 0, 0, E }, { "reply_code", "The http status code to return to a client", OFFSET(reply_code), AV_OPT_TYPE_INT, { .i64 = 200}, INT_MIN, 599, E}, @@ -393,6 +397,14 @@ redo: reconnect_delay_total > s->reconnect_delay_total_max) goto fail; + /* Both fields here are in seconds. */ + if (s->respect_retry_after && s->retry_after > 0) { + reconnect_delay = s->retry_after; + if (reconnect_delay > s->reconnect_delay_max) + goto fail; + s->retry_after = 0; + } + av_log(h, AV_LOG_WARNING, "Will reconnect at %"PRIu64" in %d second(s).\n", off, reconnect_delay); ret = ff_network_sleep_interruptible(1000U * 1000 * reconnect_delay, &h->interrupt_callback); if (ret != AVERROR(ETIMEDOUT)) @@ -1241,6 +1253,18 @@ static int process_line(URLContext *h, char *line, int line_count, int *parsed_h parse_expires(s, p); } else if (!av_strcasecmp(tag, "Cache-Control")) { parse_cache_control(s, p); + } else if (!av_strcasecmp(tag, "Retry-After")) { + /* The header can be either an integer that represents seconds, or a date. */ + struct tm tm; + int date_ret = parse_http_date(p, &tm); + if (!date_ret) { + time_t retry = av_timegm(&tm); + int64_t now = av_gettime() / 1000000; + int64_t diff = ((int64_t) retry) - now; + s->retry_after = (unsigned int) FFMAX(0, diff); + } else { + s->retry_after = strtoul(p, NULL, 10); + } } } return 1; diff --git a/libavformat/version.h b/libavformat/version.h index 41dbd4ad01..5310326bda 100644 --- a/libavformat/version.h +++ b/libavformat/version.h @@ -32,7 +32,7 @@ #include "version_major.h" #define LIBAVFORMAT_VERSION_MINOR 3 -#define LIBAVFORMAT_VERSION_MICRO 102 +#define LIBAVFORMAT_VERSION_MICRO 103 #define LIBAVFORMAT_VERSION_INT AV_VERSION_INT(LIBAVFORMAT_VERSION_MAJOR, \ LIBAVFORMAT_VERSION_MINOR, \