From patchwork Fri Nov 12 10:22:10 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Lance Wang X-Patchwork-Id: 31374 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a6b:d206:0:0:0:0:0 with SMTP id q6csp1632757iob; Fri, 12 Nov 2021 02:23:18 -0800 (PST) X-Google-Smtp-Source: ABdhPJwqvTKpCFXbm8BB3UyBArFQGFIaMuWhjAxrFhJsUk+w3H3wtcifXygAOZqR1npBgXQi4f0/ X-Received: by 2002:a05:6402:35cb:: with SMTP id z11mr19949167edc.188.1636712598505; Fri, 12 Nov 2021 02:23:18 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1636712598; cv=none; d=google.com; s=arc-20160816; b=Zh1neD84EbPmYTCjtZbJq8yy6YUMscXSWgW+EMQ8l8mhFES1PtYJ1O8jHtb27AGOva nqttLBw85SuqEYoYSjRG0uPXzVuOITbKJ8prik+6DL8zHmbB9zaCjjbn6bEo+fYkymKP 3DvYKOi4RLeuBjtkWZeWnFOI+cuwh0VuXUnOmDcsFDmc8aIPTbKlsaJvEWjbsFrctOti YYVLivKrABKcx3w+cZ9B0jhFQRHPh/Kv/MmwyslJANWaJTEkLhVYO4WB2m5Cxeqfqalj Xud3os0G+FpjdWarlzs/zplZp7tloM84zQsqnlzd5GoovC9cMsA6BES/kB0ft9hbC9oI 0Pog== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:content-transfer-encoding:mime-version:cc:reply-to :list-subscribe:list-help:list-post:list-archive:list-unsubscribe :list-id:precedence:subject:references:in-reply-to:message-id:date :to:from:dkim-signature:delivered-to; bh=g3ssVRNL9Eslh6E7lMGnAxkf/HPM8spDQ/DDkSzYKgc=; b=NidwmXUlj4nYpFIhI7sOBOPSW4hJmUYVNcnvSeSFbwZNIl2hrZ+TZsPe84qAv+R6zR kFnKuL3O1bUCUVhrO6KhenefnBIENmhlW7rRLxipY73+xKHAXFpf/Zd0/EgVAFZgCIlU 8vkc9AGp4s2z6eM2wExQb6XyjpBDampats75ItqrieFk8QiAwXgJdxUiYoXGCEbHBCkT uM1SrhmNKANxbIKAVI0EXY95PrcEfe72+0KX+9JbtEGZoVT5evzle0fWdKeDzhUhROiQ JqjHGY74+Evz4Q/q/BGutdn5Fbd0x2lduUbzHT+r2JDawt+3PSkYJS/9RrLYtGFC7gLX ft5w== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=Z+jm901l; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id ne18si13013447ejc.424.2021.11.12.02.23.18; Fri, 12 Nov 2021 02:23:18 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20210112 header.b=Z+jm901l; spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id EEEBD68AE5B; Fri, 12 Nov 2021 12:22:35 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-pg1-f181.google.com (mail-pg1-f181.google.com [209.85.215.181]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 1D4EE68A9A8 for ; Fri, 12 Nov 2021 12:22:27 +0200 (EET) Received: by mail-pg1-f181.google.com with SMTP id 136so3021111pgc.0 for ; Fri, 12 Nov 2021 02:22:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=nykEJ2LyBS3Is6WzX8bQN7J7giBU4ibgNJa1D0hFF7Y=; b=Z+jm901lzXzlMas2PtMAZXJw4VGmo0x/wZTsoEeyjbRuDwABL3F3UQu5g3ay2G4N1b PvoLZ4YahSK2D1zx4xQykB5S70Qa6tw2RRbzGynqtXh/3Giyvvm/XVFt8s1TYUwEdI49 ElxPDuZWazCNyrOKvZi0AY5WCrPTA2YNjheK9PJtGuXc5wA0UYC2na1uk5vFNh5zsVeK +iFHtf53Svt83g5gKaIytcxPf4k1Bmxh30tQUPend6Cu8f30LEGs4zPKWC2lSyvIedep Io69+knQKvXF0Gy3OdK+8k/hR3pwnWmpYj7klFMnVajpYuCYEUZlB7Bj98C19moFpDcQ 00vA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=nykEJ2LyBS3Is6WzX8bQN7J7giBU4ibgNJa1D0hFF7Y=; b=fQbhmXi9WmUEO8JN53HQU1LiP6IMKGmoyF9n9m/V5DRYQ8Fr0cDHxxTKkCdK4mKuhf 1Pnp9tZuBi6i9ZNLu+9LH/0djfFtFxr90l/i2CVQcZDLKToP/nTsoSxE3fMWweTwVzYs 94nhXw+XtEUJaS/nwDkqmqv+beg/agi/JDc+mDEvnCSiAVABaPCMufurPZ2ymmvsATDY o9YRo5/mKQpPTySnZZnWvoc/izSn5Q0q4Nor8FvaHDPGMKFPC/RtNNRjLaygyC2ZyB5s 2O7bdGy3xVcNwItOuuw0Pp7W5PWnZljfUVCE3m+p/ISbTSxQck+Ynm57/8mi8bREMz4N EMQg== X-Gm-Message-State: AOAM533/p9OdIGealaMlCGSJSH/0RDCw1EQG4iwAl6ttzqPCLXt7wFfe 0t4WlxzbswriX+eUSAU/q6AzlJDoRtY= X-Received: by 2002:a63:a12:: with SMTP id 18mr9077410pgk.171.1636712545283; Fri, 12 Nov 2021 02:22:25 -0800 (PST) Received: from vpn2.localdomain ([161.117.202.209]) by smtp.gmail.com with ESMTPSA id f19sm6030563pfc.122.2021.11.12.02.22.24 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 12 Nov 2021 02:22:25 -0800 (PST) From: lance.lmwang@gmail.com To: ffmpeg-devel@ffmpeg.org Date: Fri, 12 Nov 2021 18:22:10 +0800 Message-Id: <1636712536-13114-5-git-send-email-lance.lmwang@gmail.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1636712536-13114-1-git-send-email-lance.lmwang@gmail.com> References: <1636712536-13114-1-git-send-email-lance.lmwang@gmail.com> Subject: [FFmpeg-devel] [PATCH 05/11] avformat/rtpenc: adds partial support for the RFC 4175 X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Cc: Limin Wang MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: rxLmoRLvVE08 From: Limin Wang Signed-off-by: Limin Wang --- libavformat/Makefile | 1 + libavformat/rtpenc.c | 4 ++ libavformat/rtpenc.h | 1 + libavformat/rtpenc_rfc4175.c | 116 +++++++++++++++++++++++++++++++++++++++++++ libavformat/sdp.c | 25 ++++++++++ 5 files changed, 147 insertions(+) create mode 100644 libavformat/rtpenc_rfc4175.c diff --git a/libavformat/Makefile b/libavformat/Makefile index 3d6c8ef..a19d2e0 100644 --- a/libavformat/Makefile +++ b/libavformat/Makefile @@ -482,6 +482,7 @@ OBJS-$(CONFIG_RTP_MUXER) += rtp.o \ rtpenc_jpeg.o \ rtpenc_mpv.o \ rtpenc.o \ + rtpenc_rfc4175.o \ rtpenc_vc2hq.o \ rtpenc_vp8.o \ rtpenc_vp9.o \ diff --git a/libavformat/rtpenc.c b/libavformat/rtpenc.c index 2a1c176..4f115cc 100644 --- a/libavformat/rtpenc.c +++ b/libavformat/rtpenc.c @@ -84,6 +84,7 @@ static int is_supported(enum AVCodecID id) case AV_CODEC_ID_MJPEG: case AV_CODEC_ID_SPEEX: case AV_CODEC_ID_OPUS: + case AV_CODEC_ID_RAWVIDEO: return 1; default: return 0; @@ -619,6 +620,9 @@ static int rtp_write_packet(AVFormatContext *s1, AVPacket *pkt) case AV_CODEC_ID_MJPEG: ff_rtp_send_jpeg(s1, pkt->data, size); break; + case AV_CODEC_ID_RAWVIDEO: + ff_rtp_send_raw_rfc4175 (s1, pkt->data, size); + break; case AV_CODEC_ID_OPUS: if (size > s->max_payload_size) { av_log(s1, AV_LOG_ERROR, diff --git a/libavformat/rtpenc.h b/libavformat/rtpenc.h index 62dc9ab..70ea85b 100644 --- a/libavformat/rtpenc.h +++ b/libavformat/rtpenc.h @@ -95,6 +95,7 @@ void ff_rtp_send_vc2hq(AVFormatContext *s1, const uint8_t *buf, int size, int in void ff_rtp_send_vp8(AVFormatContext *s1, const uint8_t *buff, int size); void ff_rtp_send_vp9(AVFormatContext *s1, const uint8_t *buff, int size); void ff_rtp_send_jpeg(AVFormatContext *s1, const uint8_t *buff, int size); +void ff_rtp_send_raw_rfc4175(AVFormatContext *s1, const uint8_t *buf, int size); const uint8_t *ff_h263_find_resync_marker_reverse(const uint8_t *av_restrict start, const uint8_t *av_restrict end); diff --git a/libavformat/rtpenc_rfc4175.c b/libavformat/rtpenc_rfc4175.c new file mode 100644 index 0000000..b6f833b --- /dev/null +++ b/libavformat/rtpenc_rfc4175.c @@ -0,0 +1,116 @@ +/* + * RTP Packetization of RAW video (RFC4175) + * Copyright (c) 2021 Limin Wang + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software + * Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ +#include "avformat.h" +#include "rtpenc.h" + +void ff_rtp_send_raw_rfc4175(AVFormatContext *s1, const uint8_t *buf, int size) +{ + RTPMuxContext *s = s1->priv_data; + int width = s1->streams[0]->codecpar->width; + int height = s1->streams[0]->codecpar->height; + int xinc, yinc, pgroup; + int field = 0; + int i = 0; + int offset = 0; + + s->timestamp = s->cur_timestamp; + switch (s1->streams[0]->codecpar->format) { + case AV_PIX_FMT_UYVY422: + xinc = yinc = 2; + pgroup = 4; + break; + case AV_PIX_FMT_YUV420P: + xinc = yinc = 4; + pgroup = 6; + break; + default: + return; + } + + while (i < height) { + int left = s->max_payload_size; + uint8_t *dest = s->buf; + uint8_t *headers; + const int head_size = 6; + int next_line; + int length, cont, pixels; + + /* Extended Sequence Number */ + *dest++ = 0; + *dest++ = 0; + left -= 2; + + headers = dest; + do { + pixels = width * xinc - offset; + length = (pixels * pgroup) / xinc; + + left -= head_size; + if (left >= length) { + next_line = 1; + } else { + pixels = (left / pgroup) * xinc; + length = (pixels * pgroup) / xinc; + next_line = 0; + } + left -= length; + + /* Length */ + *dest++ = (length >> 8) & 0xff; + *dest++ = length & 0xff; + + /* Line No */ + *dest++ = ((i >> 8) & 0x7f) | ((field << 7) & 0x80); + *dest++ = i & 0xff; + if (next_line) i += yinc; + + cont = (left > (head_size + pgroup) && i < height) ? 0x80 : 0x00; + /* Offset and Continuation marker */ + *dest++ = ((offset >> 8) & 0x7f) | cont; + *dest++ = offset & 0xff; + + if (next_line) + offset = 0; + else + offset += pixels; + } while (cont); + + do { + int l_line; + int l_off; + int copy_offset; + + length = (headers[0] << 8) | headers[1]; + l_line = ((headers[2] & 0x7f) << 8) | headers[3]; + l_off = ((headers[4] & 0x7f) << 8) | headers[5]; + cont = headers[4] & 0x80; + headers += head_size; + + copy_offset = (l_line * width + l_off) * pgroup / xinc; + if (copy_offset + length > size) + break; + memcpy (dest, buf + copy_offset, length); + dest += length; + } while (cont); + + ff_rtp_send_data (s1, s->buf, s->max_payload_size - left, i >= height); + } +} diff --git a/libavformat/sdp.c b/libavformat/sdp.c index 1200e55..cc04d70 100644 --- a/libavformat/sdp.c +++ b/libavformat/sdp.c @@ -660,6 +660,31 @@ static char *sdp_write_media_attributes(char *buff, int size, AVStream *st, int p->width, p->height, pix_fmt, config); break; } + case AV_CODEC_ID_RAWVIDEO: { + const char *pix_fmt; + int bit_depth = 8; + + switch (p->format) { + case AV_PIX_FMT_UYVY422: + pix_fmt = "YCbCr-4:2:2"; + break; + case AV_PIX_FMT_YUV420P: + pix_fmt = "YCbCr-4:2:0"; + break; + default: + av_log(fmt, AV_LOG_ERROR, "Unsupported pixel format.\n"); + return NULL; + } + + av_strlcatf(buff, size, "a=rtpmap:%d raw/90000\r\n" + "a=fmtp:%d sampling=%s; " + "width=%d; height=%d; " + "depth=%d\r\n", + payload_type, payload_type, + pix_fmt, p->width, p->height, bit_depth); + break; + } + case AV_CODEC_ID_VP8: av_strlcatf(buff, size, "a=rtpmap:%d VP8/90000\r\n", payload_type);