From patchwork Sun May 5 02:13:33 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jun Li X-Patchwork-Id: 12989 Return-Path: X-Original-To: patchwork@ffaux-bg.ffmpeg.org Delivered-To: patchwork@ffaux-bg.ffmpeg.org Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by ffaux.localdomain (Postfix) with ESMTP id 9BC5B446B4E for ; Sun, 5 May 2019 05:13:53 +0300 (EEST) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 84A2E68AB32; Sun, 5 May 2019 05:13:53 +0300 (EEST) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mail-pf1-f175.google.com (mail-pf1-f175.google.com [209.85.210.175]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id E890068AAAC for ; Sun, 5 May 2019 05:13:45 +0300 (EEST) Received: by mail-pf1-f175.google.com with SMTP id 10so4879635pfo.5 for ; Sat, 04 May 2019 19:13:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id; bh=OCtKsqy8rOHqPeBLINq1Isc6s8wYU3DD9Smwms5eQRI=; b=JGHhS68Qx7yqSpGHVYdCnr1LWoX+ljoVIzs/nHMiIMn/u9Utf3JbLMSxRHwJ8r0WD+ 4xMI2wQ0CJnKRdoUznC5A2E3aDQbWG4f4qJc2HIvEN/U1M5/71qsWR5utadJgS3iWCqF XajCaYyA5hw5O7pM3gP025LLa6tU7QXSP1oZErkcStFOFuuauF5TlXr9XgzYtu+Cd+BU K4OUMNUdp6oiMEM84zCyd3nV4EOlLRwuU28d2/JvjFf3JZMp1wnZUe++f7/EuWnYxL6H FqyCkPzVGvpuE+wdHwx0pJN66qtU16SW6CCO+3r4ZoH/JgMT2cOIKwGcKcnkVFsBSufw hcEA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id; bh=OCtKsqy8rOHqPeBLINq1Isc6s8wYU3DD9Smwms5eQRI=; b=A1U6H1vQdmvbD0jjeE2XFBFyMcg/0wBw0LDvdLtThtpGak9zYdewKn9p+srHIVlkjd DiUFol23raXp+PX1zNh3grmDZ3ARHaFTCC820lGz72vBJriRRl4qTKYAAnMw9ICmGTVC LrSQ9oktlZrzsksmoSoSZknlYwGECWmJsIY5pxWh5/Teht4o4kKyKZ7K82riAxHculmC koE+wFl0hGOi9+SKJ4G4i3Z8qyR5XNkJLHih+JtXnMD1bSXgVij5fJUxDEvmpgs2Jpl2 SjGT/t+ude9iCZI39QlsRvby7fL131qORjerSwQ1I3g5fRKBx9nc6E/DLJBRud/xmiMX 4fbQ== X-Gm-Message-State: APjAAAWOBpyjmrZJY1uoys9rqLrhbyrcs45K6HF+9fbOnN9xmxllavek YK289v7Yj/Bi1t1qV+sQJzlybQV3 X-Google-Smtp-Source: APXvYqw+vafXDV3XzYplXVuSWVPDISusBV55KOLhL2xhazfOVN2ppWUT/omczaDESlg8T72tyOOSgA== X-Received: by 2002:a63:5c4c:: with SMTP id n12mr22255614pgm.111.1557022422684; Sat, 04 May 2019 19:13:42 -0700 (PDT) Received: from jun-ubuntu.corp.microsoft.com ([2001:4898:80e8:7:5811:1b50:3dbb:d20c]) by smtp.googlemail.com with ESMTPSA id b77sm14151982pfj.99.2019.05.04.19.13.41 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 04 May 2019 19:13:41 -0700 (PDT) From: Jun Li To: ffmpeg-devel@ffmpeg.org Date: Sat, 4 May 2019 19:13:33 -0700 Message-Id: <20190505021334.465-1-junli1026@gmail.com> X-Mailer: git-send-email 2.17.1 Subject: [FFmpeg-devel] [PATCH v1 1/2] fftools/ffmpeg_filter, ffplay Add flip support for rotation X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches MIME-Version: 1.0 Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Current implemantion for autoratation does not support flip. That is, if the matrix contains flip info, the API get_rotation only reflects partial information. This change is for adding support for hflip (vflip can be achieved by rotation+hflip). --- fftools/cmdutils.c | 4 ++-- fftools/cmdutils.h | 2 +- fftools/ffmpeg_filter.c | 33 +++++++++++++++++++++++++++------ fftools/ffplay.c | 24 +++++++++++++++++++----- libavutil/display.c | 12 ++++++++++++ libavutil/display.h | 14 ++++++++++++++ libavutil/tests/display.c | 8 ++++++++ tests/ref/fate/display | 4 ++++ 8 files changed, 87 insertions(+), 14 deletions(-) diff --git a/fftools/cmdutils.c b/fftools/cmdutils.c index 9cfbc45c2b..1235a3dd7b 100644 --- a/fftools/cmdutils.c +++ b/fftools/cmdutils.c @@ -2172,13 +2172,13 @@ void *grow_array(void *array, int elem_size, int *size, int new_size) return array; } -double get_rotation(AVStream *st) +double get_rotation_hflip(AVStream *st, int* hflip) { uint8_t* displaymatrix = av_stream_get_side_data(st, AV_PKT_DATA_DISPLAYMATRIX, NULL); double theta = 0; if (displaymatrix) - theta = -av_display_rotation_get((int32_t*) displaymatrix); + theta = -av_display_rotation_hflip_get((int32_t*) displaymatrix, hflip); theta -= 360*floor(theta/360 + 0.9/360); diff --git a/fftools/cmdutils.h b/fftools/cmdutils.h index 6e2e0a2acb..0349d1bea7 100644 --- a/fftools/cmdutils.h +++ b/fftools/cmdutils.h @@ -643,6 +643,6 @@ void *grow_array(void *array, int elem_size, int *size, int new_size); char name[128];\ av_get_channel_layout_string(name, sizeof(name), 0, ch_layout); -double get_rotation(AVStream *st); +double get_rotation_hflip(AVStream *st, int* hflip); #endif /* FFTOOLS_CMDUTILS_H */ diff --git a/fftools/ffmpeg_filter.c b/fftools/ffmpeg_filter.c index 72838de1e2..fca25f67c3 100644 --- a/fftools/ffmpeg_filter.c +++ b/fftools/ffmpeg_filter.c @@ -807,22 +807,43 @@ static int configure_input_video_filter(FilterGraph *fg, InputFilter *ifilter, last_filter = ifilter->filter; if (ist->autorotate) { - double theta = get_rotation(ist->st); - - if (fabs(theta - 90) < 1.0) { + int hflip = 0; + double theta = get_rotation_hflip(ist->st, &hflip); + + if (fabs(theta) < 1.0) { + if (hflip) + ret = insert_filter(&last_filter, &pad_idx, "hflip", NULL); + } else if (fabs(theta - 90) < 1.0) { ret = insert_filter(&last_filter, &pad_idx, "transpose", "clock"); - } else if (fabs(theta - 180) < 1.0) { - ret = insert_filter(&last_filter, &pad_idx, "hflip", NULL); if (ret < 0) return ret; - ret = insert_filter(&last_filter, &pad_idx, "vflip", NULL); + if (hflip) + ret = insert_filter(&last_filter, &pad_idx, "hflip", NULL); + } else if (fabs(theta - 180) < 1.0) { + if (hflip) { // rotate 180 and hflip equals vflip + ret = insert_filter(&last_filter, &pad_idx, "vflip", NULL); + } else { + ret = insert_filter(&last_filter, &pad_idx, "hflip", NULL); + if (ret < 0) + return ret; + ret = insert_filter(&last_filter, &pad_idx, "vflip", NULL); + } } else if (fabs(theta - 270) < 1.0) { ret = insert_filter(&last_filter, &pad_idx, "transpose", "cclock"); + if (ret < 0) + return ret; + if (hflip) + ret = insert_filter(&last_filter, &pad_idx, "hflip", NULL); } else if (fabs(theta) > 1.0) { char rotate_buf[64]; snprintf(rotate_buf, sizeof(rotate_buf), "%f*PI/180", theta); ret = insert_filter(&last_filter, &pad_idx, "rotate", rotate_buf); + if (ret < 0) + return ret; + if (hflip) + ret = insert_filter(&last_filter, &pad_idx, "hflip", NULL); } + if (ret < 0) return ret; } diff --git a/fftools/ffplay.c b/fftools/ffplay.c index 8f050e16e6..492ae49928 100644 --- a/fftools/ffplay.c +++ b/fftools/ffplay.c @@ -1914,19 +1914,33 @@ static int configure_video_filters(AVFilterGraph *graph, VideoState *is, const c } while (0) if (autorotate) { - double theta = get_rotation(is->video_st); - - if (fabs(theta - 90) < 1.0) { + int hflip; + double theta = get_rotation_hflip(is->video_st, &hflip); + + if (fabs(theta) < 1.0) { + if (hflip) + INSERT_FILT("hflip", NULL); + } else if (fabs(theta - 90) < 1.0) { INSERT_FILT("transpose", "clock"); + if (hflip) + INSERT_FILT("hflip", NULL); } else if (fabs(theta - 180) < 1.0) { - INSERT_FILT("hflip", NULL); - INSERT_FILT("vflip", NULL); + if (hflip) { // rotate 180 and hflip equals vflip + INSERT_FILT("vflip", NULL); + } else { + INSERT_FILT("hflip", NULL); + INSERT_FILT("vflip", NULL); + } } else if (fabs(theta - 270) < 1.0) { INSERT_FILT("transpose", "cclock"); + if (hflip) + INSERT_FILT("hflip", NULL); } else if (fabs(theta) > 1.0) { char rotate_buf[64]; snprintf(rotate_buf, sizeof(rotate_buf), "%f*PI/180", theta); INSERT_FILT("rotate", rotate_buf); + if (hflip) + INSERT_FILT("hflip", NULL); } } diff --git a/libavutil/display.c b/libavutil/display.c index a0076e067b..37c4b9be5d 100644 --- a/libavutil/display.c +++ b/libavutil/display.c @@ -71,3 +71,15 @@ void av_display_matrix_flip(int32_t matrix[9], int hflip, int vflip) for (i = 0; i < 9; i++) matrix[i] *= flip[i % 3]; } + +double av_display_rotation_hflip_get(const int32_t matrix[9], int *hflip) +{ + int32_t m[9]; + *hflip = 0; + memcpy(m, matrix, sizeof(int32_t) * 9); + if (m[0] != m[4] || m[1] != -m[3]) { + *hflip = 1; + av_display_matrix_flip(m, 1, 0); + } + return av_display_rotation_get(m); +} \ No newline at end of file diff --git a/libavutil/display.h b/libavutil/display.h index 515adad795..23d71a0bc5 100644 --- a/libavutil/display.h +++ b/libavutil/display.h @@ -106,6 +106,20 @@ void av_display_rotation_set(int32_t matrix[9], double angle); */ void av_display_matrix_flip(int32_t matrix[9], int hflip, int vflip); +/** + * Extract the rotation component and hflip status of the transformation matrix. + * + * @param matrix the transformation matrix + * @param hflip wille be set to 1 if the matrix need horizontal flipped + * @return the angle (in degrees) by which the transformation rotates the frame + * counterclockwise. The angle will be in range [-180.0, 180.0], + * or NaN if the matrix is singular. + * + * @note floating point numbers are inherently inexact, so callers are + * recommended to round the return value to nearest integer before use. + */ +double av_display_rotation_hflip_get(const int32_t matrix[9], int* hflip); + /** * @} * @} diff --git a/libavutil/tests/display.c b/libavutil/tests/display.c index 893ebb5543..65a0971e7b 100644 --- a/libavutil/tests/display.c +++ b/libavutil/tests/display.c @@ -35,6 +35,8 @@ static void print_matrix(int32_t matrix[9]) int main(void) { int32_t matrix[9]; + int hflip = 0; + double degree; // Set the matrix to 90 degrees av_display_rotation_set(matrix, 90); @@ -56,6 +58,12 @@ int main(void) print_matrix(matrix); printf("degrees: %f\n", av_display_rotation_get(matrix)); + // flip vertical + av_display_matrix_flip(matrix, 0, 1); + print_matrix(matrix); + degree = av_display_rotation_hflip_get(matrix, &hflip); + printf("degrees: %f, hflip: %i\n", degree, hflip); + return 0; } diff --git a/tests/ref/fate/display b/tests/ref/fate/display index 251e7e0cdf..841a7235b8 100644 --- a/tests/ref/fate/display +++ b/tests/ref/fate/display @@ -14,3 +14,7 @@ degrees: 135.000000 -46340 -46340 0 0 0 1073741824 degrees: -135.000000 +-46340 -46340 0 +-46340 46340 0 +0 0 1073741824 +degrees: 45.000000, hflip: 1 \ No newline at end of file