From patchwork Fri Dec 16 10:34:37 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Saliev, Rafik F" X-Patchwork-Id: 39718 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:bc95:b0:ad:ade2:bfd2 with SMTP id fx21csp1416194pzb; Fri, 16 Dec 2022 02:35:27 -0800 (PST) X-Google-Smtp-Source: AA0mqf56kNI2pR7/IVpJlGVCAD5poffUF2mZzO8nbffodT7jnm62Mbg4BT6Wds4hnPjpnkybcyB/ X-Received: by 2002:a17:906:3493:b0:7c0:bd68:ce30 with SMTP id g19-20020a170906349300b007c0bd68ce30mr27238671ejb.54.1671186926846; Fri, 16 Dec 2022 02:35:26 -0800 (PST) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id br8-20020a170906d14800b007a45e4f4ff0si1652967ejb.885.2022.12.16.02.35.26; Fri, 16 Dec 2022 02:35:26 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=jW1bTIBH; arc=fail (body hash mismatch); spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id E25BE68BD77; Fri, 16 Dec 2022 12:35:22 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id C43B168BB91 for ; Fri, 16 Dec 2022 12:35:15 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1671186921; x=1702722921; h=from:to:subject:date:message-id:in-reply-to:mime-version: content-transfer-encoding; bh=1wdncyjVUF31wmfc3RGCS8qlM2VY5YOtKfCPFQLWCIk=; b=jW1bTIBHm0JYgNv+V3/ndQkOI5WF8MbAkZrvrAI8jaYvls9lHhIv3q+a 0ymm99ynEhJgCBanomEfdl+7CXFX0WCy91lPR6uM1i+05ITlFFsd4jtwT tSXo1k6VEbqqcLDSbnbTRtnNLm5o2WMEpRntYKAHgfng2QcMxhHhL5AqF 5fTUM9povXFdbAoAYxRh7HBPI0Tiq5t95f89zcEhRvHQXfXbb5SInWLTg njCckjgrqeOcngpoJuQnkM4PpLcFA/5nNFPW4iz0QJ5s1Je1lJmOOWHSh L3TItcbYl84sHmBNli03COvahvA1MiOPIx6pKyvN4affWsRAWBQwaoKuJ w==; X-IronPort-AV: E=McAfee;i="6500,9779,10562"; a="316580943" X-IronPort-AV: E=Sophos;i="5.96,249,1665471600"; d="scan'208";a="316580943" Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 16 Dec 2022 02:34:40 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10562"; a="627527318" X-IronPort-AV: E=Sophos;i="5.96,249,1665471600"; d="scan'208";a="627527318" Received: from fmsmsx601.amr.corp.intel.com ([10.18.126.81]) by orsmga006.jf.intel.com with ESMTP; 16 Dec 2022 02:34:40 -0800 Received: from fmsmsx612.amr.corp.intel.com (10.18.126.92) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Fri, 16 Dec 2022 02:34:40 -0800 Received: from fmsmsx611.amr.corp.intel.com (10.18.126.91) by fmsmsx612.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Fri, 16 Dec 2022 02:34:39 -0800 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by fmsmsx611.amr.corp.intel.com (10.18.126.91) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Fri, 16 Dec 2022 02:34:39 -0800 Received: from NAM12-BN8-obe.outbound.protection.outlook.com (104.47.55.170) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Fri, 16 Dec 2022 02:34:39 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=DPM92Kx3D4+0uX0VhuDwK93Pmu/TH7LF2UHIcVQNF4qDfWQtRLocMTxC9TS6+cmP2Qp7zazvheRt8q9L6ThXSH9Bn2OsQN8O4diniAx6yIKiyZ/xMmem0bDH9b+YGuc/D8stuXQtUavKsRuzS5fTDZKWcPGn31T/xXbfvlCTbR9HgA9FpYmHxVZmzzUeydkuK7tL2DF8r+X1QL5r6zw0PCmWVXrryRlk5e3mH2a/7kEKmW7S6KyaYnVFzLomN4bOJKemarksEsZDwgQLOitREZaq+RYUf/M4wkky2JBQCWDzHMMxhY4KgtQHC2zIbXrmTSfNzOF2PDFoK1uFWk/jWg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Nff8ImKECGE6wZVO1oTHMD7ctME+UH4Ocal2DNo5PDU=; b=I3OcBkoTU57MCAm641CJ2R8gXihC5w+b7rCPkBgh/OLl74q8/T495Np4NJn7Rot16bOmiGYOGdQm+qeaoehgjAr4CSf+9HYmiPfDVeckDqB/52b7jdDB8+HlYbA91F5ZzuM3WIMgWjfv+TGMJxt3dbVIUsxKAeQi4Pqbs17/GR7EbBhf39zG8/zRqpA9bG1csCR6R+lT+g4q6uqkWwI4kqDm9EptD9jUS3q5NtjB4uPw3xhZClhSyr+9GhZ4K73fZ7N6pEsU9iJgIAZZMjk53p451aa+k0fN+/SWh+vWeC6KCrxo5kYvX+xKbnBNZFH1pLD1DGlUm9hsIf/OSualDQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH7PR11MB5887.namprd11.prod.outlook.com (2603:10b6:510:136::20) by PH8PR11MB6705.namprd11.prod.outlook.com (2603:10b6:510:1c4::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5924.15; Fri, 16 Dec 2022 10:34:37 +0000 Received: from PH7PR11MB5887.namprd11.prod.outlook.com ([fe80::bdec:76e4:11d0:c07a]) by PH7PR11MB5887.namprd11.prod.outlook.com ([fe80::bdec:76e4:11d0:c07a%9]) with mapi id 15.20.5880.021; Fri, 16 Dec 2022 10:34:37 +0000 From: "Saliev, Rafik F" To: "ffmpeg-devel@ffmpeg.org" Thread-Topic: [PATCH v2] libavfilter/dnn: fix openvino async mode Thread-Index: AQHZETn/NErNuJJqtUSZ6lqc2pKt/w== Date: Fri, 16 Dec 2022 10:34:37 +0000 Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-exchange-messagesentrepresentingtype: 1 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH7PR11MB5887:EE_|PH8PR11MB6705:EE_ x-ms-office365-filtering-correlation-id: 9974f954-1e25-42c4-bd14-08dadf51219d x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: nTiq4stZCjxPYla0xZN0jZvFBRX3edVVX1Nj95MCg1tWpARBfIKjNzBRjs8Kayt2Ed2mstnUBV9WTxBDc+bI3bT+snaxs850T+9Ic4CnAlMYWwZwpOlvPsNyn42rmEMpE4hYcO2931VFk+oEG1zhakBM9s8tuLgbY9Jf19qo0GXbqFfvXN5lRngAwDe5BCbf9+wMb5td1g+QJPhaAwPXoZN8bQKmkkzTqFK4eMRcPwfagDVDygEz3oAA7xxPXWFTC4GDaLsqE7sFxqbR0PSqSVU8A3Q5yzVs/0o8Wxuw1o54v4ihIQrlRODFxMF29cB6RyvJEfKhKX3fhE3QvgbvXTfn/v06R1kWxH1G5/kyUC0M4FOS78S/obPxkTOx2o3yabzufI2eg9xFJ//I1wwbi7g4GfGTtWHBTnV6R/m6dPdVSaDOutfWZtpfjKFGhYSyt3IXILNo3Y9h/wxTpUnb4/ncHDxXeQBXW63iOnc8jwQUP7rwjc+FaSid7ym2vXKRhwMUVn1qy68iMgtJSwPgRtgIwDGwLyzMtD4/XpSHOBQ4F2vp/aNaSqM5mZ5cXD/wQXknkNjwcaerpRJl3EKCT4BLhx8obj1eSgCxcz5kFZO35r0lzDI9GhPg0e24//f+XIV+yAnEVXi2thDHNxVdK786Mx4GhIPVDSiuheAxTimQefaBZTjTVAUaPMAM9W9isdB4YVteNkjTBfgXkCRS/Q== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH7PR11MB5887.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(136003)(366004)(376002)(346002)(396003)(39860400002)(451199015)(33656002)(52536014)(41300700001)(8936002)(316002)(8676002)(64756008)(66446008)(66476007)(66556008)(66946007)(76116006)(83380400001)(38100700002)(82960400001)(122000001)(55016003)(38070700005)(71200400001)(478600001)(86362001)(6916009)(7696005)(186003)(26005)(6506007)(9686003)(2906002)(5660300002); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: VFSjwizQ4WwtEo9IS0WgQ6oa33cjRJJ/lHKUMPLtHgp+meup8/9+qW/Kl7ekFBieVfc2TAR2tbjviRzyIERHD8cmLza+91QVPzgV0hS0UGuX337wLQKeN23P8uOvSgLDXbAdpQJLQb2fRDkcOxWpRH6ysc0TBAcnJciWJdwpFfsTSYFmxl895b85kO4ny4ifroulxmG7hx3ai9eLHoF1awzV9sw6tzZgObaP56OAADDLSYl4d0rE5FafmewIpii/7exKxtaCsN3F6UjZ7eCULj4dLwDD5nfCl5TOspOs/r2aNqgYBIpaXO3q/481YjfNgFQjAzNuyKEsb2qx0nYnkTtaMx1b3m/weXG0BifCuvG7Jf4me6a/gRBcqS0xX2M3Yk1hqKBD+hOhaUshUuh2tL0IUlvgSP/iXCkFNREXJxgQNml5fmKloYxIJYEtIDFrifjqI1gGdD9RxYM3DyQGN3sIoyQoCLx7twIRGaX2kivYBFyKhSUsGFDeuIkFVu+RfSeXE2rK+ZwV4rhlvvuBUXiFiJEhIAwP097OFby48xpK5iwDyILZCL+YbIlomzlKckcNzEwp2h1exZEhQIBex4XuWLRIvhPXxDFHRQcDPGSVtnz5HyzbtZTwwm2WfzDSYWFXoxEQxJf/bc7xQzJ4ApW/QyitOIKSseWt/Xk8dQvOihWk+vKse1sw1+Ss70aFcsYEN6QXPurBxpARp1WM8EFZVUuW/KH+YEDS/qNZS4wcQ8KfbHYA+9AVB3Gb3AUKj+0+mJEWlSH8U0jZ60k7XN/XQvAS/H3xoCGtztEN37X6zZXrVr3x+UsZZZM2F5Akf2sdgk/2X19l+oKtcZiJY/1JZZIDPOer7i8/En894+JxBcRwhbQem5QXH5tAZHPsObqtCY1IA18JSokHKMqSDr+ECr6WXKFGOhdtBYehsco/vPzYQmt+YBxnX+pKSGWS4ZNqW4E4rHuiOdCezmVIYEdKBwZAHNmtOqZ+3eHbvD2tHmlsmHmxmYn+uR6MKyVnVoDbw5zjjt+oN/dbJldc/1mXbqe2k93+tqV321I1GWsbqtyiiaKGQCbO5aAGopvM7+hG+n1RVkE0lP0SC2abgVA4sszUzz5AsW8Gq2QGEP0Ynd0oebWqkE3BbFRbNLS76+XW/HU1h7rjj/nrfShyPULvHD3yPGzhEUnXC5+9cAzcSnuaOLbZZBKmL1HanwAcAhGnkhOL6o8LfTdmfQUeS8daIVdOqRf4VK1ejeVc+9ekFJ4s6Md7jCUMdkOOW/w/Q3u06xpD5es6NfQz5PqnZ+VE999jdUCOu8zBlYElIKVA1492L8Os3KbaeBTkBNO2iKa7tcipsecFa1zKoA6urbIY3tk5xNzPeqSGKsLM7M/hq2GoAZBE4pccBd5T7eUkqP6upjm8Jw6yk2azj1JJNJTZ4FuS8qmbsfJo+xZ2MXx3HkWU2+4AW6rkcCwjCGydNZLqvPxcL69i0mAvLY/Tng7u+czW/aRreDhSXi3MX81qOJBwPyvqHg8n1JcV6giLDSCO+ALP7Z4gaPT4x4vN+PO1QGdOtkO0p1xGCSRAK/D3KdVWrOF6ZkO23crIV2r8 MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH7PR11MB5887.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9974f954-1e25-42c4-bd14-08dadf51219d X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Dec 2022 10:34:37.4916 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: MJUJl1qzbmXxYLOxXgbvEHyUc6U3m1ixFH9A2bFks3uBiLspfcPjbMjKNifgSllkKLGIk+S1nPPqAnSIskYSHB1bb6kdy8ycMCWsl7276lw= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH8PR11MB6705 X-OriginatorOrg: intel.com Subject: [FFmpeg-devel] [PATCH v2] libavfilter/dnn: fix openvino async mode X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: Tv8qXsYqhO7q Bugfix: The OpenVino DNN backend in the 'async' mode sets 'task->inference_done' to 'complete' prior to data copy from OpenVino output buffer to task's output frame. This order causes task destroy in ff_dnn_get_result_common() prior to model output processing. Signed-off-by: Rafik Saliev --- libavfilter/dnn/dnn_backend_openvino.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/libavfilter/dnn/dnn_backend_openvino.c b/libavfilter/dnn/dnn_backend_openvino.c index b494f26f55..b67f288336 100644 --- a/libavfilter/dnn/dnn_backend_openvino.c +++ b/libavfilter/dnn/dnn_backend_openvino.c @@ -244,7 +244,6 @@ static void infer_completion_callback(void *args) av_assert0(request->lltask_count >= 1); for (int i = 0; i < request->lltask_count; ++i) { task = request->lltasks[i]->task; - task->inference_done++; switch (ov_model->model->func_type) { case DFT_PROCESS_FRAME: @@ -278,6 +277,7 @@ static void infer_completion_callback(void *args) break; } + task->inference_done++; av_freep(&request->lltasks[i]); output.data = (uint8_t *)output.data + output.width * output.height * output.channels * get_datatype_size(output.dt);