From patchwork Fri Dec 16 09:37:27 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Saliev, Rafik F" X-Patchwork-Id: 39717 Delivered-To: ffmpegpatchwork2@gmail.com Received: by 2002:a05:6a20:bc95:b0:ad:ade2:bfd2 with SMTP id fx21csp1387269pzb; Fri, 16 Dec 2022 01:37:45 -0800 (PST) X-Google-Smtp-Source: AA0mqf64GPg2Sl0s34OiH2N+BJrAGPby0iDGFP6wVvPsWWUYzzBw3oofmLtYxGPV8LwGZilMZglJ X-Received: by 2002:a05:6402:3908:b0:461:bf05:2be1 with SMTP id fe8-20020a056402390800b00461bf052be1mr25551590edb.0.1671183465376; Fri, 16 Dec 2022 01:37:45 -0800 (PST) Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org. [79.124.17.100]) by mx.google.com with ESMTP id o19-20020aa7c7d3000000b0046cf631a74dsi1679319eds.200.2022.12.16.01.37.44; Fri, 16 Dec 2022 01:37:45 -0800 (PST) Received-SPF: pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) client-ip=79.124.17.100; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@intel.com header.s=Intel header.b=bgUqbnq5; arc=fail (body hash mismatch); spf=pass (google.com: domain of ffmpeg-devel-bounces@ffmpeg.org designates 79.124.17.100 as permitted sender) smtp.mailfrom=ffmpeg-devel-bounces@ffmpeg.org Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 0461268BD23; Fri, 16 Dec 2022 11:37:41 +0200 (EET) X-Original-To: ffmpeg-devel@ffmpeg.org Delivered-To: ffmpeg-devel@ffmpeg.org Received: from mga04.intel.com (mga04.intel.com [192.55.52.120]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id DE2AC68BB94 for ; Fri, 16 Dec 2022 11:37:32 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1671183459; x=1702719459; h=from:to:subject:date:message-id:mime-version: content-transfer-encoding; bh=1wdncyjVUF31wmfc3RGCS8qlM2VY5YOtKfCPFQLWCIk=; b=bgUqbnq5rvA9ffw2qXRXNST9S6a7RptkvhnhaVD9mmAQ1VKJ83bmgIp9 XM8xL9SPSh3Ek5z3acH05o4zzFG/i3gB5Jd7Fw5r2FwM3pXOLPiBcIu6p QtHcKK/Np7vhxNFog8f4F5ybOOYmLQ+J5644SpMtZtFvdCPkZ5405Vk5E BNT+1MjgYTS3P/iYKUgMK0BlSvQP+V2Z5IQWw0wD0Kmm7OX8F6u5blcbd LCEL0JjmwvQRIxC26bH6q/b8NGtntSEuIEGA4Kvl/HndI47TzwNMaybRI mC6DaOKUbf727WudxuZmhfS2oiMopDvRCFoFVI87bGVKvbBvt7ihXfeNd A==; X-IronPort-AV: E=McAfee;i="6500,9779,10562"; a="317626403" X-IronPort-AV: E=Sophos;i="5.96,249,1665471600"; d="scan'208";a="317626403" Received: from fmsmga004.fm.intel.com ([10.253.24.48]) by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 16 Dec 2022 01:37:30 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10562"; a="718305610" X-IronPort-AV: E=Sophos;i="5.96,249,1665471600"; d="scan'208";a="718305610" Received: from fmsmsx601.amr.corp.intel.com ([10.18.126.81]) by fmsmga004.fm.intel.com with ESMTP; 16 Dec 2022 01:37:30 -0800 Received: from fmsmsx610.amr.corp.intel.com (10.18.126.90) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Fri, 16 Dec 2022 01:37:29 -0800 Received: from fmsedg602.ED.cps.intel.com (10.1.192.136) by fmsmsx610.amr.corp.intel.com (10.18.126.90) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Fri, 16 Dec 2022 01:37:29 -0800 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (104.47.70.100) by edgegateway.intel.com (192.55.55.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Fri, 16 Dec 2022 01:37:29 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HGbUsEUHTkpFje8yEe3OSneKpklXa9Tvc/wlx955gkAW0uAED4KjKIi4xdcV+SF4hFwGzjWjwXq1QqLM6E3Ck2JhJsowPBZ0q7cHHeOm6erkszSVEYwkOq7u/Fd617m3c2g/S3R/TFYNO97+WTeTdOENi+S2+v6ZvAqlkk7UheO9hnciBf0OEIFGfTNeBv1kgpOZGQuzgFc3EDTpNx33NdstcHA20Q7gsJj4u7jMDN3P83ku6i0IQMq3Gpl/eFdPyde2hCWDrQSkgzpVx8UsdxXjkSvWwk81DpnQtjHgQNLe3uwo+7P/vtE6nw4q643477lSf0ytp2hagDpOX+u3Kg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Nff8ImKECGE6wZVO1oTHMD7ctME+UH4Ocal2DNo5PDU=; b=QGq9LxNeUX/oyWAhcZj/DPUq9uemEupAoia36JE2a8XsIaiijNj0c1VILFxE7YhjLKqvOpPDM2rLldnGIniJyTAVEPJxisQ+ZQZtQN4rPe2CrT3IiAkbP5OXiJwNSxJta7qSu3k+nKzLoMqwthHGPbhXeo+7ceDQ5KbaPFePsEIvPiqqXeb1IChrvAjH+yq3Z7rKXiPWGHP+lenL5//lEV6QGeolw6qyBofAgodVCAWaVIZYR1DCwmU+v8/3GVX2NtisaS+QbY1wtCIk02VCND8naHXOhGQIiaYe9L6pqyeQ0eIFXeC52fnTk7blI+qto6eScrzrTwfYf0XzKU/Z7w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH7PR11MB5887.namprd11.prod.outlook.com (2603:10b6:510:136::20) by SN7PR11MB7440.namprd11.prod.outlook.com (2603:10b6:806:340::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5924.12; Fri, 16 Dec 2022 09:37:27 +0000 Received: from PH7PR11MB5887.namprd11.prod.outlook.com ([fe80::bdec:76e4:11d0:c07a]) by PH7PR11MB5887.namprd11.prod.outlook.com ([fe80::bdec:76e4:11d0:c07a%9]) with mapi id 15.20.5880.021; Fri, 16 Dec 2022 09:37:27 +0000 From: "Saliev, Rafik F" To: "ffmpeg-devel@ffmpeg.org" Thread-Topic: [PATCH v2] libavfilter/dnn: fix openvino async mode Thread-Index: AdjT12AI3JCBUpfFSz6CVQAm2mZ/rQ== Date: Fri, 16 Dec 2022 09:37:27 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-exchange-messagesentrepresentingtype: 1 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH7PR11MB5887:EE_|SN7PR11MB7440:EE_ x-ms-office365-filtering-correlation-id: 071952ff-970f-4596-fe4d-08dadf49252d x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: jvMByd7gE8Wb61PVE9lO5XwPpRn/tG9FznpNk50qzRMDEZAIOzjnH5S8VqLo3QgASk0ss7P+bUGKn+qxwSasAdkMde9gSZFi+lTKKO+yEVVdudVj7LPLicTjQYdWpxUsyNQLQVKjywzKP5YJYk25Wqyd+F0ZsTmOIoeBSKTriYbUfPtbNnH7FBWM4Y6TXrZShuaBZtBrf3Q8djq7Lr/MXdbDsokkDPaVL7XLE6IKJ4Tn+LzwF1aibdwQXlJ9/vsko15od2p0agj/nq57iEUqn/xl11Kae713mjR5d7WuZN+BvAsqypVFJRZqJKoNyI6lXVBck2hqt9q2ikAhGG3C4xXrBCdfhuOW24DoEHFXOF46pcXSh1DzIREN4iAOfGJg7B2gXe3sqHGLgq34afkmat+fZai2Y6IbsDbXCvjSERw42BYmC/PADEfo2rcRVH/2tH8yGT5o1+h9XwgvAkBXcMSaB8dJGmmDDuB60YJsyiIU0DF+iQ7R/QgYiIr9zt4/r9YW2tHk3K7ELLt5AVyTj1uqWtw3ddTPbn9+Risj0MgQnPk9KWADAYf/vWlHblKlnxFOJRvq/TdJADWgQN9AKWRziVRII4U0wBMj6C5hQZKRC9odqzbm1ZIF3gWr6jChWPNCzsc9YsfL5EcvwCwMRR3mLF+QJ9qcO98I3A1D83qSV9mLXnOnoRSNc6im0n/bu6VG80eD7fb9Y84Ph+8a0A== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH7PR11MB5887.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(366004)(451199015)(83380400001)(86362001)(122000001)(38100700002)(2906002)(38070700005)(5660300002)(6916009)(52536014)(55016003)(8936002)(76116006)(26005)(8676002)(186003)(9686003)(64756008)(66476007)(498600001)(7696005)(66556008)(6506007)(66446008)(66946007)(71200400001)(82960400001)(33656002); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: iqAlLxU24C7d5XiQEhsZxQjhlKOQMPcVkYq1uD/g2k1Re/xb7YsoAGhIYfOFArDKRWGfkurayaTPKvOcNv0T4kMWL5cEHccwxThiecyK6hWe5P2Nl0QcZST2QuM2K/lXpdVScIKIxYUBAZUHUAXKkV5h6qtJPsVZp3Q1HGd/8K12enez+yY+0ns/ubJHE+l1F5UpiAIqEV37hQR2er0Dq+TP4FqnV8kfFOO3qxcrChZS4LnP2IUFugI3HMiqVkztjp1ybdnmwlmirVNWBycVvUEglXt5OyxmNlbG2oadfEW4TXYI2hnAU/YJ5IYnMXAuwzo8GbIWYxGqIJ/kRhIFl8Qm3lSkrTjnpmwlXXxaYcOg9TONAXNKNz9+5HXJxdHuTgUfib0gDBUghxoM0Dralfw+SSkRuVIahRihSUsU3PFzliK0jdyUc/fZkvfT/zY6IdInarsndtD5Ame2P08GBhaqdPga1oOoVwnGyAYpasulqJmzDLzc+ve46Cq9wutPOQIsYpK8VfWH78YklaCr+vfNZgB28jb7otttp4zXZgtnVhfSfMFNQObluoYQbqmbyWeGmPOLREc6Jcbrp8qdnVXQvqte4l4053QLJSqqG1vOi/niTt7QsrjXfOxkg4Q4v4QHfSc+3yeNFuNm/aOx4PQhPbxlt9MKcVUtdjvK+dnZbJnJeZEVYqC9v3RCbgt0r5gEnpVL/Trvaa8Ii/dGYWRfoswAi2vkBpC9ezD4qCAt5Jn4inRunZZlPSx//tUO//hNHM5krJL2I/oFW2w5jiuiOaRDHTKA1Fy4ALGpM4nGyOVgq9sMtMwTRIbgcKTPK505exVqCSfRlGLKz+59MzhOpFfoQKTjYeqatUuTimpgbV9kpyXjJoIBmemXQ4AVvD9GeYEl1Kex4q5DC/0+d+Ac2BrB17XWksMLJj0WC4MTYG7/e7/+BinvzoDd48O9z0NLDFeI7ZyuLIuvlxCLoGHqRwG8boz/ym26JDSHWxKaKw8wxMTvpLNob+sclDZ0VE63369dBTok86fa7aTG88YwVhnh164WdDdQybz1mG5dK5mz62qF+Jcc1T0oR7D6+hXMrRqfqXvcwd4BiLccSlw7bTqDJGibIPiAh9b+1gnXw/wQwI3EwYRrNHBKPnrgGrtb20czxLftuoCfALPbMxyjDHTd2dwDtfXMAF4F/8M53D6IihzMld7xx1iUFbPWU6joXIDsqq+hvmEu4+spDKxAj4VWwOEA8DZcTPXlrStdMovU+dy/8QQWeKkd5iR7UaXuIiRUpFHNPxkrmVXHWBQJkd5kyW/19xn9+6kF2LurVWHkpy2FvYMb+oArT0pLrd1ab95iR3Mr3hZENUXtqxgz+zcrwR/4cI4zyycwpeU9eLjmCk53CIR/8Q7qKs88TjXhjV5e0PsO4M72Z2yP+Xrt2EBVPNLpmlvK5ulAQvml8iFQnNoF14KDKm8wRZoUlqXgt59w/KoYvwHYl5+9lCBtcohTRoAslV5LyjaVzMAbme7iAdvjXWngziqe9QUNPzghACt311b4qwlycJS6HpOOMp96JZcevmV00z6B9Z7qv8XjMzX8Tguosm4fqSA4 MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH7PR11MB5887.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 071952ff-970f-4596-fe4d-08dadf49252d X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Dec 2022 09:37:27.1506 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: mhRc6dIaLnhhXfV8OgAeSyU6HKz5/LSV3ZP62B+eoasmaKWAnwWbnl2EoAiDMeu72I1RCEXH3RC1AVHVeT7l68DcFa/K8fhtb70lifCQN/k= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR11MB7440 X-OriginatorOrg: intel.com Subject: [FFmpeg-devel] [PATCH v2] libavfilter/dnn: fix openvino async mode X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" X-TUID: o091JT3dDbdP Bugfix: The OpenVino DNN backend in the 'async' mode sets 'task->inference_done' to 'complete' prior to data copy from OpenVino output buffer to task's output frame. This order causes task destroy in ff_dnn_get_result_common() prior to model output processing. Signed-off-by: Rafik Saliev --- libavfilter/dnn/dnn_backend_openvino.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/libavfilter/dnn/dnn_backend_openvino.c b/libavfilter/dnn/dnn_backend_openvino.c index b494f26f55..b67f288336 100644 --- a/libavfilter/dnn/dnn_backend_openvino.c +++ b/libavfilter/dnn/dnn_backend_openvino.c @@ -244,7 +244,6 @@ static void infer_completion_callback(void *args) av_assert0(request->lltask_count >= 1); for (int i = 0; i < request->lltask_count; ++i) { task = request->lltasks[i]->task; - task->inference_done++; switch (ov_model->model->func_type) { case DFT_PROCESS_FRAME: @@ -278,6 +277,7 @@ static void infer_completion_callback(void *args) break; } + task->inference_done++; av_freep(&request->lltasks[i]); output.data = (uint8_t *)output.data + output.width * output.height * output.channels * get_datatype_size(output.dt);