From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id OLRLNlJqY2MkRQAAbAwnHQ (envelope-from ) for ; Thu, 03 Nov 2022 08:14:26 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id WPZNNlJqY2N09wAA9RJhRA (envelope-from ) for ; Thu, 03 Nov 2022 08:14:26 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 93F9E29B6F for ; Thu, 3 Nov 2022 08:14:26 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oqUPz-0005EN-R7; Thu, 03 Nov 2022 03:13:40 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oqUPv-0005Dm-Gq for emacs-orgmode@gnu.org; Thu, 03 Nov 2022 03:13:36 -0400 Received: from mout02.posteo.de ([185.67.36.66]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oqUPt-0007CF-FA for emacs-orgmode@gnu.org; Thu, 03 Nov 2022 03:13:35 -0400 Received: from submission (posteo.de [185.67.36.169]) by mout02.posteo.de (Postfix) with ESMTPS id 580A8240105 for ; Thu, 3 Nov 2022 08:13:31 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1667459611; bh=5Vb96vmdA23q0nLtZPKniCW1q+2F71gAqiJIFy26S3c=; h=From:To:Cc:Subject:Date:From; b=nK6Qvy8NZ45/ELC+AIT0BrlGG39Vax4/aNuVNMgUjvDjvNFlxSUr/DqUQeC9PY7BU hwTJSOofk2RLnM8l/Wu3Fwpg+xTNqO8U+veRe+vLZ5peora2TksEm1aKkdGGFtn6xe vUTHkjDN8fhQKZ1vDgqrEX9MJp/NAHEhdZ6PPkTAg5MeGZE2dYJ9qymkyCTAdXWoEe Qa9sSK5hp00klj0HSEOALutYFtHEcxPj10sp2toJocUwOvlaOf14e8qFcSoHnZgBaw jBDQ80tRkJE0EtDsOCvX7KqYUX37Lj+c79taJ7c99vZCQslGSCu9Ezxitx7hAzwjul cDKGuIbpGSUCA== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4N2w2x5jHtz9rxF; Thu, 3 Nov 2022 08:13:29 +0100 (CET) From: Ihor Radchenko To: Christian =?utf-8?Q?K=C3=B6stlin?= Cc: emacs-orgmode@gnu.org Subject: Re: [PATCH] Ignore flaky ob-python tests In-Reply-To: References: <878rktluej.fsf@localhost> Date: Thu, 03 Nov 2022 07:14:02 +0000 Message-ID: <87leos7bnp.fsf@localhost> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=185.67.36.66; envelope-from=yantar92@posteo.net; helo=mout02.posteo.de X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "Emacs-orgmode" Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1667459666; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=5Vb96vmdA23q0nLtZPKniCW1q+2F71gAqiJIFy26S3c=; b=ddK0N17WI/Ke0cUtyhKrXR9IGQ0Id5Vo9UPdIahommGleLyN1BbGCJWJOJ9UQYLNXMa21O 2LGe54nKBoTLcidNIdkVG/bz/Qw132RIxK031ua41QXed7JS1NBvm6pVVG7PwPUSUug0TJ ghYF6N/OCQqHpKlxWL25QxMgvGe/oufbj7/FhEDJTjcC5pupaWEds9vnnPabB6Ut2Vqozd 9ChxcwDSodbbePV5VyUbu8NqnL7NBbJ+ZoEGiD670ay2DbEzz8Q94vNInW6qRGFQ+CsY67 dypWid0jHYK7y9yK7ntFkWNiInyXZuj1bpI8crSJW7AiDU6BeCZkJXTPTU1G+A== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1667459666; a=rsa-sha256; cv=none; b=gFuHG4ptDhdbortPJXXuxS7oMmuQoJSsWaRqXEFvkxwOW+28K5GPkNbk5L4TYW//BEKRBw i6RcW51/W4kqm/XEhQe54KFNLdmnRsLiIK50x398B8rjeK03R7+AAswTcTAE12o5mVN7jN WV3DnmwyZvBNdZh5eqlelAFSsM9r/99313jDKbWhICSEsR/bknrL4wBSGZh2fdjqVduN+j g25Cwn+hj2o3FOeNMsuf23CMwD/x8dpSyfQRTCpXCHSSKI/9J4tntlOr5WCr02ryImdaxm Pb11QuDCuKmZkwo7ADWaATO0CIh6rcwg2R0muF/04B2/iXO7Jp6Tk8+rKteVtA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=nK6Qvy8N; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -8.79 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=nK6Qvy8N; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 93F9E29B6F X-Spam-Score: -8.79 X-Migadu-Scanner: scn0.migadu.com X-TUID: +vavSMAIbY20 Christian K=C3=B6stlin writes: > With my patch the tests are still failing but the testsuite continues > to run and returns > with 0 as status code (one can see the failed test though). FYI, I am using automated scripts to run make test locally on multiple Emacs versions. 0 status code would do no good for my testing. >> Maybe we can instead provide some variable that can turn-on ignoring >> some problematic tests only during CI tests? > Yes ... that would also be possible e.g. skip the test or test nothing > if it's running on the ci. > (I am talking only about the 3 tests!). More like just 1 test with underscore :) The 3 tests in the patch are real failures because ob-python does not fully support python-mode.el. --=20 Ihor Radchenko // yantar92, Org mode contributor, Learn more about Org mode at . Support Org development at , or support my work at