From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:306:2d92::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id UOPoEH54LGUwZwAAauVa8A:P1 (envelope-from ) for ; Mon, 16 Oct 2023 01:40:46 +0200 Received: from aspmx1.migadu.com ([2001:41d0:306:2d92::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id UOPoEH54LGUwZwAAauVa8A (envelope-from ) for ; Mon, 16 Oct 2023 01:40:46 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1762B40D84 for ; Mon, 16 Oct 2023 01:40:44 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=basr6y2Y; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1697413246; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=xaJ7TDFZqcDc8RDAvf7veJcGlsGqgGfBZbX0CtkLDvg=; b=sEH2G2KYw5wqFEgtONEwS+j79z+869Sc8bB9MI4Z9HP054gGD8XAPyGFEDr3p8q41q1CvP vknzE9DckcjTPf4zS+Sb+kBLAq8BZJeX7UWX8RNqrJvxzL5aeJ3otC5CfhQKUIuAzxVc0z 9AjkGmBn4whQkLVf1ezmUpfqnLRbP+Zghv2tO94MWEjKIXPTSY/bH349iNYDWuh/T8mKWL UrlCUgUkT6fo74bexW2GIuGTAiCLozppzFivGh1FQegc4DqHwHzJDYQl9i15WsKk62ayf2 p9lUSCsewOI67OR3UAFkPaV0AuD7deFiC9U/7D1yMf4VYCXLp8ow9tKtTTCH6w== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=basr6y2Y; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=key1; d=yhetil.org; t=1697413246; a=rsa-sha256; cv=none; b=ZTX+aDIlmNEBGl47mHYx3jr4B7yxynqjfIcoRtkDOcvjd6gkemBKlgRz8bRfnxzhA+jJf8 GF8pYCCYPgMwtNUnXbDmsu2qqJWFfCIKnxMLzMzhRTc5Z9WQ0avwssHr3h1i0/WQs+1AZB UON3xUI2X6qCPyVq/W0suor4Ql0FfXrucU1+pXr6RCZlVFuB/Hfd+92ULZ69qShXoD0MXa Xk8qCVGONi2EDH6pwdOW+jkuzgS0NGIvzJqnNifxY0od+v6+W36OgpZX+4+XB/b8SJUq8+ JRPJI1ydfxkW2mS8CtzV3Ydu4s4OvJAlEYpN127zkLx5cxTxf5Ha/S4lhF42Lg== Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qsAiA-0004YK-LX; Sun, 15 Oct 2023 19:39:54 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qsAi8-0004Xy-Gj for emacs-orgmode@gnu.org; Sun, 15 Oct 2023 19:39:52 -0400 Received: from mail-pg1-x535.google.com ([2607:f8b0:4864:20::535]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qsAi6-0007iD-Pb for emacs-orgmode@gnu.org; Sun, 15 Oct 2023 19:39:52 -0400 Received: by mail-pg1-x535.google.com with SMTP id 41be03b00d2f7-578b4981526so2188245a12.0 for ; Sun, 15 Oct 2023 16:39:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697413189; x=1698017989; darn=gnu.org; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :from:to:cc:subject:date:message-id:reply-to; bh=xaJ7TDFZqcDc8RDAvf7veJcGlsGqgGfBZbX0CtkLDvg=; b=basr6y2YtooXGFe9o6kRfHavpFQ64YM/m5G87mROh6kg4Qnvr+B4913/+vGqFIWc/j P5IRsYrfYt806zvOOcYwPCv7CKlNeySTQ+yAlRcxCzy9YpU/BCsePjkZ8IvpI5IQfx4u 1QzIQJuEJFTxSusEaZaWB9L+E/I5qx768o3Fa316jOs3vmO37J0NmdscJqUCniM15rO/ irIGNrpIuTr/b4rBViYz1YTz0K6OSU74poZ8ZLSqxhUcNm82iKym62HILBT7nc3QduWy plKtXkBKd38AtZ3ndCaxenJKCxVSyychmHI/QnfovsBvJiw9Vzyv10M2CD/6eCkrH4kF 4cVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697413189; x=1698017989; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=xaJ7TDFZqcDc8RDAvf7veJcGlsGqgGfBZbX0CtkLDvg=; b=gOanI7RMsxC4H4vcyeDrkDzBwhHCZVVuO69098wFn/JlXnN+IYrDoNS2ae2jhPW2iz lb69WUz+1yP8Elj250eM+fX+wRyAhhzoCgXFge4IGn+VyENR11ovfqgPTyILNR4hOnK6 1JPt+BYjUk4heBTyIHH/ipn/2oytyuIQXnb/n/tLtZp44dCV+oEqww7LoiqCwsOwWywY 0Zk+JmSQQJY0Hw4vM/bTO9LePBvRbrp3wH5XR7rPnfFZS7J8rDAmDaBXasly64PTyLaq 1qX4aDo+A01F3FPx09Zr3wHUfuOb21iX/AoggsG4AGuIfu2riqy/mUobtI/PgGFXoLgZ Ggew== X-Gm-Message-State: AOJu0YwWWFJ+uX9zkMcb5nBi2mgkRUMKYu6uzpjUuDDtzaTb184xmyrj 3oxWzdYX4NWCYVsazGblW0QDgYLJ4AQ= X-Google-Smtp-Source: AGHT+IEh7okux4AlO3nYozNnjmRJnDfmMzPeaHVhkXmkpfRa2uKkMS1cP5HIZ9MKimY6LpyJ9/H6MQ== X-Received: by 2002:a17:90a:196:b0:27d:3c11:3610 with SMTP id 22-20020a17090a019600b0027d3c113610mr4887679pjc.33.1697413188601; Sun, 15 Oct 2023 16:39:48 -0700 (PDT) Received: from localhost (157-131-78-143.fiber.dynamic.sonic.net. [157.131.78.143]) by smtp.gmail.com with ESMTPSA id ju1-20020a170903428100b001b9d335223csm7241317plb.26.2023.10.15.16.39.47 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 15 Oct 2023 16:39:48 -0700 (PDT) From: Jack Kamm To: Ihor Radchenko , emacs-orgmode@gnu.org Subject: Re: [BUG] FAILED test-ob-python/session-multiline In-Reply-To: <873506j7ky.fsf@localhost> References: <873506j7ky.fsf@localhost> Date: Sun, 15 Oct 2023 16:39:47 -0700 Message-ID: <87h6mrihfg.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2607:f8b0:4864:20::535; envelope-from=jackkamm@gmail.com; helo=mail-pg1-x535.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: emacs-orgmode-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -9.45 X-Spam-Score: -9.45 X-Migadu-Queue-Id: 1762B40D84 X-Migadu-Scanner: mx2.migadu.com X-TUID: dnhzWFcT62NN Ihor Radchenko writes: > We have fairly regular CI test failures for one of the ob-python tests. > The test does not fail _every_ time, but I keep seeing the problem in > various Emacs versions, including Emacs 29. > > Example log: https://builds.sr.ht/~bzg/job/1047678#task-build > > In the test the result somehow includes prompt: > > Test test-ob-python/session-multiline condition: > (ert-test-failed > ((should > (equal "20" > (org-test-with-temp-text "#+begin_src python :session :results output\n foo = 0\n for _ in range(10):\n foo += 1\n\n foo += 1\n\n print(foo)\n#+end_src" ...))) > :form > (equal "20" ">>> 20") > :value nil :explanation > > > --> (arrays-of-different-length 2 6 "20" ">>> 20" first-mismatch-at 0))) Hello, sorry for the long time to address this. I've just pushed a commit [1] that might address this, based on a new hypothesis I have for the root cause: https://git.savannah.gnu.org/cgit/emacs/org-mode.git/commit/?id=1eb598758980d5fa4d7bb21c98dfc56f42cae59a Please let me know whether the problem continues, or whether it seems to improve. As an aside -- I am having a hard time figuring out how to monitor our CI for this. When I search in https://lists.sr.ht/~bzg/org-build-failures I can only find an example from 11 months ago. The example you sent (https://builds.sr.ht/~bzg/job/1047678#task-build) is more recent, but is "Unlisted" and doesn't show up when I search for it.