From: "Christian Köstlin" <christian.koestlin@gmail.com>
To: Ihor Radchenko <yantar92@posteo.net>
Cc: emacs-orgmode@gnu.org
Subject: Re: [PATCH] Ignore flaky ob-python tests
Date: Thu, 3 Nov 2022 22:15:18 +0100 [thread overview]
Message-ID: <CAG741+btW5D9vWTodMx9HxgfkW=ZAtVbxh2x_TXKtSZE=DBbdg@mail.gmail.com> (raw)
In-Reply-To: <87leos7bnp.fsf@localhost>
Hi Ihor,
I somehow seem to remember that the async tests were also broken with
python.el (python-mode.el not installed).
at least sometimes? or is this only the underscore test?
If it's only the underscore test, I would suggest not installing
python-mode for ci and ignoring the really flaky tests (i think the
underscore one is a candidate here).
I somehow got the async things mixed up with the flaky tests, which is
not true for python-mode.el installed.
what do you think?
I really would like to see python tests pass ...
Kind regards,
Christian
On Thu, Nov 3, 2022 at 8:13 AM Ihor Radchenko <yantar92@posteo.net> wrote:
>
> Christian Köstlin <christian.koestlin@gmail.com> writes:
>
> > With my patch the tests are still failing but the testsuite continues
> > to run and returns
> > with 0 as status code (one can see the failed test though).
>
> FYI, I am using automated scripts to run make test locally on multiple
> Emacs versions. 0 status code would do no good for my testing.
>
> >> Maybe we can instead provide some variable that can turn-on ignoring
> >> some problematic tests only during CI tests?
> > Yes ... that would also be possible e.g. skip the test or test nothing
> > if it's running on the ci.
> > (I am talking only about the 3 tests!).
>
> More like just 1 test with underscore :)
> The 3 tests in the patch are real failures because ob-python does not
> fully support python-mode.el.
>
> --
> Ihor Radchenko // yantar92,
> Org mode contributor,
> Learn more about Org mode at <https://orgmode.org/>.
> Support Org development at <https://liberapay.com/org-mode>,
> or support my work at <https://liberapay.com/yantar92>
next prev parent reply other threads:[~2022-11-03 21:17 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-11-02 0:41 [PATCH] Ignore flaky ob-python tests Christian Köstlin
2022-11-02 6:53 ` Ihor Radchenko
2022-11-02 11:15 ` Christian Köstlin
2022-11-02 13:55 ` Jack Kamm
2022-11-02 14:12 ` Ihor Radchenko
2022-11-02 14:17 ` Ihor Radchenko
2022-11-03 7:14 ` Ihor Radchenko
2022-11-03 21:15 ` Christian Köstlin [this message]
2022-11-04 4:19 ` Ihor Radchenko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://www.orgmode.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAG741+btW5D9vWTodMx9HxgfkW=ZAtVbxh2x_TXKtSZE=DBbdg@mail.gmail.com' \
--to=christian.koestlin@gmail.com \
--cc=emacs-orgmode@gnu.org \
--cc=yantar92@posteo.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/emacs/org-mode.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).