emacs-orgmode@gnu.org archives
 help / color / mirror / code / Atom feed
From: Brian Wightman <MidLifeXis@wightmanfam.org>
To: emacs-orgmode@gnu.org
Subject: Fwd: [test] Mark tests with missing dependencies as "expected to fail"
Date: Tue, 18 Oct 2011 12:03:09 -0500	[thread overview]
Message-ID: <CALbR621xZkqTcBNM7Gq1gd5NB2TcrTsgng0Tp_44ZvQp2QARuA@mail.gmail.com> (raw)
In-Reply-To: <CALbR62330+VdrP5sRHLa3Mre5HAi8+LkbkvkuxDGbyEjAApcJQ@mail.gmail.com>

Neglected forwarding to the list - sorry Eric for the double post.

Brian


---------- Forwarded message ----------
From: Brian Wightman <MidLifeXis@wightmanfam.org>
Date: Tue, Oct 18, 2011 at 12:02 PM
Subject: Re: [O] [test] Mark tests with missing dependencies as
"expected to fail"
To: Eric Schulte <schulte.eric@gmail.com>


On Tue, Oct 18, 2011 at 11:22 AM, Eric Schulte <schulte.eric@gmail.com> wrote:
> I agree it would be preferable to note that not all tests are run when
> dependencies are missing, although I don't think it is extremely
> important.  I think some version of the above would be worthwhile if it
> could be done in a file-wide manner (as are the current dependency
> checks) and wouldn't require duplicating the dependency check or
> changing every test form individually.  Perhaps a file-local-variable
> could be used to expect failures for every form defined in the file?

Perl's TAP* (http://testanything.org/) uses SKIP results for tests
that should not be run because some prerequisite is not available, and
TODO tests for those that are expected to fail (due to not being
implemented, known breakage, etc).  They can be reported separately if
the harness wishes.

It sounds like this is what is being proposed.  Perhaps some prior art
could be used.

* I reference TAP because it is what I am familiar with, not because
it is better or worse than alternatives.

Brian

  parent reply	other threads:[~2011-10-18 17:03 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-10-18  4:32 [test] Mark tests with missing dependencies as "expected to fail" David Maus
2011-10-18 16:22 ` Eric Schulte
     [not found]   ` <CALbR62330+VdrP5sRHLa3Mre5HAi8+LkbkvkuxDGbyEjAApcJQ@mail.gmail.com>
2011-10-18 17:03     ` Brian Wightman [this message]
2011-11-13 16:18   ` David Maus
2011-11-13 19:31     ` Eric Schulte
2011-11-22  6:10       ` David Maus

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://www.orgmode.org/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CALbR621xZkqTcBNM7Gq1gd5NB2TcrTsgng0Tp_44ZvQp2QARuA@mail.gmail.com \
    --to=midlifexis@wightmanfam.org \
    --cc=emacs-orgmode@gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).