From mboxrd@z Thu Jan 1 00:00:00 1970 From: Brian Wightman Subject: Fwd: [test] Mark tests with missing dependencies as "expected to fail" Date: Tue, 18 Oct 2011 12:03:09 -0500 Message-ID: References: <87fwiqnclu.wl%dmaus@ictsoc.de> <87fwiq2rsl.fsf@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([140.186.70.92]:57686) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1RGD4K-0002M9-JM for emacs-orgmode@gnu.org; Tue, 18 Oct 2011 13:03:16 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1RGD4J-0004Vz-3L for emacs-orgmode@gnu.org; Tue, 18 Oct 2011 13:03:12 -0400 Received: from mail-qy0-f176.google.com ([209.85.216.176]:34394) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1RGD4J-0004Vn-13 for emacs-orgmode@gnu.org; Tue, 18 Oct 2011 13:03:11 -0400 Received: by qyk30 with SMTP id 30so850374qyk.0 for ; Tue, 18 Oct 2011 10:03:09 -0700 (PDT) In-Reply-To: List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: emacs-orgmode@gnu.org Neglected forwarding to the list - sorry Eric for the double post. Brian ---------- Forwarded message ---------- From: Brian Wightman Date: Tue, Oct 18, 2011 at 12:02 PM Subject: Re: [O] [test] Mark tests with missing dependencies as "expected to fail" To: Eric Schulte On Tue, Oct 18, 2011 at 11:22 AM, Eric Schulte wro= te: > I agree it would be preferable to note that not all tests are run when > dependencies are missing, although I don't think it is extremely > important. =A0I think some version of the above would be worthwhile if it > could be done in a file-wide manner (as are the current dependency > checks) and wouldn't require duplicating the dependency check or > changing every test form individually. =A0Perhaps a file-local-variable > could be used to expect failures for every form defined in the file? Perl's TAP* (http://testanything.org/) uses SKIP results for tests that should not be run because some prerequisite is not available, and TODO tests for those that are expected to fail (due to not being implemented, known breakage, etc). =A0They can be reported separately if the harness wishes. It sounds like this is what is being proposed. =A0Perhaps some prior art could be used. * I reference TAP because it is what I am familiar with, not because it is better or worse than alternatives. Brian