From mboxrd@z Thu Jan 1 00:00:00 1970 From: Rainer M Krug Subject: Re: Re: Test framework needed Date: Wed, 30 Mar 2011 16:22:16 +0200 Message-ID: <4D933C98.3090207@gmail.com> References: <4D9329BC.6000106@gmail.com> <87r59og1pt.fsf@ericabrahamsen.net> <4D93369C.7010608@gmail.com> <87hbakg0l0.fsf@ericabrahamsen.net> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Return-path: Received: from [140.186.70.92] (port=59321 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Q4wHu-00032D-2d for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 10:22:23 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Q4wHs-00049A-ED for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 10:22:21 -0400 Received: from mail-wy0-f169.google.com ([74.125.82.169]:43934) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Q4wHs-00048x-5h for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 10:22:20 -0400 Received: by wyf19 with SMTP id 19so1343356wyf.0 for ; Wed, 30 Mar 2011 07:22:19 -0700 (PDT) In-Reply-To: <87hbakg0l0.fsf@ericabrahamsen.net> List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Eric Abrahamsen Cc: emacs-orgmode@gnu.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 30/03/11 16:11, Eric Abrahamsen wrote: > On Wed, Mar 30 2011, Rainer M Krug wrote: > >> On 30/03/11 15:46, Eric Abrahamsen wrote: >>> On Wed, Mar 30 2011, Rainer M Krug wrote: >>> >>>> Hi >>>> >>>> I was bitten again from an unintended regression in org-mode, and that >>>> the second time in two weeks. >>>> >>>> I am probably not the right person to suggest this, but I think it is >>>> time to introduce a test framework for org-mode, to ensure that the >>>> (without doubt useful) approach to develop org-mode does not lead to >>>> regressions. >>> >>> This would be the page to start with, though the most likely candidate >>> (Elisp Regression Testing) is only available in Emacs trunk at the >>> moment… >>> >>> http://www.emacswiki.org/emacs/UnitTesting >> >> Am I right in assuming, that all of the possible test frameworks would >> require org files and the expected output (tengle, export to ..., >> agenda, ...)? In this case, would it make sense to start collecting >> those, as they can easily be user contributed, consequently representing >> a cross section of the use cases (even not intended use cases)? > > Yup, what you would need is some org source files that exercise all of > the possible export options (for testing export, for example), including > weird edge cases, and then ERT (if that's what we ended up using) would > provide handy functions for making sure the export output matches > expectations. The excellent gentleman who created the ODT exporter, > whose name currently escapes me, has already created test files for his > exporter—that would be a perfect place to start. > > Covering all of org's various functions would end up being a bit of a > PITA, though you're quite right that it's an excellent idea, and will > become more and more necessary. So would there be a possibility of "normal org users" (if there is such a thing ...) to contribute to this? What would be needed? Any specific structure of the org files? Rainer > > E > > - -- Rainer M. Krug, PhD (Conservation Ecology, SUN), MSc (Conservation Biology, UCT), Dipl. Phys. (Germany) Centre of Excellence for Invasion Biology Natural Sciences Building Office Suite 2039 Stellenbosch University Main Campus, Merriman Avenue Stellenbosch South Africa Tel: +33 - (0)9 53 10 27 44 Cell: +27 - (0)8 39 47 90 42 Fax (SA): +27 - (0)8 65 16 27 82 Fax (D) : +49 - (0)3 21 21 25 22 44 Fax (FR): +33 - (0)9 58 10 27 44 email: Rainer@krugs.de Skype: RMkrug -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk2TPJgACgkQoYgNqgF2egoWKwCeMjWgggD7JMhVTrQTHe3f7n6s VhgAn2CG25hOa1Q4RPufarreQVYlezHm =18s2 -----END PGP SIGNATURE-----