From mboxrd@z Thu Jan 1 00:00:00 1970 From: Aankhen Subject: Re: Re: Test framework needed Date: Thu, 31 Mar 2011 01:44:55 +0530 Message-ID: References: <4D9329BC.6000106@gmail.com> <87r59og1pt.fsf@ericabrahamsen.net> <4D93369C.7010608@gmail.com> <87vcz03d4p.fsf@sbs.ch> <4D933E9E.7030907@gmail.com> <87r59o8wum.fsf@univ-nantes.fr> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from [140.186.70.92] (port=53749 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Q51nT-0002qN-Mv for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 16:15:21 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Q51nS-0003VL-9V for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 16:15:19 -0400 Received: from mail-vx0-f169.google.com ([209.85.220.169]:56733) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Q51nS-0003VD-4p for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 16:15:18 -0400 Received: by vxk20 with SMTP id 20so1726316vxk.0 for ; Wed, 30 Mar 2011 13:15:17 -0700 (PDT) In-Reply-To: <87r59o8wum.fsf@univ-nantes.fr> List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Manuel Giraud , Rainer M Krug , emacs-orgmode@gnu.org, Christian Egli On Wed, Mar 30, 2011 at 20:43, Manuel Giraud wrote: > Rainer M Krug writes: > [snip] > >> Please correct me if I am missing something. >> >> This suite should actually be updated with effectively each patch which >> introduces new features and run after each patch. > > Which renders this framework far less automatic. I think that having a > set of org files against which one could try any export and *see* that > the results are almost correct would be enough. I think the =E2=80=9Cautomated=E2=80=9D part refers to running the tests. = What you suggest=E2=80=94having a set of files that you could manually export to ver= ify the results=E2=80=94wouldn=E2=80=99t be of much help, IMHO. First, it=E2= =80=99d require a lot more time than executing a single command and checking the summary at the end. Second, it=E2=80=99d be very error-prone. A comprehensive automated test suite gives people writing patches an easier way to perform regression testing and catch any unintended consequences. On the other hand, it /does/ take a lot of effort to keep it in sync with the codebase=E2=80=A6 maybe we need a Test Fairy. ;-) Aankhen