From mboxrd@z Thu Jan 1 00:00:00 1970 From: MidLifeXis at PerlMonks Subject: Re: Re: Test framework needed Date: Wed, 30 Mar 2011 07:26:32 -0700 (PDT) Message-ID: <402797.61840.qm@web81605.mail.mud.yahoo.com> References: <4D9329BC.6000106@gmail.com> <87r59og1pt.fsf@ericabrahamsen.net> <4D93369C.7010608@gmail.com> <87hbakg0l0.fsf@ericabrahamsen.net> Reply-To: MidLifeXis at PerlMonks Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from [140.186.70.92] (port=35583 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Q4wMB-00053C-RE for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 10:26:49 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Q4wLz-0005Jn-86 for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 10:26:46 -0400 Received: from nm15-vm0.access.bullet.mail.mud.yahoo.com ([66.94.236.17]:33227) by eggs.gnu.org with smtp (Exim 4.71) (envelope-from ) id 1Q4wLz-0005J5-0I for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 10:26:35 -0400 In-Reply-To: <87hbakg0l0.fsf@ericabrahamsen.net> List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: emacs-orgmode@gnu.org As a heavy Perl user, writing /automated/ tests is a large part of my dev w= ork.=0A=0AI would suggest / plea / encourage that whatever framework is use= d can be =0Aautomated. If it cannot be run as part of an automated process= it is not going =0Ato be run. Also consider a set of testing platforms (e= macs version, supporting =0Aversions of other .el modules, OS version, exte= rnal software). There are many =0Adependencies that org has - being able t= o automate this testing is a must.=0A=0AJust my $0.02.=0A=0ABrian / MidLife= Xis=0A=0A=0A=0A----- Original Message ----=0AFrom: Eric Abrahamsen =0ATo: emacs-orgmode@gnu.org=0ASent: Wed, March 30, 2011 9= :11:23 AM=0ASubject: [O] Re: Test framework needed=0A=0AOn Wed, Mar 30 2011= , Rainer M Krug wrote:=0A=0A> On 30/03/11 15:46, Eric Abrahamsen wrote:=0A>= > On Wed, Mar 30 2011, Rainer M Krug wrote:=0A>> =0A>>> Hi=0A>>>=0A>>> I wa= s bitten again from an unintended regression in org-mode, and that=0A>>> th= e second time in two weeks.=0A>>>=0A>>> I am probably not the right person = to suggest this, but I think it is=0A>>> time to introduce a test framework= for org-mode, to ensure that the=0A>>> (without doubt useful) approach to = develop org-mode does not lead to=0A>>> regressions.=0A>> =0A>> This would = be the page to start with, though the most likely candidate=0A>> (Elisp Reg= ression Testing) is only available in Emacs trunk at the=0A>> moment=E2=80= =A6=0A>> =0A>> http://www.emacswiki.org/emacs/UnitTesting=0A>=0A> Am I righ= t in assuming, that all of the possible test frameworks would=0A> require o= rg files and the expected output (tengle, export to ...,=0A> agenda, ...)? = In this case, would it make sense to start collecting=0A> those, as they ca= n easily be user contributed, consequently representing=0A> a cross section= of the use cases (even not intended use cases)?=0A=0AYup, what you would n= eed is some org source files that exercise all of=0Athe possible export opt= ions (for testing export, for example), including=0Aweird edge cases, and t= hen ERT (if that's what we ended up using) would=0Aprovide handy functions = for making sure the export output matches=0Aexpectations. The excellent gen= tleman who created the ODT exporter,=0Awhose name currently escapes me, has= already created test files for his=0Aexporter=E2=80=94that would be a perf= ect place to start.=0A=0ACovering all of org's various functions would end = up being a bit of a=0APITA, though you're quite right that it's an excellen= t idea, and will=0Abecome more and more necessary.=0A=0AE