From mboxrd@z Thu Jan 1 00:00:00 1970 From: Nick Dokos Subject: Re: tests with travis-ci Date: Fri, 22 Mar 2013 08:55:43 -0400 Message-ID: <6085.1363956943@alphaville> References: <16047.1363748067@alphaville> <86vc8mtfcx.fsf@somewhere.org> <87fvzqnpfd.fsf@bzg.ath.cx> <87fvzozx88.fsf@bzg.ath.cx> <87hak4d712.fsf@yagnesh.org> <87vc8k4q2y.fsf@bzg.ath.cx> <87mwtwwq8a.fsf_-_@yagnesh.org> <87sj3o32p7.fsf@bzg.ath.cx> <514BFCD6.2040009@easy-emacs.de> Reply-To: nicholas.dokos@hp.com Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([208.118.235.92]:35925) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UJ1Vb-0006gX-A2 for emacs-orgmode@gnu.org; Fri, 22 Mar 2013 08:55:48 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UJ1VZ-0008Pl-HU for emacs-orgmode@gnu.org; Fri, 22 Mar 2013 08:55:47 -0400 Received: from g5t0008.atlanta.hp.com ([15.192.0.45]:32947) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UJ1VZ-0008PY-Bc for emacs-orgmode@gnu.org; Fri, 22 Mar 2013 08:55:45 -0400 In-Reply-To: Message from =?us-ascii?Q?=3D=3FISO-8859-15=3FQ=3FAndreas=5FR?= =?us-ascii?Q?=3DF6hler=3F=3D?= of "Fri\, 22 Mar 2013 07\:40\:22 BST." <514BFCD6.2040009@easy-emacs.de> List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: =?us-ascii?Q?=3D=3FISO-8859-15=3FQ=3FAndreas=5FR=3DF6hler=3F=3D?= Cc: emacs-orgmode@gnu.org Andreas R=C3=B6hler wrote: > Am 21.03.2013 21:41, schrieb Bastien: > [ ... ] > > Yes. The limitation of the pre-push hook comes from the fact that > > various developers may have various testing environments, no one > > should be prevented from pushing by the fact that tests do not pass > > for someone else. >=20 > [ ... ] >=20 > Hi, >=20 > just to ask about some more aspects: >=20 > - Typos often will break it from the beginning, so complete tests must no= t run all every time. > Will some testing at all is needed to detect the typos... >=20 Yes, run `make test'. Bastien already added a note to Worg, asking developers to run `make test' before pushing. That leaves it at the discretion of the developer, rather than having it run automatically from some hook which might have problems of its own. I believe that once developers (any that don't do so already) try it, they will find out the great benefits of doing so. And then both the problem and this discussion will die down :-) > - org-mode has already a directory testing. It was not obvious for me how= to make use of it. > Exists some docu wrt available tests? >=20 What we are talking about here is running existing test cases. For that, you just say `make test' to run the test suite. Creating new test cases and adding them to the test suite is a different matter of course. There is a useful README in the testing/ directory=20 and an examples/ subdir, but you can also just pick one of the existing tests in the lisp/ subdir and read it. Perhaps not the best example, but http://article.gmane.org/gmane.emacs.orgmode/62908/match=3Dert shows a minimal .emacs with a test case added. It should at least clarify the mechanics of creating and running a new test case, stripped down to its bare essentials. > - usually you know about the range of changes. > Limited tests checking certain features seem useful >=20 Not worth bothering about IMO: just run the whole test suite. Nick