From mboxrd@z Thu Jan  1 00:00:00 1970
From: Eric Schulte <schulte.eric@gmail.com>
Subject: Re: FYI: Org mode testing framework, Emacs 23 and 22
Date: Sat, 22 Oct 2011 10:19:55 -0600
Message-ID: <87vcrhyp5g.fsf@gmail.com>
References: <874o0veejl.wl%dmaus@ictsoc.de> <87y5y7oxyt.fsf@gmail.com>
	<877h5f558c.wl%dmaus@ictsoc.de> <87aaaaokpq.fsf@gmail.com>
	<87botakwru.fsf@gnu.org> <80hb32w4sp.fsf@somewhere.org>
Mime-Version: 1.0
Content-Type: text/plain
Return-path: <emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org>
Received: from eggs.gnu.org ([140.186.70.92]:51014)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <schulte.eric@gmail.com>) id 1RHeIl-0003ZN-Fz
	for emacs-orgmode@gnu.org; Sat, 22 Oct 2011 12:20:04 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <schulte.eric@gmail.com>) id 1RHeIk-0003gi-Cf
	for emacs-orgmode@gnu.org; Sat, 22 Oct 2011 12:20:03 -0400
Received: from mail-iy0-f169.google.com ([209.85.210.169]:54573)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <schulte.eric@gmail.com>) id 1RHeIk-0003gd-7b
	for emacs-orgmode@gnu.org; Sat, 22 Oct 2011 12:20:02 -0400
Received: by iagf6 with SMTP id f6so7410077iag.0
	for <emacs-orgmode@gnu.org>; Sat, 22 Oct 2011 09:20:01 -0700 (PDT)
In-Reply-To: <80hb32w4sp.fsf@somewhere.org> (Sebastien Vauban's message of
	"Fri, 21 Oct 2011 20:57:58 +0200")
List-Id: "General discussions about Org-mode." <emacs-orgmode.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/emacs-orgmode>,
	<mailto:emacs-orgmode-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/emacs-orgmode>
List-Post: <mailto:emacs-orgmode@gnu.org>
List-Help: <mailto:emacs-orgmode-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/emacs-orgmode>,
	<mailto:emacs-orgmode-request@gnu.org?subject=subscribe>
Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org
Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org
To: Sebastien Vauban <wxhgmqzgwmuf@spammotel.com>
Cc: emacs-orgmode@gnu.org

"Sebastien Vauban" <wxhgmqzgwmuf@spammotel.com> writes:

> Hi Bastien,
>
> Bastien wrote:
>> Hi Eric and David,
>> Eric Schulte <schulte.eric@gmail.com> writes:
>>
>>> I suppose the next step here would be to talk to Bastien about setting
>>> up such a system on the org-mode server.
>>
>> For the record, I'm all for a server-side setup that will test
>> latest Org on a regular basis.
>>

Fantastic.

>>
>> Jason, depending on our server resources, would that be feasible
>> to run regular (cron'ed) tests?  What is the best frequency?
>
> Wouldn't the best frequency be: at every commit?
>
> That's not for the minute (maybe even less) it takes to run the 102 tests, I
> guess...
>

$ time emacs -Q --batch \
    -l ~/.emacs.d/src/org/testing/org-test.el \
    --eval "(setq org-confirm-babel-evaluate nil)" \
    -f org-test-run-batch-tests 2>/dev/null 1>/dev/null \
4.00s user 0.44s system 56% cpu 7.834 total

So at 8 seconds (on my machine) it shouldn't put too much load on the
server to run after every commit, we would just want to be sure that
multiple instances of the test suite are not run at once.  A check to
only run the suite if it is not currently running shouldn't be difficult
to run.

I can work with Jason offline to figure out how to set this up.

Cheers -- Eric

--
Eric Schulte
http://cs.unm.edu/~eschulte/