From mboxrd@z Thu Jan 1 00:00:00 1970 From: Suvayu Ali Subject: Re: Re: Test framework needed Date: Wed, 30 Mar 2011 17:19:38 -0700 Message-ID: <20110330171938.16343937@kuru.homelinux.net> References: <4D9329BC.6000106@gmail.com> <87r59og1pt.fsf@ericabrahamsen.net> <4D93369C.7010608@gmail.com> <87vcz03d4p.fsf@sbs.ch> <4D933E9E.7030907@gmail.com> <87hbakp9hw.fsf@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Return-path: Received: from [140.186.70.92] (port=52345 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Q55c3-0005Bi-Du for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 20:19:48 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Q55c2-0002b5-4u for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 20:19:47 -0400 Received: from mail-yx0-f169.google.com ([209.85.213.169]:46521) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Q55c2-0002at-2L for emacs-orgmode@gnu.org; Wed, 30 Mar 2011 20:19:46 -0400 Received: by yxt33 with SMTP id 33so901695yxt.0 for ; Wed, 30 Mar 2011 17:19:45 -0700 (PDT) In-Reply-To: <87hbakp9hw.fsf@gmail.com> List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: emacs-orgmode@gnu.org On Wed, 30 Mar 2011 15:42:19 -0600 "Eric Schulte" wrote: > > > > This suite should actually be updated with effectively each patch > > which introduces new features and run after each patch. > > > > Agreed, in a perfect world... > > > > > So is it only necessary to add meat to this framework? > > > > Yes, I believe the best way forward would be to add tests to the > existing framework. I have a possibly completely useless idea regarding "automatically" checking regressions. As far I understand the problem now is its not very feasible to do automated tests with what ever test suite we have (or will have after the improvements) and see the exported results for each patch, as at some step it involves human intervention (as in, was the export good). So maybe we can have a directory on the Worg website (not part of the Worg git repo) where every week or so the test suites will publish with what ever the org-mode head is at the time for all the supported formats. Then us "puny lisp illiterate" users can check up on it over the course of the week and report back to the list if there is a problem. Since this way people can look at the export formats they are interested in, none of the formats get treated like a step child either. Would that be feasible? Or did I completely misunderstand the problem at hand? -- Suvayu Open source is the future. It sets us free.