From mboxrd@z Thu Jan 1 00:00:00 1970 From: Richard Riley Subject: Re: Re: How you can help Date: Thu, 23 Oct 2008 17:49:51 +0200 Message-ID: References: <967CE7ED-05E9-4031-9F3B-CFB826511554@alexanderonline.org> <878wsfpgtp.fsf@gollum.intra.norang.ca> <877i7zbbe4.fsf@kassiopeya.MSHEIMNETZ> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43) id 1Kt4Mk-0002QO-W5 for emacs-orgmode@gnu.org; Thu, 23 Oct 2008 13:52:59 -0400 Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43) id 1Kt4Mk-0002QC-GM for emacs-orgmode@gnu.org; Thu, 23 Oct 2008 13:52:58 -0400 Received: from [199.232.76.173] (port=57689 helo=monty-python.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Kt4Mk-0002Q9-DT for emacs-orgmode@gnu.org; Thu, 23 Oct 2008 13:52:58 -0400 Received: from yx-out-1718.google.com ([74.125.44.157]:5823) by monty-python.gnu.org with esmtp (Exim 4.60) (envelope-from ) id 1Kt4Mk-0000zQ-2N for emacs-orgmode@gnu.org; Thu, 23 Oct 2008 13:52:58 -0400 Received: by yx-out-1718.google.com with SMTP id 34so140352yxf.66 for ; Thu, 23 Oct 2008 10:52:56 -0700 (PDT) In-Reply-To: <877i7zbbe4.fsf@kassiopeya.MSHEIMNETZ> (Sebastian Rose's message of "Thu, 23 Oct 2008 17:04:51 +0200") List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Sebastian Rose Cc: Bernt Hansen , emacs-orgmode@gnu.org, Ben Alexander Sebastian Rose writes: > Bernt Hansen writes: >> Running a minimal emacs should suppress custom config files: >> emacs -q -l yourtest.el > > Added this one to the Clippboard section on new org-tests/index.org in > Worg.git. (this section will be temporary...) Something like the above should only be a link (at most) to the emacs manual. Reproducing standard info is bad in the long run in case things in the base product (emacs) change for example. > >> Some kind of regression testing framework would be awesome. Org-mode is >> large enough that this is almost a necessity to keep things stable and >> bug-free. > > It's big and feature-RICH. The nature of OSS means that the community using the product keep it stable and bug free. I dont think the efforts to produce meaningful regression tests would be beneficial in an ever morphing product like org-mode. Clearly my humble opinion on that one :-; > >> Maybe something can be put together from the git testing framework and >> use of emacs -batch to process test org files and verify the output is >> as expected (with diff or some other tool). > > > Hey, diff is a good idea!! > > I didn't take the verification of the output into account yet :-) > > I just pushed a change of Worgs start page, and added a directory > 'org-tests'. I've placed an index.org there, which now is just a > collection of ideas (I'm on my day job, so I can't really work on it > now). > > Don't know how often the git repo is published. > Bernt and Ben, are you 'worgers' allready? > > Do you think it makes sense to add snippets and ideas to the new page in > Worg? I think while the list great to exchange ideas, it's good to have > a place, where all those ideas are destilled to one-liners. I must say I am dubious about this. It means, for the tests to be meaningful, that the output must be a fixed format in base org. I doubt this will ever be the case. The presentation will fluctuate while the core information (dates, schedules periods etc) will remain pretty much constant. The majority of bugs that I see are often down to people misusing or using things in the base which are not fully explored. No amount of regression testing can cover things like that unless the regression tests include everyones customisations. Do I think regression testing is important? Yes - in certain environments. But every time Carsten, you, myself or anyone else fires up org-mode we are already doing just that. -- Inventor: A person who makes an ingenious arrangement of wheels, levers and springs, and believes it civilization. ~Ambrose Bierce, The Devil's Dictionary