From mboxrd@z Thu Jan 1 00:00:00 1970 From: Eric Schulte Subject: Re: [RFC] testing the org exporters Date: Fri, 01 Jul 2011 13:08:42 -0700 Message-ID: <87k4c1lpx9.fsf@gmail.com> References: <81iprmxk5x.fsf@gmail.com> Mime-Version: 1.0 Content-Type: text/plain Return-path: Received: from eggs.gnu.org ([140.186.70.92]:41375) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Qck6C-0005wS-53 for emacs-orgmode@gnu.org; Fri, 01 Jul 2011 16:14:01 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Qck6A-0007Ry-83 for emacs-orgmode@gnu.org; Fri, 01 Jul 2011 16:13:59 -0400 Received: from mail-pz0-f41.google.com ([209.85.210.41]:43821) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Qck69-0007PY-Qb for emacs-orgmode@gnu.org; Fri, 01 Jul 2011 16:13:57 -0400 Received: by mail-pz0-f41.google.com with SMTP id 4so3901833pzk.0 for ; Fri, 01 Jul 2011 13:13:57 -0700 (PDT) List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Jambunathan K Cc: emacs-orgmode@gnu.org Jambunathan K writes: > I have been using the attached test.org file as part of my org-odt > related work. > > The usual steps I follow for testing are quite simple: > 1. Visit the file > 2. Export it to xhtml or odt > 3. Visually make sure that everything is OK. > > I would like to add this file to the testing dir of the trunk. This file > would be a good starting point for not only validating but also > documenting (the quirks?) of various exporters. > > At the moment, I am not very inclined to have it integrated with > ert[1]. Based on my experience, the standalone test.org file has proven > it's worth multiple times over during the development phase. > > What do you think? I am happy to hear feedback on > > 1. what to put in that test.org > 2. where to put the test.org > 3. how to have it integrated with test framework. > > Footnotes: > [1] This is mostly because I don't know nothing about ert. Hi Jambunathan, I would very much like to see this test file [1] integrated into the testing repository of org-mode in (testing/examples) _and_ integrated into Org-mode's ert test framework. ERT is easy to use, and will more than repay any time spent applying it to your test file through the ability to quickly programmatically and reproducibly evaluate export results. There are many tests [2] which already implement a 1. visit example file 2. export to backend 3. confirm properties of backend (e.g., does or does not contain some string) Please try running the Org-mode test suite and look at the examples in testing/lisp. I see no reason not to take this final step and begin writing ERT tests which can serve as both documentation of issues and insurance against regression. Best -- Eric Footnotes: [1] I am not sure about including the org-mode unicorn png image in the repository as that could add alot of weight... perhaps .gitignore that file, point to a version of the file online, or generate an image on the fly with ditaa as part of the test suite [2] for example those in testing/lisp/test-ob-exp.el -- Eric Schulte http://cs.unm.edu/~eschulte/