batch failure of first org-num test

batch failure of first org-num test

[Kyle Meyer]

Hello,

When I run the tests on master in batch (specifically ‘make test’),
test-org-num/format-function fails (backtrace at end of message).  That
test doesn't fail if I run it interactively.

Looking at test-org-num.el, I see that the first test,
test-org-num/face, is commented with the explanation “FIXME: this test
fails in batch mode”.  So it seems that commenting out that test just
pushes the failure down the line.  And indeed if I comment out
test-org-num/format-function, the next test fails.

I don’t have an understanding of the underlying issue, but if I add
‘(require 'org-num)’ to test-org-num.el, all tests pass for me with
‘make test’.

--8<---------------cut here---------------start------------->8---
Test test-org-num/format-function backtrace:
  signal(ert-test-failed (((should (equal '("foo" "foo") (org-test-wit
  ert-fail(((should (equal '("foo" "foo") (org-test-with-temp-text "* 
  (if (unwind-protect (setq value-8786 (apply fn-8784 args-8785)) (set
  (let (form-description-8788) (if (unwind-protect (setq value-8786 (a
  (let ((value-8786 'ert-form-evaluation-aborted-8787)) (let (form-des
  (let* ((fn-8784 (function equal)) (args-8785 (condition-case err (le
  (closure (t) nil (let* ((fn-8784 (function equal)) (args-8785 (condi
  ert--run-test-internal(#s(ert--test-execution-info :test #s(ert-test
  ert-run-test(#s(ert-test :name test-org-num/format-function :documen
  ert-run-or-rerun-test(#s(ert--stats :selector "\\(org\\|ob\\)" :test
  ert-run-tests("\\(org\\|ob\\)" #f(compiled-function (event-type &res
  ert-run-tests-batch("\\(org\\|ob\\)")
  ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
  (let ((org-id-track-globally t) (org-test-selector (if org-test-sele
  org-test-run-batch-tests("\\(org\\|ob\\)")
  eval((org-test-run-batch-tests org-test-select-re))
  command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
  command-line()
  normal-top-level()
Test test-org-num/format-function condition:
    (ert-test-failed
     ((should
       (equal '...
        (org-test-with-temp-text "* H1
** H2" ... ...)))
      :form
      (equal
       ("foo" "foo")
       (#("1.1 " 0 4 ...)
         #("1 " 0 2 ...)))
      :value nil :explanation
      (list-elt 0
                (arrays-of-different-length 3 4 "foo"
                                            #("1.1 " 0 4 ...)
                                            first-mismatch-at 0))))
--8<---------------cut here---------------end--------------->8---

Re: batch failure of first org-num test

[Kyle Meyer]

Sorry, I just now spotted an earlier message from Kaushal that reports
the same test failure:
https://lists.gnu.org/archive/html/emacs-orgmode/2019-01/msg00112.html

Re: batch failure of first org-num test

[Kaushal Modi]

[-- Attachment #1: Type: text/plain, Size: 315 bytes --]

On Mon, Jan 7, 2019, 2:56 PM Kyle Meyer <kyle@kyleam.com wrote:

> Sorry, I just now spotted an earlier message from Kaushal that reports
> the same test failure:
> https://lists.gnu.org/archive/html/emacs-orgmode/2019-01/msg00112.html


No need to be sorry. You did the debugging and even found a fix for this. :)

[-- Attachment #2: Type: text/html, Size: 755 bytes --]