emacs-orgmode@gnu.org archives
 help / color / mirror / code / Atom feed
* failed tests
@ 2015-09-10 11:13 Alan Schmitt
  2015-09-10 12:33 ` Nicolas Goaziou
  0 siblings, 1 reply; 5+ messages in thread
From: Alan Schmitt @ 2015-09-10 11:13 UTC (permalink / raw)
  To: emacs-orgmode

[-- Attachment #1: Type: text/plain, Size: 429 bytes --]

Hello,

I’m now getting two failed tests when compiling org (instead of the
expected single failed test about bash):

2 unexpected results:
   FAILED  ob-shell/bash-uses-assoc-arrays
   FAILED  test-org-babel/indented-cached-org-bracket-link

Is this expected?

Thanks,

Alan

-- 
OpenPGP Key ID : 040D0A3B4ED2E5C7
Last week athmospheric CO₂ average (Updated September 6, 2015, Mauna Loa Obs.):
377.86 ppm

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 472 bytes --]

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: failed tests
  2015-09-10 11:13 failed tests Alan Schmitt
@ 2015-09-10 12:33 ` Nicolas Goaziou
  2015-09-10 13:31   ` Alan Schmitt
  0 siblings, 1 reply; 5+ messages in thread
From: Nicolas Goaziou @ 2015-09-10 12:33 UTC (permalink / raw)
  To: Alan Schmitt; +Cc: emacs-orgmode

Hello,

Alan Schmitt <alan.schmitt@polytechnique.org> writes:

> I’m now getting two failed tests when compiling org (instead of the
> expected single failed test about bash):
>
> 2 unexpected results:
>    FAILED  ob-shell/bash-uses-assoc-arrays
>    FAILED  test-org-babel/indented-cached-org-bracket-link
>
> Is this expected?

I cannot reproduce it, neither http://www.randomsample.de:4457/waterfall
can.

Do you run tests interactively? If so, a local setting may interfere
with the test. Also, what is failing exactly?

Regards,

-- 
Nicolas Goaziou

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: failed tests
  2015-09-10 12:33 ` Nicolas Goaziou
@ 2015-09-10 13:31   ` Alan Schmitt
  2015-09-10 19:40     ` Nicolas Goaziou
  0 siblings, 1 reply; 5+ messages in thread
From: Alan Schmitt @ 2015-09-10 13:31 UTC (permalink / raw)
  To: emacs-orgmode

[-- Attachment #1: Type: text/plain, Size: 3334 bytes --]

On 2015-09-10 14:33, Nicolas Goaziou <mail@nicolasgoaziou.fr> writes:

> Hello,
>
> Alan Schmitt <alan.schmitt@polytechnique.org> writes:
>
>> I’m now getting two failed tests when compiling org (instead of the
>> expected single failed test about bash):
>>
>> 2 unexpected results:
>>    FAILED  ob-shell/bash-uses-assoc-arrays
>>    FAILED  test-org-babel/indented-cached-org-bracket-link
>>
>> Is this expected?
>
> I cannot reproduce it, neither http://www.randomsample.de:4457/waterfall
> can.
>
> Do you run tests interactively? If so, a local setting may interfere
> with the test. Also, what is failing exactly?

The tests are run when I run make (which call up2 according to my
local.mk).

The array one has been discussed before:
http://thread.gmane.org/gmane.emacs.orgmode/87724/focus=87864 and
http://thread.gmane.org/gmane.emacs.orgmode/89787/focus=94336

The babel one is new. Here is the output on my terminal:

--8<---------------cut here---------------start------------->8---
"/var/folders/68/fvntfrw92y50gkk_67rkhsfw0000gn/T/tmp-orgtest/test.txt"
Test test-org-babel/indented-cached-org-bracket-link backtrace:
  (if (unwind-protect (setq value-50001 (let ((default-directory tempo
  (let (form-description-50002) (if (unwind-protect (setq value-50001
  (let ((value-50001 (cl-gensym "ert-form-evaluation-aborted-"))) (let
  (lambda nil (let ((value-50001 (cl-gensym "ert-form-evaluation-abort
  #[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\317\320%DC
  funcall(#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\31
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  #[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\316%DC\2
  funcall(#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\
  ert-run-test([cl-struct-ert-test test-org-babel/indented-cached-org-
  ert-run-or-rerun-test([cl-struct-ert--stats "\\(org\\|ob\\)" [[cl-st
  ert-run-tests("\\(org\\|ob\\)" #[385 "\306\307\"\203D\211\211G\310
  ert-run-tests-batch("\\(org\\|ob\\)")
  ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
  (let ((org-id-track-globally t) (org-test-selector (if org-test-sele
  org-test-run-batch-tests("\\(org\\|ob\\)")
  eval((org-test-run-batch-tests org-test-select-re))
  command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
  command-line()
  normal-top-level()
Test test-org-babel/indented-cached-org-bracket-link condition:
    (ert-test-failed
     ((should
       (let
	   (...)
	 (org-test-with-temp-text "\n* Test\n  #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n    (message \"test\")\n  #+END_SRC" ... ...)))
      :form
      (let
	  ((default-directory temporary-file-directory))
	(org-test-with-temp-text "\n* Test\n  #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n    (message \"test\")\n  #+END_SRC"
	  (org-babel-execute-src-block)
	  (string= ... ...)))
      :value nil))
   FAILED  190/581  test-org-babel/indented-cached-org-bracket-link
--8<---------------cut here---------------end--------------->8---

Should I try to run it interactively? If so, are there instructions on
how to do it?

Thanks,

Alan

-- 
OpenPGP Key ID : 040D0A3B4ED2E5C7
Last week athmospheric CO₂ average (Updated September 6, 2015, Mauna Loa Obs.):
377.86 ppm

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 472 bytes --]

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: failed tests
  2015-09-10 13:31   ` Alan Schmitt
@ 2015-09-10 19:40     ` Nicolas Goaziou
  2015-09-16  9:45       ` Alan Schmitt
  0 siblings, 1 reply; 5+ messages in thread
From: Nicolas Goaziou @ 2015-09-10 19:40 UTC (permalink / raw)
  To: Alan Schmitt; +Cc: emacs-orgmode

Alan Schmitt <alan.schmitt@polytechnique.org> writes:

> The babel one is new. Here is the output on my terminal:
>
> "/var/folders/68/fvntfrw92y50gkk_67rkhsfw0000gn/T/tmp-orgtest/test.txt"
> Test test-org-babel/indented-cached-org-bracket-link backtrace:
>   (if (unwind-protect (setq value-50001 (let ((default-directory tempo
>   (let (form-description-50002) (if (unwind-protect (setq value-50001
>   (let ((value-50001 (cl-gensym "ert-form-evaluation-aborted-"))) (let
>   (lambda nil (let ((value-50001 (cl-gensym "ert-form-evaluation-abort
>   #[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\317\320%DC
>   funcall(#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\31
>   ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
>   #[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\316%DC\2
>   funcall(#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\
>   ert-run-test([cl-struct-ert-test test-org-babel/indented-cached-org-
>   ert-run-or-rerun-test([cl-struct-ert--stats "\\(org\\|ob\\)" [[cl-st
>   ert-run-tests("\\(org\\|ob\\)" #[385 "\306\307\"\203D\211\211G\310
>   ert-run-tests-batch("\\(org\\|ob\\)")
>   ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
>   (let ((org-id-track-globally t) (org-test-selector (if org-test-sele
>   org-test-run-batch-tests("\\(org\\|ob\\)")
>   eval((org-test-run-batch-tests org-test-select-re))
>   command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
>   command-line()
>   normal-top-level()
> Test test-org-babel/indented-cached-org-bracket-link condition:
>     (ert-test-failed
>      ((should
>        (let
> 	   (...)
> 	 (org-test-with-temp-text "\n* Test\n  #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n    (message \"test\")\n  #+END_SRC" ... ...)))
>       :form
>       (let
> 	  ((default-directory temporary-file-directory))
> 	(org-test-with-temp-text "\n* Test\n  #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n    (message \"test\")\n  #+END_SRC"
> 	  (org-babel-execute-src-block)
> 	  (string= ... ...)))
>       :value nil))
>    FAILED  190/581  test-org-babel/indented-cached-org-bracket-link
>
> Should I try to run it interactively? If so, are there instructions on
> how to do it?

The test is self contained, i.e., no `org-test-at-id' insanity. You can
reproduce the steps in a temp Org buffer and see what is wrong, possibly
debugging `org-babel-execute-src-block' in the process.

Thanks for looking into it.


Regards,

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: failed tests
  2015-09-10 19:40     ` Nicolas Goaziou
@ 2015-09-16  9:45       ` Alan Schmitt
  0 siblings, 0 replies; 5+ messages in thread
From: Alan Schmitt @ 2015-09-16  9:45 UTC (permalink / raw)
  To: emacs-orgmode

[-- Attachment #1: Type: text/plain, Size: 2396 bytes --]

On 2015-09-10 21:40, Nicolas Goaziou <mail@nicolasgoaziou.fr> writes:

> Alan Schmitt <alan.schmitt@polytechnique.org> writes:
>
>> Should I try to run it interactively? If so, are there instructions on
>> how to do it?
>
> The test is self contained, i.e., no `org-test-at-id' insanity. You can
> reproduce the steps in a temp Org buffer and see what is wrong, possibly
> debugging `org-babel-execute-src-block' in the process.

This unfortunately does not make sense: the test seems to work when
I run it manually, and it works when I run it using
`ert-run-tests-interactively'. So the problem only happens when run in
batch, but the backtrace tells me nothing I can understand:

--8<---------------cut here---------------start------------->8---
Test test-org-babel/indented-cached-org-bracket-link backtrace:
  (if (unwind-protect (setq value-86301 (let ((default-directory tempo
  (let (form-description-86302) (if (unwind-protect (setq value-86301
  (let ((value-86301 (cl-gensym "ert-form-evaluation-aborted-"))) (let
  (lambda nil (let ((value-86301 (cl-gensym "ert-form-evaluation-abort
  #[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\317\320%DC
  funcall(#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\31
  ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
  #[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\316%DC\2
  funcall(#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\
  ert-run-test([cl-struct-ert-test test-org-babel/indented-cached-org-
  ert-run-or-rerun-test([cl-struct-ert--stats "\\(org\\|ob\\)" [[cl-st
  ert-run-tests("\\(org\\|ob\\)" #[385 "\306\307\"\203D\211\211G\310
  ert-run-tests-batch("\\(org\\|ob\\)")
  ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
  (let ((org-id-track-globally t) (org-test-selector (if org-test-sele
  org-test-run-batch-tests("\\(org\\|ob\\)")
  eval((org-test-run-batch-tests org-test-select-re))
  command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
  command-line()
  normal-top-level()
--8<---------------cut here---------------end--------------->8---

If someone knows how the batch testing works, I would gladly follow
instructions on how to further debug this.

Best,

Alan

-- 
OpenPGP Key ID : 040D0A3B4ED2E5C7
Last week athmospheric CO₂ average (Updated September 13, 2015, Mauna Loa Obs.):
397.77 ppm

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 472 bytes --]

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2015-09-16  9:45 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-09-10 11:13 failed tests Alan Schmitt
2015-09-10 12:33 ` Nicolas Goaziou
2015-09-10 13:31   ` Alan Schmitt
2015-09-10 19:40     ` Nicolas Goaziou
2015-09-16  9:45       ` Alan Schmitt

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).