* failed tests
@ 2015-09-10 11:13 Alan Schmitt
2015-09-10 12:33 ` Nicolas Goaziou
0 siblings, 1 reply; 5+ messages in thread
From: Alan Schmitt @ 2015-09-10 11:13 UTC (permalink / raw)
To: emacs-orgmode
[-- Attachment #1: Type: text/plain, Size: 429 bytes --]
Hello,
I’m now getting two failed tests when compiling org (instead of the
expected single failed test about bash):
2 unexpected results:
FAILED ob-shell/bash-uses-assoc-arrays
FAILED test-org-babel/indented-cached-org-bracket-link
Is this expected?
Thanks,
Alan
--
OpenPGP Key ID : 040D0A3B4ED2E5C7
Last week athmospheric CO₂ average (Updated September 6, 2015, Mauna Loa Obs.):
377.86 ppm
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 472 bytes --]
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: failed tests
2015-09-10 11:13 failed tests Alan Schmitt
@ 2015-09-10 12:33 ` Nicolas Goaziou
2015-09-10 13:31 ` Alan Schmitt
0 siblings, 1 reply; 5+ messages in thread
From: Nicolas Goaziou @ 2015-09-10 12:33 UTC (permalink / raw)
To: Alan Schmitt; +Cc: emacs-orgmode
Hello,
Alan Schmitt <alan.schmitt@polytechnique.org> writes:
> I’m now getting two failed tests when compiling org (instead of the
> expected single failed test about bash):
>
> 2 unexpected results:
> FAILED ob-shell/bash-uses-assoc-arrays
> FAILED test-org-babel/indented-cached-org-bracket-link
>
> Is this expected?
I cannot reproduce it, neither http://www.randomsample.de:4457/waterfall
can.
Do you run tests interactively? If so, a local setting may interfere
with the test. Also, what is failing exactly?
Regards,
--
Nicolas Goaziou
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: failed tests
2015-09-10 12:33 ` Nicolas Goaziou
@ 2015-09-10 13:31 ` Alan Schmitt
2015-09-10 19:40 ` Nicolas Goaziou
0 siblings, 1 reply; 5+ messages in thread
From: Alan Schmitt @ 2015-09-10 13:31 UTC (permalink / raw)
To: emacs-orgmode
[-- Attachment #1: Type: text/plain, Size: 3334 bytes --]
On 2015-09-10 14:33, Nicolas Goaziou <mail@nicolasgoaziou.fr> writes:
> Hello,
>
> Alan Schmitt <alan.schmitt@polytechnique.org> writes:
>
>> I’m now getting two failed tests when compiling org (instead of the
>> expected single failed test about bash):
>>
>> 2 unexpected results:
>> FAILED ob-shell/bash-uses-assoc-arrays
>> FAILED test-org-babel/indented-cached-org-bracket-link
>>
>> Is this expected?
>
> I cannot reproduce it, neither http://www.randomsample.de:4457/waterfall
> can.
>
> Do you run tests interactively? If so, a local setting may interfere
> with the test. Also, what is failing exactly?
The tests are run when I run make (which call up2 according to my
local.mk).
The array one has been discussed before:
http://thread.gmane.org/gmane.emacs.orgmode/87724/focus=87864 and
http://thread.gmane.org/gmane.emacs.orgmode/89787/focus=94336
The babel one is new. Here is the output on my terminal:
--8<---------------cut here---------------start------------->8---
"/var/folders/68/fvntfrw92y50gkk_67rkhsfw0000gn/T/tmp-orgtest/test.txt"
Test test-org-babel/indented-cached-org-bracket-link backtrace:
(if (unwind-protect (setq value-50001 (let ((default-directory tempo
(let (form-description-50002) (if (unwind-protect (setq value-50001
(let ((value-50001 (cl-gensym "ert-form-evaluation-aborted-"))) (let
(lambda nil (let ((value-50001 (cl-gensym "ert-form-evaluation-abort
#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\317\320%DC
funcall(#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\31
ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\316%DC\2
funcall(#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\
ert-run-test([cl-struct-ert-test test-org-babel/indented-cached-org-
ert-run-or-rerun-test([cl-struct-ert--stats "\\(org\\|ob\\)" [[cl-st
ert-run-tests("\\(org\\|ob\\)" #[385 "\306\307\"\203D\211\211G\310
ert-run-tests-batch("\\(org\\|ob\\)")
ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
(let ((org-id-track-globally t) (org-test-selector (if org-test-sele
org-test-run-batch-tests("\\(org\\|ob\\)")
eval((org-test-run-batch-tests org-test-select-re))
command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
command-line()
normal-top-level()
Test test-org-babel/indented-cached-org-bracket-link condition:
(ert-test-failed
((should
(let
(...)
(org-test-with-temp-text "\n* Test\n #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n (message \"test\")\n #+END_SRC" ... ...)))
:form
(let
((default-directory temporary-file-directory))
(org-test-with-temp-text "\n* Test\n #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n (message \"test\")\n #+END_SRC"
(org-babel-execute-src-block)
(string= ... ...)))
:value nil))
FAILED 190/581 test-org-babel/indented-cached-org-bracket-link
--8<---------------cut here---------------end--------------->8---
Should I try to run it interactively? If so, are there instructions on
how to do it?
Thanks,
Alan
--
OpenPGP Key ID : 040D0A3B4ED2E5C7
Last week athmospheric CO₂ average (Updated September 6, 2015, Mauna Loa Obs.):
377.86 ppm
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 472 bytes --]
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: failed tests
2015-09-10 13:31 ` Alan Schmitt
@ 2015-09-10 19:40 ` Nicolas Goaziou
2015-09-16 9:45 ` Alan Schmitt
0 siblings, 1 reply; 5+ messages in thread
From: Nicolas Goaziou @ 2015-09-10 19:40 UTC (permalink / raw)
To: Alan Schmitt; +Cc: emacs-orgmode
Alan Schmitt <alan.schmitt@polytechnique.org> writes:
> The babel one is new. Here is the output on my terminal:
>
> "/var/folders/68/fvntfrw92y50gkk_67rkhsfw0000gn/T/tmp-orgtest/test.txt"
> Test test-org-babel/indented-cached-org-bracket-link backtrace:
> (if (unwind-protect (setq value-50001 (let ((default-directory tempo
> (let (form-description-50002) (if (unwind-protect (setq value-50001
> (let ((value-50001 (cl-gensym "ert-form-evaluation-aborted-"))) (let
> (lambda nil (let ((value-50001 (cl-gensym "ert-form-evaluation-abort
> #[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\317\320%DC
> funcall(#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\31
> ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
> #[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\316%DC\2
> funcall(#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\
> ert-run-test([cl-struct-ert-test test-org-babel/indented-cached-org-
> ert-run-or-rerun-test([cl-struct-ert--stats "\\(org\\|ob\\)" [[cl-st
> ert-run-tests("\\(org\\|ob\\)" #[385 "\306\307\"\203D\211\211G\310
> ert-run-tests-batch("\\(org\\|ob\\)")
> ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
> (let ((org-id-track-globally t) (org-test-selector (if org-test-sele
> org-test-run-batch-tests("\\(org\\|ob\\)")
> eval((org-test-run-batch-tests org-test-select-re))
> command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
> command-line()
> normal-top-level()
> Test test-org-babel/indented-cached-org-bracket-link condition:
> (ert-test-failed
> ((should
> (let
> (...)
> (org-test-with-temp-text "\n* Test\n #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n (message \"test\")\n #+END_SRC" ... ...)))
> :form
> (let
> ((default-directory temporary-file-directory))
> (org-test-with-temp-text "\n* Test\n #+<point>BEGIN_SRC emacs-lisp :file test.txt :cache yes\n (message \"test\")\n #+END_SRC"
> (org-babel-execute-src-block)
> (string= ... ...)))
> :value nil))
> FAILED 190/581 test-org-babel/indented-cached-org-bracket-link
>
> Should I try to run it interactively? If so, are there instructions on
> how to do it?
The test is self contained, i.e., no `org-test-at-id' insanity. You can
reproduce the steps in a temp Org buffer and see what is wrong, possibly
debugging `org-babel-execute-src-block' in the process.
Thanks for looking into it.
Regards,
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: failed tests
2015-09-10 19:40 ` Nicolas Goaziou
@ 2015-09-16 9:45 ` Alan Schmitt
0 siblings, 0 replies; 5+ messages in thread
From: Alan Schmitt @ 2015-09-16 9:45 UTC (permalink / raw)
To: emacs-orgmode
[-- Attachment #1: Type: text/plain, Size: 2396 bytes --]
On 2015-09-10 21:40, Nicolas Goaziou <mail@nicolasgoaziou.fr> writes:
> Alan Schmitt <alan.schmitt@polytechnique.org> writes:
>
>> Should I try to run it interactively? If so, are there instructions on
>> how to do it?
>
> The test is self contained, i.e., no `org-test-at-id' insanity. You can
> reproduce the steps in a temp Org buffer and see what is wrong, possibly
> debugging `org-babel-execute-src-block' in the process.
This unfortunately does not make sense: the test seems to work when
I run it manually, and it works when I run it using
`ert-run-tests-interactively'. So the problem only happens when run in
batch, but the backtrace tells me nothing I can understand:
--8<---------------cut here---------------start------------->8---
Test test-org-babel/indented-cached-org-bracket-link backtrace:
(if (unwind-protect (setq value-86301 (let ((default-directory tempo
(let (form-description-86302) (if (unwind-protect (setq value-86301
(let ((value-86301 (cl-gensym "ert-form-evaluation-aborted-"))) (let
(lambda nil (let ((value-86301 (cl-gensym "ert-form-evaluation-abort
#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\317\320%DC
funcall(#[0 "\306\307!r\211q\210\310\311\312\313\314\315!\316\"\31
ert--run-test-internal([cl-struct-ert--test-execution-info [cl-struc
#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\316%DC\2
funcall(#[0 "r\304 q\210\305 )\306\307\310\311\312\313!\314\"\315\
ert-run-test([cl-struct-ert-test test-org-babel/indented-cached-org-
ert-run-or-rerun-test([cl-struct-ert--stats "\\(org\\|ob\\)" [[cl-st
ert-run-tests("\\(org\\|ob\\)" #[385 "\306\307\"\203D\211\211G\310
ert-run-tests-batch("\\(org\\|ob\\)")
ert-run-tests-batch-and-exit("\\(org\\|ob\\)")
(let ((org-id-track-globally t) (org-test-selector (if org-test-sele
org-test-run-batch-tests("\\(org\\|ob\\)")
eval((org-test-run-batch-tests org-test-select-re))
command-line-1(("--eval" "(setq vc-handled-backends nil org-startup-
command-line()
normal-top-level()
--8<---------------cut here---------------end--------------->8---
If someone knows how the batch testing works, I would gladly follow
instructions on how to further debug this.
Best,
Alan
--
OpenPGP Key ID : 040D0A3B4ED2E5C7
Last week athmospheric CO₂ average (Updated September 13, 2015, Mauna Loa Obs.):
397.77 ppm
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 472 bytes --]
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2015-09-16 9:45 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-09-10 11:13 failed tests Alan Schmitt
2015-09-10 12:33 ` Nicolas Goaziou
2015-09-10 13:31 ` Alan Schmitt
2015-09-10 19:40 ` Nicolas Goaziou
2015-09-16 9:45 ` Alan Schmitt
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/emacs/org-mode.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).