From mboxrd@z Thu Jan 1 00:00:00 1970 From: Sebastien Vauban Subject: 63 failures for org-test-run-all-tests in an Emacs GUI Date: Mon, 22 Dec 2014 16:45:41 +0100 Message-ID: <86zjaf7knu.fsf@example.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org-mXXj517/zsQ@public.gmane.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org-mXXj517/zsQ@public.gmane.org To: emacs-orgmode-mXXj517/zsQ@public.gmane.org Hello, I just ran `org-test-run-all-tests' in my active WinNT Emacs session (with Org-mode release_8.3beta-677-g0497e3), and was surprised by the high number of failures: --8<---------------cut here---------------start------------->8--- Selector: "\\(org\\|ob\\)" Passed: 332 Failed: 63 (53 unexpected) Skipped: 0 Total: 395/395 Started at: 2014-12-22 16:34:06+0100 Finished. Finished at: 2014-12-22 16:34:42+0100 ....FFF.............FF........F...ffffffffff..F................F.F.F.FF....= ..FF..FFFFFFFF.....F.F.F........FFFFFFFFF...F..F.F...F.....................= ................................F...............F..........................= F.......................................F........FFF.......................= .....................................F..........F..........F...........F.FF= FF.................. F ob-emacs-lisp/commented-last-block-line (user-error "C-c C-c can do nothing useful at this location") F ob-emacs-lisp/commented-last-block-line-no-var (user-error "C-c C-c can do nothing useful at this location") F ob-emacs-lisp/commented-last-block-line-with-var (user-error "C-c C-c can do nothing useful at this location") F ob-exp/noweb-on-export Noweb header arguments export correctly. (ert-test-failed ((should (equal '("(message \"expanded1\")" "(message \"expanded2\")" ";; noweb-1-y= es-start\n (message \"expanded1\")\n (message \"expanded1\")" ";; noweb-n= o-start\n <>" ";; noweb-2-yes-start\n (message \"expanded= 2\")\n (message \"expanded2\")" ";; noweb-tangle-start\n<>= \n<>") (org-test-at-id "eb1f6498-5bd9-45e0-9c56-50717053e7b7" (org-narrow-to-subtree) (org-element-map ... ... ...)))) :form (equal ("(message \"expanded1\")" "(message \"expanded2\")" ";; noweb-1-yes= -start\n (message \"expanded1\")\n (message \"expanded1\")" ";; noweb-no-= start\n <>" ";; noweb-2-yes-start\n (message \"expanded2\= ")\n (message \"expanded2\")" ";; noweb-tangle-start\n<>\n= <>") ("(message \"expanded1\")" "(message \"expanded2\")" ";; noweb-1-yes= -start\n (message \"expanded1\")\n (message \"expanded1\")" ";; noweb= -no-start\n <>" ";; noweb-2-yes-start\n (message \"expa= nded2\")\n (message \"expanded2\")" ";; noweb-tangle-start\n <>\n <>")) :value nil :explanation (list-elt 2 (arrays-of-different-length 68 72 ";; noweb-1-yes-start\n = (message \"expanded1\")\n (message \"expanded1\")" ";; noweb-1-yes-start\n= (message \"expanded1\")\n (message \"expanded1\")" first-mismatch-at= 23)))) F ob-exp/noweb-on-export-with-exports-results Noweb header arguments export correctly using :exports results. (error "<>could not be resolved (see `org-babel-noweb-er= ror-langs')") F ob-tangle/continued-code-blocks-w-noweb-ref Test that the :noweb-ref header argument is used correctly. (ert-test-failed ((should (re-search-forward (regexp-quote tangled) nil t)) :form (re-search-forward "df|sed '1d'|awk '{print \\$5 \" \" \\$6}'|sort -n= |tail -1|awk '{print \\$2}'" nil t) :value nil)) F test-ob-exp/org-babel-exp-src-blocks/w-no-headers2 Testing export without any headlines in the org-mode file. (user-error "Abort") F test-ob-python/colnames-no-header-argument-again (ert-test-failed ((should (equal '(... ... ...) (org-babel-execute-src-block))) :form (equal (("a*") ("b*") ("c*")) "") :value nil :explanation (different-types (("a*") ("b*") ("c*")) ""))) F test-ob-python/colnames-yes-header-argument-again (ert-test-failed ((should (equal '(... hline ... ...) (org-babel-execute-src-block))) :form (equal (("a") hline ("b*") ("c*")) "") :value nil :explanation (different-types (("a") hline ("b*") ("c*")) ""))) F test-ob/blocks-with-spaces Test expansion of blocks followed by blank lines. (ert-test-failed ((should (equal "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+END_SRC\n\n#+RESULTS:\n: = 3\n\n\n" (org-test-with-temp-text "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+= END_SRC\n\n\n" (org-babel-execute-src-block) (buffer-string)))) :form (equal "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+END_SRC\n\n#+RESULTS:\n: 3= \n\n\n" "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+END_SRC\n\n#+results:\n: 3\n\n\= n") :value nil :explanation (array-elt 44 (different-atoms (82 "#x52" "?R") (114 "#x72" "?r"))))) F test-ob/commented-last-block-line-no-var (user-error "C-c C-c can do nothing useful at this location") F test-ob/commented-last-block-line-with-var (user-error "C-c C-c can do nothing useful at this location") F test-ob/noweb-expansion-1 (ert-test-failed ((should (string=3D (org-babel-expand-noweb-references) "bar")) :form (string=3D " bar" "bar") :value nil)) F test-ob/noweb-expansion-2 (ert-test-failed ((should (string=3D (org-babel-expand-noweb-references) "barbaz")) :form (string=3D " bar baz" "barbaz") :value nil)) F test-ob/org-babel-remove-result--results-code Test `org-babel-remove-result' with :results code. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-default Test `org-babel-remove-result' with default :results. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-html Test `org-babel-remove-result' with :results html. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-latex Test `org-babel-remove-result' with :results latex. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-list Test `org-babel-remove-result' with :results list. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-org Test `org-babel-remove-result' with :results org. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-pp Test `org-babel-remove-result' with :results pp. (user-error "C-c C-c can do nothing useful at this location") F test-ob/org-babel-remove-result--results-wrap Test `org-babel-remove-result' with :results wrap. (user-error "C-c C-c can do nothing useful at this location") F test-ob/results-in-narrowed-buffer Test block execution in a narrowed buffer. (ert-test-failed ((should (equal "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+END_SRC\n\n#+RESULTS:\n: = 3" (org-test-with-temp-text "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+= END_SRC\n\nParagraph" (narrow-to-region ... ...) (org-babel-execute-src-block) (org-trim ...)))) :form (equal "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+END_SRC\n\n#+RESULTS:\n: 3= " "#+BEGIN_SRC emacs-lisp\n(+ 1 2)\n#+END_SRC\n\n#+results:\n: 3") :value nil :explanation (array-elt 44 (different-atoms (82 "#x52" "?R") (114 "#x72" "?r"))))) F test-ob/specific-colnames Test passing specific column names. (ert-test-failed ((should (equal "#+name: input-table\n| id | var1 |\n|----+------|\n| 1 | ba= r |\n| 2 | baz |\n\n#+begin_src sh :var data=3Dinput-table :exports resu= lts :colnames '(Rev Author)\necho \"$data\"\n#+end_src\n\n#+RESULTS:\n| Rev= | Author |\n|-----+--------|\n| 1 | bar |\n| 2 | baz |\n\n" (org-test-with-temp-text "#+name: input-table\n| id | var1 |\= n|----+------|\n| 1 | bar |\n| 2 | baz |\n\n#+begin_src sh :var data=3D= input-table :exports results :colnames '(Rev Author)\necho \"$data\"\n#+end= _src\n" (should ...) (goto-char ...) (org-babel-execute-src-block) (buffer-string)))) :form (equal "#+name: input-table\n| id | var1 |\n|----+------|\n| 1 | bar= |\n| 2 | baz |\n\n#+begin_src sh :var data=3Dinput-table :exports resul= ts :colnames '(Rev Author)\necho \"$data\"\n#+end_src\n\n#+RESULTS:\n| Rev = | Author |\n|-----+--------|\n| 1 | bar |\n| 2 | baz |\n\n" "#+na= me: input-table\n| id | var1 |\n|----+------|\n| 1 | bar |\n| 2 | baz |= \n\n#+begin_src sh :var data=3Dinput-table :exports results :colnames '(Rev= Author)\necho \"$data\"\n#+end_src\n\n#+results:\n| Rev | Author |\n|-----= +--------|\n| 1 | bar |\n| 2 | baz |\n\n") :value nil :explanation (array-elt 181 (different-atoms (82 "#x52" "?R") (114 "#x72" "?r"))))) F test-org-babel/combining-scalar-and-raw-result-types (error "Unknown language `sh' at position 3 in `org-test4792BBx'") F test-org-babel/inline-src_blk-default-results-replace-line-1 (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-default-results-replace-line-2 (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-manual-results-replace (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-preceded-punct-preceded-by-point (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-results-file (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-results-raw (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-results-scalar (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-results-silent (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/inline-src_blk-results-verbatim (user-error "C-c C-c can do nothing useful at this location") F test-org-babel/nested-code-block Test nested code blocks inside code blocks don't cause problems. (ert-test-failed ((should (string=3D (org-babel-execute-src-block) "#+begin_src emacs-lisp\n 'foo\n#+end_src")) :form (string=3D " #+begin_src emacs-lisp\n , 'foo\n #+end_src" "#+begi= n_src emacs-lisp\n 'foo\n#+end_src") :value nil)) F test-org-babel/parse-header-args (error "Unknown language `example-lang' at position 3 in `org-test47921= MO'") F test-org-babel/partial-nested-code-block Test nested code blocks inside code blocks don't cause problems. (ert-test-failed ((should (string=3D "#+begin_src emacs-lisp" (org-babel-execute-src-block))) :form (string=3D "#+begin_src emacs-lisp" " #+begin_src emacs-lisp") :value nil)) F test-org-clock/clocktable Test clocktable specifications. (ert-test-failed ((should (equal "| Headline | Time | |\n|-------= -----------------------+---------+-------|\n| *Total time* = | *16:00* | |\n|------------------------------+---------+-------|\n| = Relative times in clocktable | 16:00 | |\n| Foo = | | 5:00 |\n| Bar | | 11:00= |\n" (org-test-with-temp-text "* Relative times in clocktable\n** = Foo\n** Bar\n" (progn ... ... ... ... ... ... ... ... ... ...)))) :form (equal "| Headline | Time | |\n|--------= ----------------------+---------+-------|\n| *Total time* |= *16:00* | |\n|------------------------------+---------+-------|\n| R= elative times in clocktable | 16:00 | |\n| Foo = | | 5:00 |\n| Bar | | 11:00 = |\n" #("| Headline | Time | |\n|--------= ----------------------+-------+-------|\n| Total time | 1= 6:00 | |\n|------------------------------+-------+-------|\n| Relativ= e times in clocktable | 16:00 | |\n| Foo | = | 5:00 |\n| Bar | | 11:00 |\n" 198 226 (:org-clock-minutes 960) 247 250 (:org-clock-minutes 300) 296 299 (:org-clock-minutes 660))) :value nil :explanation (arrays-of-different-length 357 343 "| Headline |= Time | |\n|------------------------------+---------+-------|\n| *= Total time* | *16:00* | |\n|-------------------------= -----+---------+-------|\n| Relative times in clocktable | 16:00 | = |\n| Foo | | 5:00 |\n| Bar = | | 11:00 |\n" #("| Headline | Time= | |\n|------------------------------+-------+-------|\n| Total time = | 16:00 | |\n|------------------------------+------= -+-------|\n| Relative times in clocktable | 16:00 | |\n| Foo = | | 5:00 |\n| Bar | = | 11:00 |\n" 198 226 (:org-clock-minutes 960) 247 250 (:org-clock-minutes 300) 296 299 (:org-clock-minutes 660)) first-mismatch-at 33))) F test-org-element/inlinetask-parser Test `inlinetask' parser. (ert-test-failed ((should (org-test-with-temp-text "\n*************** Task\nDEADLINE: <2012-03= -29 thu.>" (forward-line) (org-element-property :deadline (org-element-at-point)))) :form (let ((inside-text (if ... "\n*************** Task\nDEADLINE: <2012-03-29 thu.>" .= ..))) (with-temp-buffer (org-mode) (let (...) (if point ... ... ...)) (forward-line) (org-element-property :deadline (org-element-at-point)))) :value nil)) F test-org-element/link-parser Test `link' parser. (ert-test-failed ((should (equal '("file" "projects.org" "docview") (org-test-with-temp-text "[[docview:projects.org]]" (let ... ...)))) :form (equal ("file" "projects.org" "docview") ("fuzzy" "docview:projects.org" nil)) :value nil :explanation (list-elt 0 (arrays-of-different-length 4 5 "file" "fuzzy" first-mismat= ch-at 1)))) F test-org-element/src-block-interpreter Test src block interpreter. (ert-test-failed ((should (equal (let (...) (org-test-parse-and-interpret "#+BEGIN_SRC emacs-lisp :results si= lent\n(+ 1 1)\n#+END_SRC")) "#+BEGIN_SRC emacs-lisp :results silent\n (+ 1 1)\n#+END_SRC\n")) :form (equal "#+BEGIN_SRC emacs-lisp :results silent\n(+ 1 1)\n#+END_SRC\n"= "#+BEGIN_SRC emacs-lisp :results silent\n (+ 1 1)\n#+END_SRC\n") :value nil :explanation (arrays-of-different-length 57 59 "#+BEGIN_SRC emacs-lisp :results si= lent\n(+ 1 1)\n#+END_SRC\n" "#+BEGIN_SRC emacs-lisp :results silent\n (+ 1= 1)\n#+END_SRC\n" first-mismatch-at 39))) F test-org-list/to-html Test `org-list-to-html' specifications. (ert-test-failed ((should (equal "
    \n
  • a
  • \n
" (let (org-html-indent) (with-temp-buffer ... ... ... ... ... ... ...)))) :form (equal "
    \n
  • a
  • \n
" "\n\n\n\n \n\n \n\n\n\n
    \n
  • a
  • \n
\n\n") :value nil :explanation (arrays-of-different-length 36 365 "
    \n
  • a\n
" "\n\n\n\n \n\n \n\n\n\n
    \n =
  • a
  • \n
\n\n" first-mismatch-at 1))) F test-org-src/basic Editing regular block works. with point on (ert-test-failed ((should (equal (buffer-string) "\n#+begin_src emacs-lisp\n blah(message hello)\n#+end_src\n")) :form (equal #("\n#+begin_src emacs-lisp\nblah (message hello)\n#+end_src\n" 24 = 28 (fontified nil) 28 46 (fontified nil)) "\n#+begin_src emacs-lisp\n blah(message hello)\n#+end_src\n") :value nil :explanation (array-elt 24 (different-atoms (98 "#x62" "?b") (32 "#x20" "? "))))) F test-org-src/blank-line-block Editing block with just a blank line. (ert-test-failed ((should (equal (buffer-string) "\n#+begin_src emacs-lisp\n blah\n#+end_src\n")) :form (equal #("\n#+begin_src emacs-lisp\nblah\n#+end_src\n" 0 24 (org-category "org-test47922_s" fontified nil) 24 28 (fontified nil) 28 29 (fontified nil) 29 39 (org-category "org-test47922_s" fontified nil)) "\n#+begin_src emacs-lisp\n blah\n#+end_src\n") :value nil :explanation (arrays-of-different-length 39 41 #("\n#+begin_src emacs-lisp\nblah\n#+end_= src\n" 0 24 (org-category "org-test47922_s" fontifi= ed nil) 24 28 (fontified nil) 28 29 (fontified nil) 29 39 (org-category "org-test47922_s" fontifi= ed nil)) "\n#+begin_src emacs-lisp\n blah\n#+end_= src\n" first-mismatch-at 24))) F test-org-src/empty-block Editing empty block. (ert-test-failed ((should (equal (buffer-string) "\n#+begin_src emacs-lisp\n blah\n#+end_src\n")) :form (equal #("\n#+begin_src emacs-lisp\nblah\n#+end_src\n" 24 28 (fontified nil)) "\n#+begin_src emacs-lisp\n blah\n#+end_src\n") :value nil :explanation (arrays-of-different-length 39 41 #("\n#+begin_src emacs-lisp\nblah\n#+end_= src\n" 24 28 (fontified nil)) "\n#+begin_src emacs-lisp\n blah\n#+end_= src\n" first-mismatch-at 24))) F test-org/comment-dwim Test `comment-dwim' behaviour in an Org buffer. (ert-test-failed ((should (equal "# \nComment" (org-test-with-temp-text "Comment" (progn ... ...)))) :form (equal "# \nComment" "# Comment") :value nil :explanation (arrays-of-different-length 10 9 "# \nComment" "# Comment" first-mism= atch-at 2))) F test-org/entry-put Test `org-entry-put' specifications. (ert-test-failed ((should (string=3D "* H\n" (org-test-with-temp-text "* H\nDEADLINE: <2014-03-04 tue.>" (org-entry-put ... "DEADLINE" nil) (buffer-string)))) :form (string=3D "* H\n" "* H\n:LOGBOOK:\n:END:\n") :value nil)) F test-org/insert-heading Test `org-insert-heading' specifications. (ert-test-failed ((should (equal "* H\n- item\n- item 2\n* " (org-test-with-temp-text "* H\n- item\n- item 2" (let ... ...) (buffer-string)))) :form (equal "* H\n- item\n- item 2\n* " "* H\n- item\n- item 2\n\n* ") :value nil :explanation (arrays-of-different-length 22 23 "* H\n- item\n- item 2\n* " "* H\n-= item\n- item 2\n\n* " first-mismatch-at 20))) F test-org/org-link-escape-ascii-ctrl-character Escape an ascii control character. (ert-test-failed ((should (string=3D "%09" (org-link-escape " "))) :form (string=3D "%09" " ") :value nil)) F test-org/org-link-escape-custom-table Escape string with custom character table. (ert-test-failed ((should (string=3D "Foo%3A%42ar%0A" (org-link-escape "Foo:Bar\n" '...))) :form (string=3D "Foo%3A%42ar%0A" "Foo%3A%42ar\n") :value nil)) F test-org/org-link-escape-custom-table-merge Escape string with custom table merged with default table. (ert-test-failed ((should (string=3D "%5BF%6F%6F%3A%42ar%0A%5D" (org-link-escape "[Foo:Bar\n]" '... t))) :form (string=3D "%5BF%6F%6F%3A%42ar%0A%5D" "%5BF%6F%6F%3A%42ar\n%5D") :value nil)) F test-org/org-link-escape-multibyte-character Escape an unicode multibyte character. (ert-test-failed ((should (string=3D "%E2%82%AC" (org-link-escape "=E2=82=AC"))) :form (string=3D "%E2%82%AC" "=E2=82=AC") :value nil)) F test-org/org-link-escape-url-with-escaped-char Escape and unescape a URL that includes an escaped char. (ert-test-failed ((should (string=3D "http://some.host.com/form?&id=3Dblah%2Bblah25" (org-link-unescape (org-link-escape "http://some.host.com/form?&id=3Dblah%2Bb= lah25")))) :form (string=3D "http://some.host.com/form?&id=3Dblah%2Bblah25" "http://so= me.host.com/form?&id=3Dblah+blah25") :value nil)) --8<---------------cut here---------------end--------------->8--- Note that the Python failures must be dismissed as I don't have any Python executable on my machine [1]. But it's unclear for me why the other errors are occurring now. Something that also suprises me is that, last week, I had 460+ tests ran, in (what I take as) the same conditions!? Best regards, Seb [1] I've put python as an Org Babel language to pass Nicolas' Org languages test in all my files -- I do have some Python code blocks for which I want to see the correct highlighting. --=20 Sebastien Vauban