org-publish error: "Stack overflow in regexp matcher"

org-publish error: "Stack overflow in regexp matcher"

[Vikas Rawal]

[-- Attachment #1: Type: text/plain, Size: 1905 bytes --]


When I try to publish my site built with org-mode, it scans through
all files to create the sitemap, and hangs up with error: "Stack
overflow in regexp matcher". 

Oddly, it scans through all files including the static content. It
goes through all tar.gz files, pdf files, and what not. 

My project specification is pasted below. Sitemap is supposed to be
made only with the project "indianstatistics-notes" and not with
"indianstatistics-static". But orgmode scans through the whole thing
anyway, and gives the above mentioned error.

Will be grateful for help.

# Org-mode version 8.0.5 (release_8.0.5-333-g507499 @ /home/vikas/lisp/org-mode/lisp/)
# Am enclosing backtrace also for reference.

Vikas

# Project specification: 
	("indianstatistics-notes"
	 :base-directory "~/indianstatistics/source/"
	 :base-extension "org"
       	 :publishing-directory "~/indianstatistics/web/"
	 :recursive t
	 :publishing-function org-html-publish-to-html
	 :headline-levels 2
	 :auto-preamble t
         :author "VR"
         :with-timestamps t
         :auto-sitemap t
         :sitemap-title "Sitemap for www.indianstatistics.org"
         :sitemap-sort-files anti-chronologically
         :sitemap-file-entry-format "%t (last updated on %d)"
         :html-postamble "<p>Statistics on Indian Economy and Society</p><p class=\"date\">This page last updated on: %d</p><p>Copyrights as specified in http://www.indianstatistics.org/citation.html.</p>" )

	("indianstatistics-static"
	 :base-directory "~/indianstatistics/source/"
	 :base-extension "css\\|js\\|png\\|jpg\\|gif\\|pdf\\|mp3\\|csv\\|pdf\\|ogg\\|zip\\|gz\\|TXT\\|swf\\|ico\\|htaccess"
         :include ("bibliobase_bib.html")
	 :publishing-directory "~/indianstatistics/web/"
	 :recursive t
	 :publishing-function org-publish-attachment
	 )

	("indianstatistics"
         :components ("indianstatistics-notes" "indianstatistics-static")
         )

[-- Attachment #2: backtrace --]
[-- Type: text/plain, Size: 14128 bytes --]

Debugger entered--Lisp error: (error "Stack overflow in regexp matcher")
  re-search-forward("\\(?:\\\\label{\\([^}]*\\)}\\|\\[[^]]*label[[:space:]]*=[[:space:]]*{?\\(?1:[^],}]+\\)}?\\)\\|\\(^\\)[ 	]*\\\\\\(part\\|chapter\\|section\\|subsection\\|subsubsection\\|paragraph\\|subparagraph\\|addchap\\|addsec\\)\\*?\\(\\[[^]]*\\]\\)?[[{ 	\r\n\\]\\|\\(^\\)[ 	]*\\\\\\(include\\|input\\)[{ 	]+\\([^} 	\n\r]+\\)\\|\\(^\\)[ 	]*\\(\\\\appendix\\)\\|\\(\\\\glossary\\|\\\\index\\)[[{]" nil t)
  byte-code("\306\b\307	#\211\x12\204\x16\0\310\b!\211\x13\203\x16\0\311\v!\x12\n\204%\0\312\bD\fB\x14\313\314\315\"\210\212\316\317\b\"\210\320\n\r\321=?\"\211\x16@q\210\311 \x10\322\bD\fB\x14\323 \x1eA\324\216\325\x0eB!\210\315\x1eC\212\214~\210\326b\210\327\x0eD\315\321#\203g\x01\326\225\203q\0\330\331\326!\b\x0eE#\fB\x14\202U\0\332\225\203\276\0\333\224\x16E`Sf\334=\203\205\0\335u\210\336\b!\211\x16F\203U\0\337\x0eF8\x16G\x0eH\x0eG^\x16H\x0eG\x0eHU\203\262\0\316\340\341\x0eG\x0eI\"@\342\x0eF8#\210\x0eF\fB\x14\x0eF\x16J\202U\0\343\225\203\335\0\331\343!\x16K\344\315\345\346\x0eL\"\"\204U\0\347\x0eK\f	#\x14\202U\0\350\225\203\360\0\351\315\321\"\210\352\321B\fB\x14\202U\0\353\225\203\x13\x01\x0eM\203U\0\354\b!\211\x16N\203U\0\355\356\x0eNA@\"\210\x0eN\fB\x14\202U\0\357\225\203`\x01\212\331\357!\x1eO\357\225b\210\360 \x1eP\361\216\362\363\x0eO!!*\x1eQ\364\x0eO\x0eR\"A@\211\x1eS\203F\x01\333\225b\210\202M\x01\357\225b\210\365 \210\330\x0eQ\b\x0eE\315\211%\211\x1eT\fB\x14-\202U\0\366\367!\210\202U\0\370	!\211\x16U\203w\x01\371\x0eUB\fB\x14\326b\210\327\372\315\321#\203\210\x01\373\bB\fB\x14\326b\210\327\374\315\321#\203\241\x01\375\331\376!\331\332!E\fB\x14\202\213\x01\377\bD\fB\x14.\x06\201V\0\x0e@!\207" [file master-dir file-found buf docstruct reftex-keep-temporary-buffers reftex-locate-file "tex" reftex-get-buffer-visiting buffer-file-name file-error throw exit nil message "Scanning file %s" reftex-get-file-buffer-force t bof syntax-table ((set-syntax-table saved-syntax)) set-syntax-table 1 re-search-forward reftex-label-info reftex-match-string 3 0 92 -1 reftex-section-info 5 "Scanning %s %s ..." rassoc 6 7 delq mapcar #[(x) "\302\b	\"\207" [x include-file string-match] 3] reftex-parse-from-file 9 reftex-init-section-numbers appendix 10 reftex-index-info add-to-list index-tags 11 match-data ((byte-code "\301\b\302\"\207" [save-match-data-internal set-match-data evaporate] 3)) ...] 7)
  reftex-parse-from-file("/home/vikas/indianstatistics/source/scripts/nss661_type2_scripts.tar.gz" nil "/home/vikas/indianstatistics/source/scripts/")
  reftex-do-parse(1 nil)
  reftex-access-scan-info((16))
  reftex-parse-all()
  (and (buffer-file-name) (file-exists-p (buffer-file-name)) (reftex-parse-all))
  org-mode-reftex-setup()
  run-hooks(change-major-mode-after-body-hook text-mode-hook outline-mode-hook org-mode-hook)
  apply(run-hooks (change-major-mode-after-body-hook text-mode-hook outline-mode-hook org-mode-hook))
  run-mode-hooks(org-mode-hook)
  org-mode()
  org-publish-find-date("/home/vikas/indianstatistics/source/scripts/nss661_type2_scripts.tar.gz")
  org-publish-compare-directory-files("/home/vikas/indianstatistics/source/scripts/nss661_type2_scripts.zip" "/home/vikas/indianstatistics/source/scripts/nss661_type2_scripts.tar.gz")
  sort(("/home/vikas/indianstatistics/source/scripts/." "/home/vikas/indianstatistics/source/scripts/.htaccess" "/home/vikas/indianstatistics/source/scripts/README_ASI_9394.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_8485.TXT" "/home/vikas/indianstatistics/source/scripts/asi.org" "/home/vikas/indianstatistics/source/scripts/README_NSS_6601_TYPE2.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_9697.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_8081.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_0708.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_0607.TXT" "/home/vikas/indianstatistics/source/scripts/asi0708_scripts.zip" "/home/vikas/indianstatistics/source/scripts/asi0607_scripts.zip" "/home/vikas/indianstatistics/source/scripts/asi8081_scripts.tar.gz" "/home/vikas/indianstatistics/source/scripts/asi0708_scripts.tar.gz" "/home/vikas/indianstatistics/source/scripts/asi0607_scripts.tar.gz" "/home/vikas/indianstatistics/source/scripts/README_NSS_6110.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_9495.TXT" "/home/vikas/indianstatistics/source/scripts/asi0506_scripts.zip" "/home/vikas/indianstatistics/source/scripts/asi0506_scripts.tar.gz" "/home/vikas/indianstatistics/source/scripts/README_NSS_6610.TXT" "/home/vikas/indianstatistics/source/scripts/README_NSS_6601.TXT" "/home/vikas/indianstatistics/source/scripts/README_NSS_6010.TXT" "/home/vikas/indianstatistics/source/scripts/README_NSS_5801.TXT" "/home/vikas/indianstatistics/source/scripts/README_NSS_5701.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_8990.TXT" "/home/vikas/indianstatistics/source/scripts/README_ASI_0506.TXT") org-publish-compare-directory-files)
  org-publish-get-base-files-1("/home/vikas/indianstatistics/source/scripts" t "^[^\\.].*\\.\\(org\\)$" nil nil)
  #[(f) "\306\b!\307\b!\x19\211\x1a\2032\0\v\2032\0\310\311	\"\2042\0\f\203#\0\310\f	\"?\202$\0\312\2032\0\313\b\v\r\x0e\x0f\f%\202o\0\n\206Q\0\x0e\x0f\203C\0\310\x0e\x0f	\"\206Q\0\314\315\b!!?\206Q\0\310\r	\"??\205o\0\b\x1e\x10\316\x0e\x10\x0e\x11\"\203f\0\x0e\x11\202n\0\x0e\x10\x0e\x11B\211\x16\x11)*\207" [f fnd fd-p recurse skip-dir match file-directory-p file-name-nondirectory string-match "^\\.+$" t org-publish-get-base-files-1 file-exists-p file-truename memql skip-file var org-publish-temp-files] 7]("/home/vikas/indianstatistics/source/scripts")
  mapc(#[(f) "\306\b!\307\b!\x19\211\x1a\2032\0\v\2032\0\310\311	\"\2042\0\f\203#\0\310\f	\"?\202$\0\312\2032\0\313\b\v\r\x0e\x0f\f%\202o\0\n\206Q\0\x0e\x0f\203C\0\310\x0e\x0f	\"\206Q\0\314\315\b!!?\206Q\0\310\r	\"??\205o\0\b\x1e\x10\316\x0e\x10\x0e\x11\"\203f\0\x0e\x11\202n\0\x0e\x10\x0e\x11B\211\x16\x11)*\207" [f fnd fd-p recurse skip-dir match file-directory-p file-name-nondirectory string-match "^\\.+$" t org-publish-get-base-files-1 file-exists-p file-truename memql skip-file var org-publish-temp-files] 7] ("/home/vikas/indianstatistics/source/." "/home/vikas/indianstatistics/source/scripts" "/home/vikas/indianstatistics/source/.." "/home/vikas/indianstatistics/source/datafiles" "/home/vikas/indianstatistics/source/img" "/home/vikas/indianstatistics/source/graphs" "/home/vikas/indianstatistics/source/css" "/home/vikas/indianstatistics/source/index.org" "/home/vikas/indianstatistics/source/bibliobase_bib.html" "/home/vikas/indianstatistics/source/bibliobase.html" "/home/vikas/indianstatistics/source/sitemap.org" "/home/vikas/indianstatistics/source/agriapy.org" "/home/vikas/indianstatistics/source/landuse.org" "/home/vikas/indianstatistics/source/agrarian.org" "/home/vikas/indianstatistics/source/bibliobase.bib.bak" "/home/vikas/indianstatistics/source/bibliobase.bib" "/home/vikas/indianstatistics/source/.Rhistory" "/home/vikas/indianstatistics/source/irrigation.org" "/home/vikas/indianstatistics/source/fbi.org" "/home/vikas/indianstatistics/source/ncf.org" "/home/vikas/indianstatistics/source/employment.org" "/home/vikas/indianstatistics/source/documentarchive.org" "/home/vikas/indianstatistics/source/nceus.org" "/home/vikas/indianstatistics/source/miscdocuments.org" "/home/vikas/indianstatistics/source/documentarchive.bib.bak" "/home/vikas/indianstatistics/source/documentarchive.bib" "/home/vikas/indianstatistics/source/documentarchive_bib.html" "/home/vikas/indianstatistics/source/documentarchive.html" "/home/vikas/indianstatistics/source/favicon.ico" "/home/vikas/indianstatistics/source/fertiliser.org" "/home/vikas/indianstatistics/source/external_links.org" "/home/vikas/indianstatistics/source/datadocuments.org" "/home/vikas/indianstatistics/source/socio_economic_conditions.org" "/home/vikas/indianstatistics/source/public_finance.org" "/home/vikas/indianstatistics/source/national_income.org" "/home/vikas/indianstatistics/source/animals.org" "/home/vikas/indianstatistics/source/cdr.org" "/home/vikas/indianstatistics/source/citation.org" "/home/vikas/indianstatistics/source/contribute.org" "/home/vikas/indianstatistics/source/cpial.org" "/home/vikas/indianstatistics/source/land.org" "/home/vikas/indianstatistics/source/branches.org" "/home/vikas/indianstatistics/source/analytics.html" "/home/vikas/indianstatistics/source/.htaccess" "/home/vikas/indianstatistics/source/pds.pdf" "/home/vikas/indianstatistics/source/education.org" "/home/vikas/indianstatistics/source/about.org" "/home/vikas/indianstatistics/source/pds.org" "/home/vikas/indianstatistics/source/industry.org" "/home/vikas/indianstatistics/source/consumer_expenditure.org" ...))
  org-publish-get-base-files-1("~/indianstatistics/source/" t "^[^\\.].*\\.\\(org\\)$" nil nil)
  org-publish-get-base-files(("indianstatistics-notes" :base-directory "~/indianstatistics/source/" :base-extension "org" :publishing-directory "~/indianstatistics/web/" :recursive t :publishing-function org-html-publish-to-html :headline-levels 2 :auto-preamble t :author "VR" :with-timestamps t :auto-sitemap t :sitemap-title "Sitemap for www.indianstatistics.org" :sitemap-sort-files anti-chronologically :sitemap-file-entry-format "%t (last updated on %d)" :html-postamble "<p>Statistics on Indian Economy and Society</p><p class=\"date\">This page last updated on: %d</p><p>Copyrights as specified in http://www.indianstatistics.org/citation.html.</p>") nil)
  #[(project) "\306\b@!\210\bA\x19\307	\310\"\x1a\307	\311\"^[\307	\312\"\206\x1a\0\313\x1c\307	\314\"\206#\0\315\x1d\307	\316\"\206-\0\x0e\x1f\x1e \307	\317\"\2068\0\x0e!\x1e\"\307	\320\"\x1e\x17\307	\321\"\x1e\x1d\322\b\n\"\x1e#\323\324\307	\325\"\"\x1e$\x0e\x17\203^\0\326\327!\210\v\203g\0\r\b\f\"\210\x0e#\330\x1e%\211\x1e&\203\216\0\x0e&@\211\x16%\x0e$\232\204\205\0\331\x0e%\b\332#\210\x0e&A\211\x16&\204r\0*\307	\333\"\203\245\0\334\b\307	\325\"\"\210\331\x0e$\b\332#\210\x0e\x1d\203\256\0\326\335!\210\336 .\v\207" [project project-plist exclude-regexp sitemap-p sitemap-filename sitemap-function org-publish-initialize-cache plist-get :exclude :auto-sitemap :sitemap-filename "sitemap.org" :sitemap-function org-publish-org-sitemap :sitemap-date-format :sitemap-file-entry-format :preparation-function :completion-function org-publish-get-base-files expand-file-name "theindex.org" :base-directory run-hooks preparation-function nil org-publish-file t :makeindex org-publish-index-generate-theindex completion-function org-publish-write-cache-file org-publish-sitemap-date-format org-sitemap-date-format org-publish-sitemap-file-entry-format org-sitemap-file-entry-format files theindex file --dolist-tail--] 6](("indianstatistics-notes" :base-directory "~/indianstatistics/source/" :base-extension "org" :publishing-directory "~/indianstatistics/web/" :recursive t :publishing-function org-html-publish-to-html :headline-levels 2 :auto-preamble t :author "VR" :with-timestamps t :auto-sitemap t :sitemap-title "Sitemap for www.indianstatistics.org" :sitemap-sort-files anti-chronologically :sitemap-file-entry-format "%t (last updated on %d)" :html-postamble "<p>Statistics on Indian Economy and Society</p><p class=\"date\">This page last updated on: %d</p><p>Copyrights as specified in http://www.indianstatistics.org/citation.html.</p>"))
  mapc(#[(project) "\306\b@!\210\bA\x19\307	\310\"\x1a\307	\311\"^[\307	\312\"\206\x1a\0\313\x1c\307	\314\"\206#\0\315\x1d\307	\316\"\206-\0\x0e\x1f\x1e \307	\317\"\2068\0\x0e!\x1e\"\307	\320\"\x1e\x17\307	\321\"\x1e\x1d\322\b\n\"\x1e#\323\324\307	\325\"\"\x1e$\x0e\x17\203^\0\326\327!\210\v\203g\0\r\b\f\"\210\x0e#\330\x1e%\211\x1e&\203\216\0\x0e&@\211\x16%\x0e$\232\204\205\0\331\x0e%\b\332#\210\x0e&A\211\x16&\204r\0*\307	\333\"\203\245\0\334\b\307	\325\"\"\210\331\x0e$\b\332#\210\x0e\x1d\203\256\0\326\335!\210\336 .\v\207" [project project-plist exclude-regexp sitemap-p sitemap-filename sitemap-function org-publish-initialize-cache plist-get :exclude :auto-sitemap :sitemap-filename "sitemap.org" :sitemap-function org-publish-org-sitemap :sitemap-date-format :sitemap-file-entry-format :preparation-function :completion-function org-publish-get-base-files expand-file-name "theindex.org" :base-directory run-hooks preparation-function nil org-publish-file t :makeindex org-publish-index-generate-theindex completion-function org-publish-write-cache-file org-publish-sitemap-date-format org-sitemap-date-format org-publish-sitemap-file-entry-format org-sitemap-file-entry-format files theindex file --dolist-tail--] 6] (("indianstatistics-notes" :base-directory "~/indianstatistics/source/" :base-extension "org" :publishing-directory "~/indianstatistics/web/" :recursive t :publishing-function org-html-publish-to-html :headline-levels 2 :auto-preamble t :author "VR" :with-timestamps t :auto-sitemap t :sitemap-title "Sitemap for www.indianstatistics.org" :sitemap-sort-files anti-chronologically :sitemap-file-entry-format "%t (last updated on %d)" :html-postamble "<p>Statistics on Indian Economy and Society</p><p class=\"date\">This page last updated on: %d</p><p>Copyrights as specified in http://www.indianstatistics.org/citation.html.</p>") ("indianstatistics-static" :base-directory "~/indianstatistics/source/" :base-extension "css\\|js\\|png\\|jpg\\|gif\\|pdf\\|mp3\\|csv\\|pdf\\|ogg\\|zip\\|gz\\|TXT\\|swf\\|ico\\|htaccess" :include ("bibliobase_bib.html") :publishing-directory "~/indianstatistics/web/" :recursive t :publishing-function org-publish-attachment)))
  org-publish-projects((("indianstatistics" :components ("indianstatistics-notes" "indianstatistics-static"))))
  org-publish(("indianstatistics" :components ("indianstatistics-notes" "indianstatistics-static")) nil)
  call-interactively(org-publish record nil)
  command-execute(org-publish record)
  smex-read-and-run(("eval-buffer" "eval-region" "org-reload" "recover-this-file" "replace-string" "org-version" "gnus" "org-publish" "org-mobile-push" "org-e-beamer-export-to-pdf" "org-publish-current-file" "package-list-packages" "org-mobile-pull" "describe-variable" "comment-region" "color-theme-leuven" "org-toggle-checkbox" "customize-option" "uncomment-region" "R" "load-file" "artist-mode" "org-e-publish" "org-e-beamer-mode" "kill-buffer" "server-edit" "org-babel-goto-named-result" "calc" "diary" "shell" "ispell" "diary-mode" "eval-defun" "org-agenda" "find-library" "locate-library" "replace-regexp" "search-forward" "org-publish-all" "org-footnote-action" "org-publish-project" "color-theme-initialize" "list-load-path-shadows" "org-e-odt-export-as-odf" "org-e-latex-export-to-pdf" "S" "S+" "cd" "df" "5x5" ...))
  smex()
  call-interactively(smex nil nil)

Re: org-publish error: "Stack overflow in regexp matcher"

[Nicolas Goaziou]

Hello,

Vikas Rawal <vikaslists@agrarianresearch.org> writes:

> When I try to publish my site built with org-mode, it scans through
> all files to create the sitemap, and hangs up with error: "Stack
> overflow in regexp matcher". 
>
> Oddly, it scans through all files including the static content. It
> goes through all tar.gz files, pdf files, and what not. 
>
> My project specification is pasted below. Sitemap is supposed to be
> made only with the project "indianstatistics-notes" and not with
> "indianstatistics-static". But orgmode scans through the whole thing
> anyway, and gives the above mentioned error.

I have pushed a fix for that. Could you confirm publishing now behaves
as expected?

Thank you for the detailed report.


Regards,

-- 
Nicolas Goaziou

Re: org-publish error: "Stack overflow in regexp matcher"

[Vikas Rawal]

> > Oddly, it scans through all files including the static content. It
> > goes through all tar.gz files, pdf files, and what not. 
> >
> > My project specification is pasted below. Sitemap is supposed to be
> > made only with the project "indianstatistics-notes" and not with
> > "indianstatistics-static". But orgmode scans through the whole thing
> > anyway, and gives the above mentioned error.
> 
> I have pushed a fix for that. Could you confirm publishing now behaves
> as expected?

It does work, indeed.

Wow!

Vikas