From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:403:4789::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id 0F7IOmY8wWRpQwAASxT56A (envelope-from ) for ; Wed, 26 Jul 2023 17:31:51 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:4789::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id oGzHOmY8wWRH5wAA9RJhRA (envelope-from ) for ; Wed, 26 Jul 2023 17:31:50 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9AA5750B0F for ; Wed, 26 Jul 2023 17:31:50 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=lipklim.org header.s=key1 header.b=ctMat4GQ; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=quarantine) header.from=lipklim.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1690385510; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=g2rteb1M+C08SKYJ+mu2K8FwQ4x0g5Rk+/HOBemj4UI=; b=sV5RdJ2jr3F/c5UePyqDm6vqwfSGEYsxWjbfO2UK/bOIS69vIkA6I0h6h3L4UUwxFWZJ46 adO1g0OpSASWQicgbNjdN6VuhThxynG5ojrpWXuGuHegP5y66sByCL12gh1HLxbVh8fKWK uRfiZL3aI/iJ8RtzoSxVOqb6KJRMy99LbwAp7tyHFBuf27encBGM8qAx/K9kp+NzUiRY42 dtK1/N85G+4VQzbMATAzD6AC+0dBRQFyPzAVu7XfY0yKICMFWmb8o0+aBZAO9KyYBMSUY+ IUEXxy7eW/tNyfbAxIDqCfE/powxvRV1SP6m0ahOKqXzXK+xO6k9vcPLDbvWZQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1690385510; a=rsa-sha256; cv=none; b=IMV5dIxslQmFQxs/QfmVt+bCbWeRvHb5B3oPBV+odu8BDhzAjuF5RjHand1TEhVLPvxnGR y4lmK9/hjL/6dKS0/kkM9miPSlR8FzA72w7fTVQCo8Phy6opA1EC65boFZ9JOyH0pdFwLQ vlwxQPv0Wa+/PqLX7k2MjFNJwCsJJsE5CjLOhwin3Ym+Zicr8zHbhKZwdJS297rZ/vqz16 uk/GtMZZQf9Hj3Bj/jTpV99Z0etMkX7XjXYP2iwhl+tQz6XZn6wUQm5O0KvCIXoFHgfCWK 3EfsJQMKj4vmnQtwXV+TOAAx1Hn2FUcGrwRctw9IEFRHOJJrwhn1rhcP1WZUjg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=lipklim.org header.s=key1 header.b=ctMat4GQ; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=quarantine) header.from=lipklim.org Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qOgCz-0002kE-8U; Wed, 26 Jul 2023 11:13:49 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qOgBb-0001me-3f for emacs-orgmode@gnu.org; Wed, 26 Jul 2023 11:12:23 -0400 Received: from out-52.mta0.migadu.com ([2001:41d0:1004:224b::34]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qOgBY-0001PH-Pq for emacs-orgmode@gnu.org; Wed, 26 Jul 2023 11:12:22 -0400 References: <87lefkd9tb.fsf@lipklim.org> <87h6q8d9lz.fsf@lipklim.org> <87cz0wcbtt.fsf@lipklim.org> <87ttu6j2zr.fsf@localhost> <87bkg1h4q3.fsf@lipklim.org> <87fs5c79ss.fsf@localhost> <871qgwgcc9.fsf@lipklim.org> <87mszjm94g.fsf@localhost> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lipklim.org; s=key1; t=1690384337; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=g2rteb1M+C08SKYJ+mu2K8FwQ4x0g5Rk+/HOBemj4UI=; b=ctMat4GQA+JP70v0QgDydvfp14hem3YWKfE0G3q7NnlVW1rQpJHbXcO5DJHSMFVVg4GXHY R5IqooTmlLZikjW9JZvRvCcXqQp6O1db7SziZ7P0nZexo/QaysIgqeDDIndoNmLkxXAy2C is1pXBUWDC8OaLW30HYrWy0TAP6AOy8= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Evgenii Klimov To: Ihor Radchenko Cc: emacs-orgmode@gnu.org Subject: [PATCH v5] ob-tangle.el: Blocks overwrite each other when grouping before tangling Date: Wed, 26 Jul 2023 16:07:39 +0100 In-reply-to: <87mszjm94g.fsf@localhost> Message-ID: <875y66906s.fsf@lipklim.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" Received-SPF: pass client-ip=2001:41d0:1004:224b::34; envelope-from=eugene.dev@lipklim.org; helo=out-52.mta0.migadu.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: emacs-orgmode-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -6.60 X-Spam-Score: -6.60 X-Migadu-Queue-Id: 9AA5750B0F X-Migadu-Scanner: mx1.migadu.com X-TUID: 95CiliqEfItb --=-=-= Content-Type: text/plain Ihor Radchenko writes: >> +(ert-deftest ob-tangle/collect-blocks () >> + "Test block collection into groups for tangling." >> + (org-test-with-temp-text-in-file >> + "* H1 with :tangle in properties >> +:PROPERTIES: >> +:header-args: :tangle relative.el >> +:END: >> .... >> + ;; to the first header >> + (insert (format "#+begin_src emacs-lisp :tangle %s >> +\"H1: absolute org-file.lang-ext :tangle %s\" >> +#+end_src" el-file-abs el-file-abs)) >> + (goto-char (point-max)) > > This combination of pre-filled text and insertions is a bit > disorienting. I understand why you need to insert some things only after > we know the temporary Org file name, but I'd instead placed all the > contents together via insert. Rewrote. >> +#+begin_src emacs-lisp :tangle %s >> +\"H2: relative org-file.lang-ext :tangle %s\" >> +#+end_src" el-file-rel el-file-rel)) >> + (should (equal (funcall expected-targets-fn 4) >> + (funcall collected-targets-fn (org-babel-tangle-collect-blocks)))) > > When reading this code, I have no idea what it is trying to test. > Probably something to do with function names not being descriptive. > At least, a comment would help. > > And the magic numbers "4" and "5" have no obvious meaning. Hope new version is cleaner. --=-=-= Content-Type: text/x-diff Content-Disposition: attachment; filename=v5-0001-testing-lisp-test-ob-tangle.el-Test-block-collect.patch >From f1bf00592b1ee2bb27148fe93316cc6c1a192179 Mon Sep 17 00:00:00 2001 From: Evgenii Klimov Date: Fri, 21 Jul 2023 22:40:06 +0100 Subject: [PATCH v5 1/2] testing/lisp/test-ob-tangle.el: Test block collection into groups for tangling * testing/lisp/test-ob-tangle.el (ob-tangle/collect-blocks): Test block collection into groups for tangling. --- testing/lisp/test-ob-tangle.el | 116 +++++++++++++++++++++++++++++++++ 1 file changed, 116 insertions(+) diff --git a/testing/lisp/test-ob-tangle.el b/testing/lisp/test-ob-tangle.el index 07e75f4d3..ad0e1c29c 100644 --- a/testing/lisp/test-ob-tangle.el +++ b/testing/lisp/test-ob-tangle.el @@ -569,6 +569,122 @@ another block (set-buffer-modified-p nil)) (kill-buffer buffer)))) +(ert-deftest ob-tangle/collect-blocks () + "Test block collection into groups for tangling." + (org-test-with-temp-text-in-file "" ; filled below, it depends on temp file name + (let* ((org-file (buffer-file-name)) + (test-dir (file-name-directory org-file)) + (el-file-abs (concat (file-name-sans-extension org-file) ".el")) + (el-file-rel (file-name-nondirectory el-file-abs))) + (insert (format "* H1 with :tangle in properties +:PROPERTIES: +:header-args: :tangle relative.el +:END: + +#+begin_src emacs-lisp +\"H1: inherited :tangle relative.el in properties\" +#+end_src + +#+begin_src emacs-lisp :tangle yes +\"H1: :tangle yes\" +#+end_src + +#+begin_src emacs-lisp :tangle no +\"H1: should be ignored\" +#+end_src + +#+begin_src emacs-lisp :tangle %s +\"H1: absolute org-file.lang-ext :tangle %s\" +#+end_src + +#+begin_src emacs-lisp :tangle relative.el +\"H1: :tangle relative.el\" +#+end_src + +#+begin_src emacs-lisp :tangle ./relative.el +\"H1: :tangle ./relative.el\" +#+end_src + +#+begin_src emacs-lisp :tangle /tmp/absolute.el +\"H1: :tangle /tmp/absolute.el\" +#+end_src + +#+begin_src emacs-lisp :tangle ~/../../tmp/absolute.el +\"H1: :tangle ~/../../tmp/absolute.el\" +#+end_src + +* H2 without :tangle in properties + +#+begin_src emacs-lisp +\"H2: without :tangle\" +#+end_src + +#+begin_src emacs-lisp :tangle yes +\"H2: :tangle yes\" +#+end_src + +#+begin_src emacs-lisp :tangle no +\"H2: should be ignored\" +#+end_src + +#+begin_src emacs-lisp :tangle %s +\"H2: relative org-file.lang-ext :tangle %s\" +#+end_src + +#+begin_src emacs-lisp :tangle relative.el +\"H2: :tangle relative.el\" +#+end_src + +#+begin_src emacs-lisp :tangle ./relative.el +\"H2: :tangle ./relative.el\" +#+end_src + +#+begin_src emacs-lisp :tangle /tmp/absolute.el +\"H2: :tangle /tmp/absolute.el\" +#+end_src + +#+begin_src emacs-lisp :tangle ~/../../tmp/absolute.el +\"H2: :tangle ~/../../tmp/absolute.el\" +#+end_src" el-file-abs el-file-abs el-file-rel el-file-rel)) + (letrec ((sort-fn (lambda (lst) (seq-sort-by #'car #'string-lessp lst))) + (normalize-expected-targets-alist + (lambda (blocks-per-target-alist) + "Convert to absolute file names and sort expected targets" + (funcall sort-fn + (map-apply (lambda (file nblocks) + (cons (expand-file-name file test-dir) nblocks)) + blocks-per-target-alist)))) + (count-blocks-in-target-files + (lambda (collected-blocks) + "Get sorted alist of target file names with number of blocks in each" + (funcall sort-fn (map-apply (lambda (file blocks) + (cons file (length blocks))) + collected-blocks))))) + (should (equal (funcall normalize-expected-targets-alist + `(("/tmp/absolute.el" . 4) + ("relative.el" . 5) + ;; file name differs between tests + (,el-file-abs . 4))) + (funcall count-blocks-in-target-files + (org-babel-tangle-collect-blocks)))) + ;; Simulate TARGET-FILE to test as `org-babel-tangle' and + ;; `org-babel-load-file' would call + ;; `org-babel-tangle-collect-blocks'. + (let ((org-babel-default-header-args + (org-babel-merge-params + org-babel-default-header-args + (list (cons :tangle el-file-abs))))) + (should (equal + (funcall normalize-expected-targets-alist + `(("/tmp/absolute.el" . 4) + ("relative.el" . 5) + ;; Default :tangle header now also + ;; points to the file name derived from the name of + ;; the Org file, so 5 blocks should go there. + (,el-file-abs . 5))) + (funcall count-blocks-in-target-files + (org-babel-tangle-collect-blocks))))))))) + (provide 'test-ob-tangle) ;;; test-ob-tangle.el ends here -- 2.34.1 --=-=-= Content-Type: text/x-diff Content-Disposition: attachment; filename=v5-0002-ob-tangle.el-Avoid-relative-file-names-when-group.patch >From 4b1fe9ac4496ebf8473a8f077762be9abea62078 Mon Sep 17 00:00:00 2001 From: Evgenii Klimov Date: Wed, 12 Jul 2023 19:24:48 +0100 Subject: [PATCH v5 2/2] ob-tangle.el: Avoid relative file names when grouping blocks to tangle * lisp/ob-tangle.el (org-babel-tangle-single-block, org-babel-tangle-collect-blocks): Make target file name attribute, used internally to group blocks with identical language, to be absolute. (org-babel-effective-tangled-filename): Avoid using relative file names that could cause one block to overwrite the others in `org-babel-tangle-collect-blocks' if they have the same target file but in different formats. --- lisp/ob-tangle.el | 32 ++++++++++++++++++-------------- 1 file changed, 18 insertions(+), 14 deletions(-) diff --git a/lisp/ob-tangle.el b/lisp/ob-tangle.el index b6ae4b55a..670a3dfa7 100644 --- a/lisp/ob-tangle.el +++ b/lisp/ob-tangle.el @@ -427,17 +427,19 @@ that the appropriate major-mode is set. SPEC has the form: org-babel-tangle-comment-format-end link-data))))) (defun org-babel-effective-tangled-filename (buffer-fn src-lang src-tfile) - "Return effective tangled filename of a source-code block. -BUFFER-FN is the name of the buffer, SRC-LANG the language of the -block and SRC-TFILE is the value of the :tangle header argument, -as computed by `org-babel-tangle-single-block'." - (let ((base-name (cond - ((string= "yes" src-tfile) - ;; Use the buffer name - (file-name-sans-extension buffer-fn)) - ((string= "no" src-tfile) nil) - ((> (length src-tfile) 0) src-tfile))) - (ext (or (cdr (assoc src-lang org-babel-tangle-lang-exts)) src-lang))) + "Return effective tangled absolute filename of a source-code block. +BUFFER-FN is the absolute file name of the buffer, SRC-LANG the +language of the block and SRC-TFILE is the value of the :tangle +header argument, as computed by `org-babel-tangle-single-block'." + (let* ((fnd (file-name-directory buffer-fn)) + (base-name (cond + ((string= "yes" src-tfile) + ;; Use the buffer name + (file-name-sans-extension buffer-fn)) + ((string= "no" src-tfile) nil) + ((> (length src-tfile) 0) + (expand-file-name src-tfile fnd)))) + (ext (or (cdr (assoc src-lang org-babel-tangle-lang-exts)) src-lang))) (when base-name ;; decide if we want to add ext to base-name (if (and ext (string= "yes" src-tfile)) @@ -454,7 +456,9 @@ source code blocks by languages matching a regular expression. Optional argument TANGLE-FILE can be used to limit the collected code blocks by target file." - (let ((counter 0) last-heading-pos blocks) + (let ((counter 0) + (buffer-fn (buffer-file-name (buffer-base-buffer))) + last-heading-pos blocks) (org-babel-map-src-blocks (buffer-file-name) (let ((current-heading-pos (or (org-element-begin @@ -478,7 +482,7 @@ code blocks by target file." (let* ((block (org-babel-tangle-single-block counter)) (src-tfile (cdr (assq :tangle (nth 4 block)))) (file-name (org-babel-effective-tangled-filename - (nth 1 block) src-lang src-tfile)) + buffer-fn src-lang src-tfile)) (by-fn (assoc file-name blocks))) (if by-fn (setcdr by-fn (cons (cons src-lang block) (cdr by-fn))) (push (cons file-name (list (cons src-lang block))) blocks))))))) @@ -595,7 +599,7 @@ non-nil, return the full association list to be used by comment))) (if only-this-block (let* ((file-name (org-babel-effective-tangled-filename - (nth 1 result) src-lang src-tfile))) + file src-lang src-tfile))) (list (cons file-name (list (cons src-lang result))))) result))) -- 2.34.1 --=-=-=--