From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id wKsOOh0c8GFVFwEAgWs5BA (envelope-from ) for ; Tue, 25 Jan 2022 16:49:49 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id OCy1Nh0c8GHm1wAAauVa8A (envelope-from ) for ; Tue, 25 Jan 2022 16:49:49 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9157536257 for ; Tue, 25 Jan 2022 16:49:49 +0100 (CET) Received: from localhost ([::1]:46172 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nCO4q-0007BI-DO for larch@yhetil.org; Tue, 25 Jan 2022 10:49:48 -0500 Received: from eggs.gnu.org ([209.51.188.92]:58958) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nCMi0-0001EL-Ir for emacs-orgmode@gnu.org; Tue, 25 Jan 2022 09:22:08 -0500 Received: from [2a00:1450:4864:20::130] (port=46605 helo=mail-lf1-x130.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nCMhk-0005tW-11 for emacs-orgmode@gnu.org; Tue, 25 Jan 2022 09:22:08 -0500 Received: by mail-lf1-x130.google.com with SMTP id z19so20401039lfq.13 for ; Tue, 25 Jan 2022 06:20:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=RDBcDhe5+/Lrv9FqwfTcxw/rMPwB3CfVzhVniGLxgBo=; b=QQ1kvgpEZ+eZ/Zol4NR/f3Kg791v/Ytnpda/SaYTVbtV5P98+6Wva/DQPjcBk9fxaG bioj1xQrE8n0GQiRBBaz8iALi+jzblRT98m0+3mX2BW48wdtOTSyBvG2vsBA0Bon2ZOK Er2v7BHPTgDB4c6geayZuQNFeOWqU0lHXogh/6gAG975qmRn2s3QroVrN0E+jWQSIfvR Qrm6dlHJYw5F/FwIcBZPHHVeFNTJ1DmHJTcT0o0PbN6N0DYPkotpqze9T2M2w61KcOjj WRrgKvOKmc9mrr3Lw5Jm4R591jg4yWLwjdklHBYYc2wwcfuLQtqZzY1IxiYgOvopKsnC +Yow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=RDBcDhe5+/Lrv9FqwfTcxw/rMPwB3CfVzhVniGLxgBo=; b=Llgtd7thkRsutCNl6pHhU0S5maHeccgPy9qtlnhycSa33zH0YVnh9qXEnLvHUoWMe7 B27i8JN9m7P0fRt7Rrq/l1fFhd3nq1dK3NqNqt23HwTc9GliBGtdwEr08pcIf2EJJaVx O4ierwYJZj2sX9AAB3enpfDci9q9tenu9QXpOIS3/GSQkCAThbKwm4B4lqftn2OAbe39 pGDELPDpu3VlMCRgYEm5PAo6AzqEdWiTWhd2CV+Eq091aLYw4OO63yhNB228U47f0GgZ mDcGkmWEbaP1nQ2fQHGSZR62OIizcK34X5kPxtDICjFR9S37tRZilqnRD4UGz/CBFRfU 1yDQ== X-Gm-Message-State: AOAM5338dD12/LqjtoxYFWekcB99asPxJxqlXJpAZVU8xQrq3gn30x8T +pM5zLnVoCO1tOFl/9rkOEc= X-Google-Smtp-Source: ABdhPJzUMznbcZNZRYiOKb5ajcsV+zmeVz8itC4vTx0Be+oV7qi9Zdg+3DslW3hlGVC9tPKqJQq9kw== X-Received: by 2002:a05:6512:e8a:: with SMTP id bi10mr7308811lfb.562.1643120453728; Tue, 25 Jan 2022 06:20:53 -0800 (PST) Received: from localhost ([91.210.107.150]) by smtp.gmail.com with ESMTPSA id g23sm443195ljl.34.2022.01.25.06.20.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 25 Jan 2022 06:20:53 -0800 (PST) From: Ihor Radchenko To: sebastien.miquel@posteo.eu Subject: Re: Poor org-babel-tangle-file performance with more than 100 trivial noweb-references In-Reply-To: References: <147178804.982080.1643087944384@ichabod.co-bxl> Date: Tue, 25 Jan 2022 22:25:18 +0800 Message-ID: <87sftb6gfl.fsf@localhost> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a00:1450:4864:20::130 (failed) Received-SPF: pass client-ip=2a00:1450:4864:20::130; envelope-from=yantar92@gmail.com; helo=mail-lf1-x130.google.com X-Spam_score_int: -10 X-Spam_score: -1.1 X-Spam_bar: - X-Spam_report: (-1.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, PDS_HP_HELO_NORDNS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: emacs-orgmode@gnu.org, pareto optimal Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: "Emacs-orgmode" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1643125789; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=RDBcDhe5+/Lrv9FqwfTcxw/rMPwB3CfVzhVniGLxgBo=; b=GnfNNsZ3/FWP83AtIwZtx/O2333ws0DBS+WCvuZuYNjrcc+gG9jKIHGarHkUPQcd0Vvtyr 7IrLR6SLcONbDFsFN3OlAGSn53LbzqJI/oGp/Ou19tfyXAobtXaOkOdEYclsp05letaO8G nDLLiX8LkoTM6I332xonE9blTI69SEr3fblxfDmRJ3jjXTeM3yhAFNc/B9jan+aLbXxxcG ji363Z2FmuErpXHzUoAwim6SgUffs622p7tgMsFFxAXhU3dNXmQYCpotOv8zcBbwT9Xu+I XTxP9wuCyjXKRblg/7p8acw8QRcCn8JXE7CiMX50mcdgOnXaP/XdgI+aP3TQtA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1643125789; a=rsa-sha256; cv=none; b=SBJXlhtbdl3vXcR6BR4QLxjc8xNKR12kj8K0+F3rvOlD7F5oeA8ogTSItC1yy8bV5+itkL tZK6ygxadIqfvy1nWYl8k+Ey3T1JmRllBjTaaedfhGpVOuzB0qxOM/New3M0kIjA9Qn9zb xjLKz422FoD0avsWyiF9VkCXlzpNNunGIfOgU3XS0cNP+u5Fbgaaku0Aee5oTr/mLVmX4R cR+i0imnGLHweihyXCwqK8hfUM5TNun6mgHVqKpdcVVZEkhO/txDTcjLF0W8RvgxLBa1JX X8ZeFQ5SW8Tgpp76oSZaraCssqfCO0iAiBVG+Kfx9Bim8TsHHnSfA0IBA+6bsw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20210112 header.b=QQ1kvgpE; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -1.53 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20210112 header.b=QQ1kvgpE; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 9157536257 X-Spam-Score: -1.53 X-Migadu-Scanner: scn1.migadu.com X-TUID: OiwQ+waeFaLq S=C3=A9bastien Miquel writes: > pareto optimal writes: >> Using =3Demacs -Q=3D to tangle org files with more than over 100=20 >> noweb-refs gets slow fast. > I can reproduce the slow down with my config. The culprit is > ~org-element--cache-verify-element~. Significantly decreasing > =3Dorg-element--cache-self-verify-frequency=3D yields a 5x speedup. Even with verification, we already have 10x speed improvement. I do not recommend decreasing verification frequency. Not until we make sure that there are no more lurking cache bugs on main. You might do it in your personal config, but please be careful and make sure that you have backups/version control your Org files. Best, Ihor