From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id aMlvCdkE/mGrFgAAgWs5BA (envelope-from ) for ; Sat, 05 Feb 2022 06:02:17 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id qMKxBtkE/mF4FAAA9RJhRA (envelope-from ) for ; Sat, 05 Feb 2022 06:02:17 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 760F3468BB for ; Sat, 5 Feb 2022 06:02:16 +0100 (CET) Received: from localhost ([::1]:34130 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nGDDD-0000SU-DW for larch@yhetil.org; Sat, 05 Feb 2022 00:02:15 -0500 Received: from eggs.gnu.org ([209.51.188.92]:38434) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nGDCG-0000S0-H5 for emacs-orgmode@gnu.org; Sat, 05 Feb 2022 00:01:16 -0500 Received: from [2607:f8b0:4864:20::102e] (port=36651 helo=mail-pj1-x102e.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nGDCA-0002sa-KN for emacs-orgmode@gnu.org; Sat, 05 Feb 2022 00:01:11 -0500 Received: by mail-pj1-x102e.google.com with SMTP id h20-20020a17090adb9400b001b518bf99ffso14972022pjv.1 for ; Fri, 04 Feb 2022 21:01:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=O26+RdWvkFvswsR/u6KECjlBa44atO6fH+yCwxU7ZHE=; b=M9NrmuLz4VAaK3lazZIIHrLOCAwj4+pm+TpIaPoUnW4haxOGMYJmq/exO/aBG7V3LF 9hCatjAQkfb2kw0Vr3FezTsxz8Fhc0DtIuIs/WTarPKGUM0mjK0piEG+p0g50d4yw2Y/ y3bFfWqdrGL7QtS2oDFAyLtmwPuRj2PoAx7ZfJr7l11fheAiRQ+Bc6yDxUpmZ5fqqCXo WgDialkoR0cJqXDD3wewcqPfrRDZm6fhaPXIO0Hb6payluuAUUjdYOGWj1BiTZHiQjsj NdTpA1zb+NspslGFVqEZrdcWfViBextRnVy02aGpSmOF/hIZAUDAnPWSsDAVM+8vvmFr rl4A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=O26+RdWvkFvswsR/u6KECjlBa44atO6fH+yCwxU7ZHE=; b=J9ZqODlbFG2Oc5raH0SWgHKy8+C1Z7O2MvBQX/hNUmnAHixAwCGtawo/6DWReGeO1q VTlNXPzKJbsF6v0pWbk7DosHwVYqrUHtF4kj8ljHUj/HvxbJky8As7o8FPGm5BIAugXN 5PyR9P445Q2nPZANaS/WhWb+ZBQbFG2/aZrJWaYf0YrUn2Hl1EffMlXjTdJ/jotA4GTX E44zouKR7zD2olt0EmFUHPDSTLhiqSVZRgjSKbzlgJlQNyHYTBJI1taaJ5cs80G4vby2 usTVAnIIJ5kzEFpuuUF9q3n++TJJK1Etvmonrg9i0lcD+KLKWKwSpI8gDh7bQrZmfJLF 1V5g== X-Gm-Message-State: AOAM532tci6Po8m2aLUaceySsl37cC2c4SuUKBy+UMaItPYPx/FpKggV OK1OHObg2F+inQ3ZaosDlcJAmd5TpAjGiA== X-Google-Smtp-Source: ABdhPJwXhnn7UXqB/klxE1lyBlNgaUwYlRNv8qghjdSKyU/qNVy8Qh52z+LclrwoaFtwz94S2RKqUw== X-Received: by 2002:a17:902:6505:: with SMTP id b5mr6572089plk.15.1644037267621; Fri, 04 Feb 2022 21:01:07 -0800 (PST) Received: from localhost ([103.125.234.210]) by smtp.gmail.com with ESMTPSA id j185sm4033141pfd.85.2022.02.04.21.01.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 04 Feb 2022 21:01:07 -0800 (PST) From: Ihor Radchenko To: pareto optimal Subject: Re: Experience report on org 9.6-dev perf improvement for tangling noweb-ref heavy files In-Reply-To: <520554842.677914.1644005295341@ichabod.co-bxl> References: <520554842.677914.1644005295341@ichabod.co-bxl> Date: Sat, 05 Feb 2022 13:05:53 +0800 Message-ID: <875yptuclq.fsf@localhost> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2607:f8b0:4864:20::102e (failed) Received-SPF: pass client-ip=2607:f8b0:4864:20::102e; envelope-from=yantar92@gmail.com; helo=mail-pj1-x102e.google.com X-Spam_score_int: -10 X-Spam_score: -1.1 X-Spam_bar: - X-Spam_report: (-1.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, PDS_HP_HELO_NORDNS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Emacs Orgmode Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: "Emacs-orgmode" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1644037336; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=O26+RdWvkFvswsR/u6KECjlBa44atO6fH+yCwxU7ZHE=; b=F7/VVL7dWck1Eb/kKM/fPLAWHpKG6jtqhVzWKB9p6Jaslf2nnSdEE3/4vB3OCdFJgGPZUr iy8yyUKJiyUGIrzk+6C6yKDkt0lWMz2YSMLOJDeDpEKEbafclAX5siyD6r5IxQ//SxJKoT rlWFOTPgLhJw8IQgX6zYnhlgTxim4iKJB+ZbFsWGLHDQ2u2N+Rg+iRm/Gn2dlQ/E0ERwuW cyvdidnR2fjQgOzvicKCUSuPDtBOf7Dvi7zPv9a0I4O1jxP1dr1MRF0SyqofT5EpGGUW00 0D7gs3SZkD93Q4f1g21TwfYeGSlMGDinSAEg+Eq2LA1MPGupksTOHBbjoMFAwQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1644037336; a=rsa-sha256; cv=none; b=RjTzM9BF/RXu7Hm7cXVo4zeKWV0zENMGfXMvwdxEYwhU1L6ZiQrsTRKsPW3xqU9iCwsASa NekpAJQpawztdrSlaeSIswzdfRXbbEQlYpbPZrh8ftcBS7+ghLLUwCzkEx9ZZ+mB1cX1pH AEXL3nz/tWHP2tK0gewI1vmUs2np3u5wOCeJvtkE2dEBNk8l8Gi49a4P6HYwv5VTJhreVe 6/8Hu4A4Ty+8n7CiLiEFGKvBldYP1/223AWJN4pSvqO8B0aCQLP9VB5tsTeD2ClOZuoaX1 7XJtBRR9xXktX4PzGRoeHP8E4aOjb8Zib5M0xpwk/NbsXkRvxRCrJYK9PO5Gcw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=M9NrmuLz; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -5.13 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=M9NrmuLz; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 760F3468BB X-Spam-Score: -5.13 X-Migadu-Scanner: scn0.migadu.com X-TUID: ZGw8AsH85+ge pareto optimal writes: > Hi! I reported an issue with org-babel-tangle performance issues with lot= s of noweb references here: > > https://lists.gnu.org/archive/html/emacs-orgmode/2022-01/msg00484.html > > Using 2b49d6fd9c04020a8132bfcfffa449e3e05b47e1 on my personal (but not ye= t public) config that demonstrated that issue I see a great improvement! > > It has 124 source blocks, 70 of which are noweb-ref, and I believe some o= f those noweb-refs also refer to eachother if that matters for performance = considerations. > > org 9.5.2:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 1.28, 1.33, 1.32 > org 9.6-dev:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = 0.46, 0.44, 0.43 > > Nearly 3x or 200% faster! Would you mind sharing the profiler report for org 9.6-dev with your config? I am trying to gather more information on the remaining bottlenecks. Best, Ihor