From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id wBpzB6GrNmIxTwEAgWs5BA (envelope-from ) for ; Sun, 20 Mar 2022 05:20:49 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id AIYlBKGrNmIL/gAAauVa8A (envelope-from ) for ; Sun, 20 Mar 2022 05:20:49 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id AAFB5319CA for ; Sun, 20 Mar 2022 05:20:48 +0100 (CET) Received: from localhost ([::1]:53116 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nVn3f-0005Bw-4R for larch@yhetil.org; Sun, 20 Mar 2022 00:20:47 -0400 Received: from eggs.gnu.org ([209.51.188.92]:35388) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVn3C-0005BP-AF for emacs-orgmode@gnu.org; Sun, 20 Mar 2022 00:20:18 -0400 Received: from [2607:f8b0:4864:20::42a] (port=42955 helo=mail-pf1-x42a.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nVn3A-0002Ir-Mq for emacs-orgmode@gnu.org; Sun, 20 Mar 2022 00:20:17 -0400 Received: by mail-pf1-x42a.google.com with SMTP id g19so12809376pfc.9 for ; Sat, 19 Mar 2022 21:20:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding; bh=QsRN3TN1zgglloChqykWdk9ayxwDSCBWdlM0sUdyMOw=; b=MTXAdlvme4FWB0UHwwRcqzODiFfaL7vT9xtHMU3hG7MNQqJEdhf+5VuJ7JHJdYo/Dj TQp1Tns6L7PI9qIYY5mHfolvKRRz4xD1uj17Fqm+a43LIeMIq/GwymZvBLZpSMvEL2aU gQu/oEwS4ziAwPQRldtRb7og3KQqj7a/skxUg5rzuNYK3eGjL+f268mo9f3A1y/b9gPw vLb7qEw6Z0OSI9wzH20Ue8X9+FgOmvbLjNVS7s1BRw2An518K3VGau5pnO2bOAHmGTVF ZEYrlE+u9T/KtnWJJK42FAVxgOyh/J0V/J/r813qm9qUXu/2LH07f9KG0dzToyCvO/LQ TaAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version:content-transfer-encoding; bh=QsRN3TN1zgglloChqykWdk9ayxwDSCBWdlM0sUdyMOw=; b=kjIhNihy/NbwCriAKZoEvmuAM/us2IF//432BpLiet3egb8y+zfgwcp4WpjB+rp2ut ibTM/yq3emhinD627yNErbGFqFMjcWO2rC7j4+bJHU3IRfCyHEiNCdYaQS2C3u4DD4Nj Zx/drCRnCnP362LGOH2cEO50W5ruJR1nLLgAibSQWr8XG9dJrWEkZMIBTT1MDD8dAXll jx4VKYj0TqHiT3bDjwmP+ett6Kq3sYWa0U3UwUsVKutryqHfxg8i3WE3PGiy21M57VCK V8pcrG/jVfvJdGRJP6j+Y9NaMS/7CLUulKFDNW6OMLNIPmOhg+i9QUURNtJRYw/16dcA ZdfQ== X-Gm-Message-State: AOAM533UbNEkpxUExn6QHnCyhSndecJjy3NlM2H+LrlyTKdfQI4mXXr+ DAkRNWI5CR9adrcGt1bAn18= X-Google-Smtp-Source: ABdhPJw5tcj7CmhI4AROyNOIa1ExcSDOs33pTE/LIi3kvjUwm36mvmGws0OeOC9L9uAH7SIWHZK1dg== X-Received: by 2002:a65:6741:0:b0:380:5b69:cbc5 with SMTP id c1-20020a656741000000b003805b69cbc5mr13783660pgu.89.1647750015025; Sat, 19 Mar 2022 21:20:15 -0700 (PDT) Received: from localhost ([45.128.72.3]) by smtp.gmail.com with ESMTPSA id a5-20020a621a05000000b004f79f8f795fsm15197274pfa.0.2022.03.19.21.20.13 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 19 Mar 2022 21:20:14 -0700 (PDT) From: Ihor Radchenko To: psychosis Subject: Re: [PATCH] Re: [BUG] org-cite: 10 second hang opening a ~4k org file with 10MB bibtex library In-Reply-To: References: <87pmmifirh.fsf@localhost> <87fsnefg8b.fsf@localhost> <87cziifeo4.fsf@localhost> <87a6dmfd89.fsf@localhost> <877d8qf9k8.fsf@localhost> <8735jef8eg.fsf@localhost> Date: Sun, 20 Mar 2022 12:20:42 +0800 Message-ID: <87zglldzl1.fsf@localhost> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Host-Lookup-Failed: Reverse DNS lookup failed for 2607:f8b0:4864:20::42a (failed) Received-SPF: pass client-ip=2607:f8b0:4864:20::42a; envelope-from=yantar92@gmail.com; helo=mail-pf1-x42a.google.com X-Spam_score_int: -3 X-Spam_score: -0.4 X-Spam_bar: / X-Spam_report: (-0.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, PDS_HP_HELO_NORDNS=0.659, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: emacs-orgmode@gnu.org, Nicolas Goaziou , Jamie Matthews Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: "Emacs-orgmode" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1647750048; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=QsRN3TN1zgglloChqykWdk9ayxwDSCBWdlM0sUdyMOw=; b=RIXtoydk+cw0Oy5BOQfqxOPqYUmUSE0dG7iTW+EdxJKtH89yiUrgvF7cxHbXUbuXnVmAZN pNtw9+NBZUHUQ+13v3NCgKIneeSV/31ui651E6yKyYTsQQaDqA7VpRWP7gwhb5WcBGKQcL vWHE6o7J1kdMT13/4+8ZbxmyZKMRBcrEFwEtWphuN0hDFYeskdjF3waQE5B7bBAln4eTfL 09Z7mwWcD7gZX5adB2yWtLZXMUtgdiBWWlR+YEUfN1Uyg9XaygXFEhLPf+LZc5LcvrLpda nn9vDfIgdPSrVs+OdeJTAovgxpuPk/BotVmumv9uXha2N6gEKSOCDLcWUpQ6Rg== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1647750048; a=rsa-sha256; cv=none; b=tV1CEvNs3vshtl9ewnD1pCtCX/0jIYcVKwAAM9UMDzZDFkqCING32jsVjQ01I2nEJoMCeh z2qw+y14RsC25q9LwBDLt3JM+gRlrqYQLcyuqZrbnXHF4/DgHZEddKpbp0seyrwcwW2byR 8NNip8aCcOcUlcveoNc7mK3sJMxZeNlmNG6RcIAL9zXdPkQg5rRy6T69TeX64X2Jvl3+aQ TuRxQ48Q44sNmKMEDGi6+uH8cK0eJhbqZFM96EOMrzBIfaoDzkf7dAo7ztR2sj45hvS+fQ z+831ZxvdSBzDS+QaM0rk0i5YYPGsceQrWRa3U5NcMPrx9AHFOxkfrq5mW205Q== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20210112 header.b=MTXAdlvm; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: 6.56 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=gmail.com header.s=20210112 header.b=MTXAdlvm; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: AAFB5319CA X-Spam-Score: 6.56 X-Migadu-Scanner: scn0.migadu.com X-TUID: PZvnmnpMQiw9 psychosis writes: > I have a related problem (see=20 > https://list.orgmode.org/77KM6R.3BGD0Z3Z4PHF1@disroot.org/ for=20 > reference) and Ihor=E2=80=99s patch reduced the initial load time of my=20 > biblatex bibliography file from almost ten minutes to about 10 to 20=20 > seconds. I have seen your email. Persisting the cache between sessions is a more tricky. It will require a dedicated effort - significantly more than the few-liner patch here. I assume that your bibliography is much larger than 10Mb. Am I correct? > For me the changed cite-key turns only red if I restart Emacs. This is bad. Would you mind constructing a reproducer? (using the patched Org version) > Thanks for the patch! Please let me know, if I can provide information=20 > for further improvement. You definitely can. 1. You may share your bibtex file. It will make things much easier for me. I only have 1Mb example bibliography, which I used before I switched to storing references in Org files. 2. You may provide profiling information using M-x profiler-start M-x profiler-report and using ELP as I described in the previous messages. 3. We may arrange a live jitsi meeting and profile things together. Best, Ihor