From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id oM7EHBqVmGBdFQEAgWs5BA (envelope-from ) for ; Mon, 10 May 2021 04:06:18 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id UJRdGBqVmGCXawAAB5/wlQ (envelope-from ) for ; Mon, 10 May 2021 02:06:18 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id ADA122657A for ; Mon, 10 May 2021 04:06:17 +0200 (CEST) Received: from localhost ([::1]:59956 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lfvJH-00030u-JW for larch@yhetil.org; Sun, 09 May 2021 22:06:15 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:51680) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lfvIu-00030l-8E for emacs-orgmode@gnu.org; Sun, 09 May 2021 22:05:52 -0400 Received: from mail-lf1-x12e.google.com ([2a00:1450:4864:20::12e]:37527) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lfvIr-0007Oi-Al for emacs-orgmode@gnu.org; Sun, 09 May 2021 22:05:52 -0400 Received: by mail-lf1-x12e.google.com with SMTP id 2so21039758lft.4 for ; Sun, 09 May 2021 19:05:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=YUAdmSyAwwgvSK07BKS/geQwYJl99akZZqHp2OkYd4M=; b=OKUNOYKjg0xuLmqAeA9mqe0fbB9V5SwpOUGcyzn9MjaF3SKZ1XjO1rnMVbthcRX3hZ ReNwq8YqE3nZRgBithr0qCfQDARVROheoW4Pc2D1gnURy6iFWwniySG5exhY7KyCoYjx BQKqW0HrbED0EQ0SmVBVWWe0eEeUyswjekDO4qgyLDK8jCZ2D+2/5thkUTisvJSeV3xW y+nIuJ24xIXOnWsTpwasiAe8cFoMjrb64MKygraZCgTJOcxkCee6fi7Pjp677KyZOBi3 iZFgGmFpGvkyDevCrgyKVsFXpPZ398lUvrOx8o5BNxSm7e/c60GvuiR2R68rsFXkAmCS I3aA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=YUAdmSyAwwgvSK07BKS/geQwYJl99akZZqHp2OkYd4M=; b=AP7LlbARtG4xOwPBQ7BUXfUPx+ebnfeO7qrVy+CGsU1lfpkvgSh1v8OsxExGXZaK6M MWzs+AGByVhvBRLVTTYStQHSkd+6oqcNnnmfKxYi4PgF6EH2W25SuyEBpzbpjWLMGi+3 UU2yInLgss2jelEOVl+K0o2rOqbjPwAbLSTF/oniPYoR5dCP0+HDRjmcmjchMq/0eoc/ 2pnQTfq9YAadAbD22dKfaGLR0ZFczvdz864g12OzKML97Wf2lGZxCbBENvFgrC5dZN14 ZkXLnJOYLY58QNQUAX2NJc5GHl3WodKjsZpptbDITTUAQBGc1hRCOvk8HE45jcytbBfT qFzA== X-Gm-Message-State: AOAM530xWBHWWv3PqADzwYojwLoIE682ijE0VRWTBdqVAQQA43YbIUy2 FGNpwdlgnAYkYaQKiWJIYC/D9ZYkqQqUOBlnrITHfTM9iRVm6A== X-Google-Smtp-Source: ABdhPJzIZbHqkFg4EUpWOMIt7ht0KU9ngNH/7dLj00QSp9q7ES6saHkAYNGdSN8bJgl/9S8rJfGp0loidJeSERh0HxY= X-Received: by 2002:a05:6512:3f04:: with SMTP id y4mr15674983lfa.458.1620612347240; Sun, 09 May 2021 19:05:47 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ab3:6d6b:0:0:0:0:0 with HTTP; Sun, 9 May 2021 19:05:46 -0700 (PDT) In-Reply-To: References: From: Samuel Wales Date: Sun, 9 May 2021 19:05:46 -0700 Message-ID: Subject: Re: [bug] archiving creates duplicate entries To: emacs-orgmode@gnu.org Content-Type: text/plain; charset="UTF-8" Received-SPF: pass client-ip=2a00:1450:4864:20::12e; envelope-from=samologist@gmail.com; helo=mail-lf1-x12e.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: "Emacs-orgmode" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1620612378; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=YUAdmSyAwwgvSK07BKS/geQwYJl99akZZqHp2OkYd4M=; b=lwMkVOrYia4OzyxWMpPm3h2nj1QweXp6oGymzPrzqoHi/pnfuvIc8T7xPuToMeUtdvLOKI u0qy1339fak3Rktvhec+XoowC6nLnsBgo8ME76X70Uqao8fy1G158Wv6DVT/h2CwPxIWp1 t9W6xaOuiY7e9xUA+tBIrwhdCiGZSG/RSsNqMFrIET7mTaSkmC6k9rXFCbKryqE9n/3d5M Fqwaz1i4N+4DZggbWtCBszJTemAwqUWbNKYCEGRAhoAfyz/utDb4gMfPWedGUOcWkQyuAo 2iyN8kaJf/o2FL6O/hwk6FoOw95joiclWz/V4OYiDshD/XmrdCnShyu+dde2/Q== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1620612378; a=rsa-sha256; cv=none; b=aoZQTUNIJk5fZRjvEAh+wzmXn9iSmsjKZ3C7Ue55Ka12vnlK5V1dm4bUCainw2Bfhv3q+X pNbYdZcBsyNkoKKg6zc5sPF1Jq5ghpel2abGgzZs4/zGN1eGH0ZYtsQCwseDzgBLHwnBht J1eyGYTVQbHpWaJi9juecOWYcG8furA/Z/KYKTC5U73ldV42hSqYxa1FJas9UyrL0NL8hl Yx9wnJXqEksGzvCGEnjYDoBDlWy9bqMNaxpvEqeT39NMT4c2Yz7vN6CSQ4WtjnMYHnS9An uGNyge6R1hWuagL61vLYgapo28Kq2Rib0B5gFnX7Exbmzz3pexRsm7Yp2HMZKg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20161025 header.b=OKUNOYKj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of emacs-orgmode-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=emacs-orgmode-bounces@gnu.org X-Migadu-Spam-Score: -3.15 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20161025 header.b=OKUNOYKj; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of emacs-orgmode-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=emacs-orgmode-bounces@gnu.org X-Migadu-Queue-Id: ADA122657A X-Spam-Score: -3.15 X-Migadu-Scanner: scn0.migadu.com X-TUID: +i73ulFC8OCn i have confirmed that this bug occurs as follows. archiving commands append to a buffer for the archive. they do not save, revert, or kill that buffer. my shell workaround, to allow archiving given completely unusably slow archiving, moved the archive files [so that they would not be slow]. therefore there were no archives on disk. but a full buffer. therefore, archiving appended to existing buffers that did not match what was on disk. then saved. ergo duplicates. suggested fix: kill the archive buffer before appending to it, if it is marked as unmodified. if it is not marked as unmodified, maybe it is ok to append? idk. On 5/9/21, Samuel Wales wrote: > when i do a bulk archive, it will sometimes put 2 copies > entries into the archive file. it is more likely to occur > if i am archiving more tasks. at times, it seems certain > entries do this repeatably, but i am not sure. > > there are times when i think i have reset everything (git is > clean, archives are moved out of teh way) but this still > occurs. i cannot make an mwe but it seemed worth reporting. > where is it getting the duplicates from? idk. it has to be > either the source .org file or the newly created and written > archive file. idk if there are any caches or text > properties or some hidden stuff in the agenda. but i can > tell you that there have been times when i experimented with > not cleaning everything and the duplicates increased. each > run would create a new duplicate of certain entries. > > btw i have been trying to archive tasks to files for a year > now. it is too slow for me. so i hit on the idea of moving > archives out of the way, then archiving a little at a time > to new archive files, then using the shell to append the new > archived entries to the old archive files, then moving the > old archive files back. thus, this isn't an issue of big > archive files. > > wish i could provide more for you or even figure out > debugging but i cannot; just hope it will ring bells. > -- The Kafka Pandemic Please learn what misopathy is. https://thekafkapandemic.blogspot.com/2013/10/why-some-diseases-are-wronged.html