From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id mJdpIFTi3V4+bAAA0tVLHw (envelope-from ) for ; Mon, 08 Jun 2020 07:01:40 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id SJw2HFTi3V5gJgAAB5/wlQ (envelope-from ) for ; Mon, 08 Jun 2020 07:01:40 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 8335E9408E9 for ; Mon, 8 Jun 2020 07:01:39 +0000 (UTC) Received: from localhost ([::1]:58484 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jiBmr-0002LO-Sz for larch@yhetil.org; Mon, 08 Jun 2020 03:01:37 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:51828) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ji9gk-00014t-6u for emacs-orgmode@gnu.org; Mon, 08 Jun 2020 00:47:14 -0400 Received: from dcvr.yhbt.net ([64.71.152.64]:36894) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ji9gi-0006x9-Qa; Mon, 08 Jun 2020 00:47:09 -0400 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 06EFD1F55B; Mon, 8 Jun 2020 04:47:04 +0000 (UTC) Date: Mon, 8 Jun 2020 04:47:03 +0000 From: Eric Wong To: Kyle Meyer Subject: Re: New mailing list archive at https://orgmode/list/ Message-ID: <20200608044703.GA20150@dcvr> References: <87mu5hqzur.fsf@ericabrahamsen.net> <87h7vmw7zp.fsf@kyleam.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <87h7vmw7zp.fsf@kyleam.com> Received-SPF: pass client-ip=64.71.152.64; envelope-from=e@yhbt.net; helo=dcvr.yhbt.net X-detected-operating-system: by eggs.gnu.org: First seen = 2020/06/08 00:47:04 X-ACL-Warn: Detected OS = Linux 2.2.x-3.x [generic] X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_PASS=-0.001, URIBL_BLOCKED=0.001 autolearn=_AUTOLEARN X-Spam_action: no action X-Mailman-Approved-At: Mon, 08 Jun 2020 03:00:52 -0400 X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Eric Abrahamsen , Bastien , emacs-orgmode@gnu.org Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: "Emacs-orgmode" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of emacs-orgmode-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=emacs-orgmode-bounces@gnu.org X-Spam-Score: -0.51 X-TUID: 1Nwdttp1wiU5 Kyle Meyer wrote: > [ +cc Eric Wong, mostly to say thanks for all the work he puts into > public-inbox, which is the software behind these archives, but also so > that he can correct me if I misrepresent any capabilities of or plans > for public-inbox ] > > > Bastien writes: > > > >> with Kyle's help, I've set up a new mailing list archive: > >> > >> https://orgmode/list/ > >> > >> References in https://orgmode.org and https://orgmode.org/list > >> that pointed to gmane.org are now using this, so many links are > >> functional again. > > > > Cool! I note that there's also NNTP access at news.yhetil.org, in > > addition to gmane.io. Does yhetil have a search interface, or are there > > other mechanisms for searching the archives (ideally in Gnus :))? > > The web interface ( or > ) is the main mechanism for searching. You > don't necessarily have to leave Emacs for that, as public-inbox's pages > render nicely in EWW. But of course that's not the Gnus-based search > you're hoping for. > > I use Gnus to follow some lists via NNTP, a mix of public-inbox archives > and gmane.io, but I've never really done any fancy searching from it and > don't use Gnus for my mail. To try it out, I hit GG to search on a > gmane.io list, but got an error [^1], so I suppose its search capability > went away with Gmane's HTTP interface. > > Poking around a bit, I guess nnweb.el would be the main place that > public-inbox's web search could be integrated into Gnus? I've been > (slowly) working on an Emacs package [^2] that adds public-inbox-related > functionality to different "endpoints" (currently Notmuch, Gnus, EWW, > Elfeed), and I'd be interested in any ideas for improving the Gnus > support. Cool. I'm not at all familiar with Emacs or Gnus but I"m glad it works for users of that. There'll be an alternative search API in addition to what currently exists over HTTP (and what's brewing with IMAP). Maybe JMAP and/or GraphQL, or something with JSON which seems to be favored nowadays. I'll need to do some research as I'm not familiar with either JMAP or GraphQL. > A couple of other notes: > > * You can get the entire archive locally with a 'git clone', in which > case you can transform it into a form that can be indexed/searched > however you prefer (including with public-inbox, running a local > public-inbox-httpd). There are some pointers on extracting an > archive to a Maildir at > . > > * In the message above, Eric W. mentions that he is considering > working on client tools with mairix-like search results. That'd > make the search capabilities available locally, and I'd imagine > something like that could be nicely integrated with Gnus, > considering it already has a mairix backend to use as a guide. Yes, definitely going to work on a mairix workalike this summer/fall. To be effective, there first needs to be a global search that works seamlessly across multiple inboxes.