From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id wJ4+IYVAdWN76gAAbAwnHQ (envelope-from ) for ; Wed, 16 Nov 2022 20:56:53 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id oCBGIYVAdWOu+gAAauVa8A (envelope-from ) for ; Wed, 16 Nov 2022 20:56:53 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1CBD1169A4 for ; Wed, 16 Nov 2022 20:56:52 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ovOW7-0006xp-Cd; Wed, 16 Nov 2022 14:56:15 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ovOW5-0006xf-Vo for emacs-orgmode@gnu.org; Wed, 16 Nov 2022 14:56:13 -0500 Received: from mout02.posteo.de ([185.67.36.66]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ovOW3-00029w-TU for emacs-orgmode@gnu.org; Wed, 16 Nov 2022 14:56:13 -0500 Received: from submission (posteo.de [185.67.36.169]) by mout02.posteo.de (Postfix) with ESMTPS id 3DAA7240101 for ; Wed, 16 Nov 2022 20:56:07 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1668628570; bh=LI2Qt/FfrcZapJjR2TRyepm94xTMbTmH97qhSF9gu/M=; h=From:To:Cc:Subject:Date:From; b=qNMaqDIHslkmeF6qJeMIUrYYnMKwRjt1OkHZTCBb4Cr/1xLin/ZeDwkZE04gzVY5B xjZNF0eZ/g7KKH3fZDxKnjGq45rq5l2SPIZAaivTbrBG34bxCQ1SzfCkcaEehkMIQh 3o0l3R+fJfjAyhWYC/GXMR+yybkFJ9taXJ7aztzAZEHa7t24aZvCVbQEU6rB8hPBkB hXorjbsoUus+J6MUbZ8Kt3AANVGvZ54UGfTZUAMOQBMN968ymsYkW4WOf9/DlGjqAZ I0K8jaUaI9cVU6uO0PfCgKx7iEAUi+g9TGpaq5FPuSykmGPHxioXjX4RUNGgqOYxvB Msr297MLQYuSw== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4NCDLv2FVrz9rxN; Wed, 16 Nov 2022 20:56:07 +0100 (CET) From: Philip Kaludercic To: Simon Tournier Cc: emacs-orgmode@gnu.org, Bastien Subject: Re: About org-mode-tests and CI In-Reply-To: <87sfiiycat.fsf@gmail.com> (Simon Tournier's message of "Wed, 16 Nov 2022 19:38:50 +0100") References: <87sfiiycat.fsf@gmail.com> Date: Wed, 16 Nov 2022 19:56:07 +0000 Message-ID: <87zgcqk71k.fsf@posteo.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=185.67.36.66; envelope-from=philipk@posteo.net; helo=mout02.posteo.de X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: emacs-orgmode-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1668628613; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=LawHIFXEK0oCq9EEqwCxekqq0G9SrVH3oIEn9KaMqec=; b=V3IQ9p2xh+tbqH9sWdVFaO9qdjRGAOUisCZ6Zf3O7hx7b5PChPzpeIhsk9pJr0YUoEvfRG OYbm9WpKDw3VbBtwKENJRdLBcwJlvXG4/b6vR+6m9GBb64JD82m54YsJd1RZM8qZ/lA44F +nnz0ZB3HiRd4Pro38Vk448ae+4SeY5rrXe7SluXL4RveJVcGetngyP408csDy4vve0E8H VjYFH5uRotBCjWxkIEOi4mlW3OJxfQKsoQPDnea9GZjMqIXnyb4pu+KXXT1TR+303XdPec JtMX6s1S6pseoeRxop4b6MwElBCAvJq01dEKXmKsK/jGLY1/17dhENa/x7uiDQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1668628613; a=rsa-sha256; cv=none; b=cItrDQTlDfC8eKIBZm1x6x4pwci7968WyLb0Sz+rx5PDJ3G0nUD+zvkBdEc6Th+KEwMapl oKzVLtpJbwppfCOP5kFndm8sh2WRqm4GyaOfZEd8Q481ZCfiDMe+oOAgUa5Fh6rrdtLsty IE9X8DBbsM3QLmRoDNfchfq8mTyEXX2cxF3DiURjTAf8cY6tymiJQ1/KAzG+hOnCxq10Z1 tgl5rUxDi96XTBlbU4+G6mjXpbdyaDaAxiQ6A8FVDrsYNNGOkMBJuX6HYSdVO1xSsZS7Xx 8cPlnwfSiYqvd/Blq8fgoMAISfgrLul1XrTaVDirjGAuH2d9mX/0l9yVKovIAA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=qNMaqDIH; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.73 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=qNMaqDIH; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of "emacs-orgmode-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="emacs-orgmode-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 1CBD1169A4 X-Spam-Score: -3.73 X-Migadu-Scanner: scn0.migadu.com X-TUID: /85B9Ff2Wo8K Simon Tournier writes: > Hi, > > Recently, Bastien told me about using GNU Guix for some tests of Org. > Neat! Then, Bastien pointed this org-mode-tests [1] effort. > > Unrelated, Philip provides Guix recipes [2] for various old Emacs > versions. I cannot find the discussion right now, but I should point out that for the intent of testing, if the code depends on any external packages, it will also be necessary to provide packages for every version so that the compiled byte code, to avoid byte-code incompatibility. Maybe https://yhetil.org/guix-devel/87y21n3x99.fsf@posteo.net/ could be of use? > Org and Guix are part of the GNU system. Therefore, we could imagine to > bridge instead of relying on Debian. :-) > > Moreover, what would be another advantage? Run the exact same > computational environment from locally to SourceHut builds. > > Two directions: > > 1. The SourceHut image of Guix [3] could be used but =E2=80=93 and maybe = I am > missing a point since I am not an expert about SourceHut CI =E2=80=93 the= state > (revision) of this image is not controlled and thus it requires > something like: > > image: guix > tasks: > - guix: | > guix pull -C project/path/to/channels.scm > > Well, I do not know how SourceHut is caching but somehow the .yml > configuration leads to always the same computational environment > (image), in which =E2=80=9Cmake test=E2=80=9D is run. Therefore, the CI = could spend > more time in computing again and again this fixed state than running the > Org test suite. :-) This is also what I intend to do one day (in my case for Compat), but I can imagine that if a substitute server existed with all the old versions of Emacs, then that could be pinged for tests and that would make testing a lot faster. I believe that a number of packages on MELPA and GitHub use Nix to the same effect. But perhaps the SourceHut CI integration with Guix just requires more work? I can't say, because I am neither a SourceHut CI nor a Guix export :/ > 2. Using [2], it appears to me almost straightforward to build > beforehand a Docker pack containing all the requirements; say emacs@26, > curl, gcc-toolchain, git, etc. And this Docker pack would be built > using GNU Guix, > > guix pack -f docker -m manifest.scm > > where the file manifest.scm lists all the requirements. Using adequate > option as --save-provenance, this Docker pack can be inspectable [4] and > it could be stored to any Docker registery. > > Hence, the line, > > image: debian/oldstable > > or some images as, > > image: ubuntu/focal > repositories: > emacs: http://ppa.launchpad.net/kelleyk/emacs/ubuntu focal main= 3FF0E01EEAAFC9CD > > would be replaced by some images produced by =E2=80=9Cguix pack -f docker= =E2=80=9D > stored to some Docker registery. > > > All in all, I forked the project [1] but the SourceHuts build (CI) > requires some fee, right? Well, let me know how we could test this > approach of using Guix as base for running Org test suite. > > (The maintenance of such can be part of the story too. ;-)) > > > Last, without putting the cart before the horse, I think this work could > be a kind of preliminary proof-of-concept for testing Emacs packages > (ELPA, MELPA, etc.). > > Cheers, > simon > > 1: https://git.sr.ht/~bzg/org-mode-tests > 2: https://git.sr.ht/~pkal/guix-emacs-historical > 3: https://man.sr.ht/~dhruvin/builds.sr.ht-guix-cookbook/ > 4: https://hpc.guix.info/blog/2021/10/when-docker-images-become-fixed-poi= nt/