From mboxrd@z Thu Jan 1 00:00:00 1970 From: Julian Gehring Subject: Re: babel and long-running computations Date: Thu, 17 Apr 2014 11:47:30 +0200 Message-ID: <534FA332.1080304@gmail.com> References: <87lhv4qr7l.fsf@grothesque.org> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:39861) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1WaivG-0003oE-02 for emacs-orgmode@gnu.org; Thu, 17 Apr 2014 05:48:05 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Waiv8-0003Ok-Ga for emacs-orgmode@gnu.org; Thu, 17 Apr 2014 05:47:57 -0400 Received: from plane.gmane.org ([80.91.229.3]:46429) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Waiv8-0003OW-8x for emacs-orgmode@gnu.org; Thu, 17 Apr 2014 05:47:50 -0400 Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1Waiv3-0007Ot-7y for emacs-orgmode@gnu.org; Thu, 17 Apr 2014 11:47:45 +0200 Received: from embln.embl.de ([194.94.44.220]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 17 Apr 2014 11:47:45 +0200 Received: from julian.gehring by embln.embl.de with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 17 Apr 2014 11:47:45 +0200 In-Reply-To: <87lhv4qr7l.fsf@grothesque.org> List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: emacs-orgmode@gnu.org Hi Christoph, Generally, org-babel is suited for long running computations. Its caching can help you avoid rerunning code chunks. And long runtime does not conflict with the idea of reproducible research, it just may be not very comfortable for the user. In my experience, one can avoid your problems best by structuring your code and analysis in small, logical steps and save intermediate results, such that you can restart in the middle of your analysis. Otherwise, all other frameworks for reproducible research I know have the same "limitations". Best wishes Julian On 17/04/14 10:45, Christoph Groth wrote: > Dear all, > > I’m considering the use of org-babel for “reproducible science”. Is > anyone successfully using org-babel for research that involves > calculations that typically take a few minutes up to several hours on a > single CPU (i.e. up to a few minutes on a cluster)? It seems to me that > currently org-babel is not well suited for such an usage profile, but > I’d love to be taught otherwise. > > Many thanks, > Christoph > > >