From mboxrd@z Thu Jan 1 00:00:00 1970 From: cberry@tajo.ucsd.edu Subject: Re: Bug? R: Org babel block execution *drastically* slower than in ESS session directly Date: Wed, 31 Oct 2012 13:12:18 -0700 Message-ID: <878vam1jvh.fsf@tajo.ucsd.edu> References: <874nlappb1.fsf@tajo.ucsd.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Return-path: Received: from eggs.gnu.org ([208.118.235.92]:49139) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TTeeP-0003au-EH for emacs-orgmode@gnu.org; Wed, 31 Oct 2012 16:12:34 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1TTeeO-0007mX-8y for emacs-orgmode@gnu.org; Wed, 31 Oct 2012 16:12:33 -0400 Received: from plane.gmane.org ([80.91.229.3]:42394) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TTeeO-0007mT-1j for emacs-orgmode@gnu.org; Wed, 31 Oct 2012 16:12:32 -0400 Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1TTeeT-0002kv-5e for emacs-orgmode@gnu.org; Wed, 31 Oct 2012 21:12:37 +0100 Received: from tajo.ucsd.edu ([137.110.122.165]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 31 Oct 2012 21:12:37 +0100 Received: from cberry by tajo.ucsd.edu with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 31 Oct 2012 21:12:37 +0100 List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: emacs-orgmode@gnu.org John Hendy writes: > On Wed, Oct 31, 2012 at 11:41 AM, wrote: > John Hendy writes: > >> I edited the subject to be more concise/clear.I let orgmode chug away >> on reading in some ~10-30mb csv files for nearly 30min. > > [rest deleted] > > You need an ECM.I did my best to provide one, other than the file, which I offered to provide if others requested that I upload it somewhere. Since you have done so, so have I: > - https://docs.google.com/open?id=0BzQupOSnvw08WHdabHh5VVczRGM > Let me know if that doesn't work. I put it on Google docs and sometimes have issues with the sharing settings... Not an ECM in my book, but ... On my 4 year old MacBook: ,---- | | #+PROPERTY: session *R* | | #+name: bigcsv | #+begin_src R | bigcsv <- Sys.glob("~/Downloads/*.csv") | #+end_src | | #+RESULTS: bigcsv | : /Users/cberry/Downloads/test-file.csv | | #+name: readbig | #+begin_src R :results output | system.time( | tmp <- read.csv(bigcsv) | ) | | #+end_src | | #+RESULTS: readbig | : user system elapsed | : 5.679 0.306 6.002 | `---- About the same as running from ESS. FYI, > dim(tmp) [1] 964805 9 Chuck [ rest deleted ]