On Wed, Oct 31, 2012 at 11:41 AM, <cberry@tajo.ucsd.edu> wrote:

> John Hendy <jw.hendy@gmail.com> writes:
>
> > I edited the subject to be more concise/clear.I let orgmode chug away
> > on reading in some ~10-30mb csv files for nearly 30min.
>
> [rest deleted]
>
> You need an ECM.
>

I did my best to provide one, other than the file, which I offered to
provide if others requested that I upload it somewhere. Since you have done
so, so have I:
- https://docs.google.com/open?id=0BzQupOSnvw08WHdabHh5VVczRGM

Let me know if that doesn't work. I put it on Google docs and sometimes
have issues with the sharing settings...

You will find the rest needed for a complete ECM of my setup in the
original email:
- minimal config I used with `emacs -Q --load=file`
- org file with minimal babel R block

Let me know if you can reproduce with the linked file. I'm open to
suggestions on how to bisect a file, though it's a column of strings and
several columns of numbers, I'm not exactly sure what to look for.


Best regards,
John


>
> I cannot reproduce your issue.
>
> This runs in the same amount of time, whether I execute the src block or
> run the code from ESS:
>
>
> #+begin_src R :session
> write.csv(diag(10)[rep(1:10,100000),],file="abc.csv")
> #+end_src
>
> #+begin_src R :session :results output
>   system.time(read.csv("abc.csv"))
> #+end_src
>
>
> abc.csv is >25MB
>
> If the behavior you describe only happens with some files, I suggest you
> try to bisect them to find the issue.
>
> HTH,
>
> Chuck
>
>
>