On Wed, Oct 31, 2012 at 11:41 AM,
<cberry@tajo.ucsd.edu> wrote:
John Hendy <jw.hendy@gmail.com> writes:
> I edited the subject to be more concise/clear.I let orgmode chug away
> on reading in some ~10-30mb csv files for nearly 30min.
[rest deleted]
You need an ECM.
I did my best to provide one, other than the file, which I offered to provide if others requested that I upload it somewhere. Since you have done so, so have I:
Let me know if that doesn't work. I put it on Google docs and sometimes have issues with the sharing settings...
You will find the rest needed for a complete ECM of my setup in the original email:
- minimal config I used with `emacs -Q --load=file`
- org file with minimal babel R block
Let me know if you can reproduce with the linked file. I'm open to suggestions on how to bisect a file, though it's a column of strings and several columns of numbers, I'm not exactly sure what to look for.
Best regards,
John
I cannot reproduce your issue.
This runs in the same amount of time, whether I execute the src block or
run the code from ESS:
#+begin_src R :session
write.csv(diag(10)[rep(1:10,100000),],file="abc.csv")
#+end_src
#+begin_src R :session :results output
system.time(read.csv("abc.csv"))
#+end_src
abc.csv is >25MB
If the behavior you describe only happens with some files, I suggest you
try to bisect them to find the issue.
HTH,
Chuck