Re: Very slow performance in Org-mode on 10k line file?

[Russell Adams <RLAdams@AdamsInfoServ.Com>]

John,

I have a 17,000 file I work out of constantly in Org 7.8.10 with very
little lag. Just another data point.

Thanks.

On Wed, Aug 07, 2013 at 05:06:51PM -0500, John Hendy wrote:
> Just an update:
> - I reverted back to commit release_8.0.2-73-g9998f2 (early May) with
> no change in behavior, so perhaps it wasn't anything other than
> growing file size
> - I just created archive files for work journal entries in 2011 and
> 2012, storing them in separate archive files
> - I'm now down to ~6500 lines, and lag is unnoticeable
>
> Perhaps there's some magical cutoff between 6,000 and 10,000 lines
> that starts to really bog things down?
>
>
>
> John
>
> On Wed, Aug 7, 2013 at 4:47 PM, John Hendy <jw.hendy@gmail.com> wrote:
> > On Wed, Aug 7, 2013 at 4:39 PM, Rainer Stengele
> > <rainer.stengele@online.de> wrote:
> >> Am 07.08.2013 22:25, schrieb John Hendy:
> >>> Greetings,
> >>>
> >>>
> >>> I just started experiencing major lag in Org-mode on my main work
> >>> notes file, which is at about 10k lines. Is that getting up to the
> >>> point where files get unwieldy? In googling around, I found a few
> >>> suggestions:
> >>>
> >>> - Fiddle with linum settings
> >>> http://stackoverflow.com/questions/5229705/emacs-org-mode-turn-off-line-numbers
> >>>
> >>> I set linum-eager to off and linum-delay to on for the current setting
> >>> via the customize interface and didn't perceive an effect. Any
> >>> keystroke in my org file takes 1-2 seconds to appear.
> >>>
> >>> - Fontification?
> >>> http://comments.gmane.org/gmane.emacs.orgmode/45197
> >>>
> >>> Comments there have files in the 5-137k line range and many say
> >>> there's no/little lag unless running agenda commands.
> >>>
> >>> Any other suggestions? I use this file almost daily, mostly for
> >>> reference, not adding... that's to say it hasn't grown majorly in the
> >>> past even 3months (maybe a few hundred lines), but performance
> >>> *definitely* wasn't anything like this until the last week or so.
> >>>
> >>> Thanks for any suggestions on improving or tracking down the source.
> >>> In the mean time, I'm going to revert to a few git commits ago and see
> >>> if that does anything for me.
> >>>
> >>>
> >>> Best regards,
> >>> John
> >>>
> >>>
> >> Hi,
> >>
> >> just jumping on the bandwagon.
> >> My one and only "biggest" issue with wonderful Orgmode is slow Emacs.
> >> I run Emacs on i7 hardware with lots of memory and still have an Emacs Orgmode that answers rather slowly.
> >> Slow meaning it is just not snappy at all. Creating any aganda takes several seconds which is a long time to wait
> >> for the result. I already spent a lot of thought into how to optimise the performance of my system, archiving and
> >> splitting Org files, using sticky agenda etc.
> >> I know there is no quick solution to the slowness because of the limitation of threading in Emacs - I just wanted
> >> to mention that very "unmodern" behaviour of Emacs running Orgmode. I have to use Windows 7 so this makes it even
> >> slower. I assume my environment would run faster on Linux.
> >>
> >
> > I'm running Arch Linux 64bit on an HP EliteBook 8540w with an i7 and
> > 8G of RAM. HD is 54% full at present. I agree that this shouldn't be a
> > big burden, and whatever happened recently really made this unusable
> > for me. Oddly, generating an agenda only takes a couple of seconds,
> > which is plenty fast for me, even using search.
> >
> >> So yes, this is nothing more than something like a rant.
> >> For me Orgmode is still the killer app in Emacs, it is just sad to have a slow environment on quite modern
> >> hardware with some bigger Org files.
> >> My files are of size:
> >>
> >> $ wc *org
> >>     124    1690   31670 file1.org
> >>    1555   11829   97805 file2.org
> >>   35022  262820 2314234 file3.org
> >>     999    4968  105854 file4.org
> >>     557    4029   30586 file5.org
> >>    2523   20324  162165 file6.org
> >>    2447   19974  139768 file7.org
> >>     689    4703   36495 file8.org
> >>    6789   58782  461211 file9.org
> >>   53078  403126 3531142 total
> >>
> >
> > $ wc *.org
> >     23     90    867 bibliography.org
> >     42    192   1756 clocking.org
> >   2137  18286 122303 devel.org
> >   9837  74994 494234 projects.org
> >   1536   9692  77261 reference.org
> >   1057   6673  48309 tf.org
> >  14632 109927 744730 total
> >
> > projects.org is my most used file by far, and the biggest, but nothing
> > compared to some of the folks posting on the link I showed who have
> > 30-130k line files!
> >
> >
> > John
> >
> >> Rainer
> >>
>


------------------------------------------------------------------
Russell Adams                            RLAdams@AdamsInfoServ.com

PGP Key ID:     0x1160DCB3           http://www.adamsinfoserv.com/

Fingerprint:    1723 D8CA 4280 1EC9 557F  66E8 1154 E018 1160 DCB3