Re: Very slow performance in Org-mode on 10k line file?

[John Hendy <jw.hendy@gmail.com>]

Just an update:
- I reverted back to commit release_8.0.2-73-g9998f2 (early May) with
no change in behavior, so perhaps it wasn't anything other than
growing file size
- I just created archive files for work journal entries in 2011 and
2012, storing them in separate archive files
- I'm now down to ~6500 lines, and lag is unnoticeable

Perhaps there's some magical cutoff between 6,000 and 10,000 lines
that starts to really bog things down?



John

On Wed, Aug 7, 2013 at 4:47 PM, John Hendy <jw.hendy@gmail.com> wrote:
> On Wed, Aug 7, 2013 at 4:39 PM, Rainer Stengele
> <rainer.stengele@online.de> wrote:
>> Am 07.08.2013 22:25, schrieb John Hendy:
>>> Greetings,
>>>
>>>
>>> I just started experiencing major lag in Org-mode on my main work
>>> notes file, which is at about 10k lines. Is that getting up to the
>>> point where files get unwieldy? In googling around, I found a few
>>> suggestions:
>>>
>>> - Fiddle with linum settings
>>> http://stackoverflow.com/questions/5229705/emacs-org-mode-turn-off-line-numbers
>>>
>>> I set linum-eager to off and linum-delay to on for the current setting
>>> via the customize interface and didn't perceive an effect. Any
>>> keystroke in my org file takes 1-2 seconds to appear.
>>>
>>> - Fontification?
>>> http://comments.gmane.org/gmane.emacs.orgmode/45197
>>>
>>> Comments there have files in the 5-137k line range and many say
>>> there's no/little lag unless running agenda commands.
>>>
>>> Any other suggestions? I use this file almost daily, mostly for
>>> reference, not adding... that's to say it hasn't grown majorly in the
>>> past even 3months (maybe a few hundred lines), but performance
>>> *definitely* wasn't anything like this until the last week or so.
>>>
>>> Thanks for any suggestions on improving or tracking down the source.
>>> In the mean time, I'm going to revert to a few git commits ago and see
>>> if that does anything for me.
>>>
>>>
>>> Best regards,
>>> John
>>>
>>>
>> Hi,
>>
>> just jumping on the bandwagon.
>> My one and only "biggest" issue with wonderful Orgmode is slow Emacs.
>> I run Emacs on i7 hardware with lots of memory and still have an Emacs Orgmode that answers rather slowly.
>> Slow meaning it is just not snappy at all. Creating any aganda takes several seconds which is a long time to wait
>> for the result. I already spent a lot of thought into how to optimise the performance of my system, archiving and
>> splitting Org files, using sticky agenda etc.
>> I know there is no quick solution to the slowness because of the limitation of threading in Emacs - I just wanted
>> to mention that very "unmodern" behaviour of Emacs running Orgmode. I have to use Windows 7 so this makes it even
>> slower. I assume my environment would run faster on Linux.
>>
>
> I'm running Arch Linux 64bit on an HP EliteBook 8540w with an i7 and
> 8G of RAM. HD is 54% full at present. I agree that this shouldn't be a
> big burden, and whatever happened recently really made this unusable
> for me. Oddly, generating an agenda only takes a couple of seconds,
> which is plenty fast for me, even using search.
>
>> So yes, this is nothing more than something like a rant.
>> For me Orgmode is still the killer app in Emacs, it is just sad to have a slow environment on quite modern
>> hardware with some bigger Org files.
>> My files are of size:
>>
>> $ wc *org
>>     124    1690   31670 file1.org
>>    1555   11829   97805 file2.org
>>   35022  262820 2314234 file3.org
>>     999    4968  105854 file4.org
>>     557    4029   30586 file5.org
>>    2523   20324  162165 file6.org
>>    2447   19974  139768 file7.org
>>     689    4703   36495 file8.org
>>    6789   58782  461211 file9.org
>>   53078  403126 3531142 total
>>
>
> $ wc *.org
>     23     90    867 bibliography.org
>     42    192   1756 clocking.org
>   2137  18286 122303 devel.org
>   9837  74994 494234 projects.org
>   1536   9692  77261 reference.org
>   1057   6673  48309 tf.org
>  14632 109927 744730 total
>
> projects.org is my most used file by far, and the biggest, but nothing
> compared to some of the folks posting on the link I showed who have
> 30-130k line files!
>
>
> John
>
>> Rainer
>>