Problem with automatic recursive adding of org-agenda-files

Problem with automatic recursive adding of org-agenda-files

[Tor Eriksson]

[-- Attachment #1: Type: text/plain, Size: 2223 bytes --]

Hello all,

I have searched the web without finding a solution to the following
problem:

I am using this snippet in my .emacs.d (using emacs starterkit) to
dynamically and recursively load all org files in the directory
"important-directory" and any subdirectory of this directory:

(load-library "find-lisp")
(setq org-agenda-files (find-lisp-find-files
"/home/user/important-directory" "\.org$"))

The snippet comes from http://orgmode.org/worg/org-faq.html

This set-up has worked fine for more than two years; every time I add a new
subdirectory with an .org file, this file gets picked up for the agenda.

My problem is that now suddenly, one subdirectory with an .org file does
not get picked up and I can not for the world figure out what is wrong.

I had a file important-directory/sd/file.org that was picked up by the
snippet. Then, without restarting, I changed the name to file-2.org. When
refreshing the agenda with "g" it complains that the file is missing:
"Non-existent agenda file ..../file.org. [R]emove from list or [A]bort?".

I chose Remove, thinking that restarting emacs with the snippet would pick
up the new file name instead.

However, what happens is that the new file name is not picked up. If I
restart/run snippet, org-agenda-files is built but without the new file.

I tested to see if some other code were responsible by commenting out the
snippet with ;;. Upon restart org-agenda-files was not built/created as
expected. Uncommenting the snippet and org-agenda-files was back but still
without the new file file2.org.

In fact, now I can not get the snippet to pick up *any *new .org file in
the directory .../important-directory or subdiretory! Even when the new
.org file sits adjacent to a file that is picked up by the snippet.

Also, if I do the same procedure again to another file that is picked up by
the snippet by: changing the name of the file, updating agenda with g and
pressing Abort. Then this file is also not picked up any more; not under
the new name or, if I change the name back, under it's old name.

This is causing serious trouble to me, since I use this system to keep
track of deadlines that are really important.

Does anybody have any ideas?

Kind regards,

Tor

[-- Attachment #2: Type: text/html, Size: 2806 bytes --]

Re: Problem with automatic recursive adding of org-agenda-files

[Tor Eriksson]

[-- Attachment #1: Type: text/plain, Size: 2685 bytes --]

Follow up: at almost the end of my previous message I meant to say that:

"...by: changing the name of the file, updating agenda with g and pressing *
R[emove]*. Then this file is also not picked up any more; not under the new
name or, if I change the name back, under it's old name."

Sorry for any confusion.

/Tor


2013/10/23 Tor Eriksson <teriksson2000@gmail.com>

> Hello all,
>
> I have searched the web without finding a solution to the following
> problem:
>
> I am using this snippet in my .emacs.d (using emacs starterkit) to
> dynamically and recursively load all org files in the directory
> "important-directory" and any subdirectory of this directory:
>
> (load-library "find-lisp")
> (setq org-agenda-files (find-lisp-find-files "/home/user/important-directory" "\.org$"))
>
> The snippet comes from http://orgmode.org/worg/org-faq.html
>
> This set-up has worked fine for more than two years; every time I add a
> new subdirectory with an .org file, this file gets picked up for the agenda.
>
> My problem is that now suddenly, one subdirectory with an .org file does
> not get picked up and I can not for the world figure out what is wrong.
>
> I had a file important-directory/sd/file.org that was picked up by the
> snippet. Then, without restarting, I changed the name to file-2.org. When
> refreshing the agenda with "g" it complains that the file is missing:
> "Non-existent agenda file ..../file.org. [R]emove from list or [A]bort?".
>
> I chose Remove, thinking that restarting emacs with the snippet would pick
> up the new file name instead.
>
> However, what happens is that the new file name is not picked up. If I
> restart/run snippet, org-agenda-files is built but without the new file.
>
> I tested to see if some other code were responsible by commenting out the
> snippet with ;;. Upon restart org-agenda-files was not built/created as
> expected. Uncommenting the snippet and org-agenda-files was back but still
> without the new file file2.org.
>
> In fact, now I can not get the snippet to pick up *any *new .org file in
> the directory .../important-directory or subdiretory! Even when the new
> .org file sits adjacent to a file that is picked up by the snippet.
>
> Also, if I do the same procedure again to another file that is picked up
> by the snippet by: changing the name of the file, updating agenda with g
> and pressing Abort. Then this file is also not picked up any more; not
> under the new name or, if I change the name back, under it's old name.
>
> This is causing serious trouble to me, since I use this system to keep
> track of deadlines that are really important.
>
> Does anybody have any ideas?
>
> Kind regards,
>
> Tor
>

[-- Attachment #2: Type: text/html, Size: 3643 bytes --]

Problem with automatic recursive adding of org-agenda-files

[Tor Eriksson]

[-- Attachment #1: Type: text/plain, Size: 2225 bytes --]

Hello all,

I have searched the web without finding a solution to the following
problem:

I am using this snippet in my .emacs.d (using emacs starterkit) to
dynamically and recursively load all org files in the directory
"important-directory" and any subdirectory of this directory:

(load-library "find-lisp")
(setq org-agenda-files (find-lisp-find-files
"/home/user/important-directory" "\.org$"))

The snippet comes from http://orgmode.org/worg/org-faq.html

This set-up has worked fine for more than two years; every time I add a new
subdirectory with an .org file, this file gets picked up for the agenda.

My problem is that now suddenly, one subdirectory with an .org file does
not get picked up and I can not for the world figure out what is wrong.

I had a file important-directory/sd/file.org that was picked up by the
snippet. Then, without restarting, I changed the name to file-2.org. When
refreshing the agenda with "g" it complains that the file is missing:
"Non-existent agenda file ..../file.org. [R]emove from list or [A]bort?".

I chose Remove, thinking that restarting emacs with the snippet would pick
up the new file name instead.

However, what happens is that the new file name is not picked up. If I
restart/run snippet, org-agenda-files is built but without the new file.

I tested to see if some other code were responsible by commenting out the
snippet with ;;
Upon restart org-agenda-files was not built/created as expected.
Uncommenting the snippet and org-agenda-files was back but still without
the new file file2.org.

In fact, now I can not get the snippet to pick up *any *new .org file in
the directory .../important-directory or subdiretory! Even when the new
.org file sits adjacent to a file that is picked up by the snippet.

Also, if I do the same procedure again to another file that is picked up by
the snippet by: changing the name of the file, updating agenda with g and
pressing [R]emove. Then this file is also not picked up any more; not under
the new name or, if I change the name back, under it's old name.

This is causing serious trouble to me, since I use this system to keep
track of deadlines that are really important.

Does anybody have any ideas?

Kind regards,

Tor

[-- Attachment #2: Type: text/html, Size: 2968 bytes --]

Re: Problem with automatic recursive adding of org-agenda-files

[Eric Abrahamsen]

Tor Eriksson <teriksson2000@gmail.com> writes:

> Hello all,
>
> I have searched the web without finding a solution to the following
> problem:
>
> I am using this snippet in my .emacs.d (using emacs starterkit) to
> dynamically and recursively load all org files in the directory
> "important-directory" and any subdirectory of this directory:
>
> (load-library "find-lisp")
> (setq org-agenda-files (find-lisp-find-files "/home/user/important-directory" "\.org$"))
>
> The snippet comes from http://orgmode.org/worg/org-faq.html
>
> This set-up has worked fine for more than two years; every time I add
> a new subdirectory with an .org file, this file gets picked up for
> the agenda.

I don't know why that's not working, but I'm doing this:

(setq org-agenda-files '("~/org/"))

And it works out fine. It will pick up all files under that directory
that match `org-agenda-file-regexp', which defaults as everything ending
in ".org". You might try that with "/home/user/important-directory/"?

FWIW, I don't even have a `find-lisp-find-files' function in my
installation (GNU Emacs 24.3.1).

HTH,
Eric

Re: Problem with automatic recursive adding of org-agenda-files

[Nick Dokos]

Eric Abrahamsen <eric@ericabrahamsen.net> writes:

> Tor Eriksson <teriksson2000@gmail.com> writes:
>
>> Hello all,
>>
>> I have searched the web without finding a solution to the following
>> problem:
>>
>> I am using this snippet in my .emacs.d (using emacs starterkit) to
>> dynamically and recursively load all org files in the directory
>> "important-directory" and any subdirectory of this directory:
>>
>> (load-library "find-lisp")
>> (setq org-agenda-files (find-lisp-find-files "/home/user/important-directory" "\.org$"))
>>
>> The snippet comes from http://orgmode.org/worg/org-faq.html
>>
>> This set-up has worked fine for more than two years; every time I add
>> a new subdirectory with an .org file, this file gets picked up for
>> the agenda.
>
> I don't know why that's not working, but I'm doing this:
>
> (setq org-agenda-files '("~/org/"))
>
> And it works out fine. It will pick up all files under that directory
> that match `org-agenda-file-regexp', which defaults as everything ending
> in ".org". You might try that with "/home/user/important-directory/"?
>

IIUC, this does not do a recursive enumeration though...

> FWIW, I don't even have a `find-lisp-find-files' function in my
> installation (GNU Emacs 24.3.1).
>

...whereas this does (I gather - I don't have find-lisp-find-files
either, so it's probably some add-on that the OP installed).

Back to the original problem: does

      (find-lisp-find-files "/home/user/important-directory" "\.org$")

enumerate the "missing" file? What does it return?

-- 
Nick

Re: Problem with automatic recursive adding of org-agenda-files

[Nicolas Richard]

Eric Abrahamsen <eric@ericabrahamsen.net> writes:
> FWIW, I don't even have a `find-lisp-find-files' function in my
> installation (GNU Emacs 24.3.1).

Even if you eval (load-library "find-lisp") ? It's built-in for me on
GNU Emacs 24.3.1 too.

-- 
Nico.

Re: Problem with automatic recursive adding of org-agenda-files

[Eric Abrahamsen]

Nicolas Richard <theonewiththeevillook@yahoo.fr> writes:

> Eric Abrahamsen <eric@ericabrahamsen.net> writes:
>> FWIW, I don't even have a `find-lisp-find-files' function in my
>> installation (GNU Emacs 24.3.1).
>
> Even if you eval (load-library "find-lisp") ? It's built-in for me on
> GNU Emacs 24.3.1 too.

Ah, no, there it is. I didn't realize it was in a separate library, as
apparently some find-lisp-* prefixed functions outside of that library
were already loaded by default.

Re: Problem with automatic recursive adding of org-agenda-files

[Nick Dokos]

[I got a private reply from Tor Eriksson which was obviously meant for
the list, so I am taking the liberty of reposting it here.]

> Tor Eriksson <teriksson2000@gmail.com> writes:
>
> Eric, Nick, Nicolas, thanks for the feedback.
>
> I tried (setq org-agenda-files '("~/org/")) instead, but on my
> installation it only finds files in this particular dir, not files in
> subdirs to that dir (which is what I want as well).
>
> Now, I tried C-c C-c (in org mode) right on the expression responsible
> for set org-agenda-files in my .emacs.d starterkit file (described in
> the earlier e-mail). To my surprise, this loads all the files into
> org-agenda-files correctly, including the file I renamed. Of course,
> if I now look in the agenda all my dates are there.
>
> However, when shuting off emacs and restarting it, it goes back to the
> old behaviour of loading all files except the newly renamed file. It
> is really strange.
>
> So, when starting from scratch via .emacs.d/starterkit, the file name
> of the new file fails to be set but all other file names are set
> correctly/pushed into org-agenda-files. When evaluating, with C-c C-c,
> the code in starterkit which loads the files to org-agenda-files, all
> files load correctly.
>
> Anyone having an explanation to this? If you have any suggestion for
> debugging please provide some short instruction, I am fairly good in
> programming in general but I am not super conversant with Emacs in
> particular.
>

I suspect you are somehow setting the variable again later in your
.emacs (or your custom file or ...), thereby overwriting its earlier
value. Or there is something going on with starterkit perhaps, but
somebody else will have to chime in here - I know nothing about
starterkit.

> I would be really greatful if we could solve this.

-- 
Nick

Re: Problem with automatic recursive adding of org-agenda-files

[Tor Eriksson]

[-- Attachment #1: Type: text/plain, Size: 2670 bytes --]

Nick, thanks for reposting and for your comment. Sorry, I mistakenly sent
the e-mail to you instead of the list.

Just a further comment on this problem:

I have the impression that this behaviour of all files not being correctly
added to the org-agenda-files started when I chose the option R[emove] file
from org-agenda-files proposed by org. This occured when org tried to build
the agenda but realised that one of the files named in org-agenda-files was
not there. After that, it is my impression, the problems started.

I have knowingly not made any alteration to the emacs init sequence of my
emacs.

Could there be something in the org code for agenda that spurs this
behaviour?

How could I debug this?


/Tor


2013/10/24 Nick Dokos <ndokos@gmail.com>

>
> [I got a private reply from Tor Eriksson which was obviously meant for
> the list, so I am taking the liberty of reposting it here.]
>
> > Tor Eriksson <teriksson2000@gmail.com> writes:
> >
> > Eric, Nick, Nicolas, thanks for the feedback.
> >
> > I tried (setq org-agenda-files '("~/org/")) instead, but on my
> > installation it only finds files in this particular dir, not files in
> > subdirs to that dir (which is what I want as well).
> >
> > Now, I tried C-c C-c (in org mode) right on the expression responsible
> > for set org-agenda-files in my .emacs.d starterkit file (described in
> > the earlier e-mail). To my surprise, this loads all the files into
> > org-agenda-files correctly, including the file I renamed. Of course,
> > if I now look in the agenda all my dates are there.
> >
> > However, when shuting off emacs and restarting it, it goes back to the
> > old behaviour of loading all files except the newly renamed file. It
> > is really strange.
> >
> > So, when starting from scratch via .emacs.d/starterkit, the file name
> > of the new file fails to be set but all other file names are set
> > correctly/pushed into org-agenda-files. When evaluating, with C-c C-c,
> > the code in starterkit which loads the files to org-agenda-files, all
> > files load correctly.
> >
> > Anyone having an explanation to this? If you have any suggestion for
> > debugging please provide some short instruction, I am fairly good in
> > programming in general but I am not super conversant with Emacs in
> > particular.
> >
>
> I suspect you are somehow setting the variable again later in your
> .emacs (or your custom file or ...), thereby overwriting its earlier
> value. Or there is something going on with starterkit perhaps, but
> somebody else will have to chime in here - I know nothing about
> starterkit.
>
> > I would be really greatful if we could solve this.
>
> --
> Nick
>
>
>
>
>

[-- Attachment #2: Type: text/html, Size: 3492 bytes --]

Re: Problem with automatic recursive adding of org-agenda-files

[Nicolas Richard]

Tor Eriksson <teriksson2000@gmail.com> writes:
> I have the impression that this behaviour of all files not being
> correctly added to the org-agenda-files started when I chose the
> option R[emove] file from org-agenda-files proposed by org. This
> occured when org tried to build the agenda but realised that one of
> the files named in org-agenda-files was not there. After that, it is
> my impression, the problems started. 

I don't remember how the "Remove" option work, but perhaps you should
search for the string org-agenda-files in your .emacs (or init.el if you
use that), perhaps it has sneaked in a custom-set-variables declaration.

-- 
N.

Re: Problem with automatic recursive adding of org-agenda-files

[Tor Eriksson]

[-- Attachment #1: Type: text/plain, Size: 1279 bytes --]

Nicolas, thanks for the idea. That was exactly right.

In my custom.el file, the org-agenda-files turned out to be set with a
static value of some files.

I don't know how it got there, but now I have deleted the entry in the
custom.el file and everything is back in order.

Many thanks for solving this problem; it feels great to be able to again
use my system for monitoring dates for different set terms I closely have
to follow. It would have been a mess should I had to reconstruct those
dates some other way.

Case closed!

/Tor



2013/10/24 Nicolas Richard <theonewiththeevillook@yahoo.fr>

> Tor Eriksson <teriksson2000@gmail.com> writes:
> > I have the impression that this behaviour of all files not being
> > correctly added to the org-agenda-files started when I chose the
> > option R[emove] file from org-agenda-files proposed by org. This
> > occured when org tried to build the agenda but realised that one of
> > the files named in org-agenda-files was not there. After that, it is
> > my impression, the problems started.
>
> I don't remember how the "Remove" option work, but perhaps you should
> search for the string org-agenda-files in your .emacs (or init.el if you
> use that), perhaps it has sneaked in a custom-set-variables declaration.
>
> --
> N.
>

[-- Attachment #2: Type: text/html, Size: 1906 bytes --]

Re: Problem with automatic recursive adding of org-agenda-files

[Sebastien Vauban]

Tor Eriksson wrote:
> In fact, now I can not get the snippet to pick up *any *new .org file in
> the directory .../important-directory or subdiretory! Even when the new
> .org file sits adjacent to a file that is picked up by the snippet.
>
> Also, if I do the same procedure again to another file that is picked up by
> the snippet by: changing the name of the file, updating agenda with g and
> pressing Abort. Then this file is also not picked up any more; not under
> the new name or, if I change the name back, under it's old name.
>
> This is causing serious trouble to me, since I use this system to keep
> track of deadlines that are really important.
>
> Does anybody have any ideas?

Check you don't have a "customize-variables" section at the end of your .emacs
file.

If you once did `[' or `]' or some such to add one Org file, Org adds a line in
your .emacs file. And that one will override your settings!!

Really hard to find, if we don't think at such...

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Problem with automatic recursive adding of org-agenda-files

[Mike McLean]

On Oct 26, 2013, at 10:12 AM, Sebastien Vauban <sva-news@mygooglest.com> wrote:

> Tor Eriksson wrote:
>> In fact, now I can not get the snippet to pick up *any *new .org file in
>> the directory .../important-directory or subdiretory! Even when the new
>> .org file sits adjacent to a file that is picked up by the snippet.
>> 
>> Also, if I do the same procedure again to another file that is picked up by
>> the snippet by: changing the name of the file, updating agenda with g and
>> pressing Abort. Then this file is also not picked up any more; not under
>> the new name or, if I change the name back, under it's old name.
>> 
>> This is causing serious trouble to me, since I use this system to keep
>> track of deadlines that are really important.
>> 
>> Does anybody have any ideas?
> 
> Check you don't have a "customize-variables" section at the end of your .emacs
> file.
> 
> If you once did `[' or `]' or some such to add one Org file, Org adds a line in
> your .emacs file. And that one will override your settings!!
> 
> Really hard to find, if we don't think at such…

I add the follow to my setup to avoid any possibility of this:

(add-hook 'org-mode-hook
          '(lambda ()
             (org-defkey org-mode-map "\C-c["    'undefined)
             (org-defkey org-mode-map "\C-c]"    'undefined))
          'append)