missing todo's in agenda after emacs/org upgrade

missing todo's in agenda after emacs/org upgrade

[Peter Frings]

Good afternoon all,

I recently switched from the wonderful Carbon-emacs to the `no-frills'
Emacs for OSX, and decided to use the emacs `starter-kit for social
sciences' (http://kjhealy.github.com/emacs-starter-kit/) with it.

During the upgrade, I also upgraded org-mode from 6.6. to 7.7.

Now, the agenda no longers lists my todo items... the agenda files are
the same as the previous setup, the todo keywords are the same, ... I've
examined all plausible customizations, but I can't seem to find the
problem.

The agenda shows the (re)scheduled todo items all right, the Agenda Files 
menu shows the correct files, 

Another thing that’s missing are the logged items in the time grid. The repeating 
tasks show up, but the clocked tasks don’t.

This is probably something really stupid that I’m overlooking, but i can’t find it. 
Is there someone out there that can point me in the right direction?

Thanks!
Peter.



Emacs  : GNU Emacs 23.3.1 (x86_64-apple-darwin, NS apple-appkit-1038.35)
 of 2011-03-10 on black.porkrind.org
Package: Org-mode version 7.7

current state:
==============
(setq
 org-export-latex-after-initial-vars-hook '(my-auto-tex-parameters my-auto-tex-cmd
                                            org-beamer-after-initial-vars)
 org-link-frame-setup '((vm . vm-visit-folder-other-frame) (gnus . gnus-other-frame)
                        (file . find-file-other-frame))
 org-export-latex-listings 'minted
 org-agenda-clockreport-parameter-plist '(:link t :maxlevel 3)
 org-speed-command-hook '(org-speed-command-default-hook org-babel-speed-command-hook)
 org-agenda-custom-commands '(("p" "Postponed tasks" todo
                               #("POSTPONED" 0 9 (face org-warning)) nil)
                              )
 org-shiftdown-final-hook '(windmove-down)
 org-agenda-files '("~/planning/planning.org" "~/planning/todo.org" "~/planning/notes.org"
                    "~/planning/time-sheet.org")
 org-agenda-include-diary t
 org-src-window-setup 'current-window
 org-src-fontify-natively t
 org-babel-load-languages '((emacs-lisp . t) (sh . t) (R . t) (perl . t) (ruby . t)
                            (python . t) (js . t) (haskell . t) (clojure . t) (ditaa . t))
 org-hide-leading-stars t
 org-completion-use-ido t
 org-metaup-hook '(org-babel-load-in-session-maybe)
 org-shiftup-final-hook '(windmove-up)
 org-export-preprocess-after-blockquote-hook '(org-special-blocks-make-special-cookies)
 org-after-todo-state-change-hook '(org-clock-out-if-current)
 org-babel-tangle-lang-exts '(("latex" . "tex") ("clojure" . "clj") ("haskell" . "hs")
                              ("python" . "py") ("ruby" . "rb") ("perl" . "pl")
                              ("emacs-lisp" . "el"))
 org-clock-history-length 10
 org-archive-location "~/planning/archive.org::From %s"
 org-log-state-notes-insert-after-drawers t
 org-export-html-after-blockquotes-hook '(org-special-blocks-convert-html-special-cookies)
 org-export-blocks-postblock-hook '(org-exp-res/src-name-cleanup)
 org-log-note-clock-out t
 org-export-html-style "<link rel=\"stylesheet\" type=\"text/css\" href=\"org.css\">"
 org-export-latex-format-toc-function 'org-export-latex-format-toc-default
 org-stuck-projects '("+LEVEL=2/-DONE" ("TODO" "NEXT" "NEXTACTION" "BUSY") nil)
 org-export-latex-after-blockquotes-hook '(org-special-blocks-convert-latex-special-cookies)
 org-agenda-time-grid '((daily weekly today) #("----------------" 0 16 (org-heading t))
                        (900 1000 1100 1230 1400 1500 1600 1730))
 org-src-lang-modes '(("r" . ess-mode) ("ocaml" . tuareg) ("elisp" . emacs-lisp)
                      ("ditaa" . artist) ("asymptote" . asy) ("dot" . fundamental)
                      ("sqlite" . sql) ("calc" . fundamental) ("C" . c))
 org-log-done-with-time nil
 org-tab-first-hook '(yas/org-very-safe-expand org-hide-block-toggle-maybe
                      org-src-native-tab-command-maybe org-babel-hide-result-toggle-maybe)
 org-src-mode-hook '(org-src-babel-configure-edit-buffer org-src-mode-configure-edit-buffer)
 org-confirm-shell-link-function 'yes-or-no-p
 org-mouse-1-follows-link t
 org-export-first-hook '(org-beamer-initialize-open-trackers)
 org-agenda-include-all-todo t
 org-todo-keywords '((sequence "TODO(t)" "BUSY(b)" "WAITING(w)" "|" "DONE(d)" "CANCELLED(c)"
                      "POSTPONED(p)")
                     )
 org-agenda-before-write-hook '(org-agenda-add-entry-text)
 org-export-latex-packages-alist '(("" "graphicx" t) ("" "longtable" nil) ("" "float"))
 org-default-notes-file "~/planning/notes.org"
 org-directory "~/planning/"
 org-blank-before-new-entry '((heading . t) (plain-list-item))
 org-babel-pre-tangle-hook '(save-buffer)
 org-cycle-hook '(org-cycle-hide-archived-subtrees org-cycle-hide-drawers
                  org-cycle-show-empty-lines org-optimize-window-after-visibility-change)
 org-publish-project-alist '(("org" :base-directory "~/.emacs.d/" :publishing-directory
                              "~/Documents/websites/kjhhome/esk/" :auto-sitemap t
                              :sitemap-filename "index.org" :sitemap-title
                              "Emacs Starter Kit for the Social Sciences: Documentation"
                              :section-numbers t :table-of-contents nil :style
                              "<link rel=\"stylesheet\"\n                 href=\"http://kieranhealy.org/css/blueprint/org-screen.css\"\n                 type=\"text/css\"/>")
                             )
 org-export-preprocess-before-normalizing-links-hook '(org-remove-file-link-modifiers)
 org-use-speed-commands t
 org-replace-disputed-keys t
 org-mode-hook '(org-mode-reftex-setup
                 #[nil "\300\301\302\303\304$\207"
                   [org-add-hook change-major-mode-hook org-show-block-all append local] 5]
                 (lambda nil (local-set-key "\216" (quote outline-next-visible-heading))
                  (local-set-key "\220" (quote outline-previous-visible-heading))
                  (local-set-key "\225" (quote outline-up-heading))
                  (local-set-key "\227" (quote org-table-copy-region))
                  (local-set-key "\231" (quote org-table-paste-rectangle))
                  (local-set-key "\214" (quote org-table-sort-lines))
                  (local-set-key "\311" (quote org-toggle-iimage-in-org))
                  (make-variable-buffer-local (quote yas/trigger-key))
                  (setq yas/trigger-key [tab])
                  (add-to-list (quote org-tab-first-hook) (quote yas/org-very-safe-expand))
                  (define-key yas/keymap [tab] (quote yas/next-field)))
                 #[nil "\300\301\302\303\304$\207"
                   [org-add-hook change-major-mode-hook org-babel-show-result-all append local]
                   5]
                 org-babel-result-hide-spec org-babel-hide-all-hashes)
 org-refile-targets '((org-agenda-files :maxlevel . 1))
 org-ctrl-c-ctrl-c-hook '(org-clock-update-time-maybe org-babel-hash-at-point
                          org-babel-execute-safely-maybe)
 org-tab-follows-link t
 org-confirm-elisp-link-function 'y-or-n-p
 org-shiftright-final-hook '(windmove-right)
 org-export-interblocks '((lob org-babel-exp-lob-one-liners)
                          (src org-babel-exp-inline-src-blocks))
 org-clock-out-hook '(org-clock-remove-empty-clock-drawer)
 org-occur-hook '(org-first-headline-recenter)
 org-from-is-user-regexp "\\<Peter Frings\\>"
 org-export-preprocess-before-selecting-backend-code-hook '(org-beamer-select-beamer-code)
 org-confirm-babel-evaluate nil
 org-tags-column -80
 org-modules '(org-bbdb org-bibtex org-gnus org-info org-jsinfo org-irc org-mac-message
               org-mew org-mhe org-rmail org-vm org-wl)
 org-shiftleft-final-hook '(windmove-left)
 org-remember-templates '(("Case" 99 "* TODO [[case:%^{Case}]] - %?\n  %i"
                           "~/planning/AxReqd.org" "Cases")
                          ("Todo" 116 "* TODO %^{Todo}\n %?%i\n" "~/planning/notes.org" "Todo")
                          ("Idea" 105 "* %^{Idea}\n %?%i\n" "~/planning/notes.org" "Ideas"))
 org-ellipsis " ✎"
 org-export-html-style-extra "<link rel=\"stylesheet\" href=\"http://kieranhealy.org/css/kjh-org-custom.css\" type=\"text/css\"><link rel=\"stylesheet\" href=\"http://kieranhealy.org/css/blueprint/print.css\" type=\"text/css\" media=\"print\"> <!--[if IE]><link rel=\"stylesheet\" href=\"http://kieranhealy.org/css/blueprint/ie.css\" type=\"text/css\" media=\"screen,projection\"><![endif]-->"
 org-export-latex-minted-options '(("bgcolor" "bg") ("fontsize" "\\small"))
 org-src-tab-acts-natively t
 org-export-latex-final-hook '(org-beamer-amend-header org-beamer-fix-toc
                               org-beamer-auto-fragile-frames
                               org-beamer-place-default-actions-for-lists)
 org-metadown-hook '(org-babel-pop-to-session-maybe)
 org-export-blocks '((src org-babel-exp-src-block nil)
                     (comment org-export-blocks-format-comment t)
                     (ditaa org-export-blocks-format-ditaa nil)
                     (dot org-export-blocks-format-dot nil))
 )

Re: missing todo's in agenda after emacs/org upgrade

[suvayu ali]

Hi Peter,

This is quite an extensive setup. What do you get with only the
following options:

(setq org-agenda-files
      '("~/planning/planning.org" "~/planning/todo.org"
	"~/planning/notes.org" "~/planning/time-sheet.org")
      org-agenda-include-diary t
      org-todo-keywords
      '((sequence "TODO(t)" "BUSY(b)" "WAITING(w)" "|"
      "DONE(d)" "CANCELLED(c)" "POSTPONED(p)")))

I think your best bet is to try to isolate which part of your setup is
interfering. I would start with the most basic setup and systematically
add more until I hit the problem.

GL

-- 
Suvayu

Open source is the future. It sets us free.

Re: missing todo's in agenda after emacs/org upgrade

[peter.frings]

Hi Suvayu,

> This is quite an extensive setup. What do you get with only the
> following options:
[remainder at end]

I have removed all customizations, started with an empty org-agenda-files list, opened my main planning file and added it to the agenda list. That’s about the most basic setup I can get. I do have the logged work now, that is already something, but still no TODO items on the current day (in day view). Oh, BTW, the Agenda TODO list shows all todo items… go figure!

I switched on 'Org Agenda Include All Todo’, although the description says I should better use a block agenda. However, the ‘out of the box’ agenda should show the TODO items, no?


I restored my previous set-up and voila, all was there. Grrr. Note that I mistakenly reported org-mode’s version of previous setup (with Carbon Emacs) as 6.6; it’s actually 7.4.


I’ll compare the two set-ups to see if there’s anything obvious (I did that already, but having a second look never hurts).

Thanks,
Peter.


[Remainder…]
> 
> (setq org-agenda-files
>      '("~/planning/planning.org" "~/planning/todo.org"
> 	"~/planning/notes.org" "~/planning/time-sheet.org")
>      org-agenda-include-diary t
>      org-todo-keywords
>      '((sequence "TODO(t)" "BUSY(b)" "WAITING(w)" "|"
>      "DONE(d)" "CANCELLED(c)" "POSTPONED(p)")))
> 
> I think your best bet is to try to isolate which part of your setup is
> interfering. I would start with the most basic setup and systematically
> add more until I hit the problem.
> 
> GL
> 
> -- 
> Suvayu
> 
> Open source is the future. It sets us free.

Re: missing todo's in agenda after emacs/org upgrade

[suvayu ali]

Hello Peter,

On Thu, Aug 18, 2011 at 6:36 PM,  <peter.frings@agfa.com> wrote:
> I have removed all customizations, started with an empty
> org-agenda-files list, opened my main planning file and added it to
> the agenda list. That’s about the most basic setup I can get. I do
> have the logged work now, that is already something, but still no TODO
> items on the current day (in day view). Oh, BTW, the Agenda TODO list
> shows all todo items… go figure!
>

It might be helpful to know how your TODO entries are formatted. Maybe
its not the setup, but how the agenda files are formatted that was
causing the issue?

In any case, good to hear it is resolved now.

-- 
Suvayu

Open source is the future. It sets us free.

Re: missing todo's in agenda after emacs/org upgrade

[peter.frings]

Hi Suvayu,

On 18 Aug 2011, at 18:44, suvayu ali wrote:

> It might be helpful to know how your TODO entries are formatted. Maybe
> its not the setup, but how the agenda files are formatted that was
> causing the issue?
> 
> In any case, good to hear it is resolved now.

That’s the problem, the issue is *not* resolved… the todo items show up in the global todo list, but still not in the daily agenda view.

So I believe the TODO items are formatted `according to spec’ :-).
E.g., “** TODO Fix the daily agenda view”.

I tried the really minimal set-up, as documented on worg [1], and as it is it is not showing TODO items in the agenda, either. But when I switch on 'Org Agenda Include All Todo’, it does! With the same agenda files (thus I really assume they’re properly formatted). So, one step closer… but no cigar.

I’m now comparing the org settings between the two set-ups (as included in the org bug report facility), but I don’t notice anything obvious… it’s frustrating! But tomorrow is another day, and maybe with a fresh mind… who knows?


Thanks!
Peter.

[1] http://orgmode.org/worg/org-faq.html

Re: missing todo's in agenda after emacs/org upgrade

[Puneeth Chaganti]

On Thu, Aug 18, 2011 at 11:11 PM,  <peter.frings@agfa.com> wrote:
> Hi Suvayu,
>
> On 18 Aug 2011, at 18:44, suvayu ali wrote:
>
>> It might be helpful to know how your TODO entries are formatted. Maybe
>> its not the setup, but how the agenda files are formatted that was
>> causing the issue?
>>
>> In any case, good to hear it is resolved now.
>
> That’s the problem, the issue is *not* resolved… the todo items show up in the global todo list, but still not in the daily agenda view.

As far as I understand, this has been changed. Agenda view doesn't
show the TODO list anymore, by default.  Look at the following commit
for details.

--------------------------------------------------------------
commit 770c2ddfba5c173d1b33e7b247b49a8188994f76
Author: Bernt Hansen <bernt@norang.ca>
Date:   Tue Apr 5 01:05:43 2011 +0000

    Remove obsolete functionality to add todo list in front of agenda

    * lisp/org-agenda.el: Remove obsolete code for adding todo list in front
    of the agenda

    Todo lists should be built with the TODO list or a block agenda instead.

    This code was triggered for C-u R in block agendas which is used to
    limit the clock report to the current tags filter applied to the
    agenda.
------------------------------------------------------------------------

HTH,
Puneeth

Re: missing todo's in agenda after emacs/org upgrade

[Sebastien Vauban]

Hi Peter and Puneeth,

Puneeth Chaganti wrote:
> On Thu, Aug 18, 2011 at 11:11 PM,  <peter.frings-HhcJg5Z4elQ@public.gmane.org> wrote:
>> Hi Suvayu,
>>
>> On 18 Aug 2011, at 18:44, suvayu ali wrote:
>>
>>> It might be helpful to know how your TODO entries are formatted. Maybe
>>> its not the setup, but how the agenda files are formatted that was
>>> causing the issue?
>>>
>>> In any case, good to hear it is resolved now.
>>
>> That’s the problem, the issue is *not* resolved… the todo items show up in
>> the global todo list, but still not in the daily agenda view.
>
> As far as I understand, this has been changed. Agenda view doesn't
> show the TODO list anymore, by default.  Look at the following commit
> for details.

Are we talking of SCHEDULED TODO's or not?

Peter, can you provide a minimal but complete example of what are your source
files, and your current vs expected agenda view?

Just one or two items should be sufficient to express your point, and let
people really understand your problem. I mean, I'm not totally sure to
understand the real problem you experience.

Best regards,
  Seb

-- 
Sebastien Vauban

Re: missing todo's in agenda after emacs/org upgrade

[suvayu ali]

Hi Peter,

On Thu, Aug 18, 2011 at 7:41 PM,  <peter.frings@agfa.com> wrote:
> So I believe the TODO items are formatted `according to spec’ :-).
> E.g., “** TODO Fix the daily agenda view”.

I don't think the present version of org will show an entry in the
agenda unless you have an active timestamp. To give you an example:


* TODO Plumber to fix leak
  <2011-08-04 Thu>

* TODO RooStats tutorial
  SCHEDULED: <2011-01-25 Tue 09:00>

* TODO Analysis deadline
  DEADLINE: <2011-08-19 Fri 15:00>

* TODO Read Dune
  The above 3 entries show up in the agenda, but this one doesn't.


Actually to show up in the agenda, the TODO keyword is not necessary. It
depends solely on the timestamp and you get reminders based on whether
its a regular timestamp, SCHEDULED timestamp or a DEADLINE.

I hope this helps. If you still have issues, please follow what Seb
suggested and post a minimal example which demonstrates the behaviour
you describe.

GL

-- 
Suvayu

Open source is the future. It sets us free.

Re: missing todo's in agenda after emacs/org upgrade

[peter.frings]

Good morning gents,

I think you nailed it. Thanks!


* Summary
Having the todo list in a daily view is very convenient, but not provided out-of-the-box. The enabling of it used to be relatively simply with a single variable, but in more recent version it’s now reserved for org-savvy people. Hooray for http://orgmode.org/worg/org-tutorials/org-custom-agenda-commands.html


* What the problem was
In Emacs 7.7, the variable org-agenda-include-all-todo no longer affects the daily/weekly view as documented. 

** org-agenda-include-all-todo no longer works
The docstrings states:

======================== docstring ========================
Set  means weekly/daily agenda will always contain all TODO entries.
The TODO entries will be listed at the top of the agenda, before
the entries for specific days.
This option is deprecated, it is better to define a block agenda instead.
================================================

Note that it says it’s deprecated, but it’s still present and describes the behavior I was used to. But it doesn’t. Which is in-line what what Puneeth mentioned (commit 770c2ddfba5c173d1b33e7b247b49a8188994f76).


** Terminology
Notice that org-agenda-include-all-todo’s docstring mentions ‘block agenda’, as does the ‘Agenda View’ chapter in the manual. But that term is nowhere to be found in Org’s customization options. You must first find ‘Agenda Custom Commands’, but there the docstring mentions “You can also define a set of commands, to create a __composite agenda__ buffer.” So there is a problem of terminology here.


* Thoughts
I do question this change a bit. I find it very convenient to have my to-do’s (scheduled or not) in my day view. Now, I must make a block agenda to get this. OK, I can handle that. However, out-of-the box behavior should suit beginners, and asking them to make a block agenda as the first thing to do is a bit heavy, no? (Have you seen the customization page for that? Frightening!)

So, to get what I used to have[1] I need to define a custom view like this:

(setq org-agenda-custom-commands
           '(("h" "All to-do's and Agenda"
              ((alltodo)
	       (agenda "")))))

[1] It’s not identical because of the block headers, but that might be something that is customizable. Haven’t checked it yet. 

Also, in the older version you could type `d’ or `w' to switch to day or week view from anywhere in the buffer; now you must make sure the cursor is on the agenda black and not in the todo black. This is a bit annoying.



* Example
Using GNU Emacs 23.3.1

The example uses the todo list from Suvayu’s mail:
======================== ~/planning/minimal.org ========================
 * TODO Plumber to fix leak
  <2011-08-04 Thu>
 
 * TODO RooStats tutorial
  SCHEDULED: <2011-01-25 Tue 09:00>
 
 * TODO Analysis deadline
  DEADLINE: <2011-08-19 Fri 15:00>

 * TODO Read Dune
  The above 3 entries show up in the agenda, but this one doesn’t.
================================================

And a minimal emacs init  file:
======================== ~/.emacs-minimal ========================
(add-to-list 'auto-mode-alist '("\\.\\(org\\  |org_archive\\|txt\\)$" . org-mode))
(setq org-agenda-files '("~/planning/minimal.org"))
(require 'org-install)
(require 'org-habit)

(global-set-key "\C-ca" 'org-agenda)
================================================

Start with
/Applications/Emacs.app/Contents/MacOS/Emacs --debug-init -Q -l ~/.emacs-minimal


** Behavior with Org 6.33x
Org-mode 6.33x as version with Emacs 23)

*** ‘out of the box’ setup

Do `C-c a a’

========================Weekly agenda shows=============================
Week-agenda (W33):
Monday     15 August 2011 W33
Tuesday    16 August 2011
Wednesday  17 August 2011
Thursday   18 August 2011
Friday     19 August 2011
               8:00...... ----------------
              10:00...... ----------------
              12:00...... ----------------
              14:00...... ----------------
  minimal:    15:00...... Deadline:   TODO Analysis deadline
              16:00...... ----------------
              18:00...... ----------------
              20:00...... ----------------
  minimal:    Sched.207x:  TODO RooStats tutorial
Saturday   20 August 2011
Sunday     21 August 2011
-------------------------------------------------------------

========================Daily agenda shows=============================
Day-agenda (W33):
Friday     19 August 2011
               8:00...... ----------------
              10:00...... ----------------
              12:00...... ----------------
              14:00...... ----------------
  minimal:    15:00...... Deadline:   TODO Analysis deadline
              16:00...... ----------------
              18:00...... ----------------
              20:00...... ----------------
  minimal:    Sched.207x:  TODO RooStats tutorial
================================================

*** To include the TODO items
Add this to the init file (or evaluate):

(setq org-agenda-include-all-todo t)

Then, `C-a a a’

========================Weekly agenda shows=============================
All currently open TODO items:
  minimal:    TODO Plumber to fix leak
  minimal:    TODO RooStats tutorial
  minimal:    TODO Analysis deadline
  minimal:    TODO Read Dune
Week-agenda (W33):
Monday     15 August 2011 W33
Tuesday    16 August 2011
Wednesday  17 August 2011
Thursday   18 August 2011
Friday     19 August 2011
               8:00...... ----------------
              10:00...... ----------------
              12:00...... ----------------
              14:00...... ----------------
  minimal:    15:00...... Deadline:   TODO Analysis deadline
              16:00...... ----------------
              18:00...... ----------------
              20:00...... ----------------
  minimal:    Sched.207x:  TODO RooStats tutorial
Saturday   20 August 2011
Sunday     21 August 2011

================================================

========================Weekly agenda shows=============================
All currently open TODO items:
  minimal:    TODO Plumber to fix leak
  minimal:    TODO RooStats tutorial
  minimal:    TODO Analysis deadline
  minimal:    TODO Read Dune
Day-agenda (W33):
Friday     19 August 2011
               8:00...... ----------------
              10:00...... ----------------
              12:00...... ----------------
              14:00...... ----------------
  minimal:    15:00...... Deadline:   TODO Analysis deadline
              16:00...... ----------------
              18:00...... ----------------
              20:00...... ----------------
  minimal:    Sched.207x:  TODO RooStats tutorial
================================================



** Now with org 7.7, same emacs.
emacs init file now loads a more recent version of org and sets org-agenda-include-all-todo:
======================== ~/.emacs-minimal ========================
;; use more recent org
(add-to-list 'load-path (expand-file-name "~/.emacs.d/src/org/lisp"))
(add-to-list 'auto-mode-alist '("\\.\\(org\\  |org_archive\\|txt\\)$" . org-mode))
(setq org-agenda-files '("~/planning/minimal.org"))
(require 'org-install)
(require 'org-habit)

;;; expecting to get the TODO items in the daily agenda view!
;;;
(setq org-agenda-include-all-todo t)

(global-set-key "\C-ca" 'org-agenda)
================================================

Now, the same `C-c a a’ yields

======================== Week view ========================
Week-agenda (W33):
Monday     15 August 2011 W33
Tuesday    16 August 2011
Wednesday  17 August 2011
Thursday   18 August 2011
Friday     19 August 2011
               8:00...... ----------------
               9:26...... now - - - - - - - - - - - - - - - - - - - - - - - - -
              10:00...... ----------------
              12:00...... ----------------
              14:00...... ----------------
  minimal:    15:00...... Deadline:   TODO Analysis deadline
              16:00...... ----------------
              18:00...... ----------------
              20:00...... ----------------
  minimal:    Sched.207x:  TODO RooStats tutorial
Saturday   20 August 2011
Sunday     21 August 2011
================================================

======================== Day view ========================
Day-agenda (W33):
Friday     19 August 2011
               8:00...... ----------------
              10:00...... ----------------
              12:00...... ----------------
              14:00...... ----------------
  minimal:    15:00...... Deadline:   TODO Analysis deadline
              16:00...... ----------------
              18:00...... ----------------
              20:00...... ----------------
  minimal:    Sched.207x:  TODO RooStats tutorial
================================================

No more TODO overview, even with org-agenda-include-all-todo set. Clearly, it’s not only deprecated, but completely ignored. Hence, it should be removed.


I hope I’ve managed to better describe the problems I had :-)

Cheers and thanks for the help!
Peter.

Re: missing todo's in agenda after emacs/org upgrade

[Carsten Dominik]

On Aug 19, 2011, at 11:02 AM, peter.frings@agfa.com wrote:

> Good morning gents,
> 
> I think you nailed it. Thanks!
> 
> 
> * Summary
> Having the todo list in a daily view is very convenient, but not provided out-of-the-box. The enabling of it used to be relatively simply with a single variable, but in more recent version it’s now reserved for org-savvy people. Hooray for http://orgmode.org/worg/org-tutorials/org-custom-agenda-commands.html
> 
> 
> * What the problem was
> In Emacs 7.7, the variable org-agenda-include-all-todo no longer affects the daily/weekly view as documented. 
> 
> ** org-agenda-include-all-todo no longer works
> The docstrings states:
> 
> ======================== docstring ========================
> Set  means weekly/daily agenda will always contain all TODO entries.
> The TODO entries will be listed at the top of the agenda, before
> the entries for specific days.
> This option is deprecated, it is better to define a block agenda instead.
> ================================================
> 
> Note that it says it’s deprecated, but it’s still present and describes the behavior I was used to. But it doesn’t. Which is in-line what what Puneeth mentioned (commit 770c2ddfba5c173d1b33e7b247b49a8188994f76).
> 
> 
> ** Terminology
> Notice that org-agenda-include-all-todo’s docstring mentions ‘block agenda’, as does the ‘Agenda View’ chapter in the manual. But that term is nowhere to be found in Org’s customization options. You must first find ‘Agenda Custom Commands’, but there the docstring mentions “You can also define a set of commands, to create a __composite agenda__ buffer.” So there is a problem of terminology here.
> 
> 
> * Thoughts
> I do question this change a bit. I find it very convenient to have my to-do’s (scheduled or not) in my day view. Now, I must make a block agenda to get this. OK, I can handle that. However, out-of-the box behavior should suit beginners, and asking them to make a block agenda as the first thing to do is a bit heavy, no? (Have you seen the customization page for that? Frightening!)
> 
> So, to get what I used to have[1] I need to define a custom view like this:
> 
> (setq org-agenda-custom-commands
>           '(("h" "All to-do's and Agenda"
>              ((alltodo)
> 	       (agenda "")))))
> 
> [1] It’s not identical because of the block headers, but that might be something that is customizable. Haven’t checked it yet. 
> 
> Also, in the older version you could type `d’ or `w' to switch to day or week view from anywhere in the buffer; now you must make sure the cursor is on the agenda black and not in the todo black. This is a bit annoying.
> 
> 
> 
> * Example
> Using GNU Emacs 23.3.1
> 
> The example uses the todo list from Suvayu’s mail:
> ======================== ~/planning/minimal.org ========================
> * TODO Plumber to fix leak
>  <2011-08-04 Thu>
> 
> * TODO RooStats tutorial
>  SCHEDULED: <2011-01-25 Tue 09:00>
> 
> * TODO Analysis deadline
>  DEADLINE: <2011-08-19 Fri 15:00>
> 
> * TODO Read Dune
>  The above 3 entries show up in the agenda, but this one doesn’t.
> ================================================
> 
> And a minimal emacs init  file:
> ======================== ~/.emacs-minimal ========================
> (add-to-list 'auto-mode-alist '("\\.\\(org\\  |org_archive\\|txt\\)$" . org-mode))
> (setq org-agenda-files '("~/planning/minimal.org"))
> (require 'org-install)
> (require 'org-habit)
> 
> (global-set-key "\C-ca" 'org-agenda)
> ================================================
> 
> Start with
> /Applications/Emacs.app/Contents/MacOS/Emacs --debug-init -Q -l ~/.emacs-minimal
> 
> 
> ** Behavior with Org 6.33x
> Org-mode 6.33x as version with Emacs 23)
> 
> *** ‘out of the box’ setup
> 
> Do `C-c a a’
> 
> ========================Weekly agenda shows=============================
> Week-agenda (W33):
> Monday     15 August 2011 W33
> Tuesday    16 August 2011
> Wednesday  17 August 2011
> Thursday   18 August 2011
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> Saturday   20 August 2011
> Sunday     21 August 2011
> -------------------------------------------------------------
> 
> ========================Daily agenda shows=============================
> Day-agenda (W33):
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> ================================================
> 
> *** To include the TODO items
> Add this to the init file (or evaluate):
> 
> (setq org-agenda-include-all-todo t)
> 
> Then, `C-a a a’
> 
> ========================Weekly agenda shows=============================
> All currently open TODO items:
>  minimal:    TODO Plumber to fix leak
>  minimal:    TODO RooStats tutorial
>  minimal:    TODO Analysis deadline
>  minimal:    TODO Read Dune
> Week-agenda (W33):
> Monday     15 August 2011 W33
> Tuesday    16 August 2011
> Wednesday  17 August 2011
> Thursday   18 August 2011
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> Saturday   20 August 2011
> Sunday     21 August 2011
> 
> ================================================
> 
> ========================Weekly agenda shows=============================
> All currently open TODO items:
>  minimal:    TODO Plumber to fix leak
>  minimal:    TODO RooStats tutorial
>  minimal:    TODO Analysis deadline
>  minimal:    TODO Read Dune
> Day-agenda (W33):
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> ================================================
> 
> 
> 
> ** Now with org 7.7, same emacs.
> emacs init file now loads a more recent version of org and sets org-agenda-include-all-todo:
> ======================== ~/.emacs-minimal ========================
> ;; use more recent org
> (add-to-list 'load-path (expand-file-name "~/.emacs.d/src/org/lisp"))
> (add-to-list 'auto-mode-alist '("\\.\\(org\\  |org_archive\\|txt\\)$" . org-mode))
> (setq org-agenda-files '("~/planning/minimal.org"))
> (require 'org-install)
> (require 'org-habit)
> 
> ;;; expecting to get the TODO items in the daily agenda view!
> ;;;
> (setq org-agenda-include-all-todo t)
> 
> (global-set-key "\C-ca" 'org-agenda)
> ================================================
> 
> Now, the same `C-c a a’ yields
> 
> ======================== Week view ========================
> Week-agenda (W33):
> Monday     15 August 2011 W33
> Tuesday    16 August 2011
> Wednesday  17 August 2011
> Thursday   18 August 2011
> Friday     19 August 2011
>               8:00...... ----------------
>               9:26...... now - - - - - - - - - - - - - - - - - - - - - - - - -
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> Saturday   20 August 2011
> Sunday     21 August 2011
> ================================================
> 
> ======================== Day view ========================
> Day-agenda (W33):
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> ================================================
> 
> No more TODO overview, even with org-agenda-include-all-todo set. Clearly, it’s not only deprecated, but completely ignored. Hence, it should be removed.
> 
> 
> I hope I’ve managed to better describe the problems I had :-)


Great summary, thanks Peter.

The ability to automatically include the TODO list in the agenda
was a very old one, left over from times when there was no separate
view to look onto the TODO list.  And I do not think it should be added back in, in fact,
some updating of the docs and cleaning up of variable names would be useful.

The two main issues you are having are these:

1. There is no simple way for beginners to get both TODO and agenda in one view
2. Moving through time does not work in a block view when the cursor is in the TODO list.

Maybe we can find ways to address these two issues?  For example, including a built-in command
for this double view, or seeding org-agenda-custom-commands with this particular block?

The 2. issue comes about because in a bock agenda, org only update the local block to save time,
and in a TODO list it does not make sense to move through time.  This could be fixed by checking
for an agenda block and updating that one instead.  I will take a look at this and make a proposal.

- Carsten

> 
> Cheers and thanks for the help!
> Peter.

- Carsten

Re: missing todo's in agenda after emacs/org upgrade

[Carsten Dominik]

[-- Attachment #1: Type: text/plain, Size: 1340 bytes --]


On Aug 19, 2011, at 11:02 AM, peter.frings@agfa.com wrote:

> Good morning gents,
> 
> I think you nailed it. Thanks!
> 
> 
> * Summary
> Having the todo list in a daily view is very convenient, but not provided out-of-the-box. The enabling of it used to be relatively simply with a single variable, but in more recent version it’s now reserved for org-savvy people. Hooray for http://orgmode.org/worg/org-tutorials/org-custom-agenda-commands.html


OK, I am attaching a patch proposal which will clean this up a bit.
It does:

- Clean up the variable name include-all, which is confusing
  for readers of the code
- Make `org-agenda-custom-commands' have a default value,
  which is a block that does put agenda and TODO list into
  one view.  Note that I have changed the sequence from Peter's
  proposal, I am putting the agenda first - this makes more sense,
  I think, and also reduces the likelihood that the cursor will be
  in the TODO list when you are trying to move through time.
- I have *not* changes the problem that trying to change time views
  in the TODO block will not work - this would have required
  more coding and would create undefined behavior in some block
  agendas.

HTH, please give me feed back.  Bastien, let me know if/when
I should push this change.

Cheers

- Carsten


[-- Attachment #2: agenda-include-all.patch --]
[-- Type: application/octet-stream, Size: 144 bytes --]

Local:  cleanup-include-all-stuff-in-agenda.el ~/lib/emacs/work/org-mode/
Head:   9404918 Set a default custom command, agenda plus TODO items


[-- Attachment #3: Type: text/plain, Size: 9245 bytes --]


> 
> 
> * What the problem was
> In Emacs 7.7, the variable org-agenda-include-all-todo no longer affects the daily/weekly view as documented. 
> 
> ** org-agenda-include-all-todo no longer works
> The docstrings states:
> 
> ======================== docstring ========================
> Set  means weekly/daily agenda will always contain all TODO entries.
> The TODO entries will be listed at the top of the agenda, before
> the entries for specific days.
> This option is deprecated, it is better to define a block agenda instead.
> ================================================
> 
> Note that it says it’s deprecated, but it’s still present and describes the behavior I was used to. But it doesn’t. Which is in-line what what Puneeth mentioned (commit 770c2ddfba5c173d1b33e7b247b49a8188994f76).
> 
> 
> ** Terminology
> Notice that org-agenda-include-all-todo’s docstring mentions ‘block agenda’, as does the ‘Agenda View’ chapter in the manual. But that term is nowhere to be found in Org’s customization options. You must first find ‘Agenda Custom Commands’, but there the docstring mentions “You can also define a set of commands, to create a __composite agenda__ buffer.” So there is a problem of terminology here.
> 
> 
> * Thoughts
> I do question this change a bit. I find it very convenient to have my to-do’s (scheduled or not) in my day view. Now, I must make a block agenda to get this. OK, I can handle that. However, out-of-the box behavior should suit beginners, and asking them to make a block agenda as the first thing to do is a bit heavy, no? (Have you seen the customization page for that? Frightening!)
> 
> So, to get what I used to have[1] I need to define a custom view like this:
> 
> (setq org-agenda-custom-commands
>           '(("h" "All to-do's and Agenda"
>              ((alltodo)
> 	       (agenda "")))))
> 
> [1] It’s not identical because of the block headers, but that might be something that is customizable. Haven’t checked it yet. 
> 
> Also, in the older version you could type `d’ or `w' to switch to day or week view from anywhere in the buffer; now you must make sure the cursor is on the agenda black and not in the todo black. This is a bit annoying.
> 
> 
> 
> * Example
> Using GNU Emacs 23.3.1
> 
> The example uses the todo list from Suvayu’s mail:
> ======================== ~/planning/minimal.org ========================
> * TODO Plumber to fix leak
>  <2011-08-04 Thu>
> 
> * TODO RooStats tutorial
>  SCHEDULED: <2011-01-25 Tue 09:00>
> 
> * TODO Analysis deadline
>  DEADLINE: <2011-08-19 Fri 15:00>
> 
> * TODO Read Dune
>  The above 3 entries show up in the agenda, but this one doesn’t.
> ================================================
> 
> And a minimal emacs init  file:
> ======================== ~/.emacs-minimal ========================
> (add-to-list 'auto-mode-alist '("\\.\\(org\\  |org_archive\\|txt\\)$" . org-mode))
> (setq org-agenda-files '("~/planning/minimal.org"))
> (require 'org-install)
> (require 'org-habit)
> 
> (global-set-key "\C-ca" 'org-agenda)
> ================================================
> 
> Start with
> /Applications/Emacs.app/Contents/MacOS/Emacs --debug-init -Q -l ~/.emacs-minimal
> 
> 
> ** Behavior with Org 6.33x
> Org-mode 6.33x as version with Emacs 23)
> 
> *** ‘out of the box’ setup
> 
> Do `C-c a a’
> 
> ========================Weekly agenda shows=============================
> Week-agenda (W33):
> Monday     15 August 2011 W33
> Tuesday    16 August 2011
> Wednesday  17 August 2011
> Thursday   18 August 2011
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> Saturday   20 August 2011
> Sunday     21 August 2011
> -------------------------------------------------------------
> 
> ========================Daily agenda shows=============================
> Day-agenda (W33):
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> ================================================
> 
> *** To include the TODO items
> Add this to the init file (or evaluate):
> 
> (setq org-agenda-include-all-todo t)
> 
> Then, `C-a a a’
> 
> ========================Weekly agenda shows=============================
> All currently open TODO items:
>  minimal:    TODO Plumber to fix leak
>  minimal:    TODO RooStats tutorial
>  minimal:    TODO Analysis deadline
>  minimal:    TODO Read Dune
> Week-agenda (W33):
> Monday     15 August 2011 W33
> Tuesday    16 August 2011
> Wednesday  17 August 2011
> Thursday   18 August 2011
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> Saturday   20 August 2011
> Sunday     21 August 2011
> 
> ================================================
> 
> ========================Weekly agenda shows=============================
> All currently open TODO items:
>  minimal:    TODO Plumber to fix leak
>  minimal:    TODO RooStats tutorial
>  minimal:    TODO Analysis deadline
>  minimal:    TODO Read Dune
> Day-agenda (W33):
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> ================================================
> 
> 
> 
> ** Now with org 7.7, same emacs.
> emacs init file now loads a more recent version of org and sets org-agenda-include-all-todo:
> ======================== ~/.emacs-minimal ========================
> ;; use more recent org
> (add-to-list 'load-path (expand-file-name "~/.emacs.d/src/org/lisp"))
> (add-to-list 'auto-mode-alist '("\\.\\(org\\  |org_archive\\|txt\\)$" . org-mode))
> (setq org-agenda-files '("~/planning/minimal.org"))
> (require 'org-install)
> (require 'org-habit)
> 
> ;;; expecting to get the TODO items in the daily agenda view!
> ;;;
> (setq org-agenda-include-all-todo t)
> 
> (global-set-key "\C-ca" 'org-agenda)
> ================================================
> 
> Now, the same `C-c a a’ yields
> 
> ======================== Week view ========================
> Week-agenda (W33):
> Monday     15 August 2011 W33
> Tuesday    16 August 2011
> Wednesday  17 August 2011
> Thursday   18 August 2011
> Friday     19 August 2011
>               8:00...... ----------------
>               9:26...... now - - - - - - - - - - - - - - - - - - - - - - - - -
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> Saturday   20 August 2011
> Sunday     21 August 2011
> ================================================
> 
> ======================== Day view ========================
> Day-agenda (W33):
> Friday     19 August 2011
>               8:00...... ----------------
>              10:00...... ----------------
>              12:00...... ----------------
>              14:00...... ----------------
>  minimal:    15:00...... Deadline:   TODO Analysis deadline
>              16:00...... ----------------
>              18:00...... ----------------
>              20:00...... ----------------
>  minimal:    Sched.207x:  TODO RooStats tutorial
> ================================================
> 
> No more TODO overview, even with org-agenda-include-all-todo set. Clearly, it’s not only deprecated, but completely ignored. Hence, it should be removed.
> 
> 
> I hope I’ve managed to better describe the problems I had :-)
> 
> Cheers and thanks for the help!
> Peter.

- Carsten

Re: missing todo's in agenda after emacs/org upgrade

[Peter Frings]

Hello Carsten,


On 19 Aug 2011, at 11:59, Carsten Dominik wrote:

> The two main issues you are having are these:
> 
> 1. There is no simple way for beginners to get both TODO and agenda in one view
> 2. Moving through time does not work in a block view when the cursor is in the TODO list.

A third one would be the docstring of org-agenda-include-all-todo set, suggesting that it still works. If there is no intention to revive it, I’d suggest to simply remove the entire variable.

About issue 1, there could be a standard, ready-for-use custom command. But don’t bother if I’m the only one that finds it convenient.

Fixing 2 would be great. Maybe there are other keystrokes that can be delegated to other blocks (e.g. in order of appearance) if the currently-focussed block doesn’t handle them?



Cheers,
Peter.
-- 
c++;         // this makes c bigger but returns the old value

Re: missing todo's in agenda after emacs/org upgrade

[Carsten Dominik]

On Aug 19, 2011, at 12:35 PM, Peter Frings wrote:

> Hello Carsten,
> 
> 
> On 19 Aug 2011, at 11:59, Carsten Dominik wrote:
> 
>> The two main issues you are having are these:
>> 
>> 1. There is no simple way for beginners to get both TODO and agenda in one view
>> 2. Moving through time does not work in a block view when the cursor is in the TODO list.
> 
> A third one would be the docstring of org-agenda-include-all-todo set, suggesting that it still works. If there is no intention to revive it, I’d suggest to simply remove the entire variable.

I agree.

> 
> About issue 1, there could be a standard, ready-for-use custom command. But don’t bother if I’m the only one that finds it convenient.
> 
> Fixing 2 would be great. Maybe there are other keystrokes that can be delegated to other blocks (e.g. in order of appearance) if the currently-focussed block doesn’t handle them?
> 
> 
> 
> Cheers,
> Peter.
> -- 
> c++;         // this makes c bigger but returns the old value
> 

- Carsten

Re: missing todo's in agenda after emacs/org upgrade

[Carsten Dominik]

On Aug 19, 2011, at 12:35 PM, Peter Frings wrote:

> Hello Carsten,
> 
> 
> On 19 Aug 2011, at 11:59, Carsten Dominik wrote:
> 
>> The two main issues you are having are these:
>> 
>> 1. There is no simple way for beginners to get both TODO and agenda in one view
>> 2. Moving through time does not work in a block view when the cursor is in the TODO list.
> 
> A third one would be the docstring of org-agenda-include-all-todo set, suggesting that it still works. If there is no intention to revive it, I’d suggest to simply remove the entire variable.
> 
> About issue 1, there could be a standard, ready-for-use custom command. But don’t bother if I’m the only one that finds it convenient.
> 
> Fixing 2 would be great. Maybe there are other keystrokes that can be delegated to other blocks (e.g. in order of appearance) if the currently-focussed block doesn’t handle them?


The reason why this would be confusing is that there might be
several blocks which accept a particular command, so it would
be unclear for the code how to select one, and even more
difficult for the user to have an intuitive feeling on what was
changed why....

If you follow my proposal to have the agenda first and the TODO
items second, the worst that can happen is that you have to move
to the beginning of the buffer, which is a single key stroke.
Maybe you can try - my feeling is that after a short
adaptation period you will find this entirely acceptable.

- Carsten


> 
> 
> 
> Cheers,
> Peter.
> -- 
> c++;         // this makes c bigger but returns the old value
> 

- Carsten

Re: missing todo's in agenda after emacs/org upgrade

[peter.frings]

On 19 Aug 2011, at 13:05, Carsten Dominik wrote:
> On Aug 19, 2011, at 12:35 PM, Peter Frings wrote:
>> On 19 Aug 2011, at 11:59, Carsten Dominik wrote:
>> 
>>> The two main issues you are having are these:
>>> 
>>> 1. There is no simple way for beginners to get both TODO and agenda in one view
>>> 2. Moving through time does not work in a block view when the cursor is in the TODO list.

>> Fixing 2 would be great. Maybe there are other keystrokes that can be delegated to other blocks (e.g. in order of appearance) if the currently-focussed block doesn’t handle them?

> The reason why this would be confusing is that there might be
> several blocks which accept a particular command, so it would
> be unclear for the code how to select one, and even more
> difficult for the user to have an intuitive feeling on what was
> changed why….

I can understand that this requires quite some changes and that it might be a lot of work. However, I don’t think it would be counter-intuitive, unless there are many conflicting commands (i.e., a same keystroke that has a different effect depending on the block type). Are there that many? E.g., take the ‘w’ or ‘d’ keys in the agenda view. Suppose I’m on the TODO block and type a ‘w’. Would it be that much surprising if the agenda block switches to a week view? Probably not. 

Of course, there might be sufficient cases that prove me wrong; after all I’m not really familiar with the different blocks. So I’ll stop nagging :-)

I’ll swap the order as you suggested and give it a try!

Thanks!
Peter.

Re: missing todo's in agenda after emacs/org upgrade

[Bastien]

Hi Carsten,

Carsten Dominik <carsten.dominik@gmail.com> writes:

> OK, I am attaching a patch proposal which will clean this up a bit.

Thanks for tackling these issues -- I can't read the patch thourh, 
as it is just two lines long, can you resent it? 

> It does:
>
> - Clean up the variable name include-all, which is confusing
>   for readers of the code
> - Make `org-agenda-custom-commands' have a default value,
>   which is a block that does put agenda and TODO list into
>   one view.  Note that I have changed the sequence from Peter's
>   proposal, I am putting the agenda first - this makes more sense,
>   I think, and also reduces the likelihood that the cursor will be
>   in the TODO list when you are trying to move through time.
> - I have *not* changes the problem that trying to change time views
>   in the TODO block will not work - this would have required
>   more coding and would create undefined behavior in some block
>   agendas.
>
> HTH, please give me feed back.  Bastien, let me know if/when
> I should push this change.

I'll test it this afternoon.

Best,

-- 
 Bastien

Re: missing todo's in agenda after emacs/org upgrade

[Carsten Dominik]

[-- Attachment #1: Type: text/plain, Size: 347 bytes --]


On Aug 19, 2011, at 3:08 PM, Bastien wrote:

> Hi Carsten,
> 
> Carsten Dominik <carsten.dominik@gmail.com> writes:
> 
>> OK, I am attaching a patch proposal which will clean this up a bit.
> 
> Thanks for tackling these issues -- I can't read the patch thourh, 
> as it is just two lines long, can you resent it? 


Strange.  Here it is again:


[-- Attachment #2: agenda-include-all.patch --]
[-- Type: application/octet-stream, Size: 5597 bytes --]

Changes at master
	Modified lisp/org-agenda.el
diff --git a/lisp/org-agenda.el b/lisp/org-agenda.el
index c2b111a..29a2377 100644
--- a/lisp/org-agenda.el
+++ b/lisp/org-agenda.el
@@ -351,7 +351,8 @@ This will be spliced into the custom type of
 `org-agenda-custom-commands'.")
 
 
-(defcustom org-agenda-custom-commands nil
+(defcustom org-agenda-custom-commands '(("n" "Agenda and all TODO's"
+					 ((agenda "") (alltodo))))
   "Custom commands for the agenda.
 These commands will be offered on the splash screen displayed by the
 agenda dispatcher \\[org-agenda].  Each entry is a list like this:
@@ -1081,14 +1082,6 @@ Custom commands can set this variable in the options section."
   :group 'org-agenda-daily/weekly
   :type 'boolean)
 
-(defcustom org-agenda-include-all-todo nil
-  "Set  means weekly/daily agenda will always contain all TODO entries.
-The TODO entries will be listed at the top of the agenda, before
-the entries for specific days.
-This option is deprecated, it is better to define a block agenda instead."
-  :group 'org-agenda-daily/weekly
-  :type 'boolean)
-
 (defcustom org-agenda-repeating-timestamp-show-all t
   "Non-nil means show all occurrences of a repeating stamp in the agenda.
 When set to a list of strings, only show occurrences of repeating
@@ -3351,7 +3344,7 @@ no longer in use."
 
 (defvar org-agenda-only-exact-dates nil) ; dynamically scoped
 
-(defun org-timeline (&optional include-all)
+(defun org-timeline (&optional dotodo)
   "Show a time-sorted view of the entries in the current org file.
 Only entries with a time stamp of today or later will be listed.  With
 \\[universal-argument] prefix, all unfinished TODO items will also be shown,
@@ -3362,7 +3355,6 @@ dates."
   (org-compile-prefix-format 'timeline)
   (org-set-sorting-strategy 'timeline)
   (let* ((dopast t)
-	 (dotodo include-all)
 	 (doclosed org-agenda-show-log)
 	 (entry (buffer-file-name (or (buffer-base-buffer (current-buffer))
 				      (current-buffer))))
@@ -3381,7 +3373,7 @@ dates."
     (setq org-agenda-redo-command
 	  (list 'progn
 		(list 'org-switch-to-buffer-other-window (current-buffer))
-		(list 'org-timeline (list 'quote include-all))))
+		(list 'org-timeline (list 'quote dotodo))))
     (if (not dopast)
 	;; Remove past dates from the list of dates.
 	(setq day-numbers (delq nil (mapcar (lambda(x)
@@ -3489,7 +3481,7 @@ Custom commands can set this variable in the options section.")
 (defvar org-starting-day nil) ; local variable in the agenda buffer
 (defvar org-agenda-current-span nil
   "The current span used in the agenda view.") ; local variable in the agenda buffer
-(defvar org-include-all-loc nil) ; local variable
+(defvar org-arg-loc nil) ; local variable
 
 (defvar org-agenda-entry-types '(:deadline :scheduled :timestamp :sexp)
   "List of types searched for when creating the daily/weekly agenda.
@@ -3525,29 +3517,29 @@ somewhat less efficient) way of determining what is included in
 the daily/weekly agenda, see `org-agenda-skip-function'.")
 
 ;;;###autoload
-(defun org-agenda-list (&optional include-all start-day span)
+(defun org-agenda-list (&optional arg start-day span)
   "Produce a daily/weekly view from all files in variable `org-agenda-files'.
 The view will be for the current day or week, but from the overview buffer
 you will be able to go to other days/weeks.
 
 With a numeric prefix argument in an interactive call, the agenda will
-span INCLUDE-ALL days.  Lisp programs should instead specify SPAN to change
+span ARG days.  Lisp programs should instead specify SPAN to change
 the number of days.  SPAN defaults to `org-agenda-span'.
 
 START-DAY defaults to TODAY, or to the most recent match for the weekday
 given in `org-agenda-start-on-weekday'."
   (interactive "P")
-  (if (and (integerp include-all) (> include-all 0))
-      (setq span include-all include-all nil))
+  (if (and (integerp arg) (> arg 0))
+      (setq span arg arg nil))
   (setq start-day (or start-day org-agenda-start-day))
   (if org-agenda-overriding-arguments
-      (setq include-all (car org-agenda-overriding-arguments)
+      (setq arg (car org-agenda-overriding-arguments)
 	    start-day (nth 1 org-agenda-overriding-arguments)
 	    span (nth 2 org-agenda-overriding-arguments)))
   (if (stringp start-day)
       ;; Convert to an absolute day number
       (setq start-day (time-to-days (org-read-date nil t start-day))))
-  (setq org-agenda-last-arguments (list include-all start-day span))
+  (setq org-agenda-last-arguments (list arg start-day span))
   (org-compile-prefix-format 'agenda)
   (org-set-sorting-strategy 'agenda)
   (let* ((span (org-agenda-ndays-to-span
@@ -3574,7 +3566,7 @@ given in `org-agenda-start-on-weekday'."
 	 s e rtn rtnall file date d start-pos end-pos todayp
 	 clocktable-start clocktable-end filter)
     (setq org-agenda-redo-command
-	  (list 'org-agenda-list (list 'quote include-all) start-day (list 'quote span)))
+	  (list 'org-agenda-list (list 'quote arg) start-day (list 'quote span)))
     (dotimes (n (1- ndays))
       (push (1+ (car day-numbers)) day-numbers))
     (setq day-numbers (nreverse day-numbers))
@@ -3582,7 +3574,7 @@ given in `org-agenda-start-on-weekday'."
 	  clocktable-end (1+ (or (org-last day-numbers) 0)))
     (org-prepare-agenda "Day/Week")
     (org-set-local 'org-starting-day (car day-numbers))
-    (org-set-local 'org-include-all-loc include-all)
+    (org-set-local 'org-arg-loc arg)
     (org-set-local 'org-agenda-current-span (org-agenda-ndays-to-span span))
     (unless org-agenda-compact-blocks
       (let* ((d1 (car day-numbers))


[-- Attachment #3: Type: text/plain, Size: 893 bytes --]





> 
>> It does:
>> 
>> - Clean up the variable name include-all, which is confusing
>>  for readers of the code
>> - Make `org-agenda-custom-commands' have a default value,
>>  which is a block that does put agenda and TODO list into
>>  one view.  Note that I have changed the sequence from Peter's
>>  proposal, I am putting the agenda first - this makes more sense,
>>  I think, and also reduces the likelihood that the cursor will be
>>  in the TODO list when you are trying to move through time.
>> - I have *not* changes the problem that trying to change time views
>>  in the TODO block will not work - this would have required
>>  more coding and would create undefined behavior in some block
>>  agendas.
>> 
>> HTH, please give me feed back.  Bastien, let me know if/when
>> I should push this change.
> 
> I'll test it this afternoon.
> 
> Best,
> 
> -- 
> Bastien

- Carsten

Re: missing todo's in agenda after emacs/org upgrade

[Bastien]

Carsten Dominik <carsten.dominik@gmail.com> writes:

> Strange.  Here it is again:

Thanks -- please go ahead!

(Good to get rid of "include-all", I stumbled on this while 
debugging the agenda a while ago...)

Best,

-- 
 Bastien

Re: missing todo's in agenda after emacs/org upgrade

[Carsten Dominik]

On Aug 19, 2011, at 3:23 PM, Bastien wrote:

> Carsten Dominik <carsten.dominik@gmail.com> writes:
> 
>> Strange.  Here it is again:
> 
> Thanks -- please go ahead!


Done.

- Carsten
> 
> (Good to get rid of "include-all", I stumbled on this while 
> debugging the agenda a while ago...)
> 
> Best,
> 
> -- 
> Bastien

- Carsten

Re: missing todo's in agenda after emacs/org upgrade

[Viktor Rosenfeld]

Carsten Dominik wrote:

> 2. Moving through time does not work in a block view when the cursor is in the TODO list.
> 
> Maybe we can find ways to address these two issues?  For example, including a built-in command
> for this double view, or seeding org-agenda-custom-commands with this particular block?
> 
> The 2. issue comes about because in a bock agenda, org only update the
> local block to save time, and in a TODO list it does not make sense to
> move through time.  This could be fixed by checking for an agenda
> block and updating that one instead.  I will take a look at this and
> make a proposal.

This would be very nice indeed. Right now, one has to jump back to the
beginning of the buffer, which is somewhat irritating.

Cheers,
Viktor