Recurring items don't always show up in timeline

Recurring items don't always show up in timeline

[Mark S]

I have a very simple calendar ORG file set up. A couple of the items have  
recurring days set to 90d. Like

  ** Do something periodically <2011-01-15 Sat +90d>

When I activate the agenda timeline, I see the first one of these (in  
January) but none of the other scheduled events show up. (I have other  
scheduled items to create a calendar that goes out further than the 90  
days). If I view this in the regular weekly agenda, using "f" to step  
through the weeks, the item does show up.

If I change the setting to +1w, I see several more entries, but not one  
for every week. Some weeks are skipped. It seems hit and miss. I haven't  
been able to establish the exact pattern, but it appears that I can not  
depend on recurring items to show up in the timeline.

Has anyone else seen this? Is there a way to make all activities show up  
in the timeline?

Thanks,
Mark
--------------------
Emacs 23.2.1
Win XP
Org-mode 7.5

-- 
Using Opera's revolutionary email client: http://www.opera.com/mail/

Re: Recurring items don't always show up in timeline

[Chris Randle]

Hi Mark

On 2011-03-14 19:02, Mark S wrote:
> Has anyone else seen this?

Working OK here. I get entries in 2011 for:

2011-01-15
2011-04-15
2011-07-14
2011-10-12

and switching to +1w, I see an entry every Saturday.

I'm running the same s/w as you, I think

Windows XP Pro SP3
GNU Emacs 23.2.1 (i386-mingw-nt5.1.2600) of 2010-05-08 on G41R2F1
Org-mode version 7.5 (d/l from Org-mode site, not from Git)

-- 
Chris Randle

Re: Recurring items don't always show up in timeline

[Mark S]

Hi Chris,

Are there any other dates in your calendar? Have you tried it with +90d?

Thanks,
Mark
--------------------
Emacs 23.2.1 | Win XP | Org-mode 7.5

On Mon, 14 Mar 2011 11:02:14 -0800, Mark S <throaway@yahoo.com> wrote:



--- On Mon, 3/14/11, Chris Randle <chris@amlog.co.uk> wrote:

> From: Chris Randle <chris@amlog.co.uk>
> Subject: Re: [O] Recurring items don't always show up in timeline
> To: emacs-orgmode@gnu.org
> Date: Monday, March 14, 2011, 1:36 PM
> Hi Mark
>On 2011-03-14 19:02, Mark S wrote:
> > Has anyone else seen this?
>Working OK here. I get entries in 2011 for:
>2011-01-15
> 2011-04-15
> 2011-07-14
> 2011-10-12
>and switching to +1w, I see an entry every Saturday.
>I'm running the same s/w as you, I think
>Windows XP Pro SP3
> GNU Emacs 23.2.1 (i386-mingw-nt5.1.2600) of 2010-05-08 on
> G41R2F1
> Org-mode version 7.5 (d/l from Org-mode site, not from
> Git)
>-- Chris Randle
>


-- 
Using Opera's revolutionary email client: http://www.opera.com/mail/

Re: Re: Recurring items don't always show up in timeline

[Chris Randle]

Hi Mark

On 2011-03-14 22:36, Mark S wrote:
> Are there any other dates in your calendar? Have you tried it with
> +90d?

Yes, oodles of other dates.

My initial test was with +90d. And looking through 2011, I saw the four
dates listed in my previous reply.

Will try your sample data.

-- 
Chris Randle

Re: Recurring items don't always show up in timeline

[Mark S]

Here's a version of the calendar I'm using. There are two date ranges as  
well as regular dates. It might be that recurring events that occur on  
days that are inside of a date range do not show up. On mine, "Bath for  
dog" doesn't show up on April 14th, for instance which happens to be  
inside of a date range. The Pay Cell Phone item does not occur 90 days  
later (about 4/15) which would also be inside of a date range. BUT it also  
does not occur on or near 7/15, which is not inside of a date range.
The "Do this every 3 months" item does not show up in June, even though it  
would not fall inside of a date range.

Mark

* CALENDAR 2011
** TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>
** TODO [#A] Bath for dog <2011-03-10 Thu +1w> 				 :PM:
** Books due at LIB1 <2011-03-24 Thu>
    More stuff here
** Books due at LIB2 <2011-03-12 Sat +1w>
    Stuff here
** DONE Check planning schedule  <2011-03-13 Sun>
    CLOSED: [2011-03-14 Mon 06:38]
    - State "DONE"       from "TODO"       [2011-03-14 Mon 06:38]
** TODO Recharge electrical equipment <2011-03-13 Sun +1w>
** TODO Orthodontist Visit <2011-03-13 >
** Book Fair <2011-03-24 Thu> 					     :Child1:
** Do this every 3 months <2011-03-28 Mon +90d>
** Parent Teacher Conference Days  <2011-03-31 Thu>--<2011-04-07 Thu>   
:Child1:
** Spring Break <2011-04-11 Mon>--<2011-04-22 Fri> 		     :Child1:
** PTA Picnic <2011-05-20 Fri> 					     :Child1:
** Memorial Day <2011-05-30 Mon>
** Summer begins <2011-06-02 Thu> 				     :Child1:
** Harry Potter's Birthday <2011-07-31 Sun>



On Mon, 14 Mar 2011 11:02:14 -0800, Mark S <throaway@yahoo.com> wrote:

> I have a very simple calendar ORG file set up. A couple of the items  
> have recurring days set to 90d. Like
>
>   ** Do something periodically <2011-01-15 Sat +90d>
>
> When I activate the agenda timeline, I see the first one of these (in  
> January) but none of the other scheduled events show up. (I have other  
> scheduled items to create a calendar that goes out further than the 90  
> days). If I view this in the regular weekly agenda, using "f" to step  
> through the weeks, the item does show up.
>
> If I change the setting to +1w, I see several more entries, but not one  
> for every week. Some weeks are skipped. It seems hit and miss. I haven't  
> been able to establish the exact pattern, but it appears that I can not  
> depend on recurring items to show up in the timeline.
>
> Has anyone else seen this? Is there a way to make all activities show up  
> in the timeline?
>
> Thanks,
> Mark
> --------------------
> Emacs 23.2.1
> Win XP
> Org-mode 7.5
>


-- 
Using Opera's revolutionary email client: http://www.opera.com/mail/

Re: Re: Recurring items don't always show up in timeline

[Nick Dokos]

Mark S <throaway@yahoo.com> wrote:

> Here's a version of the calendar I'm using. There are two date ranges
> as well as regular dates. It might be that recurring events that occur
> on  days that are inside of a date range do not show up. On mine,
> "Bath for  dog" doesn't show up on April 14th, for instance which
> happens to be  inside of a date range. The Pay Cell Phone item does
> not occur 90 days  later (about 4/15) which would also be inside of a
> date range. BUT it also  does not occur on or near 7/15, which is not
> inside of a date range.
> The "Do this every 3 months" item does not show up in June, even
> though it would not fall inside of a date range.
> 
> Mark
> 
> * CALENDAR 2011
> ** TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>
> ** TODO [#A] Bath for dog <2011-03-10 Thu +1w> 				 :PM:
> ** Books due at LIB1 <2011-03-24 Thu>
>    More stuff here
> ** Books due at LIB2 <2011-03-12 Sat +1w>
>    Stuff here
> ** DONE Check planning schedule  <2011-03-13 Sun>
>    CLOSED: [2011-03-14 Mon 06:38]
>    - State "DONE"       from "TODO"       [2011-03-14 Mon 06:38]
> ** TODO Recharge electrical equipment <2011-03-13 Sun +1w>
> ** TODO Orthodontist Visit <2011-03-13 >
> ** Book Fair <2011-03-24 Thu> 					     :Child1:
> ** Do this every 3 months <2011-03-28 Mon +90d>
> ** Parent Teacher Conference Days  <2011-03-31 Thu>--<2011-04-07 Thu>
> :Child1:
> ** Spring Break <2011-04-11 Mon>--<2011-04-22 Fri> 		     :Child1:
> ** PTA Picnic <2011-05-20 Fri> 					     :Child1:
> ** Memorial Day <2011-05-30 Mon>
> ** Summer begins <2011-06-02 Thu> 				     :Child1:
> ** Harry Potter's Birthday <2011-07-31 Sun>
> 
> 
> 
> On Mon, 14 Mar 2011 11:02:14 -0800, Mark S <throaway@yahoo.com> wrote:
> 
> > I have a very simple calendar ORG file set up. A couple of the items
> > have recurring days set to 90d. Like
> >
> >   ** Do something periodically <2011-01-15 Sat +90d>
> >
> > When I activate the agenda timeline, I see the first one of these
> > (in January) but none of the other scheduled events show up. (I have
> > other  scheduled items to create a calendar that goes out further
> > than the 90  days). If I view this in the regular weekly agenda,
> > using "f" to step  through the weeks, the item does show up.
> >
> > If I change the setting to +1w, I see several more entries, but not
> > one for every week. Some weeks are skipped. It seems hit and miss. I
> > haven't  been able to establish the exact pattern, but it appears
> > that I can not  depend on recurring items to show up in the
> > timeline.
> >
> > Has anyone else seen this? Is there a way to make all activities
> > show up in the timeline?
> >
> > Thanks,
> > Mark
> > --------------------
> > Emacs 23.2.1
> > Win XP
> > Org-mode 7.5
> >

OK, I couldn't see any problems at first, and I didn't know about the
timeline view - never used it before (C-c a L in the default setup) -
but I think I can reproduce something like this (I haven't checked in
detail) with the above file and a minimal.emacs similar to this (paths
need to be modified):

--8<---------------cut here---------------start------------->8---
(add-to-list 'load-path (expand-file-name "~/src/emacs/org/org-mode/lisp"))
(add-to-list 'auto-mode-alist '("\\.\\(org\\|org_archive\\|txt\\)$" . org-mode))
(require 'org-install)
(global-set-key "\C-cl" 'org-store-link)
(global-set-key "\C-ca" 'org-agenda)

;; modify the path to point to the file above
(setq org-agenda-files '("~/src/org/misc/marks/foo.org"))
--8<---------------cut here---------------end--------------->8---

Nick

Re: Re: Recurring items don't always show up in timeline

[Chris Randle]

Hi Mark

On 2011-03-14 22:55, Mark S wrote:
> Here's a version of the calendar I'm using. There are two date ranges as
> well as regular dates. It might be that recurring events that occur on
> days that are inside of a date range do not show up. On mine, "Bath for
> dog" doesn't show up on April 14th, for instance which happens to be
> inside of a date range. The Pay Cell Phone item does not occur 90 days
> later (about 4/15) which would also be inside of a date range. BUT it
> also does not occur on or near 7/15, which is not inside of a date range.
> The "Do this every 3 months" item does not show up in June, even though
> it would not fall inside of a date range.

I've pasted your sample Org-mode data into my Org-mode file after first 
deleting everything I had in there; i.e. nothing but your data but with 
my .emacs file and settings.

TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>

showed up (using C-c a a)

2011-01-15, 2011-04-15, 2011-07-14, 2011-10-12, 2012-01-10, etc.

The entry for 2011-04-15 appeared together with ranged entry (5/12) of 
Spring Break.

TODO [#A] Bath for dog <2011-03-10 Thu +1w>

appeared every Thursday, including 2011-04-14.

Do this every 3 months <2011-03-28 Mon +90d>

appeared on

2011-03-28, 2011-06-26, 2011-09-24, 2011-12-23, 2012-03-22, etc.

So, it all seems to work OK here.

Sorry I don't know what to suggest to try at your end other than the 
usual things about reverting to minimal .emacs and putting things back 
in one at a time. Also, making sure that there isn't a clash between 
compiled units/modules and .el files. That's something I can't comment 
on as I don't compile my Org-mode, just run from the .el files.

-- 
Chris Randle

Re: Re: Recurring items don't always show up in timeline

[Nick Dokos]

Chris Randle <chris@amlog.co.uk> wrote:

> Hi Mark
> 
> On 2011-03-14 22:55, Mark S wrote:
> > Here's a version of the calendar I'm using. There are two date ranges as
> > well as regular dates. It might be that recurring events that occur on
> > days that are inside of a date range do not show up. On mine, "Bath for
> > dog" doesn't show up on April 14th, for instance which happens to be
> > inside of a date range. The Pay Cell Phone item does not occur 90 days
> > later (about 4/15) which would also be inside of a date range. BUT it
> > also does not occur on or near 7/15, which is not inside of a date range.
> > The "Do this every 3 months" item does not show up in June, even though
> > it would not fall inside of a date range.
> 
> I've pasted your sample Org-mode data into my Org-mode file after first 
> deleting everything I had in there; i.e. nothing but your data but with 
> my .emacs file and settings.
> 
> TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>
> 
> showed up (using C-c a a)

I think Mark is using C-c a L to get the timeline: that's where the problem
lies. C-c a a works fine.

Nick

Re: Re: Recurring items don't always show up in timeline

[Chris Randle]

Hi Nick and Mark

On 2011-03-15 16:59, Nick Dokos wrote:
> I think Mark is using C-c a L to get the timeline: that's where the problem
> lies. C-c a a works fine.

Oh ****. Sorry for all the noise. I was really unobservant. I've never 
used C-c a L so I'd just assumed there was only one agenda view with 
dated entries.

Trying again (using C-c a L). All expected dates listed, but those that 
did *not* appear are in parentheses:

TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>
Results:
2011-01-15, (2011-04-15), (2011-07-14)


TODO [#A] Bath for dog <2011-03-10 Thu +1w>
Results:
2011-03-10, (2011-03-17), 2011-03-24, 2011-03-31, 2011-04-07, 
(2011-04-14)...and 6 more intervening weeks missing...2011-06-02...and 
then 8 more missing (up to 2011-07-31)

Do this every 3 months <2011-03-28 Mon +90d>
Results:
2011-03-28, (2011-06-26)

The timeline stopped at 2011-07-31, I assume because that's the last 
actual date in the file. Adding another entry

* End of year <2011-12-31>

to force another 5 months, and redoing the Timeline added no extra 
repeating items at all, just the "End of year entry" preceeded by "[... 
153 empty days omitted]"

So my results agree with yours, Mark.

Sorry again for previously adding confusion to the mix.

-- 
Chris Randle

Re: Recurring items don't always show up in timeline

[Mark S]

Hi Chris,

You say "showed up using C-a a"

Yes, but what about the Timeline?

   C-a L

The problem with the C-a a view is that you have to walk through the  
calendar week by week. The timeline would be better for scheduling events  
far out in the future -- if it worked.

Thanks again,
Mark

--- On Tue, 3/15/11, Chris Randle <chris@amlog.co.uk> wrote:

> From: Chris Randle <chris@amlog.co.uk>
> Subject: Re: [O] Re: Recurring items don't always show up in timeline
> To: emacs-orgmode@gnu.org
> Date: Tuesday, March 15, 2011, 8:57 AM
> Hi Mark
>On 2011-03-14 22:55, Mark S wrote:
> > Here's a version of the calendar I'm using. There are
> two date ranges as
> > well as regular dates. It might be that recurring
> events that occur on
> > days that are inside of a date range do not show up.
> On mine, "Bath for
> > dog" doesn't show up on April 14th, for instance which
> happens to be
> > inside of a date range. The Pay Cell Phone item does
> not occur 90 days
> > later (about 4/15) which would also be inside of a
> date range. BUT it
> > also does not occur on or near 7/15, which is not
> inside of a date range.
> > The "Do this every 3 months" item does not show up in
> June, even though
> > it would not fall inside of a date range.
>I've pasted your sample Org-mode data into my Org-mode file
> after first deleting everything I had in there; i.e. nothing
> but your data but with my .emacs file and settings.
>TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat
> +90d>
>showed up (using C-c a a)
>2011-01-15, 2011-04-15, 2011-07-14, 2011-10-12, 2012-01-10,
> etc.
>The entry for 2011-04-15 appeared together with ranged
> entry (5/12) of Spring Break.
>TODO [#A] Bath for dog <2011-03-10 Thu +1w>
>appeared every Thursday, including 2011-04-14.
>Do this every 3 months <2011-03-28 Mon +90d>
>appeared on
>2011-03-28, 2011-06-26, 2011-09-24, 2011-12-23, 2012-03-22,
> etc.
>So, it all seems to work OK here.
>Sorry I don't know what to suggest to try at your end other
> than the usual things about reverting to minimal .emacs and
> putting things back in one at a time. Also, making sure that
> there isn't a clash between compiled units/modules and .el
> files. That's something I can't comment on as I don't
> compile my Org-mode, just run from the .el files.
>-- Chris Randle
>

Re: Re: Recurring items don't always show up in timeline

[Chris Randle]

Hi Mark

On 2011-03-15 17:34, Mark S wrote:
> You say "showed up using C-a a"
> Yes, but what about the Timeline?
> C-a L

So sorry, complete misunderstanding. Please see my reply to Nick Dokos's 
earlier post pointing out my mistake.

-- 
Chris Randle

Re: Recurring items don't always show up in timeline

[Mark S]

I've tested this now in Linux, and it fails there too. Remember, we're  
talking about the timeline, typically accessed by "C-a L"

Is this something I should report to a bug log?

Thanks,
Mark

On Mon, 14 Mar 2011 14:55:56 -0800, Mark S <throaway@yahoo.com> wrote:
> * CALENDAR 2011
> ** TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>
> ** TODO [#A] Bath for dog <2011-03-10 Thu +1w> 				 :PM:
> ** Books due at LIB1 <2011-03-24 Thu>
>     More stuff here
> ** Books due at LIB2 <2011-03-12 Sat +1w>
>     Stuff here
> ** DONE Check planning schedule  <2011-03-13 Sun>
>     CLOSED: [2011-03-14 Mon 06:38]
>     - State "DONE"       from "TODO"       [2011-03-14 Mon 06:38]
> ** TODO Recharge electrical equipment <2011-03-13 Sun +1w>
> ** TODO Orthodontist Visit <2011-03-13 >
> ** Book Fair <2011-03-24 Thu> 					     :Child1:
> ** Do this every 3 months <2011-03-28 Mon +90d>
> ** Parent Teacher Conference Days  <2011-03-31 Thu>--<2011-04-07 Thu>   
> :Child1:
> ** Spring Break <2011-04-11 Mon>--<2011-04-22 Fri> 		     :Child1:
> ** PTA Picnic <2011-05-20 Fri> 					     :Child1:
> ** Memorial Day <2011-05-30 Mon>
> ** Summer begins <2011-06-02 Thu> 				     :Child1:
> ** Harry Potter's Birthday <2011-07-31 Sun>
>
>

Bug: Recurring items don't always show up in timeline

[Mark S]

I posted this before as a question, but since it has been confirmed by  
others, and shows up under Linux and Windows, I'll now post the details as  
a bug.

The Timeline view *would* be very useful for scheduling months in advance,  
reviewing history, or printing a year event calendar. Unfortunately, it  
appears that it can't really be trusted.
The basic problem is that in AGENDA TIMELINE view ("C-a L") recurring  
items are frequently and unpredictably dropped from the view. The regular  
AGENDA view works fine AFAIK -- its the TIMELINE that is at issue.

Below is a version of the calendar I'm using. There are two date ranges as  
well as regular dates. It might be that recurring events that occur on  
days that are inside of a date range do not show up. But not necessarily.  
On mine, "Bath for dog" doesn't show up on April 14th, for instance which  
happens to be inside of a date range. The Pay Cell Phone item does not  
occur 90 days later (about 4/15) which would also be inside of a date  
range. BUT it also does not occur on or near 7/15, which is not inside of  
a date range.

Likewise, the "Do this every 3 months" item does not show up in June, even  
though it would not fall inside of a date range.

If there's some magic incantation that will make this data work, it would  
be nice to know ;-)

Mark

--- Data ----------------------------------------------------

* CALENDAR 2011
** TODO Pay Cell Phone Bill TriMonthly <2011-01-15 Sat +90d>
** TODO [#A] Bath for dog <2011-03-10 Thu +1w> 				 :PM:
** Books due at LIB1 <2011-03-24 Thu>
    More stuff here
** Books due at LIB2 <2011-03-12 Sat +1w>
    Stuff here
** DONE Check planning schedule  <2011-03-13 Sun>
    CLOSED: [2011-03-14 Mon 06:38]
    - State "DONE"       from "TODO"       [2011-03-14 Mon 06:38]
** TODO Recharge electrical equipment <2011-03-13 Sun +1w>
** TODO Orthodontist Visit <2011-03-13 >
** Book Fair <2011-03-24 Thu> 					     :Child1:
** Do this every 3 months <2011-03-28 Mon +90d>
** Parent Teacher Conference Days  <2011-03-31 Thu>--<2011-04-07 Thu>   
:Child1:
** Spring Break <2011-04-11 Mon>--<2011-04-22 Fri> 		     :Child1:
** PTA Picnic <2011-05-20 Fri> 					     :Child1:
** Memorial Day <2011-05-30 Mon>
** Summer begins <2011-06-02 Thu> 				     :Child1:
** Harry Potter's Birthday <2011-07-31 Sun>

Re: Bug: Recurring items don't always show up in timeline

[Nick Dokos]

Mark S <throaway@yahoo.com> wrote:

> I posted this before as a question, but since it has been confirmed by
> others, and shows up under Linux and Windows, I'll now post the
> details as a bug.
> 
> The Timeline view *would* be very useful for scheduling months in
> advance, reviewing history, or printing a year event
> calendar. Unfortunately, it appears that it can't really be trusted.
> The basic problem is that in AGENDA TIMELINE view ("C-a L") recurring
> items are frequently and unpredictably dropped from the view. The
> regular AGENDA view works fine AFAIK -- its the TIMELINE that is at
> issue.

AFAICT, the culprit is org-get-all-dates: it matches date strings, translates
to number of days since the (imaginary) date 0001-12-31bce,
accumulates them in a list, sorts them, takes care of gaps - but
completely ignores any repeaters: iow, the "don't always show" in the
Subject line should more accurately say "never show".

Nick

Re: Bug: Recurring items don't always show up in timeline

[Chris Randle]

On 2011-03-18 21:20, Nick Dokos wrote:
> Mark S<throaway@yahoo.com>  wrote:
>
>> I posted this before as a question, but since it has been confirmed by
>> others, and shows up under Linux and Windows, I'll now post the
>> details as a bug.
>>
>> The Timeline view *would* be very useful for scheduling months in
>> advance, reviewing history, or printing a year event
>> calendar. Unfortunately, it appears that it can't really be trusted.
>> The basic problem is that in AGENDA TIMELINE view ("C-a L") recurring
>> items are frequently and unpredictably dropped from the view. The
>> regular AGENDA view works fine AFAIK -- its the TIMELINE that is at
>> issue.
>
> AFAICT, the culprit is org-get-all-dates: it matches date strings, translates
> to number of days since the (imaginary) date 0001-12-31bce,
> accumulates them in a list, sorts them, takes care of gaps - but
> completely ignores any repeaters: iow, the "don't always show" in the
> Subject line should more accurately say "never show".

Unless I'm missing something (again!), when I try it, they *do* repeat 
*sometimes*. For example, the entry

TODO [#A] Bath for dog <2011-03-10 Thu +1w>

appears in agenda timeline as follows:

2011-03-10, miss 1 week, 2011-03-24, 2011-03-31, 2011-04-07, miss 7 
weeks, 2011-06-02, miss 8 weeks (agenda terminates 2011-07-31).

-- 
Chris Randle

Re: Bug: Recurring items don't always show up in timeline

[Nick Dokos]

Chris Randle <chris@amlog.co.uk> wrote:

> On 2011-03-18 21:20, Nick Dokos wrote:
> > Mark S<throaway@yahoo.com>  wrote:
> >
> >> I posted this before as a question, but since it has been confirmed by
> >> others, and shows up under Linux and Windows, I'll now post the
> >> details as a bug.
> >>
> >> The Timeline view *would* be very useful for scheduling months in
> >> advance, reviewing history, or printing a year event
> >> calendar. Unfortunately, it appears that it can't really be trusted.
> >> The basic problem is that in AGENDA TIMELINE view ("C-a L") recurring
> >> items are frequently and unpredictably dropped from the view. The
> >> regular AGENDA view works fine AFAIK -- its the TIMELINE that is at
> >> issue.
> >
> > AFAICT, the culprit is org-get-all-dates: it matches date strings, translates
> > to number of days since the (imaginary) date 0001-12-31bce,
> > accumulates them in a list, sorts them, takes care of gaps - but
> > completely ignores any repeaters: iow, the "don't always show" in the
> > Subject line should more accurately say "never show".
> 
> Unless I'm missing something (again!), when I try it, they *do* repeat
> *sometimes*. For example, the entry
> 
> TODO [#A] Bath for dog <2011-03-10 Thu +1w>
> 
> appears in agenda timeline as follows:
> 
> 2011-03-10, miss 1 week, 2011-03-24, 2011-03-31, 2011-04-07, miss 7
> weeks, 2011-06-02, miss 8 weeks (agenda terminates 2011-07-31).
> 

That's true. I believe that's when it coincides with another entry: it
sneaks in on the heels of the other entry. But I may very well be wrong:
I have only scratched the surface a bit.

Nick

Bug: Recurring items NEVER show up in timeline unaccompanied

[Mark S]

You know, I think this may be the same bug I ran into 3 years ago when I  
last tried Org-mode. Is there any hope that this will be addressed? I note  
that this forum is the only location given for sending bug reports in the  
documentation.

Thanks!
Mark

--- On Sat, 3/19/11, Nick Dokos <nicholas.dokos@hp.com> wrote:

> From: Nick Dokos <nicholas.dokos@hp.com>
> Subject: Re: [O] Bug: Recurring items don't always show up in timeline
> To: "Chris Randle" <chris@amlog.co.uk>
> Cc: nicholas.dokos@hp.com, emacs-orgmode@gnu.org
> Date: Saturday, March 19, 2011, 11:46 AM
> Chris Randle <chris@amlog.co.uk>
> wrote:
>> On 2011-03-18 21:20, Nick Dokos wrote:
> > > Mark S<throaway@yahoo.com>wrote:
> > >
> > >> I posted this before as a question, but since
> it has been confirmed by
> > >> others, and shows up under Linux and Windows,
> I'll now post the
> > >> details as a bug.
> > >>
> > >> The Timeline view *would* be very useful for
> scheduling months in
> > >> advance, reviewing history, or printing a
> year event
> > >> calendar. Unfortunately, it appears that it
> can't really be trusted.
> > >> The basic problem is that in AGENDA TIMELINE
> view ("C-a L") recurring
> > >> items are frequently and unpredictably
> dropped from the view. The
> > >> regular AGENDA view works fine AFAIK -- its
> the TIMELINE that is at
> > >> issue.
> > >
> > > AFAICT, the culprit is org-get-all-dates: it
> matches date strings, translates
> > > to number of days since the (imaginary) date
> 0001-12-31bce,
> > > accumulates them in a list, sorts them, takes
> care of gaps - but
> > > completely ignores any repeaters: iow, the "don't
> always show" in the
> > > Subject line should more accurately say "never
> show".
> >> Unless I'm missing something (again!), when I try it,
> they *do* repeat
> > *sometimes*. For example, the entry
> >> TODO [#A] Bath for dog <2011-03-10 Thu +1w>
> >> appears in agenda timeline as follows:
> >> 2011-03-10, miss 1 week, 2011-03-24, 2011-03-31,
> 2011-04-07, miss 7
> > weeks, 2011-06-02, miss 8 weeks (agenda terminates
> 2011-07-31).
> >That's true. I believe that's when it coincides with
> another entry: it
> sneaks in on the heels of the other entry. But I may very
> well be wrong:
> I have only scratched the surface a bit.
>Nick
>

Re: Bug: Recurring items NEVER show up in timeline unaccompanied

[Nick Dokos]

Mark S <throaway@yahoo.com> wrote:

> 
> You know, I think this may be the same bug I ran into 3 years ago when I  
> last tried Org-mode. Is there any hope that this will be addressed? I note  
> that this forum is the only location given for sending bug reports in the  
> documentation.
> 
> Thanks!
> Mark
> 

I went looking for a bug report but the only thing that I can find
posted by you was a thread on "Getting org-agenda-sorting-strategy to
work" - nothing about the timeline.  I also searched for timeline and
although there was a fair amount of activity in 2008, none of it seemed
related to this bug (I might have overlooked it of course). Can you
provide a pointer to the bug report?

Be that as it may, it will certainly be addressed when somebody provides
a patch and the maintainer applies it. *When* that will be is anybody's
guess of course (remember, everybody is a volunteer here with a day job
that might or might not leave much time for org bug fixing).  But
generally speaking, once a bug bubbles to the surface, it does not stay
a bug for long.

And finally: this is the right place to post bug reports.

HTH,
Nick

PS. BTW, if you gave up on org because the timeline was not working, you
have been missing out on a bunch of good things :-) Even with a broken
timeline, org is incredibly useful. And some of us (both Chris and I e.g.,
who have been most active in the recent discussion) have never used the
timeline at all...

Re: Bug: Recurring items NEVER show up in timeline unaccompanied

[Nick Dokos]

Some more comments and another bug in org-timeline:

o a repeater always gets reported on its initial date - it only gets reported
  on subsequent instances iff it coincides with some other entry that will be
  reported on that date.

o the initial comment of org-timeline says "Only entries with a time
  stamp of today or later will be listed." However, in the let*, we have
    (let* ((dopast t)
           ...
  so by default we get past dates as well.

o [the additional bug] if dopast is set to nil in the let*, then we run the
  following code to get rid of past dates:

    (if (not dopast)
	;; Remove past dates from the list of dates.
	(setq day-numbers (delq nil (mapcar (lambda(x)
					      (if (>= x today) x nil))
					    day-numbers))))

  But day-numbers isn't just numbers: it's a list of day numbers
  interspersed with gap information:

   (733451 (:omitted . 28) 733479 (:omitted . 5) 733484 (:omitted . 21) 733505 (:omitted . 15) 733520 ...)
  and the mapcar function chokes when it has to deal with a gap argument.


Since there is no way to set dopast from the outside, perhaps the thing
to do is to remove both it and the above code (as well as one additional
instance of the variable) and declare that org-timeline will always do
both past and future. Or, given some global option variable, it can be
set to that value, in which case the code above needs to be fixed to
deal with the gaps.

Also, some stopping point will need to be provided. Right now, that is
the last explicit date in the file, but in the presence of repeaters
(and assuming that org-timeline gets modified to deal with them), that
natural stopping point gets pushed all the way to infinity, so some
other way will need to be provided to stop the enumeration.

Comments?

Nick

  

Re: Bug: Recurring items NEVER show up in timeline unaccompanied

[Carsten Dominik]

Hi everyone,

On 22.3.2011, at 21:10, Nick Dokos wrote:

> Some more comments and another bug in org-timeline:
> 
> o a repeater always gets reported on its initial date - it only gets reported
>  on subsequent instances iff it coincides with some other entry that will be
>  reported on that date.
> 
> o the initial comment of org-timeline says "Only entries with a time
>  stamp of today or later will be listed." However, in the let*, we have
>    (let* ((dopast t)
>           ...
>  so by default we get past dates as well.
> 
> o [the additional bug] if dopast is set to nil in the let*, then we run the
>  following code to get rid of past dates:
> 
>    (if (not dopast)
> 	;; Remove past dates from the list of dates.
> 	(setq day-numbers (delq nil (mapcar (lambda(x)
> 					      (if (>= x today) x nil))
> 					    day-numbers))))
> 
>  But day-numbers isn't just numbers: it's a list of day numbers
>  interspersed with gap information:
> 
>   (733451 (:omitted . 28) 733479 (:omitted . 5) 733484 (:omitted . 21) 733505 (:omitted . 15) 733520 ...)
>  and the mapcar function chokes when it has to deal with a gap argument.
> 
> 
> Since there is no way to set dopast from the outside, perhaps the thing
> to do is to remove both it and the above code (as well as one additional
> instance of the variable) and declare that org-timeline will always do
> both past and future. Or, given some global option variable, it can be
> set to that value, in which case the code above needs to be fixed to
> deal with the gaps.
> 
> Also, some stopping point will need to be provided. Right now, that is
> the last explicit date in the file, but in the presence of repeaters
> (and assuming that org-timeline gets modified to deal with them), that
> natural stopping point gets pushed all the way to infinity, so some
> other way will need to be provided to stop the enumeration.

Dear all,

Maybe I can add the following background information to Nick's
amazing analysis.

- The timeline was the first agenda-like view I implemented,
  it used to be (many years ago) the only way to see what was
  coming up.  That is why it only listed the future, and included
  the past when used with e prefix argument (I believe).

- Since then the agenda view came along, with vastly better
  properties for being used as a planning tool for the coming
  day an d week.  It also included the possibility to look
  at several files, which made the timelines view of a single
  file look poor.  Since then, the timeline has been a more
  or less orphaned feature, and this is why it does not
  work well with stuff like repeaters (repeaters where added
  MUCH later).

- So the use-case of the timeline view became slowly redefined
  as a way to look at the milestones and events of a single
  project.  One consequence was to always include the past.

- For historic reasons, the timeline uses the same mechanics
  as the agenda:  Pick a date, find everything that is going
  on on that date, move on to the next date.  Lather, rinse,
  repeat.  However, when looking at a project that may have
  dates spread over potentially many years, this mechanics
  is not very practical.  First, there will be many empty
  days where nothing is going on.  This will make the view
  look very boring and will make it hard to find useful
  dates.  Second, constructing the view in this way
  takes forever because of the inefficient pick-a-day,
  scan-entire-file-to-see-what-fits-strategy.

- To makes things more efficient, the timeline starts by
  first making a list of relevant days in the project by
  looking at all explicit dates, and at ranges.  Here is
  where the repeaters go wrong - they should return a whole
  list of dates where they are important - but they only
  add one, the starting date.  With this list of dates,
  it knows how to skip ranges of dates where nothing is
  happening.

Solutions for this problem are (these are alternatives)

1. Be satisfied with the way things are, just realize that
   repeaters only show up on the first date when the
   event happens for the first time.

2. Use the agenda, restricted to a single file, for a time
   range you specify.  This has the advantage that also
   diary sexps will work properly - the timeline currently
   has no way to deal with these.

3. Change the section of the timeline code that produces
   the list of interesting dates.  One strategy could be
   to first make a list of explicit dates, in order to
   define an overall range.  Then find all repeaters and
   add dates this repeater targets, restricted to
   the range of explicit dates in the file.  If done
   like this, you could always put a target date
   for conclusion of the project into the file, and that
   far-into-the-future date would define the range of
   the repeaters automatically.

4. Define a variable that will make the timeline always
   look at *every* date in the range covered by the
   file.  And live with the fact that constructing the
   view might take long.  Maybe it will not even to
   terribly long if you really use this view for single
   projects.  This would be easy to implement.

5. Rebuilt the entire timeline view to not use the
   agendas mechanics of picking a date, scanning the file,
   picking a date etc.  Instead, do a single pass over the
   file and build a list of dates with events in this way
   and then format and display the list.  Disadvantage
   here would be that many things which now work easily,
   like log view to include logging dates, would have to
   be thought over and reimplemented specially for the
   timeline.

Hope this helps.

- Carsten  

Re: Bug: Recurring items NEVER show up in timeline unaccompanied

[Nick Dokos]

Carsten Dominik <carsten.dominik@gmail.com> wrote:

> Dear all,
> 
> Maybe I can add the following background information to Nick's
> amazing analysis.

I wouldn't call it "amazing", but thanks for the kind words!

> 
> - The timeline was the first agenda-like view I implemented,
>   it used to be (many years ago) the only way to see what was
>   coming up.  That is why it only listed the future, and included
>   the past when used with e prefix argument (I believe).
> 
> - Since then the agenda view came along, with vastly better
>   properties for being used as a planning tool for the coming
>   day an d week.  It also included the possibility to look
>   at several files, which made the timelines view of a single
>   file look poor.  Since then, the timeline has been a more
>   or less orphaned feature, and this is why it does not
>   work well with stuff like repeaters (repeaters where added
>   MUCH later).
> 
> - So the use-case of the timeline view became slowly redefined
>   as a way to look at the milestones and events of a single
>   project.  One consequence was to always include the past.
> 
> - For historic reasons, the timeline uses the same mechanics
>   as the agenda:  Pick a date, find everything that is going
>   on on that date, move on to the next date.  Lather, rinse,
>   repeat.  However, when looking at a project that may have
>   dates spread over potentially many years, this mechanics
>   is not very practical.  First, there will be many empty
>   days where nothing is going on.  This will make the view
>   look very boring and will make it hard to find useful
>   dates.  Second, constructing the view in this way
>   takes forever because of the inefficient pick-a-day,
>   scan-entire-file-to-see-what-fits-strategy.
> 
> - To makes things more efficient, the timeline starts by
>   first making a list of relevant days in the project by
>   looking at all explicit dates, and at ranges.  Here is
>   where the repeaters go wrong - they should return a whole
>   list of dates where they are important - but they only
>   add one, the starting date.  With this list of dates,
>   it knows how to skip ranges of dates where nothing is
>   happening.
> 

A very interesting history lesson: thanks very much for that.

> Solutions for this problem are (these are alternatives)
> 
> 1. Be satisfied with the way things are, just realize that
>    repeaters only show up on the first date when the
>    event happens for the first time.
> 
> 2. Use the agenda, restricted to a single file, for a time
>    range you specify.  This has the advantage that also
>    diary sexps will work properly - the timeline currently
>    has no way to deal with these.
> 
> 3. Change the section of the timeline code that produces
>    the list of interesting dates.  One strategy could be
>    to first make a list of explicit dates, in order to
>    define an overall range.  Then find all repeaters and
>    add dates this repeater targets, restricted to
>    the range of explicit dates in the file.  If done
>    like this, you could always put a target date
>    for conclusion of the project into the file, and that
>    far-into-the-future date would define the range of
>    the repeaters automatically.
> 
> 4. Define a variable that will make the timeline always
>    look at *every* date in the range covered by the
>    file.  And live with the fact that constructing the
>    view might take long.  Maybe it will not even to
>    terribly long if you really use this view for single
>    projects.  This would be easy to implement.
> 
> 5. Rebuilt the entire timeline view to not use the
>    agendas mechanics of picking a date, scanning the file,
>    picking a date etc.  Instead, do a single pass over the
>    file and build a list of dates with events in this way
>    and then format and display the list.  Disadvantage
>    here would be that many things which now work easily,
>    like log view to include logging dates, would have to
>    be thought over and reimplemented specially for the
>    timeline.
> 

And a very clear analysis of the situation. In these possibilities,
there is the underlying assumption that the timeline is kept as a
feature. What about the additional possibility of actually declaring it
obsolete and getting rid of it? Can the agenda (possibly with some
extension) cover the need of Mark S for omitting days where nothing
happens?  Is there anything else that the timeline offers?

> Hope this helps.

Extremely helpful, thanks!

Nick

Re: Bug: Recurring items NEVER show up in timeline unaccompanied

[Mark S]

Hello Carsten et al,

--- On Thu, 3/24/11, Carsten Dominik <carsten.dominik@gmail.com> wrote:

> 1. Be satisfied with the way things are, just realize
>    that repeaters only show up on the first date when
>    the event happens for the first time.

This would mean that you could never *trust* the
timeline when dealing with events more than a week or
two out. You would always have that lingering worry
that you forgot to bump one of the repeaters.

> 2. Use the agenda, restricted to a single file, for a
>    time range you specify.  This has the advantage
>    that also diary sexps will work properly - the
>    timeline currently has no way to deal with these.

This would be great if there were a "sparse"
agenda. There isn't a way to make the agenda not show
empty days is there? As it is, if you make an agenda
extending out a year, you will have to wade through
several hundred lines worth of empty days.

> 3. Change the section of the timeline code that
>    produces the list of interesting dates.

That seems like a good solution. Is it difficult?

> 4. Define a variable that will make the timeline
>    always look at *every* date in the range covered
>    by the file.  And live with the fact that
>    constructing the view might take long.  Maybe it
>    will not even to terribly long if you really use
>    this view for single projects.  This would be easy
>    to implement.

This would work too, I think. Creating an agenda that
goes out one year only took about 3 seconds on my
not-state-of-the-art machine. Presumably the timeline
would be faster, since it wouldn't produce all the
extra gap lines.

Actually, when I tried to make a year long agenda using
v-y I spent just about as much getting past the "are
you sure" screens as it took to build the agenda.

The ideal solution would be that the Timeline view
would process dates exactly like the agenda, including
multiple-files, but display them like the traditional
timeline, with ranges of dates omitted.

Mark

Re: Bug: Recurring items NEVER show up in timeline unaccompanied

[Carsten Dominik]

On 24.3.2011, at 18:31, Mark S wrote:

> Hello Carsten et al,
> 
> --- On Thu, 3/24/11, Carsten Dominik <carsten.dominik@gmail.com> wrote:
> 
>> 1. Be satisfied with the way things are, just realize
>>   that repeaters only show up on the first date when
>>   the event happens for the first time.
> 
> This would mean that you could never *trust* the
> timeline when dealing with events more than a week or
> two out. You would always have that lingering worry
> that you forgot to bump one of the repeaters.
> 
>> 2. Use the agenda, restricted to a single file, for a
>>   time range you specify.  This has the advantage
>>   that also diary sexps will work properly - the
>>   timeline currently has no way to deal with these.
> 
> This would be great if there were a "sparse"
> agenda. There isn't a way to make the agenda not show
> empty days is there? As it is, if you make an agenda
> extending out a year, you will have to wade through
> several hundred lines worth of empty days.
> 
>> 3. Change the section of the timeline code that
>>   produces the list of interesting dates.
> 
> That seems like a good solution. Is it difficult?
> 
>> 4. Define a variable that will make the timeline
>>   always look at *every* date in the range covered
>>   by the file.  And live with the fact that
>>   constructing the view might take long.  Maybe it
>>   will not even to terribly long if you really use
>>   this view for single projects.  This would be easy
>>   to implement.
> 
> This would work too, I think. Creating an agenda that
> goes out one year only took about 3 seconds on my
> not-state-of-the-art machine. Presumably the timeline
> would be faster, since it wouldn't produce all the
> extra gap lines.
> 
> Actually, when I tried to make a year long agenda using
> v-y I spent just about as much getting past the "are
> you sure" screens as it took to build the agenda.
> 
> The ideal solution would be that the Timeline view
> would process dates exactly like the agenda, including
> multiple-files, but display them like the traditional
> timeline, with ranges of dates omitted.

This is already possible, by binding the variable
org-agenda-show-all-dates to nil around the call to make
the agenda (for examples using the options section of a
custom agenda command).  So the only missing piece for
your preferred solution is the determination of starting
dates and end date in  a useful and automatic way.  Maybe
I can take a look some time this week and see if 
there is a simple way to replace the time line with
something better.

- Carsten

> 
> Mark
>