Calendar-like view of the org-agenda

Calendar-like view of the org-agenda

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 388 bytes --]

Hi list,

Is there a way to have a calendar-like overview of the agenda with org?
Taskwarrior (http://taskwarrior.org/projects/show/taskwarrior) can render an
overview like this, and it is really nice when you want to get some
perspective:
http://taskwarrior.org/attachments/293/Screen_shot_2011-04-04_at_10.04.35_PM.png

Is there a way to render the agenda like this?

Cheers,

Marcelo.

[-- Attachment #2: Type: text/html, Size: 645 bytes --]

Re: Calendar-like view of the org-agenda

[Memnon Anon]

Hi Marcelo,

Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> Is there a way to have a calendar-like overview of the agenda with
> org? Taskwarrior (http://taskwarrior.org/projects/show/ taskwarrior)
> can render an overview like this, and it is really nice when you want
> to get some perspective: http://
> taskwarrior.org/attachments/293/Screen_shot_2011-04-04_at_10.04.35_PM.png
>
> Is there a way to render the agenda like this?

Nice screenshot, seems like Taskwarrior is coming along pretty well.
But I am not sure I am interpreting the screenshot correctly.

What is the "defaultwidth" and "These are highlighted in *color*" bit
about? 

On first sight, it looks very similar to M-x calendar, which interacts
very well with orgmode.

Memnon

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Marcelo,

Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> Is there a way to have a calendar-like overview of the agenda with
> org?

Not exactly what you want, but here is what I use.

I have a separate rdv.org for appointments.  
Then a ~/.diary file including them into Emacs's calendar:

%%(org-diary :scheduled) /home/guerry/org/rdv.org

M-x calendar RET shows the calendar, then pressing `m' in
the calendar highlights days with appointments.

I found using a separate rdv.org speeds up things, .diary 
should better not include too many things, otherwise the
M-x calendar RET command takes too long.

HTH,

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[Bastien]

PS: there are definitely nice things in Taskwarrior I would love to see
integrated in Org.  Let's continue brainstorming about this.

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[Michael Markert]

[-- Attachment #1: Type: text/plain, Size: 702 bytes --]

On 1 Jul 2011, Bastien wrote:

> PS: there are definitely nice things in Taskwarrior I would love to
> see integrated in Org.  Let's continue brainstorming about this.

I don't know if Taskwarrior features that, but I'd like to see a
time-table like week-view with correct (maybe color coded) time
ranges. Since I'm a student I've got lots of recurring lectures and it
would be nice to have a nice overview.

To give an example: The way Google Calendar displays it fulfills my
need, but I don't like feeding my appointments to Google.

Pointers where I should look to implement it (or maybe Org already
features it and I just don't know it -- after all this is Org ;)) are
highly appreciated!

Michael

[-- Attachment #2: Type: application/pgp-signature, Size: 836 bytes --]

Re: Calendar-like view of the org-agenda

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 923 bytes --]

Oh, I didn't know calender integrate with org! Living and learning. Thanks
for that, Memnon.

M>

On Fri, Jul 1, 2011 at 5:06 AM, Michael Markert <
markert.michael@googlemail.com> wrote:

> On 1 Jul 2011, Bastien wrote:
>
> > PS: there are definitely nice things in Taskwarrior I would love to
> > see integrated in Org.  Let's continue brainstorming about this.
>
> I don't know if Taskwarrior features that, but I'd like to see a
> time-table like week-view with correct (maybe color coded) time
> ranges. Since I'm a student I've got lots of recurring lectures and it
> would be nice to have a nice overview.
>
> To give an example: The way Google Calendar displays it fulfills my
> need, but I don't like feeding my appointments to Google.
>
> Pointers where I should look to implement it (or maybe Org already
> features it and I just don't know it -- after all this is Org ;)) are
> highly appreciated!
>
> Michael
>

[-- Attachment #2: Type: text/html, Size: 1339 bytes --]

Re: Calendar-like view of the org-agenda

[Kan-Ru Chen]

Michael Markert <markert.michael@googlemail.com> writes:

> On 1 Jul 2011, Bastien wrote:
>
>> PS: there are definitely nice things in Taskwarrior I would love to
>> see integrated in Org.  Let's continue brainstorming about this.
>
> I don't know if Taskwarrior features that, but I'd like to see a
> time-table like week-view with correct (maybe color coded) time
> ranges. Since I'm a student I've got lots of recurring lectures and it
> would be nice to have a nice overview.
>
> To give an example: The way Google Calendar displays it fulfills my
> need, but I don't like feeding my appointments to Google.

I just find this emacs-calfw project today.

  https://github.com/kiwanami/emacs-calfw

It looks very interesting and supports org!

> Pointers where I should look to implement it (or maybe Org already
> features it and I just don't know it -- after all this is Org ;)) are
> highly appreciated!
>
> Michael

-- 
Kanru

Re: Calendar-like view of the org-agenda

[Michael Markert]

[-- Attachment #1: Type: text/plain, Size: 1105 bytes --]

On 4 Jul 2011, Kan-Ru Chen wrote:

> Michael Markert <markert.michael@googlemail.com> writes:
>
>> On 1 Jul 2011, Bastien wrote:
>>
>>> PS: there are definitely nice things in Taskwarrior I would love to
>>> see integrated in Org.  Let's continue brainstorming about this.
>>
>> I don't know if Taskwarrior features that, but I'd like to see a
>> time-table like week-view with correct (maybe color coded) time
>> ranges. Since I'm a student I've got lots of recurring lectures and
>> it would be nice to have a nice overview.
>>
>> To give an example: The way Google Calendar displays it fulfills my
>> need, but I don't like feeding my appointments to Google.
>
> I just find this emacs-calfw project today.
>
> https://github.com/kiwanami/emacs-calfw
>
> It looks very interesting and supports org!

Indeed. Not quite what I was looking for but interesting nonetheless.

What I miss:
- It lacks some org support (e.g. org-contacts anniversaries -- they
  look horrible)
- a week view
- a time grid

It basically is a M-x calendar in "usable", i.e. you can see what is
scheduled on those days.

Michael

[-- Attachment #2: Type: application/pgp-signature, Size: 836 bytes --]

Re: Calendar-like view of the org-agenda

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 1470 bytes --]

> https://github.com/kiwanami/emacs-calfw

Wow, this is really cool!

I wonder if the author subscribes to this list? Some collaboration between
the two projects would be cool, this look very promising.

M>

On Mon, Jul 4, 2011 at 12:01 PM, Michael Markert <
markert.michael@googlemail.com> wrote:

> On 4 Jul 2011, Kan-Ru Chen wrote:
>
> > Michael Markert <markert.michael@googlemail.com> writes:
> >
> >> On 1 Jul 2011, Bastien wrote:
> >>
> >>> PS: there are definitely nice things in Taskwarrior I would love to
> >>> see integrated in Org.  Let's continue brainstorming about this.
> >>
> >> I don't know if Taskwarrior features that, but I'd like to see a
> >> time-table like week-view with correct (maybe color coded) time
> >> ranges. Since I'm a student I've got lots of recurring lectures and
> >> it would be nice to have a nice overview.
> >>
> >> To give an example: The way Google Calendar displays it fulfills my
> >> need, but I don't like feeding my appointments to Google.
> >
> > I just find this emacs-calfw project today.
> >
> > https://github.com/kiwanami/emacs-calfw
> >
> > It looks very interesting and supports org!
>
> Indeed. Not quite what I was looking for but interesting nonetheless.
>
> What I miss:
> - It lacks some org support (e.g. org-contacts anniversaries -- they
>  look horrible)
> - a week view
> - a time grid
>
> It basically is a M-x calendar in "usable", i.e. you can see what is
> scheduled on those days.
>
> Michael
>

[-- Attachment #2: Type: text/html, Size: 2490 bytes --]

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Michael Markert <markert.michael <at> googlemail.com> writes:
> 
> On 4 Jul 2011, Kan-Ru Chen wrote:
> 
> > Michael Markert <markert.michael <at> googlemail.com> writes:
> > :
> > I just find this emacs-calfw project today.
> >
> > https://github.com/kiwanami/emacs-calfw
> >
> > It looks very interesting and supports org!
> 
> Indeed. Not quite what I was looking for but interesting nonetheless.
> 
> What I miss:
> - It lacks some org support (e.g. org-contacts anniversaries -- they
>   look horrible)
> - a week view
> - a time grid

Just yesterday in JST, I released calfw v1.0.
I will write and append the documents.

In the latest version (v1.0), this program can display
the 1, 2 week view and daily view. Key bindings are following:
- M Monthly view
- W 1 week view
- T 2 week view
- D Daily view
And, pushing SPC key, a daily view is displayed, like the Quicklook in Mac.

The handling of the time grid is a new task.
Because the calfw is designed with focusing on the replacement of the 
calendar.el, I should consider the extending schedule data.

I have not used orgmode so far, so I'm not good at the schedule management in 
the orgmode. Comments and patches are welcome.

--
SAKURAI Masashi

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Masashi's,

welcome to the list!

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> Just yesterday in JST, I released calfw v1.0.

Thanks for this -- I guess you'll find a lot of dedicated testers here.

Please use and abuse Org-mode.  You'll soon find out that calendar.el 
is a central piece of Org-mode: it uses it to quickly pick up a date.

Also explore the Agenda views (M-x org-agenda -- see the manual), your
package might give us new ideas on how to display agenda information.

Best regards,

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[Memnon Anon]

Bastien <bzg@altern.org> writes:

> Thanks for this -- I guess you'll find a lot of dedicated testers here.
[...]
> Also explore the Agenda views (M-x org-agenda -- see the manual), your
> package might give us new ideas on how to display agenda information.

might? I'm almost certain it will!
This is *beautiful*. 

Just when I thought it couldn't get any better, *pow*, there comes a new
project along.

,----
| Date:   Mon Jan 3 19:11:07 2011 +0900
| 
|     first commit
`----
,----
| Date:   Thu Jun 9 14:58:57 2011 +0900
| 
|     added: org-agenda integration.
`----

Hui, rapid development. And org integration is fairly fresh...

Note to self:
** TODO Check backup setup for core orgfiles

,----[ calfw-org.el ]
| ;; Display org-agenda items in the calfw buffer.
| ;; (Because I don't use the org-agenda mainly,
| ;; I hope someone continue integration with the org.)
`----

With so many orgers around, I have no doubt that org integration will
improve. 

Memnon

Re: Calendar-like view of the org-agenda

[Russell Adams]

On Wed, Jul 06, 2011 at 11:30:02AM +0000, Memnon Anon wrote:

> This is *beautiful*.

I concur completely! This has filled a gap I've had for quite a while,
needing to visualize org tasks across a calendar.

Two minor FRs (I hope you continue to monitor the list):

 - 'q' key to close the calendar buffer, like org-agenda does
 - Support for keyword highlight, whether org keyword (TODO/DONE) and
   faces or otherwise.

Thanks!

------------------------------------------------------------------
Russell Adams                            RLAdams@AdamsInfoServ.com

PGP Key ID:     0x1160DCB3           http://www.adamsinfoserv.com/

Fingerprint:    1723 D8CA 4280 1EC9 557F  66E8 1154 E018 1160 DCB3

Re: Calendar-like view of the org-agenda

[Memnon Anon]

Russell Adams <RLAdams@AdamsInfoServ.Com> writes:

> Two minor FRs (I hope you continue to monitor the list):

https://github.com/kiwanami/emacs-calfw/issues ?

>  - 'q' key to close the calendar buffer, like org-agenda does

,----[ https://github.com/kiwanami/emacs-calfw/pull/4 ]
TSDH:  aee24d8   	   	 Bind q to bury-buffer in calendar buffer
| [...]
KIWA: I'm going to check them and would merge them.
`----
 
Memnon

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Fri, 8 Jul 2011 15:00:05 +0000 (UTC),
Memnon Anon wrote:
> 
> Russell Adams <RLAdams@AdamsInfoServ.Com> writes:
> 
> > Two minor FRs (I hope you continue to monitor the list):
> 
> https://github.com/kiwanami/emacs-calfw/issues ?
> 
> >  - 'q' key to close the calendar buffer, like org-agenda does
> 
> ,----[ https://github.com/kiwanami/emacs-calfw/pull/4 ]
> TSDH:  aee24d8   	   	 Bind q to bury-buffer in calendar buffer
> | [...]
> KIWA: I'm going to check them and would merge them.
> `----

I merged them and tagged v1.1.

- Bug fixed: an error of cfw:open-calendar-buffer
- Improved: Customize grid characters
- Improved: Modified keymap

They are small changes.
However, I would continue improve calfw and org integration.


Thank you,

--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

Russell Adams <RLAdams@AdamsInfoServ.Com> writes:

Hi Russell,

>> This is *beautiful*.
>
> I concur completely! This has filled a gap I've had for quite a while,
> needing to visualize org tasks across a calendar.
>
> Two minor FRs (I hope you continue to monitor the list):
>
>  - 'q' key to close the calendar buffer, like org-agenda does

In my github fork, I've already bound `q' to `bury-buffer' which does
what you want.  Masashi is reviewing my changes and hopefully pull.

I've also made the characters used for table rendering customizable, so
that you can use nice unicode glyphs.

  http://dl.dropbox.com/u/30611246/img/calfw-unicode.png

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[Marcus Klemm]

Tassilo Horn <tassilo <at> member.fsf.org> writes:

> I've also made the characters used for table rendering customizable, so
> that you can use nice unicode glyphs.

This is awesome! Could it somehow incorporated into orgmode to draw the
tables there?

Ciao, Marcus

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

Marcus Klemm <marcus.klemm@googlemail.com> writes:

Hi Marcus,

>> I've also made the characters used for table rendering customizable,
>> so that you can use nice unicode glyphs.
>
> This is awesome! Could it somehow incorporated into orgmode to draw
> the tables there?

I don't think that would be a good idea, cause in org you partly draw
the tables on your own, that is, you write |<TAB> for another row etc..
You don't want to have to insert unicode characters there.

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[Marcus Klemm]

Hello Tassilo,

Tassilo Horn <tassilo <at> member.fsf.org> writes:
> I don't think that would be a good idea, cause in org you partly draw
> the tables on your own, that is, you write |<TAB> for another row etc..
> You don't want to have to insert unicode characters there.

You are right, it would not be enough to simply replace the characters,
one would have to translate the "traditional" input to the unicode
characters on the fly. But it looks sooo much better and would be,
strictly speaking, still just plain text.

I love org-mode for its power and flexibility but I grew up using an
Amiga, laughing at the MS-DOS users with their ancient text mode
interfaces and I still can't force myself to like that aspect of org.
So everything that makes it look more "graphic" is welcome to me.

Re: Calendar-like view of the org-agenda

[Bastien]

Marcus Klemm <marcus.klemm@googlemail.com> writes:

> I love org-mode for its power and flexibility but I grew up using an
> Amiga, laughing at the MS-DOS users with their ancient text mode
> interfaces and I still can't force myself to like that aspect of org.
> So everything that makes it look more "graphic" is welcome to me.

Com'on Marcus!  I grew up with an ATARI 520ST, close to the Amiga in
graphical possibilities... and I still love plain text :)

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[Eric S Fraga]

Bastien <bzg@altern.org> writes:

> Marcus Klemm <marcus.klemm@googlemail.com> writes:
>
>> I love org-mode for its power and flexibility but I grew up using an
>> Amiga, laughing at the MS-DOS users with their ancient text mode
>> interfaces and I still can't force myself to like that aspect of org.
>> So everything that makes it look more "graphic" is welcome to me.
>
> Com'on Marcus!  I grew up with an ATARI 520ST, close to the Amiga in
> graphical possibilities... and I still love plain text :)

Hey, I grew up with punch cards... I'm still getting used to these
*bold* and /italic/ bits. ;-)

-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.0.50.1
: using Org-mode version 7.6 (release_7.6.35.g30182)

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Tassilo,

Tassilo Horn wrote:
> I've also made the characters used for table rendering customizable, so
> that you can use nice unicode glyphs.
>
>   http://dl.dropbox.com/u/30611246/img/calfw-unicode.png

Now that this has been made configurable, could you share your customization
for getting such a (very) nice view?  Which characters are you using?

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi,

At Mon, 11 Jul 2011 17:50:27 +0200,
Sebastien Vauban wrote:
> :
> Tassilo Horn wrote:
> > I've also made the characters used for table rendering customizable, so
> > that you can use nice unicode glyphs.
> >
> >   http://dl.dropbox.com/u/30611246/img/calfw-unicode.png
> 
> Now that this has been made configurable, could you share your customization
> for getting such a (very) nice view?  Which characters are you using?

Here is a sample code.

https://gist.github.com/1074205
==================================================
;; Default setting
(setq cfw:fchar-junction ?+
      cfw:fchar-vertical-line ?|
      cfw:fchar-horizontal-line ?-
      cfw:fchar-left-junction ?+
      cfw:fchar-right-junction ?+
      cfw:fchar-top-junction ?+
      cfw:fchar-top-left-corner ?+
      cfw:fchar-top-right-corner ?+ )

;; Nice view (Unicode characters)
(setq cfw:fchar-junction ?╋
      cfw:fchar-vertical-line ?┃
      cfw:fchar-horizontal-line ?━
      cfw:fchar-left-junction ?┣
      cfw:fchar-right-junction ?┫
      cfw:fchar-top-junction ?┯
      cfw:fchar-top-left-corner ?┏
      cfw:fchar-top-right-corner ?┓)
==================================================

Regards,
--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Masashi,

SAKURAI Masashi wrote:
> Sebastien Vauban wrote:
>> Tassilo Horn wrote:
>> > I've also made the characters used for table rendering customizable, so
>> > that you can use nice unicode glyphs.
>> >
>> >   http://dl.dropbox.com/u/30611246/img/calfw-unicode.png
>> 
>> Now that this has been made configurable, could you share your customization
>> for getting such a (very) nice view?  Which characters are you using?
>
> Here is a sample code.
>
> https://gist.github.com/1074205
> ==================================================
> ;; Default setting
> (setq cfw:fchar-junction ?+
>       cfw:fchar-vertical-line ?|
>       cfw:fchar-horizontal-line ?-
>       cfw:fchar-left-junction ?+
>       cfw:fchar-right-junction ?+
>       cfw:fchar-top-junction ?+
>       cfw:fchar-top-left-corner ?+
>       cfw:fchar-top-right-corner ?+ )
>
> ;; Nice view (Unicode characters)
> (setq cfw:fchar-junction ?╋
>       cfw:fchar-vertical-line ?┃
>       cfw:fchar-horizontal-line ?━
>       cfw:fchar-left-junction ?┣
>       cfw:fchar-right-junction ?┫
>       cfw:fchar-top-junction ?┯
>       cfw:fchar-top-left-corner ?┏
>       cfw:fchar-top-right-corner ?┓)
> ==================================================

Thanks for that.

But what a pitty: they don't exist (I mean they have no graphical
representation) in Consolas, my default font for Emacs... Damn!

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Calendar-like view of the org-agenda

[Eric S Fraga]

"Sebastien Vauban" <wxhgmqzgwmuf@spammotel.com> writes:

[...]

>>       cfw:fchar-top-right-corner ?xxxx=┓)
>> ==================================================
>
> Thanks for that.
>
> But what a pitty: they don't exist (I mean they have no graphical
> representation) in Consolas, my default font for Emacs... Damn!

I was going to suggest you try Liberation Mono; it's what I moved to
from Consolas for just this reason.  However, I am confused about fonts
in Emacs.  If I "C-u C-x =" at any character in this paragraph, I get
for example:

: xft:-unknown-Liberation Mono-normal-normal-normal-*-16-*-*-*-m-0-iso10646-1 (#x4C)

If, however, I do this at the top right corner character above, I get

: xft:-unknown-DejaVu Sans Mono-normal-normal-normal-*-16-*-*-*-m-0-iso10646-1 (#x933)

It seems Emacs is using different typefaces...

In any case, I do recommend Liberation but I guess I should also
recomment DejaVu Sans? ;-)

-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.0.50.1
: using Org-mode version 7.6 (release_7.6.57.g462c0)

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Eric S Fraga,

Eric S Fraga wrote:
> "Sebastien Vauban" <wxhgmqzgwmuf-geNee64TY+gS+FvcfC7Uqw@public.gmane.org> writes:
>>>       cfw:fchar-top-right-corner ?xxxx=┓)
>>
>> But what a pitty: they don't exist (I mean they have no graphical
>> representation) in Consolas, my default font for Emacs... Damn!
>
> I was going to suggest you try Liberation Mono; it's what I moved to from
> Consolas for just this reason. However, I am confused about fonts in Emacs.
> If I "C-u C-x =" at any character in this paragraph, I get for example:
>
> : xft:-unknown-Liberation Mono-normal-normal-normal-*-16-*-*-*-m-0-iso10646-1 (#x4C)

Look at the results under Windows (in 8 pt):

http://i.imgur.com/qkavC.png

Some figures are simply missing dots in their graphical representation...

> If, however, I do this at the top right corner character above, I get
>
> : xft:-unknown-DejaVu Sans Mono-normal-normal-normal-*-16-*-*-*-m-0-iso10646-1 (#x933)
>
> It seems Emacs is using different typefaces...
>
> In any case, I do recommend Liberation but I guess I should also recomment
> DejaVu Sans? ;-)

DejaVu Sans is a bit better, but it must be in 9pt to be right... while I
really like smaller fonts.

I still will give it a try for a couple of days. But, as of now, nothing beats
Consolas yet...

Thanks for your tip.

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Calendar-like view of the org-agenda

[Jason F. McBrayer]

On Tue, 12 Jul 2011 11:38:53 +0200, Sebastien Vauban wrote:
> Eric S Fraga wrote:
>> I was going to suggest you try Liberation Mono; it's what I moved to
>> from Consolas for just this reason. However, I am confused about 
>> fonts
>> in Emacs. If I "C-u C-x =" at any character in this paragraph, I get
>> for example: : xft:-unknown-Liberation
>> Mono-normal-normal-normal-*-16-*-*-*-m-0-iso10646-1 (#x4C)
>
> Look at the results under Windows (in 8 pt):
>
> http://i.imgur.com/qkavC.png [2]Some figures are simply missing dots 
> in
> their graphical representation...
>
>> If, however, I do this at the top right corner character above, I 
>> get :
>> xft:-unknown-DejaVu Sans
>> Mono-normal-normal-normal-*-16-*-*-*-m-0-iso10646-1 (#x933) It seems
>> Emacs is using different typefaces... In any case, I do recommend
>> Liberation but I guess I should also recomment DejaVu Sans? ;-)
>
> DejaVu Sans is a bit better, but it must be in 9pt to be right... 
> while I
> really like smaller fonts.
>
> I still will give it a try for a couple of days. But, as of now, 
> nothing
> beats Consolas yet...
>

I /think/ that in X, emacs will select the closest font it can find to
in order to get the characters it needs. However, in Windows, it will
only use the default font (or whatever is explicitly specified for the
face), even if that font is missing characters. The only workaround
I've found for buffers that need a lot of Unicode characters is to use
DejaVu Sans Mono. Consolas is very nice, but its Unicode coverage is
not good.

-- 
+-----------------------------------------------------------+
| Jason F. McBrayer jmcbray@carcosa.net                     |
| If someone conquers a thousand times a thousand others in |
| battle, and someone else conquers himself, the latter one |
| is the greatest of all conquerors. --- The Dhammapada     |

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Jason,

"Jason F. McBrayer" wrote:
>> I still will give it a try for a couple of days. But, as of now, nothing
>> beats Consolas yet...
>
> I /think/ that in X, emacs will select the closest font it can find to
> in order to get the characters it needs. However, in Windows, it will
> only use the default font (or whatever is explicitly specified for the
> face), even if that font is missing characters. The only workaround
> I've found for buffers that need a lot of Unicode characters is to use
> DejaVu Sans Mono. Consolas is very nice, but its Unicode coverage is
> not good.

That could explain why I was sure that I did get a bit more representable
characters when using Consolas under Ubuntu: they came from another font.

Thanks for the explanation...

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Calendar-like view of the org-agenda

[Aankhen]

[-- Attachment #1: Type: text/plain, Size: 1059 bytes --]

Hi,

On Tue, Jul 12, 2011 at 21:00, Jason F. McBrayer <jmcbray@carcosa.net> wrote:
> I /think/ that in X, emacs will select the closest font it can find to
> in order to get the characters it needs. However, in Windows, it will
> only use the default font (or whatever is explicitly specified for the
> face), even if that font is missing characters. The only workaround
> I've found for buffers that need a lot of Unicode characters is to use
> DejaVu Sans Mono. Consolas is very nice, but its Unicode coverage is
> not good.

That’s odd.  I’m using Emacs 24 on Windows 7 64-bit (and before this
I’ve used 23 on both 7 and Vista), and my font is set to Consolas.
Emacs happily substitutes other fonts where Consolas is missing glyphs
(see the attached screenshot).  The only snag is that it takes a while
to find a suitable font, at times.

I’m using a precompiled binary from emacs-for-windows.[1] Perhaps it
has special support for font substitution or something…

Aankhen

[1]: http://code.google.com/p/emacs-for-windows/

[-- Attachment #2: Emacs font substitution.png --]
[-- Type: image/png, Size: 35605 bytes --]

Re: Calendar-like view of the org-agenda

[Jason F. McBrayer]

On Wed, 13 Jul 2011 11:34:48 +0530, Aankhen wrote:

> That's odd. I'm using Emacs 24 on Windows 7 64-bit (and before this
> I've used 23 on both 7 and Vista), and my font is set to Consolas.
> Emacs happily substitutes other fonts where Consolas is missing 
> glyphs
> (see the attached screenshot). The only snag is that it takes a while
> to find a suitable font, at times.
>
> I'm using a precompiled binary from emacs-for-windows.[1] Perhaps it
> has special support for font substitution or something…

Huh. I looked at the HELLO file, and you seem to be right. It's pulling 
in
fonts as needed for various South Asian, East Asian, and Middle/Near 
Eastern
languages, but still failing horribly with unicode box drawing, as well 
as
various symbols (like the recycle symbol, which we use abundantly on
identi.ca). Perhaps Consolas falsely reports that it has those symbols.

Re: Calendar-like view of the org-agenda

[Aankhen]

On Wed, Jul 13, 2011 at 18:14, Jason F. McBrayer <jmcbray@carcosa.net> wrote:
> On Wed, 13 Jul 2011 11:34:48 +0530, Aankhen wrote:
>
>> That's odd. I'm using Emacs 24 on Windows 7 64-bit (and before this
>> I've used 23 on both 7 and Vista), and my font is set to Consolas.
>> Emacs happily substitutes other fonts where Consolas is missing glyphs
>> (see the attached screenshot). The only snag is that it takes a while
>> to find a suitable font, at times.
>>
>> I'm using a precompiled binary from emacs-for-windows.[1] Perhaps it
>> has special support for font substitution or something…
>
> Huh. I looked at the HELLO file, and you seem to be right. It's pulling in
> fonts as needed for various South Asian, East Asian, and Middle/Near Eastern
> languages, but still failing horribly with unicode box drawing, as well as
> various symbols (like the recycle symbol, which we use abundantly on
> identi.ca). Perhaps Consolas falsely reports that it has those symbols.

Box drawing seems to work okay here, whereas the recycling symbol is
missing (it just shows a box with the hex code to indicate the missing
glyph).  It’s probably down to whether you have any monospace fonts
which contain those glyphs.

Aankhen

Re: Calendar-like view of the org-agenda

[Achim Gratz]

"Sebastien Vauban"
<wxhgmqzgwmuf@spammotel.com> writes:
> Look at the results under Windows (in 8 pt):

You may be interested in this:
http://cygutils.fruitbat.org/mintty-font-test/


HTH,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Factory and User Sound Singles for Waldorf Q+, Q and microQ:
http://Synth.Stromeko.net/Downloads.html#WaldorfSounds

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Achim,

Achim Gratz wrote:
>> Look at the results under Windows (in 8 pt):
>
> You may be interested in this:
> http://cygutils.fruitbat.org/mintty-font-test/

Yes, I am, and will give a better look at that tomorrow.

Though, what I don't understand in Emacs (on Windows, currently) is that the
font in 9pt, for example, is much different (bigger, at least) than its
version 8pt. There is no relationship like between 9 divided by 8: the change
is bigger than that. Why...

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Achim,

Achim Gratz wrote:
> "Sebastien Vauban" writes:
>> Look at the results under Windows (in 8 pt):
>
> You may be interested in this:
> http://cygutils.fruitbat.org/mintty-font-test/

What your article showed to me is that the version of the Consolas font is
important. I had version 1.0, and installed 5.22 (the best coverage, from the
article author).

Here is the new look of the calendar under Consolas 8pt:
http://i.imgur.com/M3mUv.png.

Better, not perfect yet...

Thanks for your pointer.

Best regards,
  Seb

-- 
Sebastien Vauban

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Wed, 6 Jul 2011 11:30:02 +0000 (UTC),
Memnon Anon wrote:
> 
> Bastien <bzg@altern.org> writes:
> 
> > Thanks for this -- I guess you'll find a lot of dedicated testers here.
> [...]
> > Also explore the Agenda views (M-x org-agenda -- see the manual), your
> > package might give us new ideas on how to display agenda information.
> 
> might? I'm almost certain it will!
> This is *beautiful*. 
> 
> Just when I thought it couldn't get any better, *pow*, there comes a new
> project along.

Thank you for your comment!

> ,----[ calfw-org.el ]
> | ;; Display org-agenda items in the calfw buffer.
> | ;; (Because I don't use the org-agenda mainly,
> | ;; I hope someone continue integration with the org.)
> `----
> 
> With so many orgers around, I have no doubt that org integration will
> improve. 

In this week, I hardly have had a time for calfw and org ML.
I will continue better integration with orgmode.

Thank you

Re: Calendar-like view of the org-agenda

[Sebastien Vauban]

Hi Masashi,

SAKURAI Masashi wrote:
> At Wed, 6 Jul 2011 11:30:02 +0000 (UTC), Memnon Anon wrote:
>> Bastien <bzg-whniv8GeeGkdnm+yROfE0A@public.gmane.org> writes:
>> 
>> > Thanks for this -- I guess you'll find a lot of dedicated testers here.
>> [...]
>> > Also explore the Agenda views (M-x org-agenda -- see the manual), your
>> > package might give us new ideas on how to display agenda information.
>> 
>> might? I'm almost certain it will!
>> This is *beautiful*. 
>> 
>> Just when I thought it couldn't get any better, *pow*, there comes a new
>> project along.
>
> Thank you for your comment!

They are right: we all can already dream at a wonderful integration of both,
and gain a nice calendar view that can prove to be quickly very useful...

Two details to mention:

- I was hoping `r' to redraw the grid, after I've changed Emacs frame size. It
  does not seem to be the case. Could that be foreseen?  I've seen you already
  all the available space, when drawing the grid for the first time.

- I have a S-expr specification:

#+begin_src org
,** Sunrise/Sunsbet
   :PROPERTIES:
   :CATEGORY: Weather
   :END:

%%(when (eq span 'day) (diary-sunrise))
%%(when (eq span 'day) (diary-sunset))
#+end_src

  which says that, when in day-view, I want to see the time of sunrise/sunset.

  In your calendar, that appears everyday in week/month views. Is there a way
  to get rid of these 2 lines?  Very minor thing, though, very minor!

Best regards,
  Seb

-- 
Sebastien Vauban

weekly-view.el (was: Calendar-like view of the org-agenda)

[Bastien]

I'v just seen this on emacswiki:

  http://www.emacswiki.org/emacs-en/CalendarWeeklyView
  http://www.emacswiki.org/emacs/weekly-view.el

Did anyone tested this?

Maybe some efforts can be merged here.

HTH,

-- 
 Bastien

Re: weekly-view.el

[Eric S Fraga]

Bastien <bzg@altern.org> writes:

> I'v just seen this on emacswiki:
>
>   http://www.emacswiki.org/emacs-en/CalendarWeeklyView
>   http://www.emacswiki.org/emacs/weekly-view.el
>
> Did anyone tested this?

I've tried this out but it doesn't work particularly well for me as it
has all the appointments in a day run together for some reason.  I've
not spent more than a few minutes with it, mind you, so it could be
something trivial caused by this -> diary -> org...

However, it does have appeal!

-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.0.50.1
: using Org-mode version 7.6 (release_7.6.35.g30182)

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

"Sebastien Vauban"
<wxhgmqzgwmuf@spammotel.com> writes:

Hi Sebastien,

> - I was hoping `r' to redraw the grid, after I've changed Emacs frame size. It
>   does not seem to be the case. Could that be foreseen?  I've seen you already
>   all the available space, when drawing the grid for the first time.

I've implemented that in my fork.

     http://github.com/tsdh/emacs-calfw

Masashi, feel free to pull if you think it's ok.

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Tassilo,

At Wed, 13 Jul 2011 21:55:09 +0200,
Tassilo Horn wrote:
> :
> > - I was hoping `r' to redraw the grid, after I've changed Emacs frame size. It
> >   does not seem to be the case. Could that be foreseen?  I've seen you already
> >   all the available space, when drawing the grid for the first time.
> 
> I've implemented that in my fork.
> 
>      http://github.com/tsdh/emacs-calfw
> 
> Masashi, feel free to pull if you think it's ok.

Thank you!
I will check and merge it.

Regards,
--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[OSiUX]

[-- Attachment #1: Type: text/plain, Size: 500 bytes --]

CFW it's AWESOME!

When change the name of days and months, emacs crash!!::

 (setq calendar-week-start-day 7
  european-calendar-style t
  calendar-day-name-array
  ["Dom" "Lun" "Mar" "Mie" "Jue" "Vie" "Sab"]
  calendar-month-name-array
  ["Ene" "Feb" "Mar" "Abr" "May" "Jun" "Jul" "Ago" "Sep" "Oct" "Nov" "Dic"]
 )

-- 
::

  Osiris Alejandro Gomez (OSiUX) osiux@osiux.com.ar
  AA70 93FD B6EF EB42 6920 7530 A799 B226 74C8 A3FE
  http://osiux.com http://wiki.buenosaireslibre.org

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

Re: Calendar-like view of the org-agenda

[Michael Markert]

[-- Attachment #1: Type: text/plain, Size: 497 bytes --]

On 15 Jul 2011, OSiUX wrote:
> When change the name of days and months, emacs crash!!::
>
> (setq calendar-week-start-day 7
>       european-calendar-style t
>       calendar-day-name-array
>          ["Dom" "Lun" "Mar" "Mie" "Jue" "Vie" "Sab"]
>       calendar-month-name-array
>          ["Ene" "Feb" "Mar" "Abr" "May" "Jun" "Jul"
>           "Ago" "Sep" "Oct" "Nov" "Dic"] )

The names are no problem, but `calendar-week-start-day' is. The day
array is 0-indexed, so you want 6 not 7.

Michael

[-- Attachment #2: Type: application/pgp-signature, Size: 836 bytes --]

Re: Calendar-like view of the org-agenda

[Reiner Steib]

On Fri, Jul 15 2011, Michael Markert wrote:

> On 15 Jul 2011, OSiUX wrote:
>> When change the name of days and months, emacs crash!!::
>>
>> (setq calendar-week-start-day 7
[...]
> The names are no problem, but `calendar-week-start-day' is. The day
> array is 0-indexed, so you want 6 not 7.

Anyhow, if this causes an Emacs crash, it is bug in Emacs.  Please
report it using M-x report-emacs-bug RET.

Bye, Reiner.
-- 
       ,,,
      (o o)
---ooO-(_)-Ooo---  |  PGP key available  |  http://rsteib.home.pages.de/

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Wed, 13 Jul 2011 21:55:09 +0200,
Tassilo Horn wrote:
> :
> "Sebastien Vauban"
> <wxhgmqzgwmuf@spammotel.com> writes:
> :
> > - I was hoping `r' to redraw the grid, after I've changed Emacs frame size. It
> >   does not seem to be the case. Could that be foreseen?  I've seen you already
> >   all the available space, when drawing the grid for the first time.
> 
> I've implemented that in my fork.
> 
>      http://github.com/tsdh/emacs-calfw
> 
> Masashi, feel free to pull if you think it's ok.

Thank you so much for many advice and patches. I pulled and merged it.

My master branch of calfw [https://github.com/kiwanami/emacs-calfw]
has been added following improvements from v1.0:

- Improved navigation keymaps.
- Remove display text properties because images screw the table layout.
- Add defcustoms for line drawing chars.
- Added cfw:org-agenda-schedule-args variable to limit the schedule items. 
- Schedule items in a day are sorted by time.
- SPC key is bound to org-agenda with day view.
- Range items are displayed by a band.

I will continue to improve calfw and org integration.
Please check it and let me know any ideas.

Thank you,
--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Rasmus]

Hi,

Thank a bunch for Calfw. It is great. 

> - Add defcustoms for line drawing chars.
> - Added cfw:org-agenda-schedule-args variable to limit the schedule items. 

Is is somehow possible to change the font family used in Calfw windows
only? Using my regular font, Monofur, the table gets screwed when using
Unicode characters for line drawing. If I switch to e.g. Terminus
everything looks properly.

Thus, I'd like something like 
#+begin_src emacs-lisp
(set-frame-parameter (selected-frame) 'font "Terminus-11")
#+end_sry
But very local (i.e. only in 'this' particular windows). 

For some reason, changeing the font family for Calfw's line drawing
affects all of Emacs.

Thanks,
Rasmus

-- 
Sent from my Emacs

Re: Calendar-like view of the org-agenda

[Rasmus]

Rasmus <rasmus@gmx.us> writes:

> Is is somehow possible to change the font family used in Calfw windows
> only?

Hardly perfect, the following let me change the font used in Calfw
sessions. It seems rather fragile, though as it only seems to work with
`:height 90'. Obviously there is a more fundamental problem that I ought
to address. 

#begin_src emacs-lisp
(add-hook 'cfw:calendar-mode-hook
          '(lambda ()
;;             (local-set-key (kbd "q") 'kill-this-buffer)
	     (buffer-face-set '(:family "monofur" :height 90))
))

(setq cfw:fchar-junction ?╋
      cfw:fchar-vertical-line ?┃
      cfw:fchar-horizontal-line ?━
      cfw:fchar-left-junction ?┣
      cfw:fchar-right-junction ?┫
      cfw:fchar-top-junction ?┯
      cfw:fchar-top-left-corner ?┏
      cfw:fchar-top-right-corner ?┓)
#+end_src

–Rasmus

-- 
Sent from my Emacs

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Rasmus,

Thanks for your setting sample.

At Sun, 17 Jul 2011 20:59:19 +0200,
Rasmus wrote:
> :
> > Is is somehow possible to change the font family used in Calfw windows
> > only?
> 
> Hardly perfect, the following let me change the font used in Calfw
> sessions. It seems rather fragile, though as it only seems to work with
> `:height 90'. Obviously there is a more fundamental problem that I ought
> to address. 

Yes. Some Japanese users use the function `buffer-face-set' too.
They also worry about the difference between the value of `char-width' for
the charactors and the real width of the font glyphs.

Indeed, the font setting in Emacs has been very difficult.

--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Masashi,

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> I will continue to improve calfw and org integration.

Thanks a lot for this effort!

> Please check it and let me know any ideas.

I suggest everyone to use [calfw] as a tag in the subject of the 
emails sent to the list, it will help filter through these requests.

Thanks,

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Bastien,

At Mon, 18 Jul 2011 10:53:22 +0200,
Bastien wrote:
> :
> > Please check it and let me know any ideas.
> 
> I suggest everyone to use [calfw] as a tag in the subject of the 
> emails sent to the list, it will help filter through these requests.

Thanks for your advice. I will add a tag.

Regards
--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Niels Giesen]

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

[...]

> Just yesterday in JST, I released calfw v1.0.

This is just awesome!

[...]

> I have not used orgmode so far, so I'm not good at the schedule management in 
> the orgmode. Comments and patches are welcome.

Ok. Here you go:

1. I have just send you a patch off-list to deal with bad sexps caused by
unbound `span' variable (this appears e.g. in diary-sunset and friends -- see
http://orgmode.org/worg/org-hacks.html). And while writing this email,
you notified me you have applied it... thanks!

2. For people using org-google-weather and using icons to spicen up
their agenda views for the weather, there is a problem with the grid as
the icons do not fit well inside a grid.

The simplest way to get around this I guess is advising
`cfw:org-collect-schedules-period' (I use a similar strategy for
`org-mobile-push' where one would otherwise only see the text "icon").

#+begin_src emacs-lisp
  (defadvice cfw:org-collect-schedules-period (around no-icon activate)
    (let (org-google-weather-display-icon-p)
      ad-do-it))
#+end_src

3. I'd like to select items with my keyboard, but the normal emacs
navigation bindings are not available. Maybe tabbing to items in
`cfw:details-mode' (but preferably also in cfw:calendar-mode) would do
it for me, where it would be nice if the mouse echo was also shown when
entering an item by way of keyboard navigation.

4. I do not know whether it is possible due to the dynamic construction
of mode maps in calfw.el, but it would be nice if you could take
advantage of the self-documenting nature of Emacs by including a
reference to the keymap in the docstring for the various modes. For
cfw:calendar-mode this would be st. like:

#+begin_src diff
   "This hook is called at end of setting up major mode `cfw:calendar-mode'.")
 
 (defun cfw:calendar-mode (&optional custom-map)
-  "Set up major mode `cfw:calendar-mode'."
+  "Set up major mode `cfw:calendar-mode'.
+
+\\{cfw:calendar-mode-map}"
   (kill-all-local-variables)
   (setq truncate-lines t)
   (use-local-map (cfw:calendar-mode-map custom-map))
#+end_src

This way users have a quick overview of keybindings by pressing C-h m.

5. (perhaps slightly OT) From your screenshots I see you have no problem
with putting multibyte (japanese) characters inside a grid, something
with which I always have problems (e.g. in org tables but also in your
calendar). Do you do anything special to make that work?

Regards and many thanks for such a nice addition to Emacs and Org Mode,
Niels.

-- 
http://pft.github.com/

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi, all

Thank you for many comments.
I'm so glad to know many people are interesting in calfw.

I'm working on my job in daytime, so I will reply later.

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Tue, 05 Jul 2011 13:49:15 +0200,
Niels Giesen wrote:
> :
> > I have not used orgmode so far, so I'm not good at the schedule management in 
> > the orgmode. Comments and patches are welcome.
> 
> Ok. Here you go:
> :
> 2. For people using org-google-weather and using icons to spicen up
> their agenda views for the weather, there is a problem with the grid as
> the icons do not fit well inside a grid.
> 
> The simplest way to get around this I guess is advising
> `cfw:org-collect-schedules-period' (I use a similar strategy for
> `org-mobile-push' where one would otherwise only see the text "icon").
> 
> #+begin_src emacs-lisp
>   (defadvice cfw:org-collect-schedules-period (around no-icon activate)
>     (let (org-google-weather-display-icon-p)
>       ad-do-it))
> #+end_src

I received the similar issue on github,
https://github.com/kiwanami/emacs-calfw/issues/1

In the current implementation, invalidating images and deleting the
`display' property are simple solution.

But I would try to display images in calfw.


> 3. I'd like to select items with my keyboard, but the normal emacs
> navigation bindings are not available. Maybe tabbing to items in
> `cfw:details-mode' (but preferably also in cfw:calendar-mode) would do
> it for me, where it would be nice if the mouse echo was also shown when
> entering an item by way of keyboard navigation.

I also think key binding should be improved.
I would try to implement TAB key navigation you mentioned.

The problem of navigation is discussed on the github issue too.
https://github.com/kiwanami/emacs-calfw/issues/2


> 4. I do not know whether it is possible due to the dynamic construction
> of mode maps in calfw.el, but it would be nice if you could take
> advantage of the self-documenting nature of Emacs by including a
> reference to the keymap in the docstring for the various modes. For
> cfw:calendar-mode this would be st. like:
>  :

I will do this. Thank you for your helpful code.


> 5. (perhaps slightly OT) From your screenshots I see you have no problem
> with putting multibyte (japanese) characters inside a grid, something
> with which I always have problems (e.g. in org tables but also in your
> calendar). Do you do anything special to make that work?

Instead of `length', the function `string-width' of mule.el should be
used to calculate display width of the string. This function treats
not only East Asian characters but also complex Unicode ones. Some
functions, such as `cfw:render-truncate', use it.

However, it is not so easy for Japanese users to fit a grid, because
of the font and rendering problems of Emacs. One can find many
Japanese blog articles about beautiful font setting on Emacs.


Thank you for your many comments.

Re: Calendar-like view of the org-agenda

[Eric S Fraga]

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

[...]

>> > https://github.com/kiwanami/emacs-calfw

[...]

>
> Just yesterday in JST, I released calfw v1.0.

This is brilliant!  Many thanks for this.  Very useful for quick diary
planning!  I particularly like the different views and, for once, the
default colour scheme ;-)  Also, as a long time vi user (sorry), I like
the vi movement commands.

One quick question: I loaded the relevant files and then, not knowing
exactly what to do, I followed the instructions in calfw.el which said:

;;; Usage:

;; Executing the command `cfw:open-calendar-buffer', switch to the calendar buffer.
;; You can navigate the date like calendar.el.

so I tried M-x cfw:open-calendar-buffer which proceeded to give me the
error:

let: Symbol's function definition is void: cfw:create-calendar-buffer

I did get the calendar working by executing, instead,
cfw:open-org-calendar so everything is fine but I thought I would
suggest changing the usage documentation in calfw.el to give a pointer
to the more appropriate command?

One feature request: in the display of individual calendar items, it
would be nice to have tags and the originating file name highlighted (in
different ways, of course), but this is a minor request.

Thanks again,
eric
-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.0.50.1
: using Org-mode version 7.5 (release_7.5.574.g5a503)

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Tue, 05 Jul 2011 15:33:53 +0100,
Eric S Fraga wrote:
> 
> SAKURAI Masashi <m.sakurai@kiwanami.net> writes:
> 
> [...]
> 
> >> > https://github.com/kiwanami/emacs-calfw
> 
> [...]
> 
> >
> > Just yesterday in JST, I released calfw v1.0.
> 
> This is brilliant!  Many thanks for this.  Very useful for quick diary
> planning!  I particularly like the different views and, for once, the
> default colour scheme ;-)  Also, as a long time vi user (sorry), I like
> the vi movement commands.

I'm very encouraged. Thank you.
I choose the color scheme of calfw carefully.
Some Japanese users create other color scheme.
http://sheephead.homelinux.org/2011/01/19/6571/
http://valvallow.blogspot.com/2011/01/emacs-face.html
(Note: These settings are written for v0.1, little bit changed.)

> so I tried M-x cfw:open-calendar-buffer which proceeded to give me the
> error:
> 
> let: Symbol's function definition is void: cfw:create-calendar-buffer

This is a bug. I fixed and pushed it to master branch.
I'm sorry that many people met this trouble.


> One feature request: in the display of individual calendar items, it
> would be nice to have tags and the originating file name highlighted (in
> different ways, of course), but this is a minor request.

Is this the same issue which is discussed at another thread?


--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Eric S Fraga]

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> At Tue, 05 Jul 2011 15:33:53 +0100,
> Eric S Fraga wrote:

[...]

>> so I tried M-x cfw:open-calendar-buffer which proceeded to give me the
>> error:
>> 
>> let: Symbol's function definition is void: cfw:create-calendar-buffer
>
> This is a bug. I fixed and pushed it to master branch.
> I'm sorry that many people met this trouble.

Thanks!

>> One feature request: in the display of individual calendar items, it
>> would be nice to have tags and the originating file name highlighted (in
>> different ways, of course), but this is a minor request.
>
> Is this the same issue which is discussed at another thread?

Related, I think, in that it's about displaying the same type of
information that the agenda view gives, and in the same way.  
-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.0.50.1
: using Org-mode version 7.5 (release_7.5.586.g382e6)

Re: Calendar-like view of the org-agenda

[Christopher Allan Webber]

Hi,

I'm very excited about this project!  However it doesn't seem to work?

Calling M-x cfw:open-calendar-buffer results in:
  let: Symbol's function definition is void: cfw:create-calendar-buffer

It seems that this function isn't defined anywhere?

I'm running off of git master.

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> Michael Markert <markert.michael <at> googlemail.com> writes:
>> 
>> On 4 Jul 2011, Kan-Ru Chen wrote:
>> 
>> > Michael Markert <markert.michael <at> googlemail.com> writes:
>> > :
>> > I just find this emacs-calfw project today.
>> >
>> > https://github.com/kiwanami/emacs-calfw
>> >
>> > It looks very interesting and supports org!
>> 
>> Indeed. Not quite what I was looking for but interesting nonetheless.
>> 
>> What I miss:
>> - It lacks some org support (e.g. org-contacts anniversaries -- they
>>   look horrible)
>> - a week view
>> - a time grid
>
> Just yesterday in JST, I released calfw v1.0.
> I will write and append the documents.
>
> In the latest version (v1.0), this program can display
> the 1, 2 week view and daily view. Key bindings are following:
> - M Monthly view
> - W 1 week view
> - T 2 week view
> - D Daily view
> And, pushing SPC key, a daily view is displayed, like the Quicklook in Mac.
>
> The handling of the time grid is a new task.
> Because the calfw is designed with focusing on the replacement of the 
> calendar.el, I should consider the extending schedule data.
>
> I have not used orgmode so far, so I'm not good at the schedule management in 
> the orgmode. Comments and patches are welcome.
>
> --
> SAKURAI Masashi
>
>

-- 
𝓒𝓱𝓻𝓲𝓼𝓽𝓸𝓹𝓱𝓮𝓻 𝓐𝓵𝓵𝓪𝓷 𝓦𝓮𝓫𝓫𝓮𝓻

Re: Calendar-like view of the org-agenda

[Christopher Allan Webber]

Also, cfw:open-org-calendar works, but things seem really slow... it
looks like you're recalculating the entire orgmode agenda for every day.
I wonder if things could be sped up if the orgmode agenda was calculated
for the entire period all at once and then broke that up into days?

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> Michael Markert <markert.michael <at> googlemail.com> writes:
>> 
>> On 4 Jul 2011, Kan-Ru Chen wrote:
>> 
>> > Michael Markert <markert.michael <at> googlemail.com> writes:
>> > :
>> > I just find this emacs-calfw project today.
>> >
>> > https://github.com/kiwanami/emacs-calfw
>> >
>> > It looks very interesting and supports org!
>> 
>> Indeed. Not quite what I was looking for but interesting nonetheless.
>> 
>> What I miss:
>> - It lacks some org support (e.g. org-contacts anniversaries -- they
>>   look horrible)
>> - a week view
>> - a time grid
>
> Just yesterday in JST, I released calfw v1.0.
> I will write and append the documents.
>
> In the latest version (v1.0), this program can display
> the 1, 2 week view and daily view. Key bindings are following:
> - M Monthly view
> - W 1 week view
> - T 2 week view
> - D Daily view
> And, pushing SPC key, a daily view is displayed, like the Quicklook in Mac.
>
> The handling of the time grid is a new task.
> Because the calfw is designed with focusing on the replacement of the 
> calendar.el, I should consider the extending schedule data.
>
> I have not used orgmode so far, so I'm not good at the schedule management in 
> the orgmode. Comments and patches are welcome.
>
> --
> SAKURAI Masashi
>
>

-- 
𝓒𝓱𝓻𝓲𝓼𝓽𝓸𝓹𝓱𝓮𝓻 𝓐𝓵𝓵𝓪𝓷 𝓦𝓮𝓫𝓫𝓮𝓻

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

Christopher Allan Webber <cwebber@dustycloud.org> writes:

Hi Christopher,

> Also, cfw:open-org-calendar works, but things seem really slow... it
> looks like you're recalculating the entire orgmode agenda for every
> day.  I wonder if things could be sped up if the orgmode agenda was
> calculated for the entire period all at once and then broke that up
> into days?

For me, creating a custom org agenda with the next 21 days takes not
much less than building an calfw calendar buffer with 42 days.  It's
about one second for the former and 2 seconds for the latter, so it
seems calfw does the right thing.

One thing which I'm currently missing is that the calfw entries gathered
from org are missing the times (if that's specified using the 'time text
property) and are sorted in an order I can't understand.  For example,
my org agenda for yesterday was

  uni:        08:30-10:00 Übung GST SS 2011 (B 013)          :agebert:teaching::
  uni:        14:30-16:30 AG Ebert-Treffen                            :agebert::
  uni:        Deadline:   DONE CoffeeList-Blatt 25 mal drucken :agebert:teaching::

which is shown as

  +---------------+
  | 5 (3)         |
  |AG Ebert-Tre...|
  |DONE CoffeeL...|
  |Übung GST SS...|
  |               |
  |               |
  |               |
  |               |
  +---------------+

I think it would be good if the sorting was by time (items with no time
at the bottom) and the time was visible somehow, for example in the
tooltips.

Another thing: If you have several split windows and calfw selects a
window very narrow in height (or there are simply too many items for
some day), then not all items are shown.  That would be ok if there was
some indication that some items are missing.

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[Manuel Hermenegildo]

First, thanks very much to Sakurai for a wonderful tool and having
integrated it so well with org!

 > For me, creating a custom org agenda with the next 21 days takes
 > not much less than building an calfw calendar buffer with 42 days.

Same here, the times are comparable. For me building the org calendar
is a little slower but it makes sense because it is running some
filters, while calfw is not.  Which brings me to my question, which is
related to:

 > One thing which I'm currently missing is that the calfw entries
 > gathered from org are missing the times (if that's specified using the
 > 'time text property) and are sorted in an order I can't understand.

Seems like calfw is ignoring the org priorities and order.  In my case
the problem is that calfw is gathering all the tasks ignoring my per
tag filters. I explain: in my case I only want to see in my agenda
entries that have a certain tag (my tag): I share org files with other
people and we assign tasks by marking E.g., I am MH and my tasks are
like:

* TODO Thank Sakurai for a great tool <2011-07-05 Tue>  :MH:

which should appear in my agenda and there are other tasks like:

* TODO Write paper  <2011-07-05 Tue> :JF:

which should only appear in JF's agenda. This is done using a custom
agenda command that filters by tag.

It seems to me too complicated to try to reproduce all the nuances and
capabilities of org agenda generation (priorities, filtering, custom
views, etc.) and do it all again in calfw --it would always be very
hard to keep them in sync.

I have not had time to look at the code, but perhaps calfw, instead of
reading directly the org files could instead use the org code that
generates the agenda and then present the agenda in its very nice and
graphical way. I.e., an idea would be to add a back end to the code
that generates the org agenda which, instead of rendering the agenda
creates the calfw objects.

Or, perhaps even simpler, calfw could simply read the org-agenda
buffer (colors and all) instead of reading the org files.  

This would have the enormous advantage that it would always generate
the tasks with the same order, priorities, filters, customizations,
etc. as the org agenda.

What do you think?

Manuel 



-- 
-------------------------------------------------------------------------------
Manuel Hermenegildo                       | Prof., C.S.Dept., T.U. Madrid (UPM)
Director, IMDEA SW Institute & CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
-------------------------------------------------------------------------------

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

Manuel Hermenegildo <herme@fi.upm.es> writes:

Hi!

> Or, perhaps even simpler, calfw could simply read the org-agenda
> buffer (colors and all) instead of reading the org files.
>
> This would have the enormous advantage that it would always generate
> the tasks with the same order, priorities, filters, customizations,
> etc. as the org agenda.
>
> What do you think?

I don't think that would be simpler.  The way it operates now requires
only picking several text properties (like 'date which it does, and
'time or 'priority which it currently doesn't).  Parsing agenda buffers
would require building 42 org day agenda buffers and heavy
transformation on strings, like cutting the time grid and moving the
times around (you don't want to have a long string 08:00-10:00 in front
of timed entries in calfw, because then you won't see anything from the
headline/description), and other stuff.

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[Eric S Fraga]

Tassilo Horn <tassilo@member.fsf.org> writes:

> Manuel Hermenegildo <herme@fi.upm.es> writes:
>
> Hi!
>
>> Or, perhaps even simpler, calfw could simply read the org-agenda
>> buffer (colors and all) instead of reading the org files.
>>
>> This would have the enormous advantage that it would always generate
>> the tasks with the same order, priorities, filters, customizations,
>> etc. as the org agenda.
>>
>> What do you think?
>
> I don't think that would be simpler.  The way it operates now requires
> only picking several text properties (like 'date which it does, and
> 'time or 'priority which it currently doesn't).  Parsing agenda buffers
> would require building 42 org day agenda buffers and heavy
> transformation on strings, like cutting the time grid and moving the
> times around (you don't want to have a long string 08:00-10:00 in front
> of timed entries in calfw, because then you won't see anything from the
> headline/description), and other stuff.

yes, I agree (on the not wanting time information etc).  but it all
depends on the design goals for this software.  I particularly like
having a graphical view of my commitments, especially for a month,
without worrying about detail.  Org's agenda view becomes cumbersome
(for me) when going beyond a week's view (or even a day sometimes...)
[1].

what I would like, however, is that the detailed view that is accessible
from hitting the space bar in the cfw view put me into an agenda view
for that day.  that would then give me full access to org!  this should
be quite simple: replace the detail view with a simple invocation of the
default org-agenda view (what you get from C-c a a, say) for that
particular date?

just some thoughts!

thanks,
eric

Footnotes: 
[1]  I often use Google's calendar for this, having uploaded all my
org details but I don't expect to use Google to update my org files.

-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.0.50.1
: using Org-mode version 7.5 (release_7.5.580.g301b34)

Re: Calendar-like view of the org-agenda

[Manuel Hermenegildo]

 > what I would like, however, is that the detailed view that is accessible
 > from hitting the space bar in the cfw view put me into an agenda view
 > for that day.  that would then give me full access to org!  this should
 > be quite simple: replace the detail view with a simple invocation of the
 > default org-agenda view (what you get from C-c a a, say) for that
 > particular date?

Great idea. This would indeed be a good (and simple)
solution. However, unfortunately it does not solve the other problem:

 > I particularly like having a graphical view of my commitments,
 > especially for a month, without worrying about detail.  Org's
 > agenda view becomes cumbersome (for me) when going beyond a week's
 > view (or even a day sometimes...)  [1].

Me too, but the problem with the current approach is that, at least
for me, this view is full of tasks that are not mine, are in a
different order (not by priorities), etc., which then does not help.

Manuel

-- 

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Wed, 6 Jul 2011 12:41:06 +0200,
Manuel Hermenegildo wrote:
> :
>  > I particularly like having a graphical view of my commitments,
>  > especially for a month, without worrying about detail.  Org's
>  > agenda view becomes cumbersome (for me) when going beyond a week's
>  > view (or even a day sometimes...)  [1].
> 
> Me too, but the problem with the current approach is that, at least
> for me, this view is full of tasks that are not mine, are in a
> different order (not by priorities), etc., which then does not help.

Sorry for my less experience of orgmode.
Can I get a sample task file which contains such complex schedules?

Re: Calendar-like view of the org-agenda

[Manuel Hermenegildo]

 > Sorry for my less experience of orgmode.
 > Can I get a sample task file which contains such complex schedules?

I can illustrate the point with a simple one :-):

* TODO Thank Sakurai for a great tool <2011-07-05 Tue>  :MH:
* TODO Write paper  <2011-07-05 Tue> :JF:

We share org files among different people (e.g., for software
projects) and use tags to determine whose task it is and in whose
agenda it should appear.  The first one should appear in MH's agenda
and the second one in JF's agenda. A lot of people use the same to
have, e.g., a home agenda and a work agenda:

* TODO Buy groceries <2011-07-05 Tue>  :home:
* TODO Ask boss for a raise  <2011-07-05 Tue> :work:

Currently, both tasks will appear in the calfw view. 

In the normal org agenda views the necessary filtering is done via the
"org-agenda-custom-commands" variable, defining a "custom agenda
command" with a filter (this is the recommended way of creating
different agendas and todo lists in org). For example, to get an
agenda view with only my tasks, which I identfy with the tag "MH" I
use (this is my normal agenda view):

(setq org-agenda-custom-commands
      (list
	(list 
	 "a" "Agenda with (only) my tasks (those that have my tag and a date)"
	 '((agenda 
	    ""
	    ((org-agenda-skip-function '(my-skip-by-tags "MH"))
	     (org-agenda-overriding-header 
            "Agenda -- with (only) my tasks (those that have my tag and a date)")
	 ))))))

(defun my-skip-by-tags (tag)
  "Skip tasks except those that contain tag (with inheritance!)." 
  (let ((line-end (save-excursion (progn (end-of-line) (point))))) ;; return pos
    (if (or 
	 (member tag (org-get-local-tags)) ;; check first if only local (speed)
	 (member tag (org-get-tags-at (point))) ;; rest include inherited tags
	 ) 
	nil ; do not skip
      line-end))) ; skip, continue after that

The particular filter that I use (my-skip-by-tags) is a function that
checks for inherited tags. I am not sure this can be done with
org-agenda-get-day-entries.  This is why I was suggesting perhaps
using a modified version of org-agenda (a back-end) that would feed
the data computed to calfw (the same could be used for all the other
agenda exports). Or perhaps org-agenda-get-day-entries can be made to
call a filter function like the one above?

Cheers,

Manuel


 > From: Manuel Hermenegildo <herme@fi.upm.es>
 > To: Tassilo Horn <tassilo@member.fsf.org>
 > Cc: Christopher Allan Webber <cwebber@dustycloud.org>,
 > 	SAKURAI Masashi <m.sakurai@kiwanami.net>,
 > 	emacs-orgmode@gnu.org
 > Subject: Re: [O] Calendar-like view of the org-agenda
 > Date: Wed, 6 Jul 2011 11:39:47 +0200
 > 
 > 
 > First, thanks very much to Sakurai for a wonderful tool and having
 > integrated it so well with org!
 > 
 >  > For me, creating a custom org agenda with the next 21 days takes
 >  > not much less than building an calfw calendar buffer with 42 days.
 > 
 > Same here, the times are comparable. For me building the org calendar
 > is a little slower but it makes sense because it is running some
 > filters, while calfw is not.  Which brings me to my question, which is
 > related to:
 > 
 >  > One thing which I'm currently missing is that the calfw entries
 >  > gathered from org are missing the times (if that's specified using the
 >  > 'time text property) and are sorted in an order I can't understand.
 > 
 > Seems like calfw is ignoring the org priorities and order.  In my case
 > the problem is that calfw is gathering all the tasks ignoring my per
 > tag filters. I explain: in my case I only want to see in my agenda
 > entries that have a certain tag (my tag): I share org files with other
 > people and we assign tasks by marking E.g., I am MH and my tasks are
 > like:
 > 
 > * TODO Thank Sakurai for a great tool <2011-07-05 Tue>  :MH:
 > 
 > which should appear in my agenda and there are other tasks like:
 > 
 > * TODO Write paper  <2011-07-05 Tue> :JF:
 > 
 > which should only appear in JF's agenda. This is done using a custom
 > agenda command that filters by tag.
 > 
 > It seems to me too complicated to try to reproduce all the nuances and
 > capabilities of org agenda generation (priorities, filtering, custom
 > views, etc.) and do it all again in calfw --it would always be very
 > hard to keep them in sync.
 > 
 > I have not had time to look at the code, but perhaps calfw, instead of
 > reading directly the org files could instead use the org code that
 > generates the agenda and then present the agenda in its very nice and
 > graphical way. I.e., an idea would be to add a back end to the code
 > that generates the org agenda which, instead of rendering the agenda
 > creates the calfw objects.
 > 
 > Or, perhaps even simpler, calfw could simply read the org-agenda
 > buffer (colors and all) instead of reading the org files.  
 > 
 > This would have the enormous advantage that it would always generate
 > the tasks with the same order, priorities, filters, customizations,
 > etc. as the org agenda.
 > 
 > What do you think?
 > 
 > Manuel 
 > 
 > 
 > 
 > -- 
 > -------------------------------------------------------------------------------
 > Manuel Hermenegildo                       | Prof., C.S.Dept., T.U. Madrid (UPM)
 > Director, IMDEA SW Institute & CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
 > -------------------------------------------------------------------------------


 > From: Manuel Hermenegildo <herme@fi.upm.es>
 > To: SAKURAI Masashi <m.sakurai@kiwanami.net>
 > Cc: tassilo@member.fsf.org, emacs-orgmode@gnu.org
 > Subject: Re: [O] Calendar-like view of the org-agenda
 > Date: Fri, 8 Jul 2011 05:11:23 +0200
 > 
 > 
 >  > > Seems like calfw is ignoring the org priorities and order.  In my case
 >  > > the problem is that calfw is gathering all the tasks ignoring my per
 >  > > tag filters. I explain: in my case I only want to see in my agenda
 >  > > entries that have a certain tag (my tag): I share org files with other
 >  > > people and we assign tasks by marking E.g., I am MH and my tasks are
 >  > > like:
 >  > > 
 >  > > * TODO Thank Sakurai for a great tool <2011-07-05 Tue>  :MH:
 >  > > 
 >  > > which should appear in my agenda and there are other tasks like:
 >  > > 
 >  > > * TODO Write paper  <2011-07-05 Tue> :JF:
 >  > > 
 >  > > which should only appear in JF's agenda. This is done using a custom
 >  > > agenda command that filters by tag.
 >  > > 
 >  > > It seems to me too complicated to try to reproduce all the nuances and
 >  > > capabilities of org agenda generation (priorities, filtering, custom
 >  > > views, etc.) and do it all again in calfw --it would always be very
 >  > > hard to keep them in sync.
 >  > 
 >  > I read the code of org-agenda-list and subsequent callee functions.
 >  > Indeed it was very hard way and I didn't understand all codes because
 >  > I was not a orgmode user.
 >  > 
 >  > Then, I use the function org-agenda-get-day-entries to get schedule
 >  > items of the org-agenda-files. The function can receive some arguments
 >  > to limit the tasks, but I didn't understand exactly.  Do you use this
 >  > function? If so, it may be easy to implement a simple filter.
 >  ...
 >  > org-agenda-get-day-entries can take more
 >  > arguments like :scheduled :deadline to help reduce the size of listed
 >  > entries.  See the docstring of org-diary, which understands the same
 >  > list of arguments.
 > 
 > I use the "org-agenda-custom-commands" variable and define a command
 > with a filter (this is the recommended way of creating different
 > agendas and todo lists in org). For example, to get an agenda view
 > with only my tasks, which I identfy with the tag "MH" I use (this is
 > my normal agenda view):
 > 
 > (setq org-agenda-custom-commands
 >       (list
 > 	(list 
 > 	 "a" "Agenda with (only) my tasks (those that have my tag and a date)"
 > 	 '((agenda 
 > 	    ""
 > 	    ((org-agenda-skip-function '(my-skip-by-tags-mytag "MH"))
 > 	     (org-agenda-overriding-header 
 >             "Agenda -- with (only) my tasks (those that have my tag and a date)")
 > 	 ))))))
 > 
 > (defun my-skip-by-tags-mytag (tag)
 >   "Skip tasks except those that contain tag (with inheritance!)." 
 >   (let ((line-end (save-excursion (progn (end-of-line) (point))))) ;; return pos
 >     (if (or 
 > 	 (member tag (org-get-local-tags)) ;; check first if only local (speed)
 > 	 (member tag (org-get-tags-at (point))) ;; rest include inherited tags
 > 	 ) 
 > 	nil ; do not skip
 >       line-end))) ; skip, continue after that
 > 
 > The issue here is that the filter is a function that checks for
 > inherited tags. I am not sure this can be done with
 > org-agenda-get-day-entries.  This is why I was suggesting perhaps
 > using a modified version of org-agenda that would feed data to calfw
 > instead of (or, perhaps even better, in addition to) generating the
 > org agenda views. Or perhaps org-agenda-get-day-entries can be made to
 > call a filter function like the one above?
 > 
 > Manuel 
 > 
 > --


-- 
-------------------------------------------------------------------------------
Manuel Hermenegildo                       | Prof., C.S.Dept., T.U. Madrid (UPM)
Director, IMDEA SW Institute & CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
-------------------------------------------------------------------------------

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Manuel,

Thank you for your example.
I have to study a lot of customize variables of org-agenda.
The org-mode is very deep world!

At Mon, 11 Jul 2011 21:02:48 +0200,
Manuel Hermenegildo wrote:
> :
> Currently, both tasks will appear in the calfw view. 
> 
> In the normal org agenda views the necessary filtering is done via the
> "org-agenda-custom-commands" variable, defining a "custom agenda
> command" with a filter (this is the recommended way of creating
> different agendas and todo lists in org). For example, to get an
> agenda view with only my tasks, which I identfy with the tag "MH" I
> use (this is my normal agenda view):
> 
> (setq org-agenda-custom-commands
>       (list
> 	(list 
> 	 "a" "Agenda with (only) my tasks (those that have my tag and a date)"
> 	 '((agenda 
> 	    ""
> 	    ((org-agenda-skip-function '(my-skip-by-tags "MH"))
> 	     (org-agenda-overriding-header 
>             "Agenda -- with (only) my tasks (those that have my tag and a date)")
> 	 ))))))
> :
> The particular filter that I use (my-skip-by-tags) is a function that
> checks for inherited tags. I am not sure this can be done with
> org-agenda-get-day-entries.  This is why I was suggesting perhaps
> using a modified version of org-agenda (a back-end) that would feed
> the data computed to calfw (the same could be used for all the other
> agenda exports). Or perhaps org-agenda-get-day-entries can be made to
> call a filter function like the one above?

I think org-agenda-get-day-entries uses the customize function
org-agenda-skip-function via org-agenda-get-xxx functions.
So, I can display schedules filtered by the my-skip-by-tags, 
like following ad-hoc code.

==================================================

(defun cfw:org-collect-schedules-period (begin end)
  "[internal] Return org schedule items between BEGIN and END."
  (let ((org-agenda-prefix-format "")
        (span 'day)
        (org-agenda-skip-function '(my-skip-by-tags "MH"))) ;; Added here!!
    (org-compile-prefix-format nil)
    (loop for date in (cfw:enumerate-days begin end) append
          (loop for file in (org-agenda-files nil 'ifmode) append
                (progn
                  (org-check-agenda-file file)
                  (apply 'org-agenda-get-day-entries 
                         file date 
                         cfw:org-agenda-schedule-args))))))

==================================================

I will think about the customization of such filters.
If someone has a good idea or patch, please let me know.

Thank you,
--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Wed, 06 Jul 2011 11:23:00 +0100,
Eric S Fraga wrote:
> :
> what I would like, however, is that the detailed view that is accessible
> from hitting the space bar in the cfw view put me into an agenda view
> for that day.  that would then give me full access to org!  this should
> be quite simple: replace the detail view with a simple invocation of the
> default org-agenda view (what you get from C-c a a, say) for that
> particular date?

I will try this idea. It may be easy to implement.

> Footnotes: 
> [1]  I often use Google's calendar for this, having uploaded all my
> org details but I don't expect to use Google to update my org files.

One can display an org schedule and a google calendar one in the same
buffer. Here is a sample code.

==================================================
(require 'calfw-org)
(require 'calfw-ical)

(defun my-open-calendar ()
  (interactive)
  (cfw:open-calendar-buffer
   :view 'month
   :contents-sources
   (list 
    (cfw:org-create-source "Seagreen4") ; color
    (cfw:ical-create-source "ical" "https://www.google.com/calendar/ical/../basic.ics" "#2952a3"))))
    ;; title, URL, color
==================================================

The commands `cfw:open-org-calendar' and `cfw:open-ical-calendar' are
simple API for quick use. Giving schedule source (cfw:source) objects
via the argument `:contents-sources', one can mix some calendar
schedules in one buffer.

I will write the document about calfw customization soon.

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Wed, 6 Jul 2011 11:39:47 +0200,
Manuel Hermenegildo wrote:
> 
> First, thanks very much to Sakurai for a wonderful tool and having
> integrated it so well with org!

Thank you for your comment. I'm very encouraged!


>  > For me, creating a custom org agenda with the next 21 days takes
>  > not much less than building an calfw calendar buffer with 42 days.
> :
> Seems like calfw is ignoring the org priorities and order.  In my case
> the problem is that calfw is gathering all the tasks ignoring my per
> tag filters. I explain: in my case I only want to see in my agenda
> entries that have a certain tag (my tag): I share org files with other
> people and we assign tasks by marking E.g., I am MH and my tasks are
> like:
> 
> * TODO Thank Sakurai for a great tool <2011-07-05 Tue>  :MH:
> 
> which should appear in my agenda and there are other tasks like:
> 
> * TODO Write paper  <2011-07-05 Tue> :JF:
> 
> which should only appear in JF's agenda. This is done using a custom
> agenda command that filters by tag.
> 
> It seems to me too complicated to try to reproduce all the nuances and
> capabilities of org agenda generation (priorities, filtering, custom
> views, etc.) and do it all again in calfw --it would always be very
> hard to keep them in sync.

I read the code of org-agenda-list and subsequent callee functions.
Indeed it was very hard way and I didn't understand all codes because
I was not a orgmode user.

Then, I use the function org-agenda-get-day-entries to get schedule
items of the org-agenda-files. The function can receive some arguments
to limit the tasks, but I didn't understand exactly.  Do you use this
function? If so, it may be easy to implement a simple filter.


> I have not had time to look at the code, but perhaps calfw, instead of
> reading directly the org files could instead use the org code that
> generates the agenda and then present the agenda in its very nice and
> graphical way. I.e., an idea would be to add a back end to the code
> that generates the org agenda which, instead of rendering the agenda
> creates the calfw objects.
> 
> Or, perhaps even simpler, calfw could simply read the org-agenda
> buffer (colors and all) instead of reading the org files.  
> 
> This would have the enormous advantage that it would always generate
> the tasks with the same order, priorities, filters, customizations,
> etc. as the org agenda.

The face property and other text properties which are put by
org-agenda-get-day-entries, are remained in calfw buffer.

Customization of summary texts of org items is the variable
cfw:org-schedule-summary-transformer or the function
cfw:org-summary-format. Because I have used orgmode not so heavily,
the current integration is very simple.

I think calfw can display the items in any way how you want.
I would implement simple ideas as soon as possible.


Thank you.

--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Bastien]

[-- Attachment #1: Type: text/plain, Size: 508 bytes --]

Hi Masashi,

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> Then, I use the function org-agenda-get-day-entries to get schedule
> items of the org-agenda-files. The function can receive some arguments
> to limit the tasks, but I didn't understand exactly.  

See the attached patch -- org-agenda-get-day-entries can take more
arguments like :scheduled :deadline to help reduce the size of listed
entries.  See the docstring of org-diary, which understands the same
list of arguments.

Hope this helps,


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-Variable-for-faster-use-of-org-agenda-get-day-entrie.patch --]
[-- Type: text/x-patch, Size: 1170 bytes --]

From 7d54f5dc7cca22912d3dd9a8f6d00df7138942f3 Mon Sep 17 00:00:00 2001
From: Bastien Guerry <bzg@altern.org>
Date: Thu, 7 Jul 2011 17:15:08 +0200
Subject: [PATCH] Variable for faster use of org-agenda-get-day-entries.

This is just an example.
---
 calfw-org.el |    7 ++++++-
 1 files changed, 6 insertions(+), 1 deletions(-)

diff --git a/calfw-org.el b/calfw-org.el
index 99fe18e..ec43796 100644
--- a/calfw-org.el
+++ b/calfw-org.el
@@ -34,6 +34,9 @@
 (require 'org)
 (require 'org-agenda)
 
+(defvar cfw:org-agenda-schedule-args '(:scheduled)
+  "Default arguments for collecting agenda entries.")
+
 (defun cfw:org-collect-schedules-period (begin end)
   "[internal] Return org schedule items between BEGIN and END."
   (let ((org-agenda-prefix-format "")
@@ -43,7 +46,9 @@
           (loop for file in (org-agenda-files nil 'ifmode) append
                 (progn
                   (org-check-agenda-file file)
-                  (org-agenda-get-day-entries file date))))))
+                  (apply 'org-agenda-get-day-entries 
+			 file date 
+			 cfw:org-agenda-schedule-args))))))
 
 (defun cfw:org-onclick ()
   "Jump to the clicked org item."
-- 
1.7.5.2


[-- Attachment #3: Type: text/plain, Size: 14 bytes --]


-- 
 Bastien

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

Bastien <bzg@altern.org> writes:

>> Then, I use the function org-agenda-get-day-entries to get schedule
>> items of the org-agenda-files. The function can receive some
>> arguments to limit the tasks, but I didn't understand exactly.
>
> See the attached patch -- org-agenda-get-day-entries can take more
> arguments like :scheduled :deadline to help reduce the size of listed
> entries.  See the docstring of org-diary, which understands the same
> list of arguments.

I think it's a good idea to add that variable to let users decide if
they want deadlines or scheduled (in org terms) items in their calfw
view.

> +(defvar cfw:org-agenda-schedule-args '(:scheduled)
> +  "Default arguments for collecting agenda entries.")

I'd go with a default value of `nil' meaning "put every org entry with a
timestamp into the calfw view".  Only getting SCHEDULED org tasks there
is a somewhat peculiar default.

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Tassilo,

Tassilo Horn <tassilo@member.fsf.org> writes:

>> +(defvar cfw:org-agenda-schedule-args '(:scheduled)
>> +  "Default arguments for collecting agenda entries.")
>
> I'd go with a default value of `nil' meaning "put every org entry with a
> timestamp into the calfw view".  Only getting SCHEDULED org tasks there
> is a somewhat peculiar default.

Agreed -- I used :scheduled in this example just to make sure to
illustrate the filtering.

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Tassilo and Bastien

> >> +(defvar cfw:org-agenda-schedule-args '(:scheduled)
> >> +  "Default arguments for collecting agenda entries.")
> >
> > I'd go with a default value of `nil' meaning "put every org entry with a
> > timestamp into the calfw view".  Only getting SCHEDULED org tasks there
> > is a somewhat peculiar default.
> 
> Agreed -- I used :scheduled in this example just to make sure to
> illustrate the filtering.

Thank you for your advice.
I merged and pushed it to master branch.

--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Masashi,

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> I merged and pushed it to master branch.

thanks a lot!

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Bastien

At Thu, 07 Jul 2011 17:32:44 +0200,
Bastien wrote:
> :
> SAKURAI Masashi <m.sakurai@kiwanami.net> writes:
> 
> > Then, I use the function org-agenda-get-day-entries to get schedule
> > items of the org-agenda-files. The function can receive some arguments
> > to limit the tasks, but I didn't understand exactly.  
> 
> See the attached patch -- org-agenda-get-day-entries can take more
> arguments like :scheduled :deadline to help reduce the size of listed
> entries.  See the docstring of org-diary, which understands the same
> list of arguments.

Thank you for your advice and patch. I will merge it.

One question, is it fixed variable for an user?  I mean, one often
changes the argument parameter to change the filtering in a single
Emacs session. If one frequently changes it, should I design the UI to
change it and re-draw the calendar?


--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Masashi,

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> Thank you for your advice and patch. I will merge it.

Thanks!

> One question, is it fixed variable for an user?  I mean, one often
> changes the argument parameter to change the filtering in a single
> Emacs session. 

It would actually be nice to be able to change this parameters on the
fly -- even for org agendas.  That's not currently possible but I will
consider implementing this for Org.

> If one frequently changes it, should I design the UI to change it and
> re-draw the calendar?

I think you can already do this independantly from Org's implementation.

Best,

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi Bastien,

At Tue, 12 Jul 2011 09:24:25 +0200,
Bastien wrote:
> :
> > One question, is it fixed variable for an user?  I mean, one often
> > changes the argument parameter to change the filtering in a single
> > Emacs session. 
> 
> It would actually be nice to be able to change this parameters on the
> fly -- even for org agendas.  That's not currently possible but I will
> consider implementing this for Org.

I see.

> > If one frequently changes it, should I design the UI to change it and
> > re-draw the calendar?
> 
> I think you can already do this independantly from Org's implementation.

Ok. I will try to design the customization.  I think it should be done
together with the filter function discussed at another thread.

--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Manuel Hermenegildo]

 > > Seems like calfw is ignoring the org priorities and order.  In my case
 > > the problem is that calfw is gathering all the tasks ignoring my per
 > > tag filters. I explain: in my case I only want to see in my agenda
 > > entries that have a certain tag (my tag): I share org files with other
 > > people and we assign tasks by marking E.g., I am MH and my tasks are
 > > like:
 > > 
 > > * TODO Thank Sakurai for a great tool <2011-07-05 Tue>  :MH:
 > > 
 > > which should appear in my agenda and there are other tasks like:
 > > 
 > > * TODO Write paper  <2011-07-05 Tue> :JF:
 > > 
 > > which should only appear in JF's agenda. This is done using a custom
 > > agenda command that filters by tag.
 > > 
 > > It seems to me too complicated to try to reproduce all the nuances and
 > > capabilities of org agenda generation (priorities, filtering, custom
 > > views, etc.) and do it all again in calfw --it would always be very
 > > hard to keep them in sync.
 > 
 > I read the code of org-agenda-list and subsequent callee functions.
 > Indeed it was very hard way and I didn't understand all codes because
 > I was not a orgmode user.
 > 
 > Then, I use the function org-agenda-get-day-entries to get schedule
 > items of the org-agenda-files. The function can receive some arguments
 > to limit the tasks, but I didn't understand exactly.  Do you use this
 > function? If so, it may be easy to implement a simple filter.
 ...
 > org-agenda-get-day-entries can take more
 > arguments like :scheduled :deadline to help reduce the size of listed
 > entries.  See the docstring of org-diary, which understands the same
 > list of arguments.

I use the "org-agenda-custom-commands" variable and define a command
with a filter (this is the recommended way of creating different
agendas and todo lists in org). For example, to get an agenda view
with only my tasks, which I identfy with the tag "MH" I use (this is
my normal agenda view):

(setq org-agenda-custom-commands
      (list
	(list 
	 "a" "Agenda with (only) my tasks (those that have my tag and a date)"
	 '((agenda 
	    ""
	    ((org-agenda-skip-function '(my-skip-by-tags-mytag "MH"))
	     (org-agenda-overriding-header 
            "Agenda -- with (only) my tasks (those that have my tag and a date)")
	 ))))))

(defun my-skip-by-tags-mytag (tag)
  "Skip tasks except those that contain tag (with inheritance!)." 
  (let ((line-end (save-excursion (progn (end-of-line) (point))))) ;; return pos
    (if (or 
	 (member tag (org-get-local-tags)) ;; check first if only local (speed)
	 (member tag (org-get-tags-at (point))) ;; rest include inherited tags
	 ) 
	nil ; do not skip
      line-end))) ; skip, continue after that

The issue here is that the filter is a function that checks for
inherited tags. I am not sure this can be done with
org-agenda-get-day-entries.  This is why I was suggesting perhaps
using a modified version of org-agenda that would feed data to calfw
instead of (or, perhaps even better, in addition to) generating the
org agenda views. Or perhaps org-agenda-get-day-entries can be made to
call a filter function like the one above?

Manuel 

--

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Manuel,

Manuel Hermenegildo <herme@fi.upm.es> writes:

> I.e., an idea would be to add a back end to the code
> that generates the org agenda which, instead of rendering the agenda
> creates the calfw objects.

I'm all for an Org agenda backend -- but before that, we *need* to 
make `org-agenda-get-day-entries' much more efficient.

If someone manages to reduce the execution time of this function by 
20%, then I'll work on such a backend :)

The challenge is open -- no deadline!

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Wed, 06 Jul 2011 09:16:32 +0200,
Tassilo Horn wrote:
> :
> Christopher Allan Webber <cwebber@dustycloud.org> writes:
> 
> Hi Christopher,
> 
> > Also, cfw:open-org-calendar works, but things seem really slow... it
> > looks like you're recalculating the entire orgmode agenda for every
> > day.  I wonder if things could be sped up if the orgmode agenda was
> > calculated for the entire period all at once and then broke that up
> > into days?
> 
> For me, creating a custom org agenda with the next 21 days takes not
> much less than building an calfw calendar buffer with 42 days.  It's
> about one second for the former and 2 seconds for the latter, so it
> seems calfw does the right thing.

Thank you for your confirming.

I implemented calfw-org with consultation of the code of
org-agenda-list. I think it is difficult to make the speed faster with
a simple way, the re-design of the whole org-agenda-list algorithm
seems to be needed, because the key function
org-agenda-get-day-entries requires only one date and the subsequent
dependent functions also are designed by the API.


> One thing which I'm currently missing is that the calfw entries gathered
> from org are missing the times (if that's specified using the 'time text
> property) and are sorted in an order I can't understand.  For example,
>  :

Yes. The current implementation, calfw sorts the items by alphabet,
i.e. string-less, in one date cell. This is intent to sort the items which 
has time header like "10:00 meeting" "13:00 go to airport" "16:00 meeting".

It is not so difficult to add a customize of the sort criteria.
And you can try your custom summary format, modifying cfw:org-summary-format.
In the function, you can get the time value from the text property.

Re: Calendar-like view of the org-agenda

[Tassilo Horn]

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

Hi!

>> For me, creating a custom org agenda with the next 21 days takes not
>> much less than building an calfw calendar buffer with 42 days.  It's
>> about one second for the former and 2 seconds for the latter, so it
>> seems calfw does the right thing.
>
> Thank you for your confirming.
>
> I implemented calfw-org with consultation of the code of
> org-agenda-list. I think it is difficult to make the speed faster with
> a simple way, the re-design of the whole org-agenda-list algorithm
> seems to be needed, because the key function
> org-agenda-get-day-entries requires only one date and the subsequent
> dependent functions also are designed by the API.

I think it's pretty fast, so I'd vote for keeping the good and simple
design of the org schedule import in contrast to reimplement the wheel
for a slight speedup.

>> One thing which I'm currently missing is that the calfw entries
>> gathered from org are missing the times (if that's specified using
>> the 'time text property) and are sorted in an order I can't
>> understand.  For example, :
>
> Yes. The current implementation, calfw sorts the items by alphabet,
> i.e. string-less, in one date cell. This is intent to sort the items
> which has time header like "10:00 meeting" "13:00 go to airport"
> "16:00 meeting".

Yeah, that would work.  However, org times are usually ranges like
10:00-12:00 which is 11 characters wide.  You don't want to prefix the
displayed items with that, because then you wouldn't see anything from
the item's description text.  So I'd prepend the times so that I can see
them when hoovering with the mouse on that item.  Of course, then
`string-less' won't sort according to date.

> It is not so difficult to add a customize of the sort criteria.  And
> you can try your custom summary format, modifying
> cfw:org-summary-format.  In the function, you can get the time value
> from the text property.

Right.  Maybe a good idea was allowing a custom sort function that sorts
the `contents' for one day in `cfw:org-schedule-period-to-calendar'.
There, you still have the 'time text property that you can use for
sorting.

Bye,
Tassilo

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

Hi, Tassilo

At Thu, 07 Jul 2011 09:24:33 +0200,
Tassilo Horn wrote:
> 
> SAKURAI Masashi <m.sakurai@kiwanami.net> writes:
> 
> Hi!
> :
> > I implemented calfw-org with consultation of the code of
> > org-agenda-list. I think it is difficult to make the speed faster with
> > a simple way, the re-design of the whole org-agenda-list algorithm
> > seems to be needed, because the key function
> > org-agenda-get-day-entries requires only one date and the subsequent
> > dependent functions also are designed by the API.
> 
> I think it's pretty fast, so I'd vote for keeping the good and simple
> design of the org schedule import in contrast to reimplement the wheel
> for a slight speedup.

Thanks for your advice.
I think the importing speed depends on the size of org files.
I would discuss this topic on another thead.


> > It is not so difficult to add a customize of the sort criteria.  And
> > you can try your custom summary format, modifying
> > cfw:org-summary-format.  In the function, you can get the time value
> > from the text property.
> 
> Right.  Maybe a good idea was allowing a custom sort function that sorts
> the `contents' for one day in `cfw:org-schedule-period-to-calendar'.
> There, you still have the 'time text property that you can use for
> sorting.

I will implement a simple custom sort function.
After then, I would like to discuss time management on calfw.

Thank you,

--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Re: Calendar-like view of the org-agenda

[Bastien]

Hi Masashi,

SAKURAI Masashi <m.sakurai@kiwanami.net> writes:

> the re-design of the whole org-agenda-list algorithm
> seems to be needed, because the key function
> org-agenda-get-day-entries requires only one date and the subsequent
> dependent functions also are designed by the API.

FWIW, I'm all ears -- if you have ideas on how to make org-agenda-list
more effective please let us know, I could try to implement them.

Best,

-- 
 Bastien

Re: Calendar-like view of the org-agenda

[SAKURAI Masashi]

At Tue, 05 Jul 2011 12:13:09 -0500,
Christopher Allan Webber wrote:
> 
> Also, cfw:open-org-calendar works, but things seem really slow... it
> looks like you're recalculating the entire orgmode agenda for every day.
> I wonder if things could be sped up if the orgmode agenda was calculated
> for the entire period all at once and then broke that up into days?

I read the implementation of `org-agenda-list' to get schedule items.
Then, I found it may be slow in this implementation. I want to know
better way to get the schedule items.


Well, it is midnight in JST, so I will reply to subsequent discussions 
tomorrow. Sorry that I could not catch up your discussion speed...

Thank you,
--
SAKURAI, Masashi (family, given)
m.sakurai@kiwanami.net

Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

Hi list,

I've got a plenty of very big org files (~50KB). When it reaches
~30KB, org struggles to handle it -- it becomes very slow to navigate
through the file, the response time is far from smooth.

release_7.01g-20-gdd484 and GNU Emacs 23.2.1 (x86_64-apple-darwin, NS
apple-appkit-1038.29) of 2010-05-08 on black.local

OSX Snow Leopard, 10.6

Any ideas?

Marcelo.

Re: Org file rendering/manipulation too slow

[Nick Dokos]

Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:


> I've got a plenty of very big org files (~50KB). When it reaches
> ~30KB, org struggles to handle it -- it becomes very slow to navigate
> through the file, the response time is far from smooth.
> 
> release_7.01g-20-gdd484 and GNU Emacs 23.2.1 (x86_64-apple-darwin, NS
> apple-appkit-1038.29) of 2010-05-08 on black.local
> 
> OSX Snow Leopard, 10.6
> 
> Any ideas?
> 

o Do you compile the .el files? A lot of people don't and don't have
  any problems (Bernt in particular), but your circumstances might be
  such that compilation might be a win (although you will have a slightly
  harder time at (re)installation and you will need to watch out for
  outdated .elc files.)

o If that doesn't produce the desired results, then profiling the code
  should be your next step:

  M-x elp-instrument-package <RET> org <RET>

  then run your slow command, then M-x elp-results.

HTH,
Nick

Re: Org file rendering/manipulation too slow

[Bastien]

Hi Marcelo,

Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> I've got a plenty of very big org files (~50KB). When it reaches
> ~30KB, org struggles to handle it -- it becomes very slow to navigate
> through the file, the response time is far from smooth.
>
> release_7.01g-20-gdd484 and GNU Emacs 23.2.1 (x86_64-apple-darwin, NS
> apple-appkit-1038.29) of 2010-05-08 on black.local

Maybe you could share (or link to) your Org configuration file?

That would help digg the issue.

Thanks,

PS: I live in one Org files of ~700K and I've no problem with it.

-- 
 Bastien

Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

Hi Bastien,

Here it is:  http://github.com/celoserpa/emacs-starter-kit/blob/master/fullofcaffeine/org.el

I'm using it on OSX Snow Leopard (latest updates applied).

Marcelo.

On Sat, Jul 31, 2010 at 3:56 AM, Bastien <bzg@altern.org> wrote:
> Hi Marcelo,
>
> Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:
>
>> I've got a plenty of very big org files (~50KB). When it reaches
>> ~30KB, org struggles to handle it -- it becomes very slow to navigate
>> through the file, the response time is far from smooth.
>>
>> release_7.01g-20-gdd484 and GNU Emacs 23.2.1 (x86_64-apple-darwin, NS
>> apple-appkit-1038.29) of 2010-05-08 on black.local
>
> Maybe you could share (or link to) your Org configuration file?
>
> That would help digg the issue.
>
> Thanks,
>
> PS: I live in one Org files of ~700K and I've no problem with it.
>
> --
>  Bastien
>

Re: Org file rendering/manipulation too slow

[Bastien]

Hi Marcelo,

Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> Here it is:
> http://github.com/celoserpa/emacs-starter-kit/blob/master/fullofcaffeine/org.el

Thanks - note that it might be confusing to name your config file org.el
since this is also the name of the main Org file.

Some comments on the fly:

1. you have a double entry for (setq org-return-follows-link t)
2. (add-hook 'org-mode-hook 'turn-on-font-lock) is not necessary
3. you should use org-capture :)

> I'm using it on OSX Snow Leopard (latest updates applied).

I can't see anything suspicious in your config file that would explain
the slowliness. Maybe someone using OSX Snow Leopard could help further.

Best,

-- 
 Bastien

Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

Hi Batien,

Thank you for the insights,

Might be related to the OSX build -- any other OSX users around? :)

Do you mind if I answer with some additional questions?

>2. (add-hook 'org-mode-hook 'turn-on-font-lock) is not necessary
Hmm, I'm not really sure about this setting. I'll remove it, but what
is it about?
>3. you should use org-capture :)
What is org-capture? :)

Thanks,

Marcelo.

On Fri, Aug 6, 2010 at 3:49 AM, Bastien <bastien.guerry@wikimedia.fr> wrote:
> Hi Marcelo,
>
> Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:
>
>> Here it is:
>> http://github.com/celoserpa/emacs-starter-kit/blob/master/fullofcaffeine/org.el
>
> Thanks - note that it might be confusing to name your config file org.el
> since this is also the name of the main Org file.
>
> Some comments on the fly:
>
> 1. you have a double entry for (setq org-return-follows-link t)
> 2. (add-hook 'org-mode-hook 'turn-on-font-lock) is not necessary
> 3. you should use org-capture :)
>
>> I'm using it on OSX Snow Leopard (latest updates applied).
>
> I can't see anything suspicious in your config file that would explain
> the slowliness. Maybe someone using OSX Snow Leopard could help further.
>
> Best,
>
> --
>  Bastien
>

Re: Org file rendering/manipulation too slow

[Manuel Hermenegildo]

 > Might be related to the OSX build -- any other OSX users around? :)

I also use Mac OS and I also see very slow performance when navigating
through large org files. Basically, sometimes emacs will freeze for 20
seconds or so when I switch to a large org buffer (about 30,000 lines,
1M --large but should be workable, see below). The strange thing is
that it happens only sometimes.  When I get desperate (it can be very
annoying) I switch to a -nw session inside a terminal and then
everything works fine, so I do get the impression that it has to do
with screen rendering in the OS X build. My current emacs version is
23.2.1. --Manuel

-- 
-------------------------------------------------------------------------------
 Manuel Hermenegildo                     | Prof., C.S.Dept., T.U. Madrid (UPM)
 Director, IMDEA Software and CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
-------------------------------------------------------------------------------

Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

Any hints on this one? It's really annoying to handle (not so) large
org files in the OSX version of emacs. Maybe recompiling it with
different options?

Marcelo.

On Sat, Aug 7, 2010 at 5:38 AM, Manuel Hermenegildo <herme@fi.upm.es> wrote:
>
>  > Might be related to the OSX build -- any other OSX users around? :)
>
> I also use Mac OS and I also see very slow performance when navigating
> through large org files. Basically, sometimes emacs will freeze for 20
> seconds or so when I switch to a large org buffer (about 30,000 lines,
> 1M --large but should be workable, see below). The strange thing is
> that it happens only sometimes.  When I get desperate (it can be very
> annoying) I switch to a -nw session inside a terminal and then
> everything works fine, so I do get the impression that it has to do
> with screen rendering in the OS X build. My current emacs version is
> 23.2.1. --Manuel
>
> --
> -------------------------------------------------------------------------------
>  Manuel Hermenegildo                     | Prof., C.S.Dept., T.U. Madrid (UPM)
>  Director, IMDEA Software and CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
> -------------------------------------------------------------------------------
>
>

Re: Org file rendering/manipulation too slow

[Bernt Hansen]

Hi Marcelo,

I don't use a Mac but someone on the #org-mode IRC channel mentioned
trying this:

(setq font-lock-verbose nil)

HTH,
Bernt


Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> Any hints on this one? It's really annoying to handle (not so) large
> org files in the OSX version of emacs. Maybe recompiling it with
> different options?
>
> Marcelo.
>
> On Sat, Aug 7, 2010 at 5:38 AM, Manuel Hermenegildo <herme@fi.upm.es> wrote:
>>
>>  > Might be related to the OSX build -- any other OSX users around? :)
>>
>> I also use Mac OS and I also see very slow performance when navigating
>> through large org files. Basically, sometimes emacs will freeze for 20
>> seconds or so when I switch to a large org buffer (about 30,000 lines,
>> 1M --large but should be workable, see below). The strange thing is
>> that it happens only sometimes.  When I get desperate (it can be very
>> annoying) I switch to a -nw session inside a terminal and then
>> everything works fine, so I do get the impression that it has to do
>> with screen rendering in the OS X build. My current emacs version is
>> 23.2.1. --Manuel
>>
>> --
>> -------------------------------------------------------------------------------
>>  Manuel Hermenegildo                     | Prof., C.S.Dept., T.U. Madrid (UPM)
>>  Director, IMDEA Software and CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
>> -------------------------------------------------------------------------------
>>
>>
>
> _______________________________________________
> Emacs-orgmode mailing list
> Please use `Reply All' to send replies to the list.
> Emacs-orgmode@gnu.org
> http://lists.gnu.org/mailman/listinfo/emacs-orgmode

Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

Hi Bernt,

It did help a lot, the rendering is faster and I can actually navigate
through my reference org file.

Would someone mind explaining me what this function does and why does
disabling it would make things faster.

Marcelo.

On Wed, Aug 25, 2010 at 2:45 PM, Bernt Hansen <bernt@norang.ca> wrote:
> Hi Marcelo,
>
> I don't use a Mac but someone on the #org-mode IRC channel mentioned
> trying this:
>
> (setq font-lock-verbose nil)
>
> HTH,
> Bernt
>
>
> Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:
>
>> Any hints on this one? It's really annoying to handle (not so) large
>> org files in the OSX version of emacs. Maybe recompiling it with
>> different options?
>>
>> Marcelo.
>>
>> On Sat, Aug 7, 2010 at 5:38 AM, Manuel Hermenegildo <herme@fi.upm.es> wrote:
>>>
>>>  > Might be related to the OSX build -- any other OSX users around? :)
>>>
>>> I also use Mac OS and I also see very slow performance when navigating
>>> through large org files. Basically, sometimes emacs will freeze for 20
>>> seconds or so when I switch to a large org buffer (about 30,000 lines,
>>> 1M --large but should be workable, see below). The strange thing is
>>> that it happens only sometimes.  When I get desperate (it can be very
>>> annoying) I switch to a -nw session inside a terminal and then
>>> everything works fine, so I do get the impression that it has to do
>>> with screen rendering in the OS X build. My current emacs version is
>>> 23.2.1. --Manuel
>>>
>>> --
>>> -------------------------------------------------------------------------------
>>>  Manuel Hermenegildo                     | Prof., C.S.Dept., T.U. Madrid (UPM)
>>>  Director, IMDEA Software and CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
>>> -------------------------------------------------------------------------------
>>>
>>>
>>
>> _______________________________________________
>> Emacs-orgmode mailing list
>> Please use `Reply All' to send replies to the list.
>> Emacs-orgmode@gnu.org
>> http://lists.gnu.org/mailman/listinfo/emacs-orgmode
>

Re: Org file rendering/manipulation too slow

[Bernt Hansen]

I think it's something like this:

It's a variable not a function.  I think it controls how much stuff is
written out via (message ...) calls in the implementation of font lock
code on your mac version of emacs lisp.  Calls to message are slow and
there are lots of them in this implementation.  This is just making it
skip these calls.

If anyone has better information than this speculation please chime
in :)

-Bernt


Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> Hi Bernt,
>
> It did help a lot, the rendering is faster and I can actually navigate
> through my reference org file.
>
> Would someone mind explaining me what this function does and why does
> disabling it would make things faster.
>
> Marcelo.
>
> On Wed, Aug 25, 2010 at 2:45 PM, Bernt Hansen <bernt@norang.ca> wrote:
>> Hi Marcelo,
>>
>> I don't use a Mac but someone on the #org-mode IRC channel mentioned
>> trying this:
>>
>> (setq font-lock-verbose nil)
>>
>> HTH,
>> Bernt
>>
>>
>> Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:
>>
>>> Any hints on this one? It's really annoying to handle (not so) large
>>> org files in the OSX version of emacs. Maybe recompiling it with
>>> different options?
>>>
>>> Marcelo.
>>>
>>> On Sat, Aug 7, 2010 at 5:38 AM, Manuel Hermenegildo <herme@fi.upm.es> wrote:
>>>>
>>>>  > Might be related to the OSX build -- any other OSX users around? :)
>>>>
>>>> I also use Mac OS and I also see very slow performance when navigating
>>>> through large org files. Basically, sometimes emacs will freeze for 20
>>>> seconds or so when I switch to a large org buffer (about 30,000 lines,
>>>> 1M --large but should be workable, see below). The strange thing is
>>>> that it happens only sometimes.  When I get desperate (it can be very
>>>> annoying) I switch to a -nw session inside a terminal and then
>>>> everything works fine, so I do get the impression that it has to do
>>>> with screen rendering in the OS X build. My current emacs version is
>>>> 23.2.1. --Manuel
>>>>
>>>> --
>>>> -------------------------------------------------------------------------------
>>>>  Manuel Hermenegildo                     | Prof., C.S.Dept., T.U. Madrid (UPM)
>>>>  Director, IMDEA Software and CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
>>>> -------------------------------------------------------------------------------
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Emacs-orgmode mailing list
>>> Please use `Reply All' to send replies to the list.
>>> Emacs-orgmode@gnu.org
>>> http://lists.gnu.org/mailman/listinfo/emacs-orgmode
>>

Re: Org file rendering/manipulation too slow

[Manuel Hermenegildo]

It worked for me too: it is much better now. Thanks very much for the
tip! ---Manuel

-- 
-------------------------------------------------------------------------------
Manuel Hermenegildo                       | Prof., C.S.Dept., T.U. Madrid (UPM)
Director, IMDEA SW Institute & CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
-------------------------------------------------------------------------------

Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

Yeah, thanks. It is really a shame that emacs will run orgmode this
slow on OSX. OSX is now my platform of choice, and emacs my editor of
choice. I keep a big reference org file with tons of tons of notes,
but, even with the settings you suggested (thanks for that!) it is
still very slow. I'm considering switching my notes to evernote,
although I would really like to just stay with emacs+orgmode, but it's
just too slow as of now :(

Marcelo.

On Sun, Aug 29, 2010 at 10:02 AM, Manuel Hermenegildo <herme@fi.upm.es> wrote:
>
> It worked for me too: it is much better now. Thanks very much for the
> tip! ---Manuel
>
> --
> -------------------------------------------------------------------------------
> Manuel Hermenegildo                       | Prof., C.S.Dept., T.U. Madrid (UPM)
> Director, IMDEA SW Institute & CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
> -------------------------------------------------------------------------------
>
>

Re: Re: Org file rendering/manipulation too slow

[Nick Dokos]

Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:

> Yeah, thanks. It is really a shame that emacs will run orgmode this
> slow on OSX. OSX is now my platform of choice, and emacs my editor of
> choice. I keep a big reference org file with tons of tons of notes,
> but, even with the settings you suggested (thanks for that!) it is
> still very slow. I'm considering switching my notes to evernote,
> although I would really like to just stay with emacs+orgmode, but it's
> just too slow as of now :(
> 

Please take a profile: Just do

       M-x elp-instrument-package <RET> org <RET>

then run the slow command, then M-x elp-results and post the output to
the list. It might not be enough to solve your problem but it would at
least provide *some* information.

Thanks,
Nick

Re: Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 1062 bytes --]

Hi Nick,

The output of elp-results is attached. I have opened a big org file I
have, and navigated through the items a bit.

Thanks,

Marcelo.

On Mon, Aug 30, 2010 at 9:31 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:
> Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
>
>> Yeah, thanks. It is really a shame that emacs will run orgmode this
>> slow on OSX. OSX is now my platform of choice, and emacs my editor of
>> choice. I keep a big reference org file with tons of tons of notes,
>> but, even with the settings you suggested (thanks for that!) it is
>> still very slow. I'm considering switching my notes to evernote,
>> although I would really like to just stay with emacs+orgmode, but it's
>> just too slow as of now :(
>>
>
> Please take a profile: Just do
>
>       M-x elp-instrument-package <RET> org <RET>
>
> then run the slow command, then M-x elp-results and post the output to
> the list. It might not be enough to solve your problem but it would at
> least provide *some* information.
>
> Thanks,
> Nick
>

[-- Attachment #2: output.txt --]
[-- Type: text/plain, Size: 5199 bytes --]

org-cycle                                                     3           0.050032      0.0166773333
org-cycle-internal-local                                      3           0.04951       0.0165033333
org-optimize-window-after-visibility-change                   2           0.0380670000  0.0190335000
org-subtree-end-visible-p                                     1           0.015067      0.015067
org-self-insert-command                                       12          0.0071790000  0.00059825
org-fix-tags-on-the-fly                                       12          0.003489      0.00029075
org-end-of-subtree                                            7           0.002255      0.0003221428
org-at-table-p                                                16          0.0019060000  0.0001191250
org-on-heading-p                                              12          0.0016690000  0.0001390833
org-activate-footnote-links                                   26          0.001309      5.034...e-05
org-activate-plain-links                                      34          0.0011889999  3.497...e-05
org-align-tags-here                                           11          0.001091      9.918...e-05
org-return                                                    1           0.000976      0.000976
org-do-emphasis-faces                                         27          0.0008660000  3.207...e-05
org-activate-tags                                             45          0.0008179999  1.817...e-05
org-outline-level                                             82          0.0006119999  7.463...e-06
org-unfontify-region                                          26          0.000437      1.680...e-05
org-activate-dates                                            38          0.0004119999  1.084...e-05
org-activate-bracket-links                                    32          0.0004099999  1.281...e-05
org-cycle-show-empty-lines                                    2           0.000357      0.0001785
org-fontify-meta-lines-and-blocks                             26          0.0003260000  1.253...e-05
org-cycle-hide-archived-subtrees                              2           0.00032       0.00016
org-activate-angle-links                                      26          0.000274      1.053...e-05
org-get-level-face                                            228         0.0002529999  1.109...e-06
org-show-entry                                                1           0.000214      0.000214
org-activate-code                                             26          0.0001730000  6.653...e-06
org-back-to-heading                                           14          0.000171      1.221...e-05
org-cycle-hide-drawers                                        3           0.000152      5.066...e-05
org-get-todo-face                                             19          0.00015       7.894...e-06
org-font-lock-add-priority-faces                              26          0.0001380000  5.307...e-06
org-remove-flyspell-overlays-in                               46          0.0001209999  2.630...e-06
org-hide-block-toggle-maybe                                   3           0.0001019999  3.399...e-05
org-hide-wide-columns                                         26          9.300...e-05  3.576...e-06
org-remove-font-lock-display-properties                       26          7.800...e-05  3.000...e-06
org-at-item-p                                                 3           4.1e-05       1.366...e-05
org-babel-hide-result-toggle-maybe                            3           3.9e-05       1.3e-05
org-at-heading-p                                              4           3.8e-05       9.5e-06
org-hide-archived-subtrees                                    1           3.2e-05       3.2e-05
org-do-latex-and-special-faces                                26          3.100...e-05  1.192...e-06
org-font-lock-hook                                            26          3.100...e-05  1.192...e-06
org-cycle-level                                               3           2.7e-05       9e-06
org-fontify-entities                                          26          2.600...e-05  1.000...e-06
org-activate-target-links                                     26          2.500...e-05  9.615...e-07
org-font-lock-add-tag-faces                                   26          2.400...e-05  9.230...e-07
org-before-change-function                                    13          2.300...e-05  1.769...e-06
org-raise-scripts                                             26          2.200...e-05  8.461...e-07
org-face-from-face-or-color                                   19          1.900...e-05  1.000...e-06
org-point-at-end-of-empty-headline                            3           1.1e-05       3.666...e-06
org-cycle-item-indentation                                    3           8e-06         2.666...e-06
org-load-modules-maybe                                        3           7e-06         2.333...e-06
org-invisible-p                                               2           6e-06         3e-06
org-item-re                                                   3           4.999...e-06  1.666...e-06

[-- Attachment #3: Type: text/plain, Size: 201 bytes --]

_______________________________________________
Emacs-orgmode mailing list
Please use `Reply All' to send replies to the list.
Emacs-orgmode@gnu.org
http://lists.gnu.org/mailman/listinfo/emacs-orgmode

Re: Re: Org file rendering/manipulation too slow

[Nick Dokos]

Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:

> Hi Nick,
> 
> The output of elp-results is attached. I have opened a big org file I
> have, and navigated through the items a bit.
> 
> Thanks,
> 
> Marcelo.
> 
> On Mon, Aug 30, 2010 at 9:31 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:
> > Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
> >
> >> Yeah, thanks. It is really a shame that emacs will run orgmode this
> >> slow on OSX. OSX is now my platform of choice, and emacs my editor of
> >> choice. I keep a big reference org file with tons of tons of notes,
> >> but, even with the settings you suggested (thanks for that!) it is
> >> still very slow. I'm considering switching my notes to evernote,
> >> although I would really like to just stay with emacs+orgmode, but it's
> >> just too slow as of now :(
> >>
> >
> > Please take a profile: Just do
> >
> >       M-x elp-instrument-package <RET> org <RET>
> >
> > then run the slow command, then M-x elp-results and post the output to
> > the list. It might not be enough to solve your problem but it would at
> > least provide *some* information.
> >
> > Thanks,
> > Nick
> >

OK - thanks for doing that. Given the stats:

,----
| org-cycle                                                     3           0.050032      0.0166773333
| org-cycle-internal-local                                      3           0.04951       0.0165033333
| org-optimize-window-after-visibility-change                   2           0.0380670000  0.0190335000
| ...
`----

it seems clear that org-mode is not the culprit and, at 0.05s, any
improvements made there are going to be completely swamped by the real
time sink (maybe the display code if I understand things correctly.)
Also, presumably you are not complaining about the 50ms delay: that
would be almost unnoticeable. How long does it take for emacs to show
you the file?

Some questions:

How much memory do you have on your system? How much memory does emacs
consume? Is your disk active when emacs is taking forever?

On linux, I get the first with

         sed 1q /proc/meminfo

and the second with

         ps awlx | grep emacs

and look at the RSS field (field 8 in the output); e.g.

,----
| $ ps awlx | grep emacs
| 0  9772 11777     1  20   0  51284 32660 -      R    ?          1:02 /usr/local/bin/emacs
`----

shows me that emacs is consuming roughly 32Mb. I have 1Gb of memory on
the machine, so that's a comfortable fit (about 1/30 of available
memory: leaves just enough space for X and firefox :-) ). If your
numbers are closer, then maybe that's a problem: in particular, if your
disk goes wild while emacs is trying to do its thing, you are probably
swapping heavily and your performance will *really* be in the
toilet. The only solution is to buy more memory (assuming your machine
can handle it.)

I should say that I know very little about Darwin, so all of the above
is pure speculation. Parts of it may be applicable: you'd need to check
with an OSX expert for more details.

If there are no problems of the sort described above, I would ask in an
emacs forum about the performance of the display engine on Darwin: do
other people see the slowness? It would show up even without org
(although org make the situation marginally worse to be sure.)  Given
the font-lock setting that Bernt dug up, it seems likely that if memory
is not the problem, the display engine is.

HTH,
Nick

Re: Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

HI Nicholas, thanks for the reply,

>How long does it take for emacs to show
>you the file?

From the moment I press <enter> on the minibuffer to the moment the
whole file is rendered, it takes about 3 seconds. So, it does take
longer than I would expect.

I have a 10-months old Macbook, and its specs are quite recent, check
out (from System Profiler):

  Model Name:	MacBook
  Model Identifier:	MacBook6,1
  Processor Name:	Intel Core 2 Duo
  Processor Speed:	2.26 GHz
  Number Of Processors:	1
  Total Number Of Cores:	2
  L2 Cache:	3 MB
  Memory:	4 GB
  Bus Speed:	1.07 GHz
  Boot ROM Version:	MB61.00C8.B00
  SMC Version (system):	1.51f53
  Serial Number (system):	W89483Q78PX
  Hardware UUID:	413C6EF2-12B3-5C38-A3CA-5A1F924867D7
  Sudden Motion Sensor:
  State:	Enabled

So, the system is quite capable and is definetly should not be the bottleneck.

What I note though is that when I open this big org file and try to
naviagate around, the Emacs.app CPU usage goes up to 100% and then
gradually goes down to 0 as I stop giving any other commands. Check
out the screenshot below:

http://i56.tinypic.com/123sbcj.png

When I run "ps awlx | grep emacs", I get the following output:

 >501  5733  5578   0  31  0  2425520    168 -      R+   s000
0:00.00 grep emacs

Some additional information:

Emacs version string:

>GNU Emacs 23.2.1 (x86_64-apple-darwin, NS apple-appkit-1038.29) of 2010-05-08 on black.local

Org-mode version string:

>Org-mode version 7.01trans (release_7.01g.20.gdd484.dirty)

It is really unfortunate that org-mode runs like this on OSX. I can't
really think of anything else I could use to manage my personal
information and todo lists, but handling big orgfiles, as of now, is
really starting to be a blocker :-(

Thanks for the help,

Marcelo.


On Sun, Sep 5, 2010 at 9:07 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:
> Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
>
>> Hi Nick,
>>
>> The output of elp-results is attached. I have opened a big org file I
>> have, and navigated through the items a bit.
>>
>> Thanks,
>>
>> Marcelo.
>>
>> On Mon, Aug 30, 2010 at 9:31 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:
>> > Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
>> >
>> >> Yeah, thanks. It is really a shame that emacs will run orgmode this
>> >> slow on OSX. OSX is now my platform of choice, and emacs my editor of
>> >> choice. I keep a big reference org file with tons of tons of notes,
>> >> but, even with the settings you suggested (thanks for that!) it is
>> >> still very slow. I'm considering switching my notes to evernote,
>> >> although I would really like to just stay with emacs+orgmode, but it's
>> >> just too slow as of now :(
>> >>
>> >
>> > Please take a profile: Just do
>> >
>> >       M-x elp-instrument-package <RET> org <RET>
>> >
>> > then run the slow command, then M-x elp-results and post the output to
>> > the list. It might not be enough to solve your problem but it would at
>> > least provide *some* information.
>> >
>> > Thanks,
>> > Nick
>> >
>
> OK - thanks for doing that. Given the stats:
>
> ,----
> | org-cycle                                                     3           0.050032      0.0166773333
> | org-cycle-internal-local                                      3           0.04951       0.0165033333
> | org-optimize-window-after-visibility-change                   2           0.0380670000  0.0190335000
> | ...
> `----
>
> it seems clear that org-mode is not the culprit and, at 0.05s, any
> improvements made there are going to be completely swamped by the real
> time sink (maybe the display code if I understand things correctly.)
> Also, presumably you are not complaining about the 50ms delay: that
> would be almost unnoticeable. How long does it take for emacs to show
> you the file?
>
> Some questions:
>
> How much memory do you have on your system? How much memory does emacs
> consume? Is your disk active when emacs is taking forever?
>
> On linux, I get the first with
>
>         sed 1q /proc/meminfo
>
> and the second with
>
>         ps awlx | grep emacs
>
> and look at the RSS field (field 8 in the output); e.g.
>
> ,----
> | $ ps awlx | grep emacs
> | 0  9772 11777     1  20   0  51284 32660 -      R    ?          1:02 /usr/local/bin/emacs
> `----
>
> shows me that emacs is consuming roughly 32Mb. I have 1Gb of memory on
> the machine, so that's a comfortable fit (about 1/30 of available
> memory: leaves just enough space for X and firefox :-) ). If your
> numbers are closer, then maybe that's a problem: in particular, if your
> disk goes wild while emacs is trying to do its thing, you are probably
> swapping heavily and your performance will *really* be in the
> toilet. The only solution is to buy more memory (assuming your machine
> can handle it.)
>
> I should say that I know very little about Darwin, so all of the above
> is pure speculation. Parts of it may be applicable: you'd need to check
> with an OSX expert for more details.
>
> If there are no problems of the sort described above, I would ask in an
> emacs forum about the performance of the display engine on Darwin: do
> other people see the slowness? It would show up even without org
> (although org make the situation marginally worse to be sure.)  Given
> the font-lock setting that Bernt dug up, it seems likely that if memory
> is not the problem, the display engine is.
>
> HTH,
> Nick
>
>
>

Re: Re: Org file rendering/manipulation too slow

[Nick Dokos]

Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:

> HI Nicholas, thanks for the reply,
> 
> >How long does it take for emacs to show
> >you the file?
> 
> From the moment I press <enter> on the minibuffer to the moment the
> whole file is rendered, it takes about 3 seconds. So, it does take
> longer than I would expect.
> 
> I have a 10-months old Macbook, and its specs are quite recent, check
> out (from System Profiler):
> 
>   Model Name:	MacBook
>   Model Identifier:	MacBook6,1
>   Processor Name:	Intel Core 2 Duo
>   Processor Speed:	2.26 GHz
>   Number Of Processors:	1
>   Total Number Of Cores:	2
>   L2 Cache:	3 MB
>   Memory:	4 GB
>   Bus Speed:	1.07 GHz
>   Boot ROM Version:	MB61.00C8.B00
>   SMC Version (system):	1.51f53
>   Serial Number (system):	W89483Q78PX
>   Hardware UUID:	413C6EF2-12B3-5C38-A3CA-5A1F924867D7
>   Sudden Motion Sensor:
>   State:	Enabled
> 
> So, the system is quite capable and is definetly should not be the bottleneck.
> 

It depends of course on what *else* you are running, but prima facie,
swapping doesn't look to be the problem. Nevertheless, is a disk going
wild while you are opening the file?

> What I note though is that when I open this big org file and try to
> naviagate around, the Emacs.app CPU usage goes up to 100% and then
> gradually goes down to 0 as I stop giving any other commands. Check
> out the screenshot below:
> 
> http://i56.tinypic.com/123sbcj.png
> 

Does this happen when you open *any* large file or only when you open
the org file (and iirc, it was not a very big file: smaller than 1Mb?)

> When I run "ps awlx | grep emacs", I get the following output:
> 
>  >501  5733  5578   0  31  0  2425520    168 -      R+   s000
> 0:00.00 grep emacs
> 

This is the wrong process: this is the line for the "grep emacs"
command, not for emacs itself. Maybe try "grep Emacs"? I don't know
what the emacs command name is on OSX.

> ...
> It is really unfortunate that org-mode runs like this on OSX. I can't
> really think of anything else I could use to manage my personal
> information and todo lists, but handling big orgfiles, as of now, is
> really starting to be a blocker :-(
> 

But is it org mode that runs like this? or something else? The elp stats
showed that org-mode was pretty much in the noise.

Nick

Re: Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

>It depends of course on what *else* you are running, but prima facie,
>swapping doesn't look to be the problem. Nevertheless, is a disk going
>wild while you are opening the file?

No. CPU is going wild, though.

>This is the wrong process: this is the line for the "grep emacs"
>command, not for emacs itself. Maybe try "grep Emacs"? I don't know
>what the emacs command name is on OSX.

Sorry about that. Here it is:

>501  6163   213   0  48  0  2858968  46920 -      S      ??    0:04.30 /Applications/Emacs.app/Contents/MacOS/Emacs -psn_0_782527

>But is it org mode that runs like this? or something else? The elp stats
>showed that org-mode was pretty much in the noise.

>Does this happen when you open *any* large file or only when you open
>the org file (and iirc, it was not a very big file: smaller than 1Mb?)

Seems so. For example, if I open the same org file without orgmode
activated, it renders pretty fast, without any apparent issues. I also
have some big ruby script files which don't have any rendering
performance issues whatsoever.

I might have to reinstall emacs and configure things from scratch to
try to isolate the issue.

Thanks!

Marcelo.





On Sun, Sep 5, 2010 at 11:08 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:
> Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
>
>> HI Nicholas, thanks for the reply,
>>
>> >How long does it take for emacs to show
>> >you the file?
>>
>> From the moment I press <enter> on the minibuffer to the moment the
>> whole file is rendered, it takes about 3 seconds. So, it does take
>> longer than I would expect.
>>
>> I have a 10-months old Macbook, and its specs are quite recent, check
>> out (from System Profiler):
>>
>>   Model Name: MacBook
>>   Model Identifier:   MacBook6,1
>>   Processor Name:     Intel Core 2 Duo
>>   Processor Speed:    2.26 GHz
>>   Number Of Processors:       1
>>   Total Number Of Cores:      2
>>   L2 Cache:   3 MB
>>   Memory:     4 GB
>>   Bus Speed:  1.07 GHz
>>   Boot ROM Version:   MB61.00C8.B00
>>   SMC Version (system):       1.51f53
>>   Serial Number (system):     W89483Q78PX
>>   Hardware UUID:      413C6EF2-12B3-5C38-A3CA-5A1F924867D7
>>   Sudden Motion Sensor:
>>   State:      Enabled
>>
>> So, the system is quite capable and is definetly should not be the bottleneck.
>>
>
> It depends of course on what *else* you are running, but prima facie,
> swapping doesn't look to be the problem. Nevertheless, is a disk going
> wild while you are opening the file?
>
>> What I note though is that when I open this big org file and try to
>> naviagate around, the Emacs.app CPU usage goes up to 100% and then
>> gradually goes down to 0 as I stop giving any other commands. Check
>> out the screenshot below:
>>
>> http://i56.tinypic.com/123sbcj.png
>>
>
> Does this happen when you open *any* large file or only when you open
> the org file (and iirc, it was not a very big file: smaller than 1Mb?)
>
>> When I run "ps awlx | grep emacs", I get the following output:
>>
>>  >501  5733  5578   0  31  0  2425520    168 -      R+   s000
>> 0:00.00 grep emacs
>>
>
> This is the wrong process: this is the line for the "grep emacs"
> command, not for emacs itself. Maybe try "grep Emacs"? I don't know
> what the emacs command name is on OSX.
>
>> ...
>> It is really unfortunate that org-mode runs like this on OSX. I can't
>> really think of anything else I could use to manage my personal
>> information and todo lists, but handling big orgfiles, as of now, is
>> really starting to be a blocker :-(
>>
>
> But is it org mode that runs like this? or something else? The elp stats
> showed that org-mode was pretty much in the noise.
>
> Nick
>

Re: Re: Org file rendering/manipulation too slow

[Marcelo de Moraes Serpa]

So, I just found out something interesting. I told emacs not to load
my init.el file (i.e vanilla emacs). I then opened the same "big"
orgmode file and it rendered pretty quickly! Also, navigating through
the file and sending other org commands happens instantly. It is
probably some configuration that I have throughout my big suite of el
files. I will try to isolate it tomorrow and share the veredict with
you guys.

Marcelo.

On Sun, Sep 5, 2010 at 11:19 PM, Marcelo de Moraes Serpa
<celoserpa@gmail.com> wrote:
>>It depends of course on what *else* you are running, but prima facie,
>>swapping doesn't look to be the problem. Nevertheless, is a disk going
>>wild while you are opening the file?
>
> No. CPU is going wild, though.
>
>>This is the wrong process: this is the line for the "grep emacs"
>>command, not for emacs itself. Maybe try "grep Emacs"? I don't know
>>what the emacs command name is on OSX.
>
> Sorry about that. Here it is:
>
>>501  6163   213   0  48  0  2858968  46920 -      S      ??    0:04.30 /Applications/Emacs.app/Contents/MacOS/Emacs -psn_0_782527
>
>>But is it org mode that runs like this? or something else? The elp stats
>>showed that org-mode was pretty much in the noise.
>
>>Does this happen when you open *any* large file or only when you open
>>the org file (and iirc, it was not a very big file: smaller than 1Mb?)
>
> Seems so. For example, if I open the same org file without orgmode
> activated, it renders pretty fast, without any apparent issues. I also
> have some big ruby script files which don't have any rendering
> performance issues whatsoever.
>
> I might have to reinstall emacs and configure things from scratch to
> try to isolate the issue.
>
> Thanks!
>
> Marcelo.
>
>
>
>
>
> On Sun, Sep 5, 2010 at 11:08 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:
>> Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
>>
>>> HI Nicholas, thanks for the reply,
>>>
>>> >How long does it take for emacs to show
>>> >you the file?
>>>
>>> From the moment I press <enter> on the minibuffer to the moment the
>>> whole file is rendered, it takes about 3 seconds. So, it does take
>>> longer than I would expect.
>>>
>>> I have a 10-months old Macbook, and its specs are quite recent, check
>>> out (from System Profiler):
>>>
>>>   Model Name: MacBook
>>>   Model Identifier:   MacBook6,1
>>>   Processor Name:     Intel Core 2 Duo
>>>   Processor Speed:    2.26 GHz
>>>   Number Of Processors:       1
>>>   Total Number Of Cores:      2
>>>   L2 Cache:   3 MB
>>>   Memory:     4 GB
>>>   Bus Speed:  1.07 GHz
>>>   Boot ROM Version:   MB61.00C8.B00
>>>   SMC Version (system):       1.51f53
>>>   Serial Number (system):     W89483Q78PX
>>>   Hardware UUID:      413C6EF2-12B3-5C38-A3CA-5A1F924867D7
>>>   Sudden Motion Sensor:
>>>   State:      Enabled
>>>
>>> So, the system is quite capable and is definetly should not be the bottleneck.
>>>
>>
>> It depends of course on what *else* you are running, but prima facie,
>> swapping doesn't look to be the problem. Nevertheless, is a disk going
>> wild while you are opening the file?
>>
>>> What I note though is that when I open this big org file and try to
>>> naviagate around, the Emacs.app CPU usage goes up to 100% and then
>>> gradually goes down to 0 as I stop giving any other commands. Check
>>> out the screenshot below:
>>>
>>> http://i56.tinypic.com/123sbcj.png
>>>
>>
>> Does this happen when you open *any* large file or only when you open
>> the org file (and iirc, it was not a very big file: smaller than 1Mb?)
>>
>>> When I run "ps awlx | grep emacs", I get the following output:
>>>
>>>  >501  5733  5578   0  31  0  2425520    168 -      R+   s000
>>> 0:00.00 grep emacs
>>>
>>
>> This is the wrong process: this is the line for the "grep emacs"
>> command, not for emacs itself. Maybe try "grep Emacs"? I don't know
>> what the emacs command name is on OSX.
>>
>>> ...
>>> It is really unfortunate that org-mode runs like this on OSX. I can't
>>> really think of anything else I could use to manage my personal
>>> information and todo lists, but handling big orgfiles, as of now, is
>>> really starting to be a blocker :-(
>>>
>>
>> But is it org mode that runs like this? or something else? The elp stats
>> showed that org-mode was pretty much in the noise.
>>
>> Nick
>>
>

Re: Re: Org file rendering/manipulation too slow

[Manuel Hermenegildo]

I am also under the impression that it is something to do with the
screen rendering or font lock (the fact that setting font-lock-verbose
to nil speeds up things quite a bit points in this direction).

 > Seems so. For example, if I open the same org file without orgmode
 > activated, it renders pretty fast, without any apparent issues. I also
 > have some big ruby script files which don't have any rendering
 > performance issues whatsoever.

Interesting! 

 > I might have to reinstall emacs and configure things from scratch to
 > try to isolate the issue.

Look forward to the results! 

Manuel 

-- 
-------------------------------------------------------------------------------
Manuel Hermenegildo                       | Prof., C.S.Dept., T.U. Madrid (UPM)
Director, IMDEA SW Institute & CLIP Group | +34-91-336-7435 (W) -352-4819 (Fax)
-------------------------------------------------------------------------------

Re: Org file rendering/manipulation too slow

[Achim Gratz]

Marcelo de Moraes Serpa <celoserpa@gmail.com> writes:

> From the moment I press <enter> on the minibuffer to the moment the
> whole file is rendered, it takes about 3 seconds. So, it does take
> longer than I would expect.

Wild-ass guess: EMACS asks for all the fonts to be rendered that you are
using in this file... if so, opening the file a second time in the same
session should be a lot faster unless something is badly misconfigured.


Achim.

[OT] Encoding error when calling a ruby script from Emacs using shell-command

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 1686 bytes --]

Hey list,

I've tried posting on help-gnu-emacs mailing list first, but not luck so
far, so I thought I'd try here, as I know there are many savvy emacs users
around.

I have a small Ruby CLI program that I want to call from emacs. This script
simply opens an emacs orgmode file from a specific location in my hard
drive, and does some text processing. When I call it from the terminal
directly, it works fine. When I call it from emacs, the script fails with
an encoding error.

I'm using this elisp to call it from emacs after a buffer is saved:

(defun test ()
>   (let ((universal-coding-system-argument 'utf-8-unix))
>         (shell-command  "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do
> /usr/bin/myrubyscript")
>     ))
> (add-hook 'after-save-hook 'test)



NOTE: The (let ((universal-coding-system-argument 'utf-8-unix)) was an
attempt to fix it, but it made no difference whatsoever.

After I save a buffer, the shell-command function is fired, but I get the
following output in the "*Shell Command Output*" buffer:

F, [2012-08-30T01:59:18.688827 #94004] FATAL -- : invalid byte sequence in
> US-ASCII (ArgumentError)
> /Users/myself/.rvm/gems/ruby-1.9.3-p194/gems/org-ruby-0.6.3/lib/org-ruby/parser.rb:89:in
> `split'
> /Users/myself/.rvm/gems/ruby-1.9.3-p194/gems/org-ruby-0.6.3/lib/org-ruby/parser.rb:89:in
> `initia


The strange thing is that the file that this script opens *is* accessible,
and is the same file it would open if it were fired up from the terminal.
For some reason, Emacs is getting in the way, but I have no idea what that
could be. Am I missing something? If someone could enlighten me here, I'd
be really grateful!

Thanks in advance,

- Marcelo.

[-- Attachment #2: Type: text/html, Size: 4186 bytes --]

Re: [OT] Encoding error when calling a ruby script from Emacs using shell-command

[Nick Dokos]

Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:

> Hey list,
> 
> I've tried posting on help-gnu-emacs mailing list first, but not luck so far, so I thought I'd try here, as I know there are many savvy emacs users around.
> 
> I have a small Ruby CLI program that I want to call from emacs. This script simply opens an emacs orgmode file from a specific location in my hard drive, and does some text processing. When I call it from the terminal directly, it works fine. When I call it from emacs, the
> script fails with an encoding error.
> 
> I'm using this elisp to call it from emacs after a buffer is saved:
> 
>     (defun test ()
>       (let ((universal-coding-system-argument 'utf-8-unix))
>             (shell-command  "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do /usr/bin/myrubyscript")
>         ))
>     (add-hook 'after-save-hook 'test)
> 
> NOTE: The (let ((universal-coding-system-argument 'utf-8-unix)) was an attempt to fix it, but it made no difference whatsoever.
> 

Probably wrong, but who knows? it may work by some miracle:

(let ((coding-system-for-read 'utf-8-unix)
      (coding-system-for-write 'utf-8-unix))
  (shell-command "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do /usr/bin/myrubyscript")


> After I save a buffer, the shell-command function is fired, but I get the following output in the "*Shell Command Output*" buffer:
> 
>     F, [2012-08-30T01:59:18.688827 #94004] FATAL -- : invalid byte sequence in US-ASCII (ArgumentError)
>     /Users/myself/.rvm/gems/ruby-1.9.3-p194/gems/org-ruby-0.6.3/lib/org-ruby/parser.rb:89:in `split'
>     /Users/myself/.rvm/gems/ruby-1.9.3-p194/gems/org-ruby-0.6.3/lib/org-ruby/parser.rb:89:in `initia
> 

But this looks like ruby is expecting ASCII and is getting something else (probably UTF-8).
What does the output of the command, when executed from a terminal, look like? Redirect it into
a file and then use od to look at bytes.

Also, you can try adding an output buffer as argument to the shell-command and then eyeballing the
output in that buffer to see if it matches the terminal output.

Nick

> The strange thing is that the file that this script opens *is* accessible, and is the same file it would open if it were fired up from the terminal. For some reason, Emacs is getting in the way, but I have no idea what that could be. Am I missing something? If someone could
> enlighten me here, I'd be really grateful!
> 
> Thanks in advance,
> 
> - Marcelo.
> 
> 
> ----------------------------------------------------
> Alternatives:
> 
> ----------------------------------------------------

Re: [OT] Encoding error when calling a ruby script from Emacs using shell-command

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 3420 bytes --]

Alright, I solved it.

The problem is that emacs' shell-command doesn't use the same environment,
so it wasn't picking up the value of those three vars:

✗ export | grep UTF
    LANG=en_US.UTF-8
    LC_ALL=en_US.UTF-8
    LC_CTYPE=en_US.UTF-8

So, I did this:

(defun test ()
  (setenv "LANG" "en_US.UTF-8")
  (setenv "LC_ALL" "en_US.UTF-8")
  (setenv "LC_CTYPE" "en_US.UTF-8")
        (shell-command  "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do
/usr/bin/rubyscript")
        )

And now it works fine.

Cheers,

- Marcelo.




On Fri, Aug 31, 2012 at 2:51 PM, Nick Dokos <nicholas.dokos@hp.com> wrote:

> Marcelo de Moraes Serpa <celoserpa@gmail.com> wrote:
>
> > Hey list,
> >
> > I've tried posting on help-gnu-emacs mailing list first, but not luck so
> far, so I thought I'd try here, as I know there are many savvy emacs users
> around.
> >
> > I have a small Ruby CLI program that I want to call from emacs. This
> script simply opens an emacs orgmode file from a specific location in my
> hard drive, and does some text processing. When I call it from the terminal
> directly, it works fine. When I call it from emacs, the
> > script fails with an encoding error.
> >
> > I'm using this elisp to call it from emacs after a buffer is saved:
> >
> >     (defun test ()
> >       (let ((universal-coding-system-argument 'utf-8-unix))
> >             (shell-command  "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194
> do /usr/bin/myrubyscript")
> >         ))
> >     (add-hook 'after-save-hook 'test)
> >
> > NOTE: The (let ((universal-coding-system-argument 'utf-8-unix)) was an
> attempt to fix it, but it made no difference whatsoever.
> >
>
> Probably wrong, but who knows? it may work by some miracle:
>
> (let ((coding-system-for-read 'utf-8-unix)
>       (coding-system-for-write 'utf-8-unix))
>   (shell-command "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do
> /usr/bin/myrubyscript")
>
>
> > After I save a buffer, the shell-command function is fired, but I get
> the following output in the "*Shell Command Output*" buffer:
> >
> >     F, [2012-08-30T01:59:18.688827 #94004] FATAL -- : invalid byte
> sequence in US-ASCII (ArgumentError)
> >
> /Users/myself/.rvm/gems/ruby-1.9.3-p194/gems/org-ruby-0.6.3/lib/org-ruby/parser.rb:89:in
> `split'
> >
> /Users/myself/.rvm/gems/ruby-1.9.3-p194/gems/org-ruby-0.6.3/lib/org-ruby/parser.rb:89:in
> `initia
> >
>
> But this looks like ruby is expecting ASCII and is getting something else
> (probably UTF-8).
> What does the output of the command, when executed from a terminal, look
> like? Redirect it into
> a file and then use od to look at bytes.
>
> Also, you can try adding an output buffer as argument to the shell-command
> and then eyeballing the
> output in that buffer to see if it matches the terminal output.
>
> Nick
>
> > The strange thing is that the file that this script opens *is*
> accessible, and is the same file it would open if it were fired up from the
> terminal. For some reason, Emacs is getting in the way, but I have no idea
> what that could be. Am I missing something? If someone could
> > enlighten me here, I'd be really grateful!
> >
> > Thanks in advance,
> >
> > - Marcelo.
> >
> >
> > ----------------------------------------------------
> > Alternatives:
> >
> > ----------------------------------------------------
>

[-- Attachment #2: Type: text/html, Size: 4469 bytes --]

Re: [OT] Encoding error when calling a ruby script from Emacs using shell-command

[Achim Gratz]

Marcelo de Moraes Serpa writes:
> So, I did this:
>
> (defun test ()
>   (setenv "LANG" "en_US.UTF-8")
>   (setenv "LC_ALL" "en_US.UTF-8")
>   (setenv "LC_CTYPE" "en_US.UTF-8")
>         (shell-command  "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do
> /usr/bin/rubyscript")
>         )

This is nonsense, may I suggest you read locale (1p)?  If you set
LC_ALL, this overrides the other two settings no matter what they are
set to (and you may prevent some scripts trying to set LC_COLLATE or
something like that from functioning correctly).  Unless you really need
such a big hammer, set LANG (this provides the default) and leave it at
that.


Regards,
Achim.
-- 
+<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+

Factory and User Sound Singles for Waldorf Q+, Q and microQ:
http://Synth.Stromeko.net/Downloads.html#WaldorfSounds

Re: [OT] Encoding error when calling a ruby script from Emacs using shell-command

[Nick Dokos]

Achim Gratz <Stromeko@nexgo.de> wrote:

> Marcelo de Moraes Serpa writes:
> > So, I did this:
> >
> > (defun test ()
> >  (setenv "LANG" "en_US.UTF-8")
> >  (setenv "LC_ALL" "en_US.UTF-8")
> >  (setenv "LC_CTYPE" "en_US.UTF-8")
> >  (shell-command "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do
> > /usr/bin/rubyscript"))
> 
> This is nonsense, may I suggest you read locale (1p)?  If you set
> LC_ALL, this overrides the other two settings no matter what they are
> set to (and you may prevent some scripts trying to set LC_COLLATE or
> something like that from functioning correctly).  Unless you really need
> such a big hammer, set LANG (this provides the default) and leave it at
> that.
> 

I don't understand why such a hammer is needed at all: if LANG (or
LC_ALL) is set in a login shell[fn:1] and exported, then all child
processes (including emacs and including any shells that emacs spawns)
will inherit the setting. So if setting it as above with setenv
(i.e. modifying the emacs environment and therefore the processes that
emacs spawns) makes a difference, that suggests that it is not set
globally. I doubt that that is a good idea in general. Even if you want
it just in the case of emacs, it's probably better to do the setenv
first thing in .emacs.

And in that case, how/why does it work from a terminal?

Nick

Footnotes:

[fn:1] Or some equivalent way for a graphical login.

Re: [OT] Encoding error when calling a ruby script from Emacs using shell-command

[Marcelo de Moraes Serpa]

[-- Attachment #1: Type: text/plain, Size: 2716 bytes --]

>
> This is nonsense, may I suggest you read locale (1p)?  If you set
> LC_ALL, this overrides the other two settings no matter what they are
> set to (and you may prevent some scripts trying to set LC_COLLATE or
> something like that from functioning correctly).  Unless you really need
> such a big hammer, set LANG (this provides the default) and leave it at
> that.


I had no idea it worked like that. Thanks for the heads up.

I don't understand why such a hammer is needed at all


It was a simple labor of trial and error. I didn't want to spend more time
on it, and since it worked, I left it as is, for now.

And in that case, how/why does it work from a terminal?


It works fine from the terminal (iTerm/zshell), and after I used setenv
before the (shell-command), it worked just like it does from when ran from
the terminal.

I might get into it and try to figure out why emacs is not inheriting the
setting from the shell (I'm using zshell on Mac OSX Lion, and emacs is
"(GNU Emacs 23.4.1 (x86_64-apple-darwin, NS apple-appkit-1038.36) of
2012-01-29 on bob.porkrind.org)". But for now, I'll leave it as is, since
it's working as expected.

Thanks!

- Marcelo.

On Sat, Sep 1, 2012 at 8:53 AM, Nick Dokos <nicholas.dokos@hp.com> wrote:

> Achim Gratz <Stromeko@nexgo.de> wrote:
>
> > Marcelo de Moraes Serpa writes:
> > > So, I did this:
> > >
> > > (defun test ()
> > >  (setenv "LANG" "en_US.UTF-8")
> > >  (setenv "LC_ALL" "en_US.UTF-8")
> > >  (setenv "LC_CTYPE" "en_US.UTF-8")
> > >  (shell-command "/Users/myself/.rvm/bin/rvm ruby-1.9.3-p194 do
> > > /usr/bin/rubyscript"))
> >
> > This is nonsense, may I suggest you read locale (1p)?  If you set
> > LC_ALL, this overrides the other two settings no matter what they are
> > set to (and you may prevent some scripts trying to set LC_COLLATE or
> > something like that from functioning correctly).  Unless you really need
> > such a big hammer, set LANG (this provides the default) and leave it at
> > that.
> >
>
> I don't understand why such a hammer is needed at all: if LANG (or
> LC_ALL) is set in a login shell[fn:1] and exported, then all child
> processes (including emacs and including any shells that emacs spawns)
> will inherit the setting. So if setting it as above with setenv
> (i.e. modifying the emacs environment and therefore the processes that
> emacs spawns) makes a difference, that suggests that it is not set
> globally. I doubt that that is a good idea in general. Even if you want
> it just in the case of emacs, it's probably better to do the setenv
> first thing in .emacs.
>
> And in that case, how/why does it work from a terminal?
>
> Nick
>
> Footnotes:
>
> [fn:1] Or some equivalent way for a graphical login.
>
>

[-- Attachment #2: Type: text/html, Size: 5164 bytes --]