org-icalendar export problems

org-icalendar export problems

[ypuntot]

[-- Attachment #1: Type: text/plain, Size: 3333 bytes --]

I am trying to create an android calendar based on the agenda, and the first problem I am finding it's that I can't import it into android (ICSx^5). I am receiving these errors when trying to do it:

Couldn't parse iCalendar  at.bitfire.ical4android.InvalidCalendarException: Couldn't parse iCalendar at at.bitfire.ical4android.ICalendar$Companion.fromReader(ICalendar.kt:91) at at.bitfire.ical4android.Event$Companion.eventsFromReader(Event.kt:79) at at.bitfire.icsdroid.ui.AddCalendarValidationFragment$ValidationModel$validate$downloader$1.onSuccess(AddCalendarValidationFragment.kt:126) at at.bitfire.icsdroid.CalendarFetcher.fetchLocal$icsx5_72_2_1_1_standardRelease(CalendarFetcher.kt:115) at at.bitfire.icsdroid.CalendarFetcher.fetch(CalendarFetcher.kt:49) at at.bitfire.icsdroid.ui.AddCalendarValidationFragment$ValidationModel.validate(AddCalendarValidationFragment.kt:168) at at.bitfire.icsdroid.ui.AddCalendarValidationFragment$ValidationModel.access$validate(AddCalendarValidationFragment.kt:103) at at.bitfire.icsdroid.ui.AddCalendarValidationFragment$ValidationModel$4.invokeSuspend(AddCalendarValidationFragment.kt:114) at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33) at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106) at kotlinx.coroutines.scheduling.CoroutineScheduler.runSafely(CoroutineScheduler.kt:570) at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.executeTask(CoroutineScheduler.kt:750) at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.runWorker(CoroutineScheduler.kt:677) at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.run(CoroutineScheduler.kt:664) Caused by: net.fortuna.ical4j.data.ParserException: Error at line 1.893:Expected [61], read [10] at net.fortuna.ical4j.data.CalendarParserImpl.assertToken(CalendarParserImpl.java:486) at net.fortuna.ical4j.data.CalendarParserImpl.access$700(CalendarParserImpl.java:56) at net.fortuna.ical4j.data.CalendarParserImpl$ParameterParser.parse(CalendarParserImpl.java:357) at net.fortuna.ical4j.data.CalendarParserImpl$ParameterParser.access$2000(CalendarParserImpl.java:335) at net.fortuna.ical4j.data.CalendarParserImpl$ParameterListParser.parse(CalendarParserImpl.java:330) at net.fortuna.ical4j.data.CalendarParserImpl$PropertyParser.parse(CalendarParserImpl.java:266) at net.fortuna.ical4j.data.CalendarParserImpl$PropertyParser.access$1100(CalendarParserImpl.java:241) at net.fortuna.ical4j.data.CalendarParserImpl$PropertyListParser.parse(CalendarParserImpl.java:226) at net.fortuna.ical4j.data.CalendarParserImpl$ComponentParser.parse(CalendarParserImpl.java:446) at net.fortuna.ical4j.data.CalendarParserImpl$ComponentParser.access$900(CalendarParserImpl.java:422) at net.fortuna.ical4j.data.CalendarParserImpl$PropertyListParser.parse(CalendarParserImpl.java:224) at net.fortuna.ical4j.data.CalendarParserImpl.parseCalendar(CalendarParserImpl.java:128) at net.fortuna.ical4j.data.CalendarParserImpl.parseCalendarList(CalendarParserImpl.java:194) at net.fortuna.ical4j.data.CalendarParserImpl.parse(CalendarParserImpl.java:163) at net.fortuna.ical4j.data.CalendarBuilder.build(CalendarBuilder.java:197) at net.fortuna.ical4j.data.CalendarBuilder.build(CalendarBuilder.java:185) at at.bitfire.ical4android.ICalendar$Companion.fromReader(ICalendar.kt:89) ... 13 more

[-- Attachment #2: Type: text/html, Size: 3665 bytes --]

Re: org-icalendar export problems

[Ihor Radchenko]

CCing ox-icalendar maintainer.

ypuntot <ypuntot@gmail.com> writes:

> I am trying to create an android calendar based on the agenda, and the first problem I am finding it's that I can't import it into android (ICSx^5). I am receiving these errors when trying to do it:
>
> Couldn't parse iCalendar ...

May you be able to share the problematic icalendar file?

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: org-icalendar export problems

[Jack Kamm]

Ihor Radchenko <yantar92@posteo.net> writes:

> CCing ox-icalendar maintainer.
>
> ypuntot <ypuntot@gmail.com> writes:
>
>> I am trying to create an android calendar based on the agenda, and the first problem I am finding it's that I can't import it into android (ICSx^5). I am receiving these errors when trying to do it:
>>
>> Couldn't parse iCalendar ...
>
> May you be able to share the problematic icalendar file?

If you're not comfortable sharing the icalendar file on a public mail
list, you could also try out the iCalendar validator, which may help to
identify the issue with the ics file:

https://icalendar.org/validator.html

FWIW, I did try out ICSx5 with the exported ics from a simple Org file,
and it worked. So we'll need more specific information to fix the
problem.

Re: org-icalendar export problems

[ypuntot]

The validator says as follows:

Results
File Size: 19544 lines, 434248 bytes
Number of events found: 103
Number of to-do's found: 541
Problem! Found 10 warnings

Warnings
Blank line detected, specification does not address the use of blank lines near line # 9
Blank line detected, specification does not address the use of blank lines near line # 11
Blank line detected, specification does not address the use of blank lines near line # 13
Blank line detected, specification does not address the use of blank lines near line # 15
Blank line detected, specification does not address the use of blank lines near line # 17
Blank line detected, specification does not address the use of blank lines near line # 19
Blank line detected, specification does not address the use of blank lines near line # 21
Blank line detected, specification does not address the use of blank lines near line # 23
Blank line detected, specification does not address the use of blank lines near line # 26
Blank line detected, specification does not address the use of blank lines near line # 28

Problem! Found 1 error

Errors
Lines not delimited by CRLF sequence near line # 1
Reference: RFC 5545 3.1. Content Lines

Jan 30, 2024 04:30:10 Jack Kamm <jackkamm@gmail.com>:

> Ihor Radchenko <yantar92@posteo.net> writes:
> 
>> CCing ox-icalendar maintainer.
>> 
>> ypuntot <ypuntot@gmail.com> writes:
>> 
>>> I am trying to create an android calendar based on the agenda, and the first problem I am finding it's that I can't import it into android (ICSx^5). I am receiving these errors when trying to do it:
>>> 
>>> Couldn't parse iCalendar ...
>> 
>> May you be able to share the problematic icalendar file?
> 
> If you're not comfortable sharing the icalendar file on a public mail
> list, you could also try out the iCalendar validator, which may help to
> identify the issue with the ics file:
> 
> https://icalendar.org/validator.html
> 
> FWIW, I did try out ICSx5 with the exported ics from a simple Org file,
> and it worked. So we'll need more specific information to fix the
> problem.

Re: org-icalendar export problems

[Jack Kamm]

ypuntot <ypuntot@gmail.com> writes:

> Problem! Found 1 error
>
> Errors
> Lines not delimited by CRLF sequence near line # 1
> Reference: RFC 5545 3.1. Content Lines

Which version of Org are you using? (M-x org-version)

Org 9.7 (unreleased) contains some fixes for how ox-icalendar handles
newlines. If you are using a previous version of Org, please try out the
latest main branch and see if it fixes the problem.

Re: org-icalendar export problems

[Ypo]

[-- Attachment #1: Type: text/plain, Size: 1467 bytes --]

I got org updated, following Ihor's instructions: Org mode version 
9.7-pre (release_N/A-N/A-afc529 @ ./org-9.7pre0.20240130.161905/)

If I were able to fulfill a good process to export from agenda to 
icalendar, maybe we could share an easy process, useful for a lot of 
users that miss a good android calendar visualization. Do you think it 
could be possible to export, in an async way, a calendar file every time 
when a new timestamp, Schedule or Deadline are added to a buffer? What 
would happen if an export process is already running and a new timestamp 
is added? Would it be robust enough or prone to errors? I can see that 
even if a footnote is not correct, the process seems to be interrupted.

Actual state: when I try to export to icalendar, the behavior is quite 
confusing:

+ [c] Combine all agenda files: I don't get any ics file. I don't know 
what is the problem.

+ [a] All agenda files: I get just an ics file. I thought I would get 
one file for each agenda file.

Best!

On 30/01/2024 5:13, Jack Kamm wrote:
> ypuntot<ypuntot@gmail.com>  writes:
>
>> Problem! Found 1 error
>>
>> Errors
>> Lines not delimited by CRLF sequence near line # 1
>> Reference: RFC 5545 3.1. Content Lines
> Which version of Org are you using? (M-x org-version)
>
> Org 9.7 (unreleased) contains some fixes for how ox-icalendar handles
> newlines. If you are using a previous version of Org, please try out the
> latest main branch and see if it fixes the problem.

[-- Attachment #2: Type: text/html, Size: 2506 bytes --]

Re: org-icalendar export problems

[Ihor Radchenko]

Ypo <ypuntot@gmail.com> writes:

> If I were able to fulfill a good process to export from agenda to 
> icalendar, maybe we could share an easy process, useful for a lot of 
> users that miss a good android calendar visualization. Do you think it 
> could be possible to export, in an async way, a calendar file every time 
> when a new timestamp, Schedule or Deadline are added to a buffer? What 
> would happen if an export process is already running and a new timestamp 
> is added? Would it be robust enough or prone to errors? I can see that 
> even if a footnote is not correct, the process seems to be interrupted.

You can just do it on timer or when the file changed.

> Actual state: when I try to export to icalendar, the behavior is quite 
> confusing:
>
> + [c] Combine all agenda files: I don't get any ics file. I don't know 
> what is the problem.
>
> + [a] All agenda files: I get just an ics file. I thought I would get 
> one file for each agenda file.

It would help if you provided an MWE. See https://orgmode.org/manual/Feedback.html#Feedback
It is extremely hard to diagnose things blindly.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

[BUG] No result exporting combined org-agenda files to icalendar [9.6.15 (release_9.6.15 @ z:/emacs-i686/share/emacs/29.2/lisp/org/)]. It was: org-icalendar export problems

[Ypo]

[-- Attachment #1: Type: text/plain, Size: 8012 bytes --]

I am sharing a bug report from emacs -q. I don't know how to use a 
different org-version that the built-in (or if I should).


Emacs  : GNU Emacs 29.2 (build 2, x86_64-w64-mingw32)
  of 2024-01-18
Package: Org mode version 9.6.15 (release_9.6.15 @ 
./emacs-i686/share/emacs/29.2/lisp/org/)

current state:
==============
(setq
  org-link-elisp-confirm-function 'yes-or-no-p
  org-bibtex-headline-format-function #[257 "\300\x01\236A\207" [:title] 3 
"\n\n(fn ENTRY)"]
  org-persist-after-read-hook '(org-element--cache-persist-after-read)
  org-export-before-parsing-hook '(org-attach-expand-links)
  org-cycle-tab-first-hook '(org-babel-hide-result-toggle-maybe 
org-babel-header-arg-expand)
  org-archive-hook '(org-attach-archive-delete-maybe)
  org-odt-format-inlinetask-function 
'org-odt-format-inlinetask-default-function
  org-ascii-format-drawer-function #[771 "\x01\207" [] 4 "\n\n(fn NAME 
CONTENTS WIDTH)"]
  org-cycle-hook '(org-cycle-hide-archived-subtrees 
org-cycle-show-empty-lines
           org-cycle-optimize-window-after-visibility-change
           org-cycle-display-inline-images)
  org-export-with-broken-links 'mark
  org-export-with-clocks t
  org-persist-before-read-hook '(org-element--cache-persist-before-read)
  org-export-default-language "es"
  org-mode-hook '(#[0 "\300\301\302\303\304$\207"
            [add-hook change-major-mode-hook org-fold-show-all append 
local] 5]
          #[0 "\300\301\302\303\304$\207"
            [add-hook change-major-mode-hook org-babel-show-result-all 
append local] 5]
          org-babel-result-hide-spec org-babel-hide-all-hashes)
  org-export-headline-levels 888
  org-latex-format-drawer-function #[514 "\207" [] 3 "\n\n(fn _ CONTENTS)"]
  org-icalendar-use-scheduled '(event-if-not-todo event-if-todo-not-done)
  org-latex-format-headline-function 
'org-latex-format-headline-default-function
  org-confirm-shell-link-function 'yes-or-no-p
  org-export-with-date nil
  org-html-format-drawer-function #[514 "\207" [] 3 "\n\n(fn NAME 
CONTENTS)"]
  outline-isearch-open-invisible-function 'outline-isearch-open-invisible
  org-export-with-todo-keywords nil
  org-icalendar-include-todo 'all
  org-export-initial-scope 'subtree
  org-odt-format-headline-function 'org-odt-format-headline-default-function
  org-export-with-statistics-cookies nil
  org-agenda-before-write-hook '(org-agenda-add-entry-text)
  org-export-with-author nil
  org-src-mode-hook '(org-src-babel-configure-edit-buffer 
org-src-mode-configure-edit-buffer)
  org-confirm-elisp-link-function 'yes-or-no-p
  org-export-with-timestamps nil
  org-speed-command-hook '(org-speed-command-activate 
org-babel-speed-command-activate)
  org-html-format-inlinetask-function 
'org-html-format-inlinetask-default-function
  org-ascii-format-inlinetask-function 'org-ascii-format-inlinetask-default
  org-export-with-tags nil
  org-odt-format-drawer-function #[514 "\207" [] 3 "\n\n(fn NAME CONTENTS)"]
  org-persist-directory "c:/Users/KC/AppData/Local/Temp/org-persist-KWkfxv"
  org-icalendar-combined-name "icalendar-org-agenda"
  org-export-backends '(html icalendar latex odt)
  org-icalendar-combined-description "icalendar-org-agenda-files"
  org-fold-core-isearch-open-function 'org-fold--isearch-reveal
  org-latex-format-inlinetask-function 
'org-latex-format-inlinetask-default-function
  org-persist-before-write-hook '(org-element--cache-persist-before-write)
  org-tab-first-hook '(org-babel-hide-result-toggle-maybe 
org-babel-header-arg-expand)
  org-link-shell-confirm-function 'yes-or-no-p
  org-babel-pre-tangle-hook '(save-buffer)
  org-agenda-loop-over-headlines-in-active-region nil
  org-occur-hook '(org-first-headline-recenter)
  org-export-with-drawers t
  org-metadown-hook '(org-babel-pop-to-session-maybe)
  org-link-parameters '(("attachment" :follow org-attach-follow :complete
             org-attach-complete-link)
                ("id" :follow org-id-open)
                ("eww" :follow org-eww-open :store org-eww-store-link)
                ("rmail" :follow org-rmail-open :store org-rmail-store-link)
                ("mhe" :follow org-mhe-open :store org-mhe-store-link)
                ("irc" :follow org-irc-visit :store org-irc-store-link 
:export
             org-irc-export)
                ("info" :follow org-info-open :export org-info-export :store
             org-info-store-link :insert-description
             org-info-description-as-command)
                ("gnus" :follow org-gnus-open :store org-gnus-store-link)
                ("docview" :follow org-docview-open :export 
org-docview-export :store
             org-docview-store-link)
                ("bibtex" :follow org-bibtex-open :store 
org-bibtex-store-link)
                ("bbdb" :follow org-bbdb-open :export org-bbdb-export 
:complete
             org-bbdb-complete-link :store org-bbdb-store-link)
                ("w3m" :store org-w3m-store-link)
                ("doi" :follow org-link-doi-open :export 
org-link-doi-export)
                ("file+sys") ("file+emacs") ("shell" :follow 
org-link--open-shell)
                ("news" :follow
             #[514 "\301\300\302\x04Q\x02\"\207" ["news" browse-url ":"] 6
               "\n\n(fn URL ARG)"]
             )
                ("mailto" :follow
             #[514 "\301\300\302\x04Q\x02\"\207" ["mailto" browse-url ":"] 6
               "\n\n(fn URL ARG)"]
             )
                ("https" :follow
             #[514 "\301\300\302\x04Q\x02\"\207" ["https" browse-url ":"] 6
               "\n\n(fn URL ARG)"]
             )
                ("http" :follow
             #[514 "\301\300\302\x04Q\x02\"\207" ["http" browse-url ":"] 6
               "\n\n(fn URL ARG)"]
             )
                ("ftp" :follow
             #[514 "\301\300\302\x04Q\x02\"\207" ["ftp" browse-url ":"] 6
               "\n\n(fn URL ARG)"]
             )
                ("help" :follow org-link--open-help :store 
org-link--store-help)
                ("file" :complete org-link-complete-file)
                ("elisp" :follow org-link--open-elisp))
  org-html-format-headline-function 
'org-html-format-headline-default-function
  org-metaup-hook '(org-babel-load-in-session-maybe)
  org-icalendar-combined-agenda-file "~/2-Areas_R/NOTAS/org-mode-agenda.ics"
  org-icalendar-categories nil
  org-export-preserve-breaks t
  )

On 02/02/2024 17:53, Ihor Radchenko wrote:
> Ypo<ypuntot@gmail.com>  writes:
>
>> If I were able to fulfill a good process to export from agenda to
>> icalendar, maybe we could share an easy process, useful for a lot of
>> users that miss a good android calendar visualization. Do you think it
>> could be possible to export, in an async way, a calendar file every time
>> when a new timestamp, Schedule or Deadline are added to a buffer? What
>> would happen if an export process is already running and a new timestamp
>> is added? Would it be robust enough or prone to errors? I can see that
>> even if a footnote is not correct, the process seems to be interrupted.
> You can just do it on timer or when the file changed.
>
>> Actual state: when I try to export to icalendar, the behavior is quite
>> confusing:
>>
>> + [c] Combine all agenda files: I don't get any ics file. I don't know
>> what is the problem.
>>
>> + [a] All agenda files: I get just an ics file. I thought I would get
>> one file for each agenda file.
> It would help if you provided an MWE. Seehttps://orgmode.org/manual/Feedback.html#Feedback
> It is extremely hard to diagnose things blindly.
>

[-- Attachment #2: Type: text/html, Size: 10574 bytes --]

Re: [BUG] No result exporting combined org-agenda files to icalendar [9.6.15 (release_9.6.15 @ z:/emacs-i686/share/emacs/29.2/lisp/org/)]. It was: org-icalendar export problems

[Ihor Radchenko]

Ypo <ypuntot@gmail.com> writes:

> I am sharing a bug report from emacs -q. I don't know how to use a 
> different org-version that the built-in (or if I should).

Sorry for not being clear. Let me elaborate what I expect.

1. Create example Org file or a set of Org files, open them with
   emacs -Q, and try to trigger the problem where you expect to see ics
   file, but it does not appear

2. If you can do it, share the example Org files and each step you
   performed after emacs -Q until you encountered the problem.

The idea is providing me with enough info to re-create the problem on my
computer, so that I can investigate in depth.

-- 
Ihor Radchenko // yantar92,
Org mode contributor,
Learn more about Org mode at <https://orgmode.org/>.
Support Org development at <https://liberapay.com/org-mode>,
or support my work at <https://liberapay.com/yantar92>

Re: [BUG] No result exporting combined org-agenda files to icalendar [9.6.15 (release_9.6.15 @ z:/emacs-i686/share/emacs/29.2/lisp/org/)]. It was: org-icalendar export problems

[Ypo]

[-- Attachment #1: Type: text/plain, Size: 957 bytes --]

Thanks, Ihor

I can't share my private org files. And I find myself unable to isolate 
the causes of the possible errors.

I think I will keep waiting till somebody shares an easy and robust way 
to get an .ics calendar from org files.

Best!

On 02/02/2024 22:25, Ihor Radchenko wrote:
> Ypo<ypuntot@gmail.com>  writes:
>
>> I am sharing a bug report from emacs -q. I don't know how to use a
>> different org-version that the built-in (or if I should).
> Sorry for not being clear. Let me elaborate what I expect.
>
> 1. Create example Org file or a set of Org files, open them with
>     emacs -Q, and try to trigger the problem where you expect to see ics
>     file, but it does not appear
>
> 2. If you can do it, share the example Org files and each step you
>     performed after emacs -Q until you encountered the problem.
>
> The idea is providing me with enough info to re-create the problem on my
> computer, so that I can investigate in depth.
>

[-- Attachment #2: Type: text/html, Size: 1787 bytes --]

Re: [BUG] No result exporting combined org-agenda files to icalendar [9.6.15 (release_9.6.15 @ z:/emacs-i686/share/emacs/29.2/lisp/org/)]. It was: org-icalendar export problems

[Fraga, Eric]

On Saturday,  3 Feb 2024 at 13:13, Ypo wrote:
> I think I will keep waiting till somebody shares an easy and robust
> way to get an .ics calendar from org files.

Not sure what you are expecting but I can show you my (elided) shell
script that generates a single ics file from multiple org files:

--8<---------------cut here---------------start------------->8---
DIARY=${HOME}/s/notes/diary
OUTLOOK=${HOME}/s/notes/outlook
emacs -Q --batch --debug-init \
    --load=esf-org.el \
    --visit=${DIARY}.org --eval='(org-icalendar-export-to-ics)' \
    --visit=${OUTLOOK}.org --eval='(org-icalendar-export-to-ics)'
cat ${DIARY}.ics \
    ${OUTLOOK}.ics \
    > /tmp/combined.ics
--8<---------------cut here---------------end--------------->8---

where esf-org.el has some org customizations and the resulting combined
ics file is in /tmp/combined.ics.

HTH,
eric

-- 
Eric S Fraga, https://profiles.ucl.ac.uk/5958-eric-fraga

Re: [BUG] No result exporting combined org-agenda files to icalendar [9.6.15 (release_9.6.15 @ z:/emacs-i686/share/emacs/29.2/lisp/org/)]. It was: org-icalendar export problems

[Jack Kamm]

Ypo <ypuntot@gmail.com> writes:

> I can't share my private org files. And I find myself unable to isolate 
> the causes of the possible errors.

One strategy that might help is to "bisect" the Org file by repeatedly
splitting it into 2 files, and exporting each, to find where the
problematic entries are. By splitting in half every time, you might be
able to isolate the problem relatively quickly, and produce a minimal
example from that.