* Importing from Oddmuse? @ 2013-10-25 14:54 Peter Davis 2013-10-28 15:01 ` Peter Davis 2013-10-30 21:08 ` Jambunathan K 0 siblings, 2 replies; 11+ messages in thread From: Peter Davis @ 2013-10-25 14:54 UTC (permalink / raw) To: emacs-orgmode [-- Attachment #1: Type: text/plain, Size: 593 bytes --] I'm comparatively new to Org mode (actually, I've used it for years, but only a small subset of its functionality). I've used Oddmuse for years to maintain my own personal Wiki, but now I'm looking to move to Org mode. I know there are lots of tools for exporting or publishing from Org mode to Oddmuse, but how about the other direction? Any tools or tips for importing a large number of Oddmuse pages into Org mode? Ideally, I'd like to keep them as separate files, with links converted to file links, etc. Ideas? Thanks! -pd -- ---- The Tech Curmudgeon http://www.techcurmudgeon.com [-- Attachment #2: Type: text/html, Size: 1009 bytes --] ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-25 14:54 Importing from Oddmuse? Peter Davis @ 2013-10-28 15:01 ` Peter Davis 2013-10-28 18:12 ` Achim Gratz 2013-10-30 21:08 ` Jambunathan K 1 sibling, 1 reply; 11+ messages in thread From: Peter Davis @ 2013-10-28 15:01 UTC (permalink / raw) To: emacs-orgmode [-- Attachment #1: Type: text/plain, Size: 1405 bytes --] Just to answer my own question, I shamelessly took Alex Schroeder's raw.pl script and hacked it up a bit to do some conversion from Oddmuse markup to org-mode. The attached Perl script should run through all the pages in an Oddmuse Wiki and generate .org versions of them in a separate directory. This is still very much a work in progress, but I think the general framework is useful. On thing I have to fix is the hyperlinks. Right now, if the Wiki page is "one two.pg", this script will generate a file named "one_two.org," but any links will refer to "[[file:one two.org][one two]]" I concentrated on the small subset of Oddmuse markup that I'm using, but I think it's easily extensible. Let me know if this is at all useful to anyone else. -pd On 10/25/13 10:54 AM, Peter Davis wrote: > I'm comparatively new to Org mode (actually, I've used it for years, > but only a small subset of its functionality). I've used Oddmuse for > years to maintain my own personal Wiki, but now I'm looking to move to > Org mode. > > I know there are lots of tools for exporting or publishing from Org > mode to Oddmuse, but how about the other direction? Any tools or tips > for importing a large number of Oddmuse pages into Org mode? Ideally, > I'd like to keep them as separate files, with links converted to file > links, etc. > -- Peter Davis The Tech Curmudgeon www.techcurmudgeon.com [-- Attachment #2: om2org.pl --] [-- Type: text/x-perl-script, Size: 3893 bytes --] #! /usr/bin/perl -w # Copyright (C) 2005, 2007 Alex Schroeder <alex@emacswiki.org> # # Portions copyright (c) 2013, Peter Davis <pfd@pfdstudio.com> # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 3 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program. If not, see <http://www.gnu.org/licenses/>. sub ParseData { my $data = shift; my %result; while ($data =~ /(\S+?): (.*?)(?=\n[^ \t]|\Z)/sg) { my ($key, $value) = ($1, $2); $value =~ s/\n\t/\n/g; $result{$key} = $value; } return %result; } sub FixMarkUp { my $data = shift; my $orgout = "#+STARTUP: showeverything logdone\n#+options: num:nil\n\n"; my $csvMode = 0; foreach (split /\n/, $data) { if (length($_)) { s/\r//g; # csv tables if ($_ =~ /<csv>/) { $csvMode = 1; s/<csv>/#+ATTR_HTML: :border 2 :rules all :frame border/g; } elsif ($_ =~ /^\s*$/) { $csvMode = 0; } elsif ($csvMode) { s/^/|/g; s/,/|/g; s/$/|/g; } # hyperlinks s/\[\[([^]]*)\]\]/[[file:$1.org][$1]]/g; # strike through s/<\/?s>/+/g; # verse s/:::/#+BEGIN_VERSE/g; # bold and italic s/'''/*/g; s/''/\//g; # bullet lists s/^\*\*\*\*/ */g; s/^\*\*\*/ */g; s/^\*\*/ */g; s/^\*/ */g; # headers s/^\=\=\=\=/****/g; s/^\=\=\=/***/g; s/^\=\=/**/g; s/^\=/*/g; # s/ \=?$//g; s/ \=\=\=\=$//g; s/ \=\=\=$//g; s/ \=\=$//g; s/ \=$//g; s/^# / 1. /g; } else { $csvMode = 0; } $orgout = $orgout . $_ . "\n"; } return $orgout; } sub main { my ($regexp, $PageDir, $OrgDir) = @_; # include dotfiles! local $/ = undef; # Read complete files foreach my $file (glob("$PageDir/*/*.pg $PageDir/*/.*.pg")) { next unless $file =~ m|/.*/(.+)\.pg$|; my $page = $1; next if $regexp && $page !~ m|$regexp|o; $page = $page . ".org"; mkdir($OrgDir) or die "Cannot create $OrgDir directory: $!" unless -d $OrgDir; open(F, $file) or die "Cannot read $page file: $!"; my $data = <F>; close(F); my $ts = (stat("$OrgDir/$page"))[9]; my %result1 = ParseData($data); my $result2 = FixMarkUp($result1{text}); if ($ts && $ts == $result1{ts}) { print "skipping $page because it is up to date\n" if $verbose; } else { print "writing $page because $ts != $result{ts}\n" if $verbose; open(F,"> $OrgDir/$page") or die "Cannot write $page org file: $!"; # print F $result1{text}; print F $result2; close(F); utime $result1{ts}, $result1{ts}, "$OrgDir/$page"; # touch file } } } use Getopt::Long; my $regexp = undef; my $page = 'page'; my $dir = 'org'; GetOptions ("regexp=s" => \$regexp, "page=s" => \$page, "dir=s" => \$dir, "help" => \$help); if ($help) { print qq{ Usage: $0 [--regexp REGEXP] [--page DIR] [--dir DIR] Writes the org wiki text into plain text files. --regexp selects a subsets of pages whose names match the regular expression. Note that spaces have been translated to underscores. --page designates the page directory. By default this is 'page' in the current directory. If you run this script in your data directory, the default should be fine. --dir designates an output directory. By default this is 'org' in the current directory. Example: $0 --regexp '\\.el\$' --dir elisp } } else { main ($regexp, $page, $dir); } ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-28 15:01 ` Peter Davis @ 2013-10-28 18:12 ` Achim Gratz 2013-10-28 18:27 ` Peter Davis 0 siblings, 1 reply; 11+ messages in thread From: Achim Gratz @ 2013-10-28 18:12 UTC (permalink / raw) To: emacs-orgmode Peter Davis writes: > # hyperlinks > s/\[\[([^]]*)\]\]/[[file:$1.org][$1]]/g; Try this to fix the links maybe: # hyperlinks s/\[\[([^]]*)\]\]/ my $l = $1; $l =~ s: :_:g; "[[file:$l.org][$l]]"/gex; Regards, Achim. -- +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+ SD adaptation for Waldorf rackAttack V1.04R1: http://Synth.Stromeko.net/Downloads.html#WaldorfSDada ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-28 18:12 ` Achim Gratz @ 2013-10-28 18:27 ` Peter Davis 2013-10-28 19:18 ` Achim Gratz 0 siblings, 1 reply; 11+ messages in thread From: Peter Davis @ 2013-10-28 18:27 UTC (permalink / raw) To: emacs-orgmode [-- Attachment #1: Type: text/plain, Size: 649 bytes --] On 10/28/13, 2:12 PM, Achim Gratz wrote: > Peter Davis writes: >> # hyperlinks >> s/\[\[([^]]*)\]\]/[[file:$1.org][$1]]/g; > Try this to fix the links maybe: > > # hyperlinks > s/\[\[([^]]*)\]\]/ > my $l = $1; > $l =~ s: :_:g; > "[[file:$l.org][$l]]"/gex; Excellent! I modified it slightly to keep the spaces in the display string: # hyperlinks s/\[\[([^]]*)\]\]/ my $l = $1; my $orig = $1; $l =~ s: :_:g; "[[file:$l.org][$orig]]"/gex; Thanks, Achim! -pd -- ---- Peter Davis The Tech Curmudgeon www.techcurmudgeon.com [-- Attachment #2: Type: text/html, Size: 1762 bytes --] ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-28 18:27 ` Peter Davis @ 2013-10-28 19:18 ` Achim Gratz 2013-10-28 19:35 ` Peter Davis 0 siblings, 1 reply; 11+ messages in thread From: Achim Gratz @ 2013-10-28 19:18 UTC (permalink / raw) To: emacs-orgmode Peter Davis writes: > Excellent! I modified it slightly to keep the spaces in the display > string: This is better, I'd think: # hyperlinks s/\[\[([^]]*)\]\]/ my $l = $1; $l =~ s: :_:g; "[[file:$l.org][$1]]"/gex; Regards, Achim. -- +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+ Wavetables for the Waldorf Blofeld: http://Synth.Stromeko.net/Downloads.html#BlofeldUserWavetables ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-28 19:18 ` Achim Gratz @ 2013-10-28 19:35 ` Peter Davis 2013-10-28 20:26 ` Achim Gratz 0 siblings, 1 reply; 11+ messages in thread From: Peter Davis @ 2013-10-28 19:35 UTC (permalink / raw) To: emacs-orgmode On 10/28/13, 3:18 PM, Achim Gratz wrote: > Peter Davis writes: >> Excellent! I modified it slightly to keep the spaces in the display >> string: > This is better, I'd think: > > # hyperlinks > s/\[\[([^]]*)\]\]/ > my $l = $1; > $l =~ s: :_:g; > "[[file:$l.org][$1]]"/gex; That was the first thing I tried, and Perl complained about an undefined variable. I may have made a typo though. Thanks! Cheers, -pd -- Peter Davis The Tech Curmudgeon www.techcurmudgeon.com ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-28 19:35 ` Peter Davis @ 2013-10-28 20:26 ` Achim Gratz 2013-10-28 20:33 ` Peter Davis 0 siblings, 1 reply; 11+ messages in thread From: Achim Gratz @ 2013-10-28 20:26 UTC (permalink / raw) To: emacs-orgmode Peter Davis writes: > That was the first thing I tried, and Perl complained about an > undefined variable. I may have made a typo though. Nope, my error. $1 gets clobbered by the second replacement. So you'd want what you wrote or somewhat shorter: # hyperlinks s/\[\[([^]]*)\]\]/ my ($l, $o) = ($1, $1); $l =~ s: :_:g; "[[file:$l.org][$o]]"/gex; Regards, Achim. -- +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+ Factory and User Sound Singles for Waldorf rackAttack: http://Synth.Stromeko.net/Downloads.html#WaldorfSounds ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-28 20:26 ` Achim Gratz @ 2013-10-28 20:33 ` Peter Davis 0 siblings, 0 replies; 11+ messages in thread From: Peter Davis @ 2013-10-28 20:33 UTC (permalink / raw) To: Achim Gratz; +Cc: emacs-orgmode [-- Attachment #1: Type: text/plain, Size: 587 bytes --] On Mon, Oct 28, 2013 at 4:26 PM, Achim Gratz <Stromeko@nexgo.de> wrote: > Peter Davis writes: > > That was the first thing I tried, and Perl complained about an > > undefined variable. I may have made a typo though. > > Nope, my error. $1 gets clobbered by the second replacement. So you'd > want what you wrote or somewhat shorter: > > # hyperlinks > s/\[\[([^]]*)\]\]/ > my ($l, $o) = ($1, $1); > $l =~ s: :_:g; > "[[file:$l.org][$o]]"/gex; > > Yes, that works beautifully, and is nice and concise. Thank you! -pd -- ---- The Tech Curmudgeon http://www.techcurmudgeon.com [-- Attachment #2: Type: text/html, Size: 1389 bytes --] ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-25 14:54 Importing from Oddmuse? Peter Davis 2013-10-28 15:01 ` Peter Davis @ 2013-10-30 21:08 ` Jambunathan K 2013-10-30 22:44 ` Peter Davis 1 sibling, 1 reply; 11+ messages in thread From: Jambunathan K @ 2013-10-30 21:08 UTC (permalink / raw) To: Peter Davis; +Cc: emacs-orgmode Peter Davis <pfd@pfdstudio.com> writes: > I've used Oddmuse for years to maintain my own personal Wiki, but now > I'm looking to move to Org mode. I am in the process of adding Org-mode markup support to the Oddmuse wiki engine. (By support I mean, only the text markup not agenda or babel related stuff) I have some changes in my local work-area that is promising. Interested people can watch out for activity in this space - http://oddmuse.org/wiki/Org_Markup_Extension One can also look at the churnings happening here: http://repo.or.cz/w/orgmuse.git ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-30 21:08 ` Jambunathan K @ 2013-10-30 22:44 ` Peter Davis 2013-10-31 6:18 ` Marcin Borkowski 0 siblings, 1 reply; 11+ messages in thread From: Peter Davis @ 2013-10-30 22:44 UTC (permalink / raw) To: Jambunathan K; +Cc: emacs-orgmode On Thu, Oct 31, 2013 at 02:38:48AM +0530, Jambunathan K wrote: > Peter Davis <pfd@pfdstudio.com> writes: > > > I've used Oddmuse for years to maintain my own personal Wiki, but now > > I'm looking to move to Org mode. > > I am in the process of adding Org-mode markup support to the Oddmuse That would be great. I'd love to use the same markup everywhere. Thanks, -pd > One can also look at the churnings happening here: > > http://repo.or.cz/w/orgmuse.git ^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: Importing from Oddmuse? 2013-10-30 22:44 ` Peter Davis @ 2013-10-31 6:18 ` Marcin Borkowski 0 siblings, 0 replies; 11+ messages in thread From: Marcin Borkowski @ 2013-10-31 6:18 UTC (permalink / raw) To: emacs-orgmode Dnia 2013-10-30, o godz. 18:44:53 Peter Davis <pfd@pfdstudio.com> napisał(a): > On Thu, Oct 31, 2013 at 02:38:48AM +0530, Jambunathan K wrote: > > Peter Davis <pfd@pfdstudio.com> writes: > > > > > I've used Oddmuse for years to maintain my own personal Wiki, but > > > now I'm looking to move to Org mode. > > > > I am in the process of adding Org-mode markup support to the Oddmuse > > That would be great. I'd love to use the same markup everywhere. +1 > > Thanks, > -pd > > > > One can also look at the churnings happening here: > > > > http://repo.or.cz/w/orgmuse.git > -- Marcin Borkowski http://octd.wmi.amu.edu.pl/en/Marcin_Borkowski Adam Mickiewicz University ^ permalink raw reply [flat|nested] 11+ messages in thread
end of thread, other threads:[~2013-10-31 6:19 UTC | newest] Thread overview: 11+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2013-10-25 14:54 Importing from Oddmuse? Peter Davis 2013-10-28 15:01 ` Peter Davis 2013-10-28 18:12 ` Achim Gratz 2013-10-28 18:27 ` Peter Davis 2013-10-28 19:18 ` Achim Gratz 2013-10-28 19:35 ` Peter Davis 2013-10-28 20:26 ` Achim Gratz 2013-10-28 20:33 ` Peter Davis 2013-10-30 21:08 ` Jambunathan K 2013-10-30 22:44 ` Peter Davis 2013-10-31 6:18 ` Marcin Borkowski
Code repositories for project(s) associated with this public inbox https://git.savannah.gnu.org/cgit/emacs/org-mode.git This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).