From: John Hendy <jw.hendy@gmail.com>
To: Alan Schmitt <alan.schmitt@polytechnique.org>
Cc: emacs-org list <emacs-orgmode@gnu.org>
Subject: Re: Exploring data that is in org-mode format
Date: Fri, 27 Sep 2013 13:42:15 -0500 [thread overview]
Message-ID: <CA+M2ft_bdDsmYXKGUMvw_YUZXnJv7y9hSQpt6X9Bx9nRG61Zww@mail.gmail.com> (raw)
In-Reply-To: <m28uyiekzc.fsf@polytechnique.org>
On Fri, Sep 27, 2013 at 3:18 AM, Alan Schmitt
<alan.schmitt@polytechnique.org> wrote:
> Hello,
>
> This question is slightly off-topic, but it may be of interest to people
> who have a lot of data entered in org-mode.
>
> The short version: what tools are available to explore data, typically
> stored in org-mode tables?
[snip]
> So I collect all this data because it's something I enjoy doing, and I
> would really like to explore it, from the comfortable position of my own
> computer. All of this data is in org-mode tables (or can be easily
> converted to org-mode table). Hence my questions: are there tools you
> would recommend? I'm not afraid of programming (I suspect an answer will
> be 'R'), but I would like pointers to tutorials to do these kind of
> things. The kind of things I would like to do are:
> - extract weekly or monthly tallies or estimation from data collected at
> irregular intervals;
> - compare data sources against each other;
> - estimate future trends based on past data (how much will my gas bill be?);
> - display the result in some kind of dashboard.
>
For simple exploration, you might have a look at ggobi? [1] It allows
you to do some really quick/easy exploration by plotting and being
able to check which variables to use for X and Y, coloring, filtering,
changing plot type, and so on. There's an R package which allows you
to call ggobi on an R data object, which you could easily create with
babel and your existing org tables with the #+name option for the
table and :var specification in the babel block header.
I'd also highly recommend taking a look at shiny via R-Studio.[2] Not
sure if you can call it from Org-mode, but even if you can't... not
*everything* has to be done with Org. You could use the file to do
some data munging/summarization/etc., save it as a new data set (.csv
or similar), and then read that into Shiny. It could be *awesome* for
something like this. I only recently started playing with it but it's
just fantastic and would make for the ability to subset, change
scales/time ranges, and much more in an interactive web app.
I applied for a public server account with RStudio and got it so that
as I learn and do more, I can make them public. As a result of an SO
question, I repaid the answerer by creating an app from his reply:
- Post: http://stackoverflow.com/questions/17958730/faceting-a-set-of-contour-plots-in-ggplot-r
- Shiny app: http://spark.rstudio.com/jwhendy/interactive-contour/
Good luck!
John
[1] http://www.ggobi.org/
[2] http://www.rstudio.com/shiny/
> Thanks a lot,
>
> Alan
>
next prev parent reply other threads:[~2013-09-27 18:42 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-09-27 8:18 Exploring data that is in org-mode format Alan Schmitt
2013-09-27 8:25 ` Marcin Borkowski
2013-09-27 8:29 ` Karl Voit
2013-09-27 12:42 ` Nick Dokos
2013-09-27 18:42 ` John Hendy [this message]
2013-09-30 7:56 ` Alan Schmitt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://www.orgmode.org/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CA+M2ft_bdDsmYXKGUMvw_YUZXnJv7y9hSQpt6X9Bx9nRG61Zww@mail.gmail.com \
--to=jw.hendy@gmail.com \
--cc=alan.schmitt@polytechnique.org \
--cc=emacs-orgmode@gnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/emacs/org-mode.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).