From mboxrd@z Thu Jan 1 00:00:00 1970 From: Adam Porter Subject: Re: Asynchronous org-agenda-redo Date: Mon, 16 Dec 2019 04:32:25 -0600 Message-ID: <87v9qgr26e.fsf@alphapapa.net> References: <87k172ot2m.fsf@yantar92-laptop.i-did-not-set--mail-host-address--so-tickle-me> <87pngtsppt.fsf@alphapapa.net> <87o8wda6nv.fsf@yantar92-laptop.i-did-not-set--mail-host-address--so-tickle-me> <87h824sos5.fsf@alphapapa.net> <87wob0fwsg.fsf@yantar92-laptop.i-did-not-set--mail-host-address--so-tickle-me> <87d0crse6p.fsf@alphapapa.net> <878sncohs9.fsf@yantar92-laptop.i-did-not-set--mail-host-address--so-tickle-me> Mime-Version: 1.0 Content-Type: text/plain Return-path: Received: from eggs.gnu.org ([2001:470:142:3::10]:34471) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1igng7-0004fr-SJ for emacs-orgmode@gnu.org; Mon, 16 Dec 2019 05:32:41 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1igng6-0004ZZ-DK for emacs-orgmode@gnu.org; Mon, 16 Dec 2019 05:32:39 -0500 Received: from 195-159-176-226.customer.powertech.no ([195.159.176.226]:55778 helo=blaine.gmane.org) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1igng6-0004Vp-6o for emacs-orgmode@gnu.org; Mon, 16 Dec 2019 05:32:38 -0500 Received: from list by blaine.gmane.org with local (Exim 4.89) (envelope-from ) id 1igng3-000rUG-EO for emacs-orgmode@gnu.org; Mon, 16 Dec 2019 11:32:35 +0100 List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: "Emacs-orgmode" To: emacs-orgmode@gnu.org Ihor Radchenko writes: >> So, of course, you can call custom functions in queries, even your >> own skip functions (with `not', of course), but in most cases, they >> can be covered with built-in predicates. > > Unfortunately, it does not seem to be the case for me. My main agenda > view needs to take into account multiple properties, which cannot be > handled within framework of built-in org-ql predicates (AFAIK): > > - =:SHOWFROMTIME:= (always inheriting) :: The purpose of this is to be > able to assign specific projects for different days of week or, > say, show the home items only in the evening of weekdays and not > annoy me at work when I cannot do it any way. Hence, I can focus on > the items I really need to do now in this agenda. Additionally, the > time of the day after midnight is treated specially here. If > =org-extend-today-until= is not 0 and the current time is before > its value, the current time is still considered to be yesterday. > - =:SHOWFROMDATE:= :: The purpose of this is to be able to postpone the > scheduled tasks for future if I cannot do it. The property is > formatted as an org date. This property is especially useful if > there is something more pressing, so that there is a temptation to > reschedule less pressing event to another day. If the more pressing > task is done earlier than expected, the postponed tasks can be > still find in normal agenda view (not in the > [[id:ff70b03f-3876-4b2b-9aab-c3209bd31cb8][focused]] one). > - =:SHOWDATES:= (always inheriting) :: It contains dairy =sexps= to set > when the project should be shown. For example, I may want to work on > Saturday once or twice, but the working items should not be shown on > weekend normally. Hence, I can define it. Or some things can only be > done on specific dates (say, going to some shop, which is open few > days a week only) There may still be some performance improvement available for these kind of queries. For example, assuming that a function `yantar/showfromdate' is a predicate which accepts the value of property SHOWFROMDATE as its argument and returns non-nil when an entry matches a query, an org-ql query like this could work: (and (property "SHOWFROMDATE") (yantar/showfromdate (property "SHOWFROMDATE"))) The first (property "SHOWFROMDATE") clause allows org-ql to optimize the query using a regexp preamble that jumps directly to entries having that property, while the second clause passes the value of the property to the custom predicate using the built-in predicate (property "SHOWFROMDATE") to retrieve the property from the org-ql node-value cache, which reduces the number of calls to org-entry-get. (That the `property' predicate returns the value of the property when called with only a property argument is a helpful feature that I should document...) > Thanks for the info! I did not know about this optimisation in org-ql. > org-entry-get consumes most of cpu time while building my agenda views. > Though I don't think that there will be much difference for me since > most of my property conditions in agenda involve inherited properties. For properties using inheritance, the preamble regexp can't be used to optimize the query across the buffer (I have some ideas about how to do that, maybe someday...), but the node-value cache can improve performance of retrieving the values of inherited properties within a buffer, because it avoids repeated calls to org-entry-get going up an outline tree. For example, see the benchmark here: https://github.com/alphapapa/org-ql/blob/master/notes.org#caching-of-inherited-tags The node-value cache, which is used for properties, uses essentially the same code as the tag cache benchmarked here (I haven't yet converted the tag cache to use the generic node-value cache), and it provides about a 6x speedup, so property-inheritance-based queries should benefit similarly. So it sounds like your custom agendas would benefit from being written as org-ql queries. Please let me know if you try it, as your examples would give the code a good workout and might reveal some improvements to be made.