From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 4Fb9L0oB0F7cdQAA0tVLHw (envelope-from ) for ; Thu, 28 May 2020 18:22:02 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id iF28K0oB0F6nbgAAbx9fmQ (envelope-from ) for ; Thu, 28 May 2020 18:22:02 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 547EE9402D1 for ; Thu, 28 May 2020 18:22:01 +0000 (UTC) Received: from localhost ([::1]:52782 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jeNAG-0003jL-Ak for larch@yhetil.org; Thu, 28 May 2020 14:22:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:58464) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jeN9N-0003h1-DL for emacs-orgmode@gnu.org; Thu, 28 May 2020 14:21:05 -0400 Received: from mail-pl1-x644.google.com ([2607:f8b0:4864:20::644]:41257) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jeN9K-0000U4-7T for emacs-orgmode@gnu.org; Thu, 28 May 2020 14:21:05 -0400 Received: by mail-pl1-x644.google.com with SMTP id a13so11966726pls.8 for ; Thu, 28 May 2020 11:21:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:in-reply-to:references:date:message-id :mime-version; bh=S7is5slLVZPl+eW8Gb/Svfk/4MM9AgEO7r/EkPsy+Kg=; b=tZ9+KpsI45im4l+FcR06TYYrS0djDtbaB+1NB5tD0GhuaYBAXX9r5r+MtZKjvQHnmm oY1dwdTCxw44RAodeI/el57fCKNQIVeqdjOeXy2z9rmFcINbxj5074Hl4EjbRZwRHUCY N3QFaf+CtqNabPOucOgvoglOMYUajwA8i1GvR1vVpv+ZgCe35K8ciWk8CrHPS5VKjnRn Ey9nfpnscmQfEgxU87soAtKojmZIMyXFXttjNma9v7SIcxPp7zhGez2CGlIRvKYlav+s z3yJnQ3OURZDf4zcV9djFLwpx/y6EkFg72LbFKLiiROOO12YRJiKD37BMDGFOYpIouBg 4ssg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:in-reply-to:references:date :message-id:mime-version; bh=S7is5slLVZPl+eW8Gb/Svfk/4MM9AgEO7r/EkPsy+Kg=; b=kpd10JJKxFSI7kzqZthvB+G06iWyCRoSYdww78+8gOOSO+FGLYvjH12h280RP2mbOD 2nMDk5gvcT9S0Z0oXJ/kvgKShCshOMogP5lZwozd9tnUExaUgn/o4K/d6aRArmufbgx/ GOrnI7Lde3zRznPJNmFoTqL7kO3W2iq+l0cpa+5fxIGXNbgXk+52D2KmedKkrDf8+21e OFIfAvJX7g+gM7qC3MZrC8rKiHYQszw646a7VUxY4qmleS6hQisX69W+I640TqKinjBY QwCgCgtPrSyYKARIB5RPEEkwohMSIxcbwBFwc6FLhPuBx1iSU6xwdwKCr9c61nZHpQQp Snuw== X-Gm-Message-State: AOAM530FxfK7jXOeCF6qcZGghjDfn/mGPyU1prRUKZ1ijDzuYI5H7poz YI1GhO6eSrEyEWzvoL5C7tE= X-Google-Smtp-Source: ABdhPJwQvHXP7tYjqOgRbniU9Y85LBijwyzLkYQRHYNSaW+MNNTJay16OHHPNEES+jibBwDgK4X0fg== X-Received: by 2002:a17:90a:e54d:: with SMTP id ei13mr3078377pjb.126.1590690060244; Thu, 28 May 2020 11:21:00 -0700 (PDT) Received: from localhost ([104.250.131.79]) by smtp.gmail.com with ESMTPSA id u4sm8501029pjf.3.2020.05.28.11.20.58 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 28 May 2020 11:20:59 -0700 (PDT) From: Ihor Radchenko To: stardiviner Subject: Re: [Feature] add a new org-attach dispatcher command to offline save web page In-Reply-To: <87blm8nj6b.fsf@gmail.com> References: <87sgflu2gw.fsf@gmail.com> <87r1v4wyy4.fsf@fastmail.fm> <87r1v4bodg.fsf@localhost> <875zcgd0lx.fsf@gmail.com> <878shcupf6.fsf@localhost> <87blm8nj6b.fsf@gmail.com> Date: Fri, 29 May 2020 02:16:20 +0800 Message-ID: <87367kudqj.fsf@localhost> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2607:f8b0:4864:20::644; envelope-from=yantar92@gmail.com; helo=mail-pl1-x644.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: -17 X-Spam_score: -1.8 X-Spam_bar: - X-Spam_report: (-1.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001 autolearn=_AUTOLEARN X-Spam_action: no action X-BeenThere: emacs-orgmode@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Matthew Lundin , Org Mode Errors-To: emacs-orgmode-bounces+larch=yhetil.org@gnu.org Sender: "Emacs-orgmode" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=tZ9+KpsI; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of emacs-orgmode-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=emacs-orgmode-bounces@gnu.org X-Spam-Score: 0.59 X-TUID: tawBIeVbWeAH > I don't know how to implement similar functionality like monolith with > url-retrieve-synchronously + save-buffer. PATCH welcome. Sorry, I missed that the default 'url attach method exists already. > Of course curl and wget is alternative options, just still same problem. Don't > know how to download web page as a single file and save it as archive file. If > use other ways, it's just another org-board. Then this patch will be unnecessary. Well. org-board is not built-in. And curl or wget are much more likely to be installed. They can serve as a good fallback alternative to monolith. Best, Ihor stardiviner writes: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > > Ihor Radchenko writes: > >>> If have better solution, I totally agree with that. >> >> In the current state, your patch will be pretty much useless for users >> without technical background. >> >> url-retrieve-synchronously + save-buffer should be a better default. It >> will be available for all users. >> > > I don't know how to implement similar functionality like monolith with > url-retrieve-synchronously + save-buffer. PATCH welcome. > >> Ideally, there should be several customisation options. Something like: >> - url-retrieve-synchronously >> - curl >> - wget >> - monolith > > Of course curl and wget is alternative options, just still same problem. Don't > know how to download web page as a single file and save it as archive file. If > use other ways, it's just another org-board. Then this patch will be unnecessary. > >> >> Also, it would be great if you provide some description about each >> customisation in the docstring. For example, a link to github page of >> monolith and a brief description how it is different from other url >> retrieval methods should be useful for general user. > > This is good solution, I will improve option description. > >> >> Best, >> Ihor >> >> >> stardiviner writes: >> >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA256 >>> >>> >>> Ihor Radchenko writes: >>> >>>>> This looks helpful, but I think this should be an add-on rather than >>>>> integrated into the org-attach. I'm glad to learn about monolith, but >>>>> far fewer users are likely to have it installed than have wget or curl >>>>> installed. You might also want to check out org-board, which has similar >>>>> functionality: >>>> >>>> It does not mean that attaching URL directly is not worth including into >>>> org. This sounds pretty common use case, especially considering the number >>>> of packages providing similar feature. You mentioned org-board, but >>>> there is also org-download and org-web-tools. >>> >>> That's right, this phenomenon represents an obviously situation, Org Mode should >>> have this functionality. >>> >>>> >>>> I agree that monolith is completely uncommon tool and I would not expect >>>> the majority of users to have it installed, but the same functionality >>>> utilising built-in url.el (as a default) should be acceptable. >>> >>> If have better solution, I totally agree with that. >>> >>>> >>>> Best, >>>> Ihor >>>> >>>> >>>> Matthew Lundin writes: >>>> >>>>> stardiviner writes: >>>>> >>>>>> I attached the patch. >>>>>> >>>>>> I think this feature will be helpful for use who archive web page data usually >>>>>> like me. To be more portable, I also added an defcustom option for other >>>>>> external command. And use an if condition to detect whether external command >>>>>> available, else warning user. >>>>> >>>>> This looks helpful, but I think this should be an add-on rather than >>>>> integrated into the org-attach. I'm glad to learn about monolith, but >>>>> far fewer users are likely to have it installed than have wget or curl >>>>> installed. You might also want to check out org-board, which has similar >>>>> functionality: >>>>> >>>>> https://github.com/scallywag/org-board >>>>> >>>>> Best, >>>>> >>>>> Matt >>>>> >>> >>> >>> - -- >>> [ stardiviner ] >>> I try to make every word tell the meaning that I want to express. >>> >>> Blog: https://stardiviner.github.io/ >>> IRC(freenode): stardiviner, Matrix: stardiviner >>> GPG: F09F650D7D674819892591401B5DF1C95AE89AC3 >>> >>> -----BEGIN PGP SIGNATURE----- >>> >>> iQFIBAEBCAAyFiEE8J9lDX1nSBmJJZFAG13xyVromsMFAl7PXKoUHG51bWJjaGls >>> ZEBnbWFpbC5jb20ACgkQG13xyVromsOiMQf9EY7ES42hWxdjgFqiN0UqPGssRd+l >>> fcvhb+yiT5/71TYA8YbQOF0Pa2SpUBgGUw+hcHUd9aDXxAP+4ucmP4bZ/vx29UTN >>> T7YpOvuc5ZkafiN5bWghij1dLYhfi2CMDGGduU9rvjSleaRMhoX12wo8OM2qBHDm >>> 2bqWHrZsGVPsNlAK3ymN3PdmwOtxktRVUxWZOug3ZF6LYnEHWRp/rb6lvS2BF3Ej >>> qNazerYVcpfDsOiCWTSrjos2gnITT2pSlnxmrQFO69Pvex+T2dEJL7raNyuXi3Qd >>> jn5uayrnHn4ZeUwSfmAQiqvq2TsFZ5zvtH0nKM+4tp/6gSgEuTw9gYaoBQ== >>> =qrFy >>> -----END PGP SIGNATURE----- >>> > > > - -- > [ stardiviner ] > I try to make every word tell the meaning that I want to express. > > Blog: https://stardiviner.github.io/ > IRC(freenode): stardiviner, Matrix: stardiviner > GPG: F09F650D7D674819892591401B5DF1C95AE89AC3 > > -----BEGIN PGP SIGNATURE----- > > iQFIBAEBCAAyFiEE8J9lDX1nSBmJJZFAG13xyVromsMFAl7P4CwUHG51bWJjaGls > ZEBnbWFpbC5jb20ACgkQG13xyVromsMnIgf+MR3SvdlaxKofkSPZjYknvJ/MwUy4 > iJOFYe0VRUXcNyjkQVGToNVVM50rWodR29LSXy8F1WbvgjDZb0arktsjOpjy+0Oq > R/7JiE7Y8lXYPlmn+Gcqoijcuoo0tNNaE8ia6U9uYbhp8I1Whd0Jhx5kWiXCxlWe > AMf2Yz4mw2CJc67W1MVUPM/2nq8+GhduLmY7UPw56A6ph+H2HD/AO+FzgL0dlivP > lV3EKCc7j5kA5uzXqbqfWJZdylH4cUbzdHHePsW+EpWodF/tcJcGJmlIm/PUNuEX > MsIkkKQt7QFLvr47vROVrJczEjT70ZdjWqjTZf5/esEsRUhb+m8uDbgc5g== > =c9Pj > -----END PGP SIGNATURE----- -- Ihor Radchenko, PhD, Center for Advancing Materials Performance from the Nanoscale (CAMP-nano) State Key Laboratory for Mechanical Behavior of Materials, Xi'an Jiaotong University, Xi'an, China Email: yantar92@gmail.com, ihor_radchenko@alumni.sutd.edu.sg