From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Dunsmore Subject: Re: git repository over http? Date: Fri, 19 Aug 2011 07:30:59 -0500 Message-ID: <87r54hvb0c.fsf@riotblast.dunsmor.com> References: <1E33C447-B199-4358-8A0F-D3159680085D@agfa.com> <878vqsh3ug.fsf@gnu.org> <87obzmn0l8.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Received: from eggs.gnu.org ([140.186.70.92]:35830) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1QuOE3-0001Xb-1M for emacs-orgmode@gnu.org; Fri, 19 Aug 2011 08:31:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1QuOE1-00054Z-SL for emacs-orgmode@gnu.org; Fri, 19 Aug 2011 08:31:03 -0400 Received: from deathroller.dunsmor.com ([98.129.169.48]:33743) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1QuOE1-00054P-PH for emacs-orgmode@gnu.org; Fri, 19 Aug 2011 08:31:01 -0400 In-Reply-To: <87obzmn0l8.fsf@gnu.org> (Bastien's message of "Thu, 18 Aug 2011 18:30:59 +0200") List-Id: "General discussions about Org-mode." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org Sender: emacs-orgmode-bounces+geo-emacs-orgmode=m.gmane.org@gnu.org To: Bastien , Jonathan Leech-Pepin Cc: emacs-orgmode@gnu.org Bastien writes: > Hi Jonathan, > > Jonathan Leech-Pepin writes: > >> The server does seem to support HTTP for pulling, however it is very >> slow. > > Yes, I noticed this too. > >> http:// does work for cloning and pulling from the main Repo, however >> there's nothing to indicate that anything is happening until the task >> is complete. > > Yes. > > Jason, is the slowliness something worth trying to fix? > Can we get some indication that the repo is currently being > cloned? I ran some tests and found that the download speed is proportional to the size of the repo: --8<---------------cut here---------------start------------->8--- $ time /usr/bin/git clone http://orgmode.org/org-mode.git Cloning into org-mode... real 15m23.475s user 0m30.434s sys 0m7.588s $ time /usr/bin/git clone git://orgmode.org/org-mode.git org-mode2 Cloning into org-mode2... remote: Counting objects: 51864, done. remote: Compressing objects: 100% (14898/14898), done. remote: Total 51864 (delta 41315), reused 46129 (delta 36900) Receiving objects: 100% (51864/51864), 53.00 MiB | 205 KiB/s, done. Resolving deltas: 100% (41315/41315), done. real 5m19.350s user 0m19.341s sys 0m2.576s $ time /usr/bin/git clone http://repo.or.cz/r/org-mode.git org-mode3 Cloning into org-mode3... real 7m15.211s user 0m21.293s sys 0m3.652s $ du -sh org-mode* 201M org-mode 63M org-mode2 70M org-mode3 --8<---------------cut here---------------end--------------->8--- If you clone via git://, it does some optimizations during the transfer, whereas cloning via http:// does not. If I do a "git gc" on the repo, it reduces the size of the repo on the server and the time to download via http:// --8<---------------cut here---------------start------------->8--- $ cp -r /home/orgmode/org-mode.git/ /var/www/orgmode.org/org-mode-copy.git $ cd /var/www/orgmode.org/org-mode-copy.git $ du -sh 221M . $ git gc $ du -sh 65M . $ time /usr/bin/git clone http://orgmode.org/org-mode-copy.git Cloning into org-mode-copy... real 5m6.472s user 0m18.797s sys 0m2.300s $ du -sh org-mode-copy 63M org-mode-copy --8<---------------cut here---------------end--------------->8--- I'd recommend using the repo.or.cz repo for http:// downloads. repo.or.cz probably runs git-http-backend or does a "git gc" occasionally. Any user feedback for "git clone" would be up to the git client. It used to say "got... walk..." prior to 1.7. Not sure why they removed those messages in 1.7. Regards, Jason