[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: [gopher] GopherMole - a gopher media crawler



On 01/03/2015 10:40 AM, James Mills wrote:
You don't have my server (but it's new):
gopher://daisy.shortcircuit.net.au/ <http://daisy.shortcircuit.net.au/>

Thanks, I've added it right now to the database. Will be spidered very soon. That brings us to a gopherspace of 137 active servers today.

> My only retort to this is that UTF-8
> drgrades gracefully to ISO-8859-1

Quite untrue. UTF-8 doesn't 'degrade' to anything, unless only low-ascii characters are used. Anything else gets encoded into 2,3 or 4 bytes-long code points, and these are guaranteed to be misrendered by any client unaware of UTF-8.

Mateusz






On Fri, Jan 2, 2015 at 2:00 AM, Mateusz Viste <mateusz@viste.fr
<mailto:mateusz@viste.fr>> wrote:

    Hello list,

    Here's a quick update on GopherMole - I worked on it since my last
    post, and made a few improvements:

      - a 'statistics' page, where one can see some interesting numbers
      - support for PDF documents (although sadly, not many PDF files in
    the gopherspace contain proper metadata to identify them)
      - random searches (as in "give me 10 random mp3 files")

       gopher://gopher.viste.fr/1/__gophermole/
    <http://gopher.viste.fr/1/gophermole/>

    Interesting fact: my spider arrived to the end of the visible
    gopherspace, and found out there are 43'575 menus out there, spread
    over 134 servers. These are definitely not very high numbers.

    I'm curious to know whether the spider missed any servers - the full
    list is available on gophermole (in the "statistics" menu). If you
    are a gopher server owner, and see your server is not listed, I'd be
    happy to know about it!

    cheers,
    Mateusz





    On 12/30/2014 11:13 PM, Mateusz Viste wrote:

        Hi all,

        Here I present GopherMole.

        GopherMole is a project I worked on since some time now, and
        today is
        the day when it's ready enough to be put public. It is basically a
        gopher crawler, but focused on media files, and indexing the actual
        (meta) content of files, not their menu descriptions.

        It's far from being as polished as I'd like it to be, I will
        improve it
        with time. For now, it indexes MP3, OGG and EPUB files. Other
        formats
        will come later.

        Finally, here is the URL where you can take GopherMole for a
        test ride:

        gopher://gopher.viste.fr/1/__gophermole
        <http://gopher.viste.fr/1/gophermole>

        cheers,
        Mateusz


    _________________________________________________
    Gopher-Project mailing list
    Gopher-Project@lists.alioth.__debian.org
    <mailto:Gopher-Project@lists.alioth.debian.org>
    http://lists.alioth.debian.__org/cgi-bin/mailman/listinfo/__gopher-project
    <http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project>




_______________________________________________
Gopher-Project mailing list
Gopher-Project@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project


_______________________________________________
Gopher-Project mailing list
Gopher-Project@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project




Reply to: