Re: [gopher] GopherMole - a gopher media crawler
Hello list,
Here's a quick update on GopherMole - I worked on it since my last post,
and made a few improvements:
- a 'statistics' page, where one can see some interesting numbers
- support for PDF documents (although sadly, not many PDF files in the
gopherspace contain proper metadata to identify them)
- random searches (as in "give me 10 random mp3 files")
gopher://gopher.viste.fr/1/gophermole/
Interesting fact: my spider arrived to the end of the visible
gopherspace, and found out there are 43'575 menus out there, spread over
134 servers. These are definitely not very high numbers.
I'm curious to know whether the spider missed any servers - the full
list is available on gophermole (in the "statistics" menu). If you are a
gopher server owner, and see your server is not listed, I'd be happy to
know about it!
cheers,
Mateusz
On 12/30/2014 11:13 PM, Mateusz Viste wrote:
Hi all,
Here I present GopherMole.
GopherMole is a project I worked on since some time now, and today is
the day when it's ready enough to be put public. It is basically a
gopher crawler, but focused on media files, and indexing the actual
(meta) content of files, not their menu descriptions.
It's far from being as polished as I'd like it to be, I will improve it
with time. For now, it indexes MP3, OGG and EPUB files. Other formats
will come later.
Finally, here is the URL where you can take GopherMole for a test ride:
gopher://gopher.viste.fr/1/gophermole
cheers,
Mateusz
_______________________________________________
Gopher-Project mailing list
Gopher-Project@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project
Reply to: