Discuss mailing list

[Calum McAlinden <calum AT mcalinden.me.uk>]

Hello all,

Just wanted to let people know that the OpenNIC search engine
(seek.geek) I announced several weeks ago is now operational after a
complete redesign.

I am storing the page text body, title, and URL in a elasticsearch
database using a crawler written in Node.js.

The documentation gives information on how seek.geek indexes webpages
among other details. I will run a crawler all the time on a spare home
server; please use the link below and add any OpenNIC URLs you know of
to the index queue, and give my server some work to do.

I have also set up a web proxy to help non OpenNIC users access
OpenNIC domains. I have configured the proxy software to redirect
"normal" domains to the original URL, reducing load and possible abuse
of the service.

Also, I have a question: does anyone know how I can use "dig" to fetch
a list of all registered OpenNIC domains? I thought I might seed the
crawler with a list of registered domains, and therefore avoid the
necessity of having to add websites.

- Search Homepage: http://seek.geek/
- Documentation: http://opennic.mcalinden.me.uk/info
- Add URLs: http://stats.opennic.mcalinden.me.uk/
- OpenNIC Proxy: http://onproxy.mcalinden.me.uk/

If you have any questions, or find any problems, please contact me.
Thank you.

-- 
Calum McAlinden
http://www.mcalinden.me.uk