Discuss mailing list

[Jon Hebb <somebodyrocks AT gmail.com>]

You probably said this before and I just missed it, but did you write the programming for this or are you using something pre-made?

On Sun, Feb 16, 2014 at 1:14 PM, Calum McAlinden <calum AT mcalinden.me.uk> wrote:

Hello all,

Just wanted to let people know that the OpenNIC search engine
(seek.geek) I announced several weeks ago is now operational after a
complete redesign.

I am storing the page text body, title, and URL in a elasticsearch
database using a crawler written in Node.js.

The documentation gives information on how seek.geek indexes webpages
among other details. I will run a crawler all the time on a spare home
server; please use the link below and add any OpenNIC URLs you know of
to the index queue, and give my server some work to do.

I have also set up a web proxy to help non OpenNIC users access
OpenNIC domains. I have configured the proxy software to redirect
"normal" domains to the original URL, reducing load and possible abuse
of the service.

Also, I have a question: does anyone know how I can use "dig" to fetch
a list of all registered OpenNIC domains? I thought I might seed the
crawler with a list of registered domains, and therefore avoid the
necessity of having to add websites.

- Search Homepage: http://seek.geek/
- Documentation: http://opennic.mcalinden.me.uk/info
- Add URLs: http://stats.opennic.mcalinden.me.uk/
- OpenNIC Proxy: http://onproxy.mcalinden.me.uk/

If you have any questions, or find any problems, please contact me.
Thank you.

--
Calum McAlinden
http://www.mcalinden.me.uk



--------
You are a member of the OpenNIC Discuss list.
You may unsubscribe by emailing discuss-unsubscribe AT lists.opennicproject.org

--
Best Regards,
Jon Hebb
Tour Morgantown LLC

www.tour-morgantown.com
Cell: 304.680.6777
Office: 304.249.TOUR or 855.500.2696