Discuss mailing list

[Brian Koontz <brian AT pongonova.net>]

On Tue, May 24, 2011 at 10:36:01AM -0600, Jeff Taylor wrote:
> The new search engine will be running under mnogosearch.  I'm
> finding it has a lot more options available, and runs with MUCH
> lower cpu requirements.  I have been indexing websites for the past
> few days, but it still has a long ways to go -- over 80,000 pages
> indexed, but more than 500,000 pages discovered that it has not yet
> checked.  The new engine has been given the same list of OpenNic and
> NewNations websites, and should provide very complete search options
> once finished.

Jeff--

Not to throw water on your excellent efforts, but I wonder:  How many
of these pages actually reflect content unique to the OpenNIC
namespace (as opposed to, say, content in ICANN-space that is simply
pointed to by an OpenNIC A record)?  I don't know if there's a way to
differentiate the two, but I think results from sites that are simply
mirrors of ICANN-space sites should be flagged as such, or maybe
displayed only on a "top-level" basis (i.e., the initial entry page
cataloged).

  --Brian