discuss AT lists.opennicproject.org

Subject: Discuss mailing list

List archive

Re: [opennic-discuss] seed for initial crawl...

From: Julian DeMarchi <julian AT jdcomputers.com.au>
To: discuss AT lists.opennicproject.org
Subject: Re: [opennic-discuss] seed for initial crawl...
Date: Thu, 26 May 2011 16:54:14 +1000
List-archive: <http://lists.darkdna.net/pipermail/discuss>
List-id: <discuss.lists.opennicproject.org>

> any ideas / hints?
>
> how is grep.geek/search.geek initiating its data?

I will share Jeff's blackmagic for indexing OpenNIC space. You AXFR the
TLD zone from the master server and use some script to grab all the
domains out of that.

>From there, you have some domains to work with.

Jeff - Can you fill in the blanks, share your script maybe?

--julian

[opennic-discuss] seed for initial crawl..., Rene Paulokat, 05/25/2011
- Re: [opennic-discuss] can't associate openNIC domain with server, Dmitry Shalnoff, 05/26/2011
  - Re: [opennic-discuss] can't associate openNIC domain with server, Julian DeMarchi, 05/26/2011
    - Re: [opennic-discuss] can't associate openNIC domain with server, Dmitry Shalnoff, 05/26/2011
- Re: [opennic-discuss] seed for initial crawl..., Julian DeMarchi, 05/26/2011
  - Re: [opennic-discuss] seed for initial crawl..., Rene Paulokat, 05/26/2011
    - Re: [opennic-discuss] seed for initial crawl..., JP Blankert (thuis & PC based), 05/26/2011
- Re: [opennic-discuss] seed for initial crawl..., Jeff Taylor, 05/26/2011