Skip to Content.
Sympa Menu

discuss - Re: [opennic-discuss] seed for initial crawl...

discuss AT lists.opennicproject.org

Subject: Discuss mailing list

List archive

Re: [opennic-discuss] seed for initial crawl...


Chronological Thread 
  • From: Rene Paulokat <rene AT so36.net>
  • To: discuss AT lists.opennicproject.org
  • Subject: Re: [opennic-discuss] seed for initial crawl...
  • Date: Thu, 26 May 2011 10:41:19 +0200
  • List-archive: <http://lists.darkdna.net/pipermail/discuss>
  • List-id: <discuss.lists.opennicproject.org>
  • Openpgp: id=0F8DDFBB
  • Organization: SO36.NET

On Thu, 26 May 2011 16:54:14 +1000
Julian DeMarchi <julian AT jdcomputers.com.au> wrote:

> > any ideas / hints?
> >
> > how is grep.geek/search.geek initiating its data?
>
> I will share Jeff's blackmagic for indexing OpenNIC space. You AXFR the
> TLD zone from the master server and use some script to grab all the
> domains out of that.
>
> From there, you have some domains to work with.

oaky - this is what i thought.
made some prototyping yesterday - and noticed again that there is a vast
majority of either down or not responding IN A's in the opennic-tlds.

tested quick and dirty: http://paste.null/view.php?id=21

thanks anyway.

lg
rene


>
> Jeff - Can you fill in the blanks, share your script maybe?
>
> --julian
> _______________________________________________
> discuss mailing list
> discuss AT lists.opennicproject.org
> http://lists.darkdna.net/mailman/listinfo/discuss




Archive powered by MHonArc 2.6.19.

Top of Page