Go Back   PUA Forums - The UK's Leading Pick-up Artist Forum > Other Stuff > Off Topic


Reply
 
LinkBack Thread Tools
(#1)
Old
MASTER PUA
Starcastle Champion
 
Default Black Hat/Programmers help - 19-11-2014, 09:38 AM

I was wondering if anyone could think of a way to find websites that have just gone live?

Is there either

A, and index of new domains

or

B, A way to find as soon as a website uploads to the net?

Any ideas are welcome.


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote

Don't like ads? Register a free account to make them go away forever.

(#2)
Old
Status's Avatar
I don't know who I am anymore
 
Default 21-11-2014, 06:08 PM

What do you mean by 'live'?
There are all sorts of databases of domain names.

If you mean when a website appears on a domain, there's no way anyone knows until a search engine spiders it. search engines don't share that information.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#3)
Old
MASTER PUA
Starcastle Champion
 
Default 22-11-2014, 01:06 AM

Quote:
Originally Posted by Status View Post
What do you mean by 'live'?
There are all sorts of databases of domain names.

If you mean when a website appears on a domain, there's no way anyone knows until a search engine spiders it. search engines don't share that information.
so can you find recently spidered sites?

or could you get recently registered domains and build a spider to crawl them daily?

How often are these domain lists updated and how accessible are they?


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#4)
Old
MASTER PUA
Cell-Out Champion
 
Default 22-11-2014, 05:18 PM

there's loads of websites stat sites around but again depends when they index the new site.
What exactly are you aiming to do/sell?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#5)
Old
MASTER PUA
Starcastle Champion
 
Default 22-11-2014, 05:58 PM

i just want to find new business data in the UK. if i find sites that are just opened live... they are probably new


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#6)
Old
MASTER PUA
Cell-Out Champion
 
Default 22-11-2014, 09:19 PM

Probably not the best way the reason is the sites available wont allow the level of filtering you need to get to just business websites also the amount of domains created daily is large.


Why not scrape yelp/google maps and then have software that checks the website linked to the business listing against one of the whois websites that will give you registration date of the domain.

pretty much doing what you want
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#7)
Old
MASTER PUA
Starcastle Champion
 
Default 26-11-2014, 07:04 AM

1. would you know how to do that?
2. Is there a way to find the newest added pages to Facebook?


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#8)
Old
MASTER PUA
Cell-Out Champion
 
Default 26-11-2014, 03:44 PM

1. yes I do, what ever scraping tool your using program a extra step to go to the whois sites (google theres a few).
You will need proxies for the whois as they ban fast.
If you don't have any existing scraping tools and get your applications built, I would budget from £250-£650 for a fully working multithread windows application that scrapes yell or google maps and check whois with proxy support. odesk and freelancer are sites for this kind of jobs the lower price range expect less experienced people to bid at and is a risk.

This would be able to process several thousand business a day leaving you with the handful you require.



2.there was a few years ago not sure how you would do this now,youtube may have answers.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Pick-Up Artist Forum UK
Copyright © 2024

Powered by vBulletin
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.