Go Back   PUA Forums - The UK's Leading Pick-up Artist Forum > Other Stuff > Off Topic


Reply
 
LinkBack Thread Tools
(#11)
Old
RLAJay's Avatar
MASTER PUA
Fishing the Sea Champion, Gyroball Champion, Eskiv Champion, Disc Dash Champion, Crazy Closet Champion
 
Send a message via Skype™ to RLAJay
Default 03-05-2011, 05:01 PM

Phil, want you want is known as a scraping tool. That's about all I know but may help put you in the right direction on google. I've not used one for your purposes. I do use one to scrape google searches for blog updates on relevant keywords though.

If you want to change IPs regularly you either want a VPN tool like hidemyass which you can set to change IP at periodic times or a native proxy switcher(opposed to a browser plugin). You'll probably need to pay for private proxys though as public ones are notoriously unreliable.

EDIT: Chops beat me to the scraper bit.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote

Don't like ads? Register a free account to make them go away forever.

(#12)
Old
chops147's Avatar
MASTER PUA
 
Default 03-05-2011, 05:20 PM

with the proxy thing as long as you're not making requests every couple of seconds I wouldn't imagine they'd ban you just set the bot to do a random delay of 5 to 10 seconds between requests.

p.s are you using this to get details for leads so you can make sales? I remember you saying that you needed leads.

RLAjay how are you working the whole autoblogging thing I'd love to know how to work it successfully. Assuming that's what you meant.


Life is Like poker
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#13)
Old
MASTER PUA
Starcastle Champion
 
Default 03-05-2011, 06:25 PM

Quote:
Originally Posted by chops147 View Post

p.s are you using this to get details for leads so you can make sales? I remember you saying that you needed leads.
ye man!,.....


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#14)
Old
chops147's Avatar
MASTER PUA
 
Default 03-05-2011, 06:32 PM

Quote:
Originally Posted by Phil View Post
ye man!,.....
I like you style. would advise looking at the legality though but I'm sure you allready know about that.


Life is Like poker
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#15)
Old
MASTER PUA
Starcastle Champion
 
Default 03-05-2011, 06:41 PM

ok im lookin but it all means squat to me! really does anyone know about how to do it, or anyone who can do it for me, if u can ill pay for ur time!

i want the newest additions to the site


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#16)
Old
Status's Avatar
I don't know who I am anymore
 
Default 03-05-2011, 07:24 PM

To scrape a site such as Yell.com, you need a cybernerd to build you a solution really. Rentacoder or getaFreelancer.com or Elance will allow you to post up a project spec and coders will bid for the job.

It's not something a noob could do, as Refl3x said, you'll need a list of proxies to cycle through or Yell will ban yo ass.

You maybe able to download some off-the-shelf scraper, it's worth a Google.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#17)
Old
MASTER PUA
Starcastle Champion
 
Default 03-05-2011, 07:53 PM

Quote:
Originally Posted by Tw1sted View Post
To scrape a site such as Yell.com, you need a cybernerd to build you a solution really. Rentacoder or getaFreelancer.com or Elance will allow you to post up a project spec and coders will bid for the job.

It's not something a noob could do, as Refl3x said, you'll need a list of proxies to cycle through or Yell will ban yo ass.

You maybe able to download some off-the-shelf scraper, it's worth a Google.
ye but then i wouldnt know what to do with it?


* Insert Funny Tag Line *
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#18)
Old
RLAJay's Avatar
MASTER PUA
Fishing the Sea Champion, Gyroball Champion, Eskiv Champion, Disc Dash Champion, Crazy Closet Champion
 
Send a message via Skype™ to RLAJay
Default 03-05-2011, 08:00 PM

Quote:
Originally Posted by chops147 View Post
with the proxy thing as long as you're not making requests every couple of seconds I wouldn't imagine they'd ban you just set the bot to do a random delay of 5 to 10 seconds between requests.

p.s are you using this to get details for leads so you can make sales? I remember you saying that you needed leads.

RLAjay how are you working the whole autoblogging thing I'd love to know how to work it successfully. Assuming that's what you meant.
I don't autoblog, I scrape in order to find relevant blogs to drop links, I then drop my links in an entirely whitehat manner opposed to using a tool to spam stuff out there.

I do however use a tool to automate spinning and submitting articles for me, they're my own articles so it's not all bad, it is a little greyhat though and manual submission is how it's "supposed" to be done. I don't have a choice at the moment though as there's absolutely no way I'll rank worldwide for terms like "attraction" or "pua" unless I gain a serious link footprint on the net compared to all these other sites that are very established with large footprints and an old domain age. Without automation I'd never catch up, especially given that they're ALL using blackhat techniques like gateway sites in order to fill up the rankings and redirect other searchterms to their products.

On topic, you'd need to change IP once every 12 hours or so if you're making 5 second requests otherwise it's going to be picked up as automated and blocked. You don't want your home IP blocked from service on any major sites that you need or use, it sucks.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#19)
Old
RLAJay's Avatar
MASTER PUA
Fishing the Sea Champion, Gyroball Champion, Eskiv Champion, Disc Dash Champion, Crazy Closet Champion
 
Send a message via Skype™ to RLAJay
Default 03-05-2011, 08:06 PM

Actually, thinking about it... If Yell has a sitemap then it wouldn't be that big a job for someone to write for you. It'd just require building a database of the sitemap and scanning for changes to it with an export of "new" stuff into potentially an rss notification format for emails or something.

If you get someone to build it for you and they can do it in this manner then I wouldn't expect to pay a coder more than 100-200. There's some people that work for dirt cheap on those coder project sites though, you may get it done even cheaper.

EDIT: This method wouldn't work, it appears their sitemap only includes the basic infrastructure of the page, it doesn't include the individually created pages for each business unfortunately. This means it would definitely have to be a spider of some kind constantly cycling through the categories.

I assume this is to sell something to new businesses Phil? Trying to get a dynamic list of new businesses as early as possible?

Last edited by RLAJay; 03-05-2011 at 08:09 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
(#20)
Old
chops147's Avatar
MASTER PUA
 
Default 03-05-2011, 09:46 PM

RLAjay don't try to jutify it it's how you do your shit fuck everyone else if I can make money by being a cunt I'll do it it's not as if you're killing anyone. way I see it is if it's not stealing then it's fine


Life is Like poker
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiTweet this Post!
Reply With Quote
Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Pick-Up Artist Forum UK
Copyright © 2024

Powered by vBulletin
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.