Any Javascript prevents my program from crawling this page
References
Reference NO 1
http://stackoverflow.com/questions/13657982/any-javascript-prevents-my-program-from-crawling-this-page
Reference NO 2
http://stackoverflow.com/questions/9864887/how-to-stop-bots-from-crawling-my-ajax-based-urls
Reference NO 3
http://webmasters.stackexchange.com/questions/16390/preventing-robots-from-crawling-specific-part-of-a-page
Reference NO 4
http://www.sitepoint.com/forums/showthread.php?610696-how-to-prevent-email-harvester-to-crawl-my-site
Reference NO 5
http://productforums.google.com/d/topic/webmasters/xWzm5L5g8j8
Reference NO 6
http://www.affilorama.com/site-building/robots-txt
Reference NO 7
https://developers.google.com/webmasters/control-crawl-index/docs/faq
Reference NO 8
http://moz.com/beginners-guide-to-seo/basics-of-search-engine-friendly-design-and-development
No comments:
Post a Comment