Thursday, July 1, 2010

Sample robots.txt to improve page rank

Here we will see a helpful robots.txt file structure. first let us know what is a robots.txt file. it contains information for web search engine bots to not scroll the seleted pages. let's see a sample helpful robots.txt file that will be helpful for improving page rank.
user-agent: *
disallow: /images/
disallow: /css/
disallow: /js/
disallow: /assets/
disallow: /classes/
disallow: /captcha/
disallow: /admin/
disallow: /system/ /* this is for codeigniter */
disallow: /application/confiq/ /* this is for codeigniter */
disallow: /application/controllers/ /* this is for codeigniter */
disallow: /application/errors/ /* this is for codeigniter */
disallow: /application/helpers/ /* this is for codeigniter */
disallow: /application/hooks/ /* this is for codeigniter */
disallow: /application/models/ /* this is for codeigniter */
disallow: /application/libraries/ /* this is for codeigniter */
disallow: /application/language/ /* this is for codeigniter */

User-agent: Googlebot-Image
Disallow:
Allow: /*

Sitemap: http://www.example.com/sitemap.xml

Please feel free to suggest me on this topic through your helpful comments.

see how to resolve svn conflict on http://newdailyblog.blogspot.com/2010/07/resolving-svn-conflict.html
See the book OpenCart 1.4 Template Design Cookbook.
See the book Joomla Mobile Development Beginners Guide.




List of my works:

Opencart Extensions:

  1. Product Based Quantity Wise Shipping: Find it here.
  2. OpenSSLCOMMERZ: integrate SSLCOMMERZ with opencart: Find it here.
  3. Fine Search v.1.0 - Improves Opencart search feature to find relevant: Find it here.
  4. Opensweetcaptcha - An easy way to generate attractive captcha for your system!: Find it here.
  5. Custom Field Product - add unlimited custom fields to the product form: Find it here.
  6. Formcaptcha - add captcha on the register page: Find it here.

My Books:

  1. OpenCart 1.4 Template Design Cookbook.
  2. Joomla Mobile Development Beginners Guide

No comments: