SlideShare una empresa de Scribd logo
1 de 19
Meta Keyword, Meta Description and Robot tag By winwinmantra.com
Meta Keyword Tag: Do you ignore Meta Keyword tag for your webpages? Don’t do that. Google seems to ignore Meta keyword tag but still other search engines give some value to it. And you should not ignore this because what all tags are available for SEO should be utilized under the umbrella of White Hat. Include keyword phrases between 12 to 15.  http://www.winwinmantra.com
Meta Keyword Tag: Don’t use a common keyword in all key phrases. You will come under spamming.  If you have already developed your website without using Meta Keyword tag then I suggest let it be as is. Don’t spend time to insert Meta keywords.  Each page should have Meta keywords related to the web page content.  http://www.winwinmantra.com
Meta Keyword Tag: Best usage of Meta keywords is inserting synonyms, misspellings and alternate words. eg1:- in page content use “Web Page”. In Meta keyword use “Webpage” eg2:- in page content use “Enrollment”. In meta keyword use “Enrolment”  http://www.winwinmantra.com
Meta Keyword Tag: eg3:- in page content use “Wordpress 2.8″. In meta keyword use “Wordpress 2.x” eg4:- “Prescription” is often mistyped as “Perscription” http://www.winwinmantra.com
Meta Description Tag: It is an important tag that you should consider seriously because it will be displayed in the search results.  It should describe what exactly the page all about is. Don’t stuff keywords but write the content for human eye.  Each page should have unique Meta description with keyword phrases included in it. http://www.winwinmantra.com
Meta Description Tag: Keep the Meta description tag length between 150 – 160 characters. Because anything more than that will cut off in the search result. If you have already developed your site with title tag more than 160 characters then evaluate if the keywords are covered with-in 160 characters or not. If any keywords are placed after 160 characters then you need to fix it else you can ignore. It will not affect your SEO. http://www.winwinmantra.com
Meta Description Tag: Do not repeat same sentences and keywords which are already covered in Title tag.  Display the fact of the content that is not covered/described in the Title tag. Dynamic websites that generate single description for all pages need to figure out alternative for it or any plug-in to create Meta descriptions for each page. Note: When we cover Google Webmaster tool, we are going to see how to check duplicate Meta description in a website. http://www.winwinmantra.com
Meta Robot Tag Meta robot tag is used to tell the Robot which page to be indexed/ followed and which should not. This tag need to be included in those pages which you don’t want to get indexed. Syntax: <meta content=”noindex,nofollow”> http://www.winwinmantra.com
Robots.txt: On a server, you may place presentation or documents which you want your prospects to access on demand. When a search engine crawls to your server, it will read all the files and folders available on server including the folder in which you have placed the files for your prospect. Since all the files got indexed in the search engine, when a user searches and the keywords get matched with the files present on the server, those presentations or documents will get displayed in result page. To overcome this issue robots.txt file is used. http://www.winwinmantra.com
Robots.txt: By default search engine robots will crawl in all the folders on your server. Robots.txt file is used to tell the search engine which files and folders to be crawled/indexed and which should not be crawled/indexed.  Robots.txt can only prevent the robots from get crawled on your server, but your pages will be indexed if those links are found by robot on other websites. http://www.winwinmantra.com
Robots.txt: Place the robots.txt file on the root level.  To write a comment in the robots.txt file use # symbol at the beginning of the line.  If you don’t want to set robots.txt then at-least make a dummy notepad with the name robots.txt and upload it on the server. It will prevent the 404 error in the log file. http://www.winwinmantra.com
Robots.txt: In a database driven website, most URLs will be passing values in the form of GET methods. To avoid these pages from getting crawled, use this format: Disallow: /*?  To avoid pages from getting crawled for a particular file extension in the URL, use this format: Disallow: /*.php$ Use Google Web Master Tool to evaluate any errors in the robots.txt file. http://www.winwinmantra.com
Robots.txt: Drawback: Someone can hack or try to steal the data from your website by seeing the robots.txt as all the paths are mentioned in it. Make sure your server security is strong enough. http://www.winwinmantra.com
Creating robots.txt file: Create a file with the name robots.txt using a text editor (Notepad). Syntax: User-agent: Specify the robot name Disallow: Specify the filename or the directory name To specify all the robots: User-agent: * To specify all the robots starting with the letter “G”: User-agent: G* http://www.winwinmantra.com
Creating robots.txt file: To stop robot from indexing any of the files or directories: Disallow: / To stop robot from indexing a particular file or directory: Disallow: /showcase Disallow:/default.asp Simply leave “Disallow” as blank to tell robots to crawl all the files and directories http://www.winwinmantra.com
Creating robots.txt file: Example 1: # Allow Google to index all the files and directories on your server. User-agent: Googlebot Disallow: Example 2: # All search engine spiders not to index specific directories. User-agent: * Disallow:/cgi-bin/ Disallow:/download/ http://www.winwinmantra.com
Creating robots.txt file: If you set general rules that are common for all the search engines robots and rules for a specific robot then the specific robot will ignore the general rules. User-agent: Googlebot Disallow: User-agent: * Disallow: / In the above case, Googlebot will crawl all the pages. Googlebot will ignore “User-agent: *” command. http://www.winwinmantra.com
Website Traffic Secrets Tutorial Thank you for your interest in winwinmantra. To view other topics on SEO, visit:http://www.winwinmantra.com/ To view “Table of Index” for website traffic secrets tutorial, visit: http://ww.winwinmantra.com/traffic-secrets/trafficsecret-process.html http://www.winwinmantra.com

Más contenido relacionado

Destacado

CRM - Customer Relationship Management
CRM - Customer Relationship ManagementCRM - Customer Relationship Management
CRM - Customer Relationship Managementvinaya.hs
 
Customer relationship management
Customer relationship managementCustomer relationship management
Customer relationship managementcharanreddy589
 
Search Engine Optimization (SEO)
Search Engine Optimization (SEO)Search Engine Optimization (SEO)
Search Engine Optimization (SEO)Dennis Deacon
 
How to Build SEO into Content Strategy
How to Build SEO into Content StrategyHow to Build SEO into Content Strategy
How to Build SEO into Content StrategyJonathon Colman
 
SEO Guide for Beginners, The Beginner Guide to SEO
SEO Guide for Beginners, The Beginner Guide to SEOSEO Guide for Beginners, The Beginner Guide to SEO
SEO Guide for Beginners, The Beginner Guide to SEORahul Kumar
 
The Basics Of CRM
The Basics Of CRMThe Basics Of CRM
The Basics Of CRMAmal Biswas
 

Destacado (7)

SEO - A Beginners' Guide
SEO - A Beginners' GuideSEO - A Beginners' Guide
SEO - A Beginners' Guide
 
CRM - Customer Relationship Management
CRM - Customer Relationship ManagementCRM - Customer Relationship Management
CRM - Customer Relationship Management
 
Customer relationship management
Customer relationship managementCustomer relationship management
Customer relationship management
 
Search Engine Optimization (SEO)
Search Engine Optimization (SEO)Search Engine Optimization (SEO)
Search Engine Optimization (SEO)
 
How to Build SEO into Content Strategy
How to Build SEO into Content StrategyHow to Build SEO into Content Strategy
How to Build SEO into Content Strategy
 
SEO Guide for Beginners, The Beginner Guide to SEO
SEO Guide for Beginners, The Beginner Guide to SEOSEO Guide for Beginners, The Beginner Guide to SEO
SEO Guide for Beginners, The Beginner Guide to SEO
 
The Basics Of CRM
The Basics Of CRMThe Basics Of CRM
The Basics Of CRM
 

Último

ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSJoshuaGantuangco2
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxPoojaSen20
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Mark Reed
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxMaryGraceBautista27
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 

Último (20)

ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 

Tips on Meta Keyword, Meta Description and Robot tag

  • 1. Meta Keyword, Meta Description and Robot tag By winwinmantra.com
  • 2. Meta Keyword Tag: Do you ignore Meta Keyword tag for your webpages? Don’t do that. Google seems to ignore Meta keyword tag but still other search engines give some value to it. And you should not ignore this because what all tags are available for SEO should be utilized under the umbrella of White Hat. Include keyword phrases between 12 to 15. http://www.winwinmantra.com
  • 3. Meta Keyword Tag: Don’t use a common keyword in all key phrases. You will come under spamming. If you have already developed your website without using Meta Keyword tag then I suggest let it be as is. Don’t spend time to insert Meta keywords. Each page should have Meta keywords related to the web page content. http://www.winwinmantra.com
  • 4. Meta Keyword Tag: Best usage of Meta keywords is inserting synonyms, misspellings and alternate words. eg1:- in page content use “Web Page”. In Meta keyword use “Webpage” eg2:- in page content use “Enrollment”. In meta keyword use “Enrolment” http://www.winwinmantra.com
  • 5. Meta Keyword Tag: eg3:- in page content use “Wordpress 2.8″. In meta keyword use “Wordpress 2.x” eg4:- “Prescription” is often mistyped as “Perscription” http://www.winwinmantra.com
  • 6. Meta Description Tag: It is an important tag that you should consider seriously because it will be displayed in the search results. It should describe what exactly the page all about is. Don’t stuff keywords but write the content for human eye. Each page should have unique Meta description with keyword phrases included in it. http://www.winwinmantra.com
  • 7. Meta Description Tag: Keep the Meta description tag length between 150 – 160 characters. Because anything more than that will cut off in the search result. If you have already developed your site with title tag more than 160 characters then evaluate if the keywords are covered with-in 160 characters or not. If any keywords are placed after 160 characters then you need to fix it else you can ignore. It will not affect your SEO. http://www.winwinmantra.com
  • 8. Meta Description Tag: Do not repeat same sentences and keywords which are already covered in Title tag. Display the fact of the content that is not covered/described in the Title tag. Dynamic websites that generate single description for all pages need to figure out alternative for it or any plug-in to create Meta descriptions for each page. Note: When we cover Google Webmaster tool, we are going to see how to check duplicate Meta description in a website. http://www.winwinmantra.com
  • 9. Meta Robot Tag Meta robot tag is used to tell the Robot which page to be indexed/ followed and which should not. This tag need to be included in those pages which you don’t want to get indexed. Syntax: <meta content=”noindex,nofollow”> http://www.winwinmantra.com
  • 10. Robots.txt: On a server, you may place presentation or documents which you want your prospects to access on demand. When a search engine crawls to your server, it will read all the files and folders available on server including the folder in which you have placed the files for your prospect. Since all the files got indexed in the search engine, when a user searches and the keywords get matched with the files present on the server, those presentations or documents will get displayed in result page. To overcome this issue robots.txt file is used. http://www.winwinmantra.com
  • 11. Robots.txt: By default search engine robots will crawl in all the folders on your server. Robots.txt file is used to tell the search engine which files and folders to be crawled/indexed and which should not be crawled/indexed. Robots.txt can only prevent the robots from get crawled on your server, but your pages will be indexed if those links are found by robot on other websites. http://www.winwinmantra.com
  • 12. Robots.txt: Place the robots.txt file on the root level. To write a comment in the robots.txt file use # symbol at the beginning of the line. If you don’t want to set robots.txt then at-least make a dummy notepad with the name robots.txt and upload it on the server. It will prevent the 404 error in the log file. http://www.winwinmantra.com
  • 13. Robots.txt: In a database driven website, most URLs will be passing values in the form of GET methods. To avoid these pages from getting crawled, use this format: Disallow: /*? To avoid pages from getting crawled for a particular file extension in the URL, use this format: Disallow: /*.php$ Use Google Web Master Tool to evaluate any errors in the robots.txt file. http://www.winwinmantra.com
  • 14. Robots.txt: Drawback: Someone can hack or try to steal the data from your website by seeing the robots.txt as all the paths are mentioned in it. Make sure your server security is strong enough. http://www.winwinmantra.com
  • 15. Creating robots.txt file: Create a file with the name robots.txt using a text editor (Notepad). Syntax: User-agent: Specify the robot name Disallow: Specify the filename or the directory name To specify all the robots: User-agent: * To specify all the robots starting with the letter “G”: User-agent: G* http://www.winwinmantra.com
  • 16. Creating robots.txt file: To stop robot from indexing any of the files or directories: Disallow: / To stop robot from indexing a particular file or directory: Disallow: /showcase Disallow:/default.asp Simply leave “Disallow” as blank to tell robots to crawl all the files and directories http://www.winwinmantra.com
  • 17. Creating robots.txt file: Example 1: # Allow Google to index all the files and directories on your server. User-agent: Googlebot Disallow: Example 2: # All search engine spiders not to index specific directories. User-agent: * Disallow:/cgi-bin/ Disallow:/download/ http://www.winwinmantra.com
  • 18. Creating robots.txt file: If you set general rules that are common for all the search engines robots and rules for a specific robot then the specific robot will ignore the general rules. User-agent: Googlebot Disallow: User-agent: * Disallow: / In the above case, Googlebot will crawl all the pages. Googlebot will ignore “User-agent: *” command. http://www.winwinmantra.com
  • 19. Website Traffic Secrets Tutorial Thank you for your interest in winwinmantra. To view other topics on SEO, visit:http://www.winwinmantra.com/ To view “Table of Index” for website traffic secrets tutorial, visit: http://ww.winwinmantra.com/traffic-secrets/trafficsecret-process.html http://www.winwinmantra.com