Friday, December 14, 2007

search engine optimization

Search Engine Optimization or SEO is the art of making your site more accessible to the search engine spiders, as well as getting the maximum number of pages indexed. It is all about incorporating practices that search engines and users want.

Search engine optimization is a general terms helps a website to be highly visible on Internet। Now imagine that you have a website related to car and bike. But nobody will ever come to know that such a site related to car and bike exists. Even person living in your backyard won't be knowing anything about your website and you are not getting even single sale a day and then what's the meaning of using a website that doesn't working in favor of you.

Here search engine optimization comes in handy.Most of the business and visitors and you can directly say sales comes through different search engines using search terms such as Google, Yahoo, Alexa, MSN etc. using key phrase. Being on top of Google means free advertisement on the front page of a popular daily newspaper.Google counts for about 72% of total searches on the Internet with MSN on second position an around 22%. Google search more relevant sites more quickly, delivering the most relevant results. Google has developed a special system called Page rank to determine the importance of a Web Page by using voting system.Page Rank relies on the uniquely democratic nature of the web by using its vast link structure as an indicator of an individual page's value.That means how much Google providing importance to that page.

Google uses voting system. In essence, Google interprets a link from page x to page y as a vote, by page x, for page y. But, Google looks at more than the sheer volume of votes, or links a page receives; it also analyzes the page that casts the vote. High-quality sites receive a higher PR, which Google remembers each time it conducts a search. Of course, relevant pages mean nothing to you if they don't match your search. Along with Page rank there are some more terms that you should know like relevancy of page to search term, keyword density, prominency,proximity.

Let if page x links out to page y Back link: Page y is said to have a "back link" from page x.

Incoming link: Page y has incoming link from page x. As the link on x leads the visitor to Page y.

Outgoing link: Page x has outgoing link to page y.

Internal links: Internal link are those which leads a visitor to some other Web Page of the same website.

External link: If the link leads to some other website then it is called External link.Now more the number of incoming links and lesser the number of outgoing links, more it's beneficial for the website. Website will get more importance and hence higher the page rank.

Therefore the first step towards to get a good page rank is to get more incoming links. Increasing the internal links in your site can minimize the damage to your PR when you give away votes by linking to external sites. Getting more and more inbound links to your site is the only way to increase site's average PR.But what do think for finance site a link from furniture site is helpful. The answer is absolutely No.

The best way of increasing traffic on your web site to get more and more incoming incoming link in your favor.Now a days Link building is not the only factor that increase your popularity.

Alternatives of Link Building

In today’s ever-changing scenario a search engine optimization compagin can never be dependent of link exchange only. So we have other more effective alternatives like article submission, directory submission, search engine submission(On page and Off page) ,press release and forum posting RSS feed etc. By using these alternative search engine optimization methods we can boost the visibility, ranking, and traffic of client website.

Rajesh Gupta is a Web Designer with a company having well connected development infrastructure in India having a strong portfolio of International clients offering superior web design india and solutions at competitive costs.You can contact him at rajeshgupta.seo@gmail.com

SEO Services Life Cycle

Search Engine optimization and Website Promotion service is done in following phases:
PHASE: I - Site Analysis

Website code Analysis

Competition Analysis

Keyword Analysis

Link Popularity Analysis

Check for Broken site links


PHASE: II - Website Optimization Process

HTML code validation and repair

Keyword Research

Keywords Popularity analysis

Web page and Image Optimization

Meta Tags analysis and Keyword density


PHASE: III - Website Promotion Process

Sitemap creation and submission (ROR, XML, TXT)

Search engine submission

Directory submission

Creation and Submission of RSS Feeds


LS Blogs

PHASE: IV - Ongoing Link Popularity Process

Link exchange

Buying Links of High PR

Creating Blog

Article Submission

Submission of new posts and Feeds

Creating Bookmarks


PHASE: V - SEO Reporting and Final Analysis

E-Mail & Telephone support

Monthly Ranking Reports

SEO Tracking

The Blog
Directory

PHASE: VI - Site Monitoring and Maintenance

Monthly Ranking Reports

Optimization Tracking


Use following methods for Link Building as described below :-


Link Building Methods

RECIPROCAL LINK EXCHANGE

Link exchange by swapping links with website of good page rank

ONE WAY LINK EXCHANGE TECHNIQUES


Free

1. E-new letters

2. Contests / Games

3. E-Mail Service

4. Articles

5. Forums

6. Blogs

7. E-Mail Marketing

8. Publish Press Releases

9. White-papers

10. E-books

11. Profile Pages

12. Affiliate programs

Website Maintenance Services Need

Whether you have an internal web team or are exploring outsourced website maintenance services, it is necessary to determine the service needed for the various updates required to keep your content fresh and relevant. In short the why, how and where of your website maintenance.

Google seems to allow hidden content in some cases

"If the hidden content is a more-accessible-but-less-pretty version of the content that hides it--e.g. text behind an image containing those words--our quality measures should not mind. Of course, we suggest using the ALT and TITLE attributes of the IMG tag, which were designed for this very purpose (providing alternative text to replace images), but you are, of course, free to design your site as you see fit."

Role of Spider in SEO

Know Thy SEO Spider

NO I am not talking about the eight-legged hairy creatures of nightmares. These spiders are electronic, used by search engines, and if you ignore them they give you nightmares that will haunt you every waking moment.

Search Engine Optimization (SEO) is all about common sense; it doesn’t necessitate specific knowledge of algorithms, programming and classifications. All it requires is a basic understanding of how search engines spiders work. Taking care of the search engine spiders likes and dislikes can prove to be crucial for the health and success of your website.

The Spider at Work

They are called spiders because they crawl over the Web in search of content. Search engines gather data about a website by ‘sending’ the spider or bots to ‘read’ the site and copy its content. This content is stored in the search engine’s database. As they copy and absorb content from one document, they create record links and send other bots to make copies of content on those linked documents this process goes on and on. As of now the major search engines have established databases that measure their size in the tens of billions using this process.

Spiders are designed to read site content like a human. It will start at the top left hand corner, reading line by line. In case of columns spiders will read the left hand column before moving to central and right hand column. It will read and record the whole site to the very last word.

Likes of the Spider

Provide clear paths for spiders to follow, put easy to follow text links directed to the most important pages in the site at the bottom of each document. The sitemap is the most important link in the site as it directs spiders through the website.

Provide as much relevant key word rich text as possible. Search engine spiders read the text that is on your Web site to decide if your site is relevant or not. If they do not find the keyword being searched they will simply ignore your site and move to the next site. Also make sure the text is relevant and makes sense.

Provide clear identification between areas that to be used and areas that are off limit to the spiders.

Provide clear titles; after the URL of a site, the first information a spider records is the title of the site. Titles should have the most important keyword targets.

Provide a well written Description Meta tag. Search engines use Description Meta tag to collect information on the topic or theme of the site.

Dislikes of the Spider

Avoid Very large volume in content. Spiders can only download a fraction of the Web pages within a given time frame, so if you have too much it might skip the most important parts.

Avoid dynamic page generation, spiders generally tend to avoid pages having any resources that have a "?" i.e. dynamic in nature. Stick to static generation spiders prefer them.

Avoid too many graphics. Spiders are not fond of graphics as they are not readable for them so keep it simple.

Avoid Key word misuse. Doesn’t just string a lot of keywords together, remember the spiders are very smart and they will ban you for spamming.

In conclusion……..

The whole point of the article is to reinforce that Search Engine Optimization starts with the designing of your website. It is not something that can be added as an enhancement later on.

Knowing the way around the spider might just make you king of the web.

Keywords --- Key to SEO Success

Keywords are one of the most crucial tools for you, that is if you want to score on search engines. And believe me you do.

Search Engine Optimization (SEO) is essential for the success of almost every business. Majority of traffic to websites is brought in by search engines if search engines ignore your site, you are as good as invisible.

Key words

Keywords are words and phrases that web users put into search engines when they are looking for particular topics, services or products.

Optimizing your website so it turns up in the top of the search engine results pages (SERPs) search engine ranking of pages, can spell success for you. Only if you choose the right keywords can you begin on the winning trail of SEO.

Deciding on keywords

How exactly do you choose keywords- this is a precise art:

First you must prepare a list of your product/services workings. Every word that describes product/service must be included. Not that all the words will be used but it’s handy to have a database.

Secondly you must identify your target audience. Choosing effective keywords is about putting yourself in your audience’s shoes. Research their tastes, likes-dislikes, their needs and requirements.

The next stage is to judge the value of the words and phrases on your list have as search terms. For this there are several software’s available like-

Wordtracker is the most popular and respected keyword research tool.

KeywordDiscovery have an extensive keyword database.

Google AdWords provide a keyword generation tool, to help you choose keyword variations.

In the last stage you must narrow down your Keyword choice to 2-3 words or phrases. Any more than this your web page will resemble crowded street.

Keyword Density

Keyword density is a calculation of how many times your keywords repeated in a page. The more times the keyword appears in relation to the total number of on page words, the greater the overall keyword density. There is no hard and fast rule for keywords but it’s best to keep the keyword percentage below five percent of the total number of words on the page.

A careful balance is needed too much and you end up on the crowded street, which users find exasperating and which search engines call spamming. (Search engines may penalize you for anything close to spamming).

Each search engine has a different mathematical equation concerning the density of keywords that is rewarded with higher search ranking placement. Different search engines have different criteria’s for keyword density. The best thing to do is use keyword density analyzers that calculate keyword density for given URLs.

Keyword Placement

Keyword placement refers to the location of the words on a Web page, some of the best places to put keyword are:

Page title

headings

As links

bold text

first 25 words on the page

URLs

META tags

In Short

Keywords are not a license to spill, using too many keywords or using them too often is the best way to loose customers and be kicked out by search engines. The best way to raise your SERPs is to research, plan and place your keywords carefully.

Pay-per-click advertisement

Pay-per-click advertisement: Present predicament and future alternatives
The phenomenal growth of pay-per-click advertisement amid uncertainties
Today pay-per-click advertising, by and large, is assumed to be one of the quickest and effective ways of promoting one’s business online. To many it is still an effective medium to get listed in the top of the search engines without having to undertake strenuous preparatory works for search engine optimization.

But the beginning was not the same as it is now. Rather this concept encountered bleeding teething problems in its progressive strides. The idea was not well-received; some critics even went to the extent of prophesying that it is definitely headed for a doom.

People questioned the rationale of paying any penny for getting web site in prominent positions where the search is exclusively keyword driven. They justified their proposition by saying that as against the banner ad, pay-per-click is relatively minor advertising stunt, and that too is not there all the time.
As of now, situations have taken a positive turn. The success saga of pay-per-click advertising is known to one and all. Now advertisers promptly bid on keywords, promising to pay certain amount of money every time someone clicks on their ad, which pops up when a search exercise is performed by any surfer.
Pay-per-click advertisement is in eye of the storm

Pay-per-click advertisement has grown over the years, but it has also become susceptible to what is referred to as “Click Fraud.” There are an increasing number of people, who have mastered the art of tampering with pay-per-click advertisement, and have posed a real threat to the prospects of pay-per-click advertisement for online advertisers and the companies offering them.
Click fraud comes into picture when a user -- accidentally or deliberately -- or a competitor with malafide intention, clicks on a business’ ad and subsequently disappears into the thin air. No actual use of the advertisement – mere clicking through. Such instances tend to inflate the earmarked advertising budget of the company which has chosen this medium for online sales and marketing. On the other side of the fence, it adds to earning potential of an affiliate web site which hosts pay-per-click advertisement campaign on behalf of select companies opting for this genre online advertising.

Statistics from the industry reveal that click frauds account for as high as 20 per cent for certain keywords. Further, estimate suggests that one out every five dollars spend on pay-per-click advertisement goes down the drain.
What led to the present messy situations?

Definitely the present state of pay-per-click advertisements has given its doom pundits a reason to rejoice, and they may be basking in their proud moments. Many companies have turned to the advantages of such kind of web promotion, while small and mid-sized firms have realized that pay-per-click- advertisement is particularly beneficial for them because they don’t have to put in much investment.

This was until click fraud did not begin to spread its ugly wings. Now it is a roller-coaster ride for companies, and they are wishing to have some way for plugging in the loopholes existing in the system.

Let’s understand the reasons for such messy state of affairs.

The “gold rush” can be blamed on more than one count. This fact is deplorable that it is excessively easy to publish pay-per-click advertising links from Google and Yahoo. What suffices for the purpose is joining Google AdSense or corresponding Yahoo program. Your business gets a fillip, and you do not have to spare even a penny.


It is highly inexpensive to purchase a domain name, and this is another major reason for the predicament pay-per-click advertisement is faced with. VeriSign, which runs the .com and .net domain names, offers domain names for as little as $6 to $7 per year. Hence, a web site hosting pay-per-click ads doesn't’t need to get many people clicking through its ads in order to turn a profit. To make it worse, there is five-day “Add Grace Period,” during which new registrations can be deleted for a full refund.
Is the time ripe for switching over to other online advertising model, if any?

Bill Gross was the force behind GoTo.com’s “pay-per-click” advertising model which heralded an era of pop-ups advertisement. GoTo.com was subsequently purchased by Yahoo in 2003, and later on Google also adopted a similar online advertising medium called AdWords. But click fraud inflicted them all.
Bill Gross’ new advertising model called cost-per-action holds answer to challenge posed by click fraud. The model aptly called cost-per-action is based on the premise that companies do not have to pay every time a user clicks on an ad and enter their web sites. Payment becomes obligatory only when clicking through an ad leads to a desired action, for instance, a purchase, filling out a firm, downloading some stuff and so forth. The bottom line in this model is that this is mutually beneficial this time around on an equitable basis.

This model is inherently and fundamentally strong not to give click fraud a chance. Click fraud occurs when someone visits an advertiser’s web site with malicious intention for securing pecuniary advantage or harming the interest of other partner. Since the advertiser is no longer under obligation to pay for damn mindless clicks, click fraud can’t happen.

Snap.com is leading from the front

This online advertising model, better described as “a next-generation search engine for broadband users.” was characteristic feature of Snap.com, which launched it for the first time. Snap.com has some other enabling technology going for it. It joins algorithmic search results together with human click stream data, and calls it “behavioral ranking.” The cardinal principle here is that sites which give people more value will rank higher than others who do not. Snap.com holds the reason that values are measurable in terms of quality of content and number of transactions completed. The higher the qualities of content, the longer surfers are likely to be engrossed is what Snap.com believes in.

Cost-per-action model seems to be all set to grow manifold. Sooner than the later, it will influence other search engines to adopt their own versions of its model and become more customer-centric. The possibility is not far off that this time around Bill Gross’s innovative approach is deservedly purchased by Google.

Tips for getting high Google ranking

Tips for getting high Google ranking
Google’s ranking is objective. Results are difficult to tamper with

The growing popularity and hence the widening marker share of Google is an established fact. Google has outgrown the competition and has set industry standards for others to emulate. Google believes that when any user comes searching for his or her query on Google, he or she should get most relevant and quality results. And this is probably how Google has maintained its sanctity as a formidable search engine to reckon with.

To dish out meaningful results to searchers on the web, Google has adopted a methodology called search algorithm which takes care that filtered results against the search criteria are as “honest”, “objective” and “easy” (Google’s own terminology) as is possible using cutting edge technologies at its end.
One of the intriguing aspects of Google’s search algorithm is that it keeps on changing. However, what does not change is its commitment to serve the users in an impartial and meaningful way. One can well understand the arduous challenges Google took head-on when it became operational as a search engine with this vision.

This is not unexpected that in such a massive operation, discrepancies and flaws would creep in. Google did have its set of flaws in the initial years and web masters played around the loopholes for a better ranking. In an attempt to prevent such maneuvers in future, Google fixed the bugs in search algorithm as and when they came to the fore. And, best of all, it adopted a highly dynamic methodology to rank the pages and this methodology changes a bit before the flaws become general knowledge for all to tamper search results.

Notwithstanding all such aspects, getting a good placement on Google is not an enigma at all. Though it could be a mystery for people who intend to cheat on the Google. Google specifically mentions what it looks for while ranking a web page, and what it takes to be on the high search engine results. This is true that whatever is written on this page are at best broad guidelines, but one can learn to formulate such placement strategies as are in conformity with the spirit of Google’s search algorithm.
Scaling new rankings on Google

As no one can deny or debate the indispensability of some good rankings on Google, so there is a point to learn the secrets of this great advantageous possibility of your web site on the Net.

Let’s discuss how to go about it

Go for quality inbound links

It is held that the greater the number of links you manage to get at your web page, the greater is the possibility that your web page will be ranked high on Google. But it should be kept in mind that link or links pointing at your web page must be relevant, related and meaningful. Basically, nothing but these are the characteristics of a link that qualifies for a quality link with respect to your web page. There is another advantage associated with it: Google rankings of the web pages whose links you have displayed at your web page contribute its little bit in the ranking of your web page. Simply put, quality links are fairly good means for optimizing your page.

Make your title tags relevant

The title tag of your home page is crucial for your web page. As is common understanding, the title of a page speaks cogently about what is to follow in the ensuing page. When it comes to Google optimization, it is equally significant as Google does read title tags and then proceeds to the page for content evaluation.
So, crisp and concise title tags that relate to the core focus of your web page or better still title tags that are identical to your chosen keyword(s) are helpful for optimization of your page.

Decide your keyword(s) and determine its density

Basically, keyword is the word with which users are likely to search in Google in order to reach you and you too have it on your web page. In other words, you decide what your page is all about in a few words, keeping in view with what sort of words users are likely to search for your page or similar pages on the Net. Like for example, if your web site is into offering web design consultancy and service, you can settle down with the keywords like web design, web site design, web development, web design consultancy and the like.

Keyword density is the ratio of number of occurrence of your selected keyword(s) and the total number of words on the web page. As is evident now, the more a keyword is repeated on the page, the higher the keyword density.
But there is a word of caution here: though good keyword density is taken positively by Google, mindless dumping and clustering of keywords resulting into content chaos may deteriorate your existing ranking or even your site may be banned. Remember a good keyword density is never a two digit figure on a web page; it could preferably be four to five i.e. keyword can safely be repeated four to five times on the web page for better results.
Some Google friendly considerations for a good ranking

Incorporate the links on your web site with keyword(s) if possible

Google’s founders have revealed that if the links placed on your web site also contain your keyword, then there are pretty good chances that your web site will be ranked higher as against that keyword. So, linking strategy has got double advantage for your web page optimization. Firstly, the relevance of the link on your site, and secondly the presence of keyword on that link is crucial respectively. If combined together, they go in strong favor for a higher Google placement of the page in search results.

Hence, if you are thinking on some truly helpful strategy to optimize your page, why not to adopt this linking duo to push up your Google ranking.

Use ALT tags on images

Be it known to you that Google does index the Alt tags and texts contained therein. Therefore, if you use various images on your web site, do not forget to use ALT tags and give relevant content. It is likely to give your web page a boost in terms of ranking.

Some people do not use Alt tags on images simply out of sheer ignorance. This is, of course, will not be the case with you anymore. Will it be?

Put a link to your dynamic pages

Contrary to other search engines, Google is compatible to index all your pages including dynamic ones. However, Google’s ability to read your dynamic pages depends on the fact that whether a link is there or not to them. Once you provide a link to your dynamic pages, Google will index these pages without any apparent difficulty.

It is recommended that you do not let Google to escape your dynamic pages due to mere lack of a supporting link.

Avoid using Meta tags

Google does not take into consideration the Meta tags while indexing a page. Thus, spending time and energy on carefully using Meta tags makes no sense. Instead, exploit your time and resources on the strategy that works, like ones which have been discussed up to this point here in this article.

Lesson

The only lesson that works in matter of high Google ranking is the lesson given by Google itself. Keep your eyes and ears wide open to sense how you can be Google’s algorithm friendly to sustain your competitive edge over others.

Search Engine Marketing

SEM- Search engine marketing is one of the most important aspects for businesses who sell products and services online or who use their websites to generate sales leads. SEM can provide valuable solutions for driving highly targeted visitors to your site.

SEM Marketing Strategies

There are a few SEM strategies that if done properly can generate customers and make your site a favorite among search engines.

Search Engine Optimization

Search Engine Optimization or SEO is the art of making your site more accessible to the search engine spiders, as well as getting the maximum number of pages indexed. It is all about incorporating practices that search engines and users want.

Many site owners do not understand that SEO should be taken into consideration before you build your site and not afterwards. Fortunately, SEO can also be done after a site is built, but this costs money and time. SEO is just a matter of understanding what search engines look for when they visit your site.

For this you need to concentrate on:

Ø Domain Names

Ø The Title Tag

Ø Meta Description and Meta Keyword Tags

Ø Content

Ø ALT Tags

Ø Site Map


Some practices are not SEO friendly and should be used sparingly or avoid:


Ø FLASH pages

Ø Dynamic Pages

Ø JavaScript


Keywords & Phrases


Before you start writing the content for your site you have to know which keywords and key phrases to use. Keywords or key phrases are the words or phrases that user’s type into search engines. For getting to know the best keywords or phrases you have to research your target users thoroughly and understand their needs and desires.

Search Engine Submission


Search engine submission is the most important step after SEO. This is important as this will get your sight listed among the search engines and directories.

There are three ways to get your site listed in a search engine or directory:


Ø Submit your site directly to the search engines through a free submit form.

Ø Through links to your site from other sites such as directories.

Ø Paying the search engine to index your site.


Link Popularity

Link popularity is a key factor in search engine marketing and ranking well in search engines and generating traffic to your site. Link popularity is the number of incoming links coming to your site from directories, articles, or web sites.

The most important link factors are:


Ø Getting Links to Your Site

Ø Checking Your Link Popularity Regularly


Paid Inclusion


Paid inclusion is a way of paying search engines to index pages from your site. This is a quick way of getting search engines to find and index your site. It is also called PPI (Pay per Inclusion). This is a good method to get noticed quickly, but in the end does not have a high ROI.


Pay per Click Campaign

PPC is a form of online advertisement. The object of Pay per Click (PPC) search engine marketing is to drive targeted traffic to your website. You pay search engines money only when someone clicks on an ad on the search engine's results page or homepage. Hence the terms ‘pay per click’ because you only pay when the visitor clicks on your ad. This may sound an easy way to high ROI, but can prove to be a headache if not managed correctly. Since it is not important that every visitor is converted to a customer, PPC has to be carefully targeted and controlled.


Organic Search Engine Optimization


Organic Search Engine Optimization is a process that involves analyzing and changing of the site's underlying code, architecture and content in such a way that it is selected and ranked naturally by search engines i.e. without any payment involved.


Search engine marketing is as important as any other advertising method for the advancement of your business or product. Maybe it is more important as it is viewed globally by millions.

Long Tail Search Engine Optimization

Long tail searches are combined searches formed from several high frequency keywords and key phrases.

Long tail optimization simply targets the customers that very few others target using the less popular keyword or phrases. There are the hundreds to thousands of less popular keywords and key phrases that a site is searched for, yet rarely noticed or used by site owners or internet marketers.

Principle of the Long Tail

The principle of the Long Tail is the opposite of focusing on the top 10-20 keywords or key phrases for marketing of sites. According to long tail principal the length, or total number of low-number referred terms outnumbers the height or the total of top 10 terms.

In other words, the terms that are most popular, are rarely those that provide the most business. In most cases the victory of the site was from the hundreds of words outside of the most popular terms.

A long tail search may also be considered an evolving search, for ex:

Loan

House Loan

Long Island House Loan


How to Optimize for Long Tail

Unlike your main keywords, you can never tell what keywords to look for in long tail, so the biggest dilemma for long tail optimization (LTO) is figuring out which keywords or key phrases to use. There are a few options that you can try:

1. Constantly keep researching you’re site to see which terms are attracting traffic.

2. Try adding a few articles and see which terms are attracting visitors to your article and then optimize accordingly.

3. Combinations of different keywords or key phrases and different combinations of the same keywords or key phrases will help in LTO

4. Very long articles with large amount of content can help you rank for numerous keywords and key phrases.

5. Unlike normal article writing, you should do a lot of "rearticulating" of your keywords, try and use "lesser" used keywords and key phrases.

6. Writing numerous shorter length articles is another way.

7. Separate your long articles and short articles into sections, with each section dealing with a specialized topic.

8. Use longer titles for your articles, your main keywords should be in front, but also add more terms related to your article to help in long tail.

9. Anchor text in your internal links should have more keywords and key phrases

10. Use the author’s name or the site name or the company name, even if they are not famous, as many people tend to search by name.

11. Create customized web pages within your site specifically targeting many individual groups of customers.

Benefits of LTO [ Long Tail Search Engine Optimization ]

Designing your site according to LTO or optimizing for long tail searches lets you gain new customers and increase profits rapidly. A new site can see increasing sales and at the same time build the importance of depth of the site over a reasonable period of time. This allows you to invest and take rake in more profit.

With long tail optimization you will see higher sales closing rate, the reason being that you're web site becomes naturally tailored to a wider audience.

Long tail search optimization is the future of web site and internet marketing, ignoring it might just cost you a fortune.

X-Robots tag Google yahoo

Google, Yahoo, the X-Robots directive and your website rankings

Last week, Yahoo announced that they now support the X-Robots-Tag in the HTTP header. This new tag allows you to influence how Google and Yahoo index your website pages.

What is the X-Robots-Tag?

Google introduced the new X-Robots-Tag directive in 2007 to allow webmasters to control access to non-web page documents, such as Adobe PDF files, video and audio files.

The X-Robots-Tag is included in the HTTP header of a document. The HTTP header is the initial reply of a server to a query. It contains information about the document that follows, including content type, creation date, character set, encodings, etc.

The new X-Robots-Tag allows webmasters to add information about search engine indexing to the HTTP header.

Which commands are supported by the X-Robots-Tag?

At this time, the X-Robots-Tag supports the following commands:


  1. X-Robots-Tag: NOINDEX (Use this tag if you don't want to show the URL in Google's search results)

  2. X-Robots-Tag: NOARCHIVE (Use this tag if you don't want to see a Cache link in the search result pages for the document)

  3. X-Robots-Tag: NOSNIPPET (Use this tag if you don't want to display a summary in the search result pages.)

  4. X-Robots-Tag: NOFOLLOW (Use this tag if you don't want Googe and Yahoo to index the links in the page.)

The X-Robots-Tag is currently supported by Google and Yahoo. Other search engines don't support the tag yet.

How to add the X-Robots-Tag to your documents

It depends on your server and on the method you use to create your web pages how you can add additional tags to the HTTP header. If your web server uses Apache, you can use the htaccess file to modify your HTTP headers.

In general, you shouldn't mess with the HTTP header if you're not 100% sure what you're doing. A broken HTTP header can keep search engines away so that no search engine will index your website.

Instead of using the X-Robots-Tag, you can also add meta tags with the same functionality to your web pages:


You can edit these tags directly in the head part of your web pages. They have the same effect as the corresponding X-Robots-Tags explained above.

Do you need the X-Robots-Tag or the corresponding meta tags?

If you don't want to limit access to your documents of if you only have normal web pages on your website then you don't need the X-Robots-Tag or the meta tags.

The X-Robots-Tag has been designed to restrict access to your documents. That means that it does not help to increase search engine rankings.

The new X-Robots-Tag and the meta robots tag allow you to restrict access to your documents. If you want to make sure that search engines index all of your web pages then you have to optimize your web pages.

Search engine robots must be able to easily parse your web pages and they must be able to find the right elements on your web pages. If you optimize the right web page elements with the right keywords, your web page will get high search engine rankings for these keywords.