Friday, September 18, 2009

Changing your site's title and description in search results

Google's creation of sites' titles and descriptions (or "snippets") is completely automated and takes into account both the content of a page as well as references to it that appear on the web.

We use a number of different sources for this information, including descriptive information in the META tag for each page. Where this information isn't available, we may use publicly available information from DMOZ. While accurate meta descriptions can improve clickthrough, they won't impact your ranking within search results. We frequently prefer to display meta descriptions of pages (when available) because it gives users a clear idea of the URL's content. This directs them to good results faster and reduces the click-and-backtrack behavior that frustrates visitors and inflates web traffic metrics.

While we're unable to manually change titles or snippets for individual sites, we're always working to make them as relevant as possible. You can help improve the quality of the snippets displayed for your pages by providing informative meta descriptions for each page.

Create good meta descriptions
  • Differentiate the descriptions for different pages. Using identical or similar descriptions on every page of a site isn't very helpful when individual pages appear in the web results. In these cases we're less likely to display the boilerplate text. Wherever possible, create descriptions that accurately describe the specific page. Use site-level descriptions on the main home page or other aggregation pages, and use page-level descriptions everywhere else. If you don't have time to create a description for every single page, try to prioritize your content: At the very least, create a description for the critical URLs like your home page and popular pages.
  • Include clearly tagged facts in the description. The meta description doesn't just have to be in sentence format; it's also a great place to include structured data about the page. For example, news or blog postings can list the author, date of publication, or byline information. This can give potential visitors very relevant information that might not be displayed in the snippet otherwise. Similarly, product pages might have the key bits of information - price, age, manufacturer - scattered throughout a page. A good meta description can bring all this data together. For example, the following meta description provides detailed information about a book.

    In this example, information is clearly tagged and separated.

  • Programmatically generate descriptions. For some sites, like news media sources, generating an accurate and unique description for each page is easy: since each article is hand-written, it takes minimal effort to also add a one-sentence description. For larger database-driven sites, like product aggregators, hand-written descriptions can be impossible. In the latter case, however, programmatic generation of the descriptions can be appropriate and are encouraged. Good descriptions are human-readable and diverse, as we talked about in the first point above. The page-specific data we mentioned in the second point is a good candidate for programmatic generation. Keep in mind that meta descriptions comprised of long strings of keywords don't give users a clear idea of the page's content, and are less likely to be displayed in place of a regular snippet.
  • Use quality descriptions. Finally, make sure your descriptions are truly descriptive. Because the meta descriptions aren't displayed in the pages the user sees, it's easy to let this content slide. But high-quality descriptions can be displayed in Google's search results, and can go a long way to improving the quality and quantity of your search traffic.
Prevent search engines from displaying DMOZ data in search results for your site

One source we use to generate snippets is the Open Directory Project. You can direct us not to use this as a source by adding a meta tag to your pages.

To prevent all search engines (that support the meta tag) from using this information for the page's description, use the following:

To specifically prevent Google from using this information for a page's description, use the following:

If you use the robots meta tag for other directives, you can combine those. For instance:

Note that once you add this meta tag to your pages, it may take some time for changes to your snippets to appear in the index.

If you're concerned about content in your title or snippet, you may want to double-check that this content doesn't appear on your site. If it does, changing it may affect your Google snippet after we next crawl your site. If it doesn't, try searching Google.com for the title or snippet enclosed in quotation marks. This will display pages on the web that refer to your site using this text. If you contact these webmasters to request that they change their information about your site, any changes to their sites will be recognized by our crawler after we next crawl their pages.


Content Source:

Thursday, September 17, 2009

Battle of the URL Shorteners

In the social web it seems there is nothing quite as fun as sharing URLs. With the rise of sites like Twitter, which limits communications to only 140 characters, and the often long length of URLs, there is a new breed of sites coming online that shorten URLs into tiny snippets of their former selves.

Take this URL for example, on Yahoo! about the Manny Ramirez drug scandal: http://sports.yahoo.com/mlb/news?slug=ys-ramirezsuspension050709&prov=yhoo&type=lgns. If you were to post that URL to Twitter, 85 or your 140 character limit would already be used up, leaving you just 55 characters to type in your witty comment.

Along come the URL shorteners. Go to Tinyurl.com, copy that 85 character long Yahoo! URL into the text box, click the "Make Tiny URL" button, and receive this alternative tiny URL, http://tinyurl.com/cmrt9s, just 25 characters in length. That leaves me with 120 characters for my witty remarks.

Tinyurl has been around the Web for a long time, well before twitter came along. It has been a simple and single-purpose website. But, now that Twitter, Facebook, Digg, and so many other social sites have reached the big time, something new is happening. The sharing of URLs has reached critical mass, and services like Tinyurl have an opportunity to grow into something altogether new.

The sharing of URLs online is no longer just random unimportant noise. It is news. It is a pulse, indicating what is happening in a society. Take Tweetmeme for example. They get it. They treat all URLs shared via Twitter as news, and sort the most popular shared URLs to the top. Go to Tweetmeme any time of day and you can see what the society thinks is important right now, at this particular moment. That is because what we share via Twitter, in aggregate, is news.

Does Tinyurl understand how sites like Twitter have changed what it means to be an URL shortener? Upstart URL shortener Bit.ly seems to get it. They understand that the act of sharing an URL is an explicit act indicating interest in an URL and that there is more to be done with that information. Here are some new features of Bit.ly that prove my point:
  • Bit.ly remembers the URLs I've shortened. When I go back to Bit.ly they are all there for me to peruse.
  • Clicking on "info" shows me stats for the shortened URL. How many times was it clicked? Where were people located geographically when they clicked my url? What services were people on when they on when they clicked my shortened url? Who else shortened that URL. And so much more.
  • Bit.ly submits all shortened urls to OpenCalais to be semantically classified, categorized and tagged.
There are a number of other URL shorteners out there with other interesting and sometimes even funny features (I'm talking about you, I CAN HAZ dot COM.) I mention Bit.ly and Tinyurl.com specifically because Twitter recently switched from using Tinyurl's URL shortening service to Bit.ly. Now, when you type a long URL into Twitter, it will automatically shorten that URL for you using Bit.ly.

Until now, Tinyurl has been the biggest of the URL shorteners by a comfortable margin. I suspect, with this recent change by Twitter, more people are going to see the advantages of Bit.ly and start switching over. It won't happen overnight, but having Twitter repeatedly show your URL to millions daily is bound to have an effect on users. Looking at the chart to the left you can see the relative size of the two services, Bit.ly and Tinyurl.com, measured in visitors, and the amount of overlap between the two. Two months from now I expect that green circle to be a lot larger.

Another less discussed effect of having Twitter default to Bit.ly as an URL shortener is the profound effect it will have on Bit.ly's search engine placement. Search engines always try to sort the important links to the top, and one of the most important measures of a site/link's importance is the number of links pointing to it (this is a somewhat simplified explanation, but mostly right.)

As you can see from the data below, Tinyurl.com has been benefiting from the Twitter relationship.

Number of sites linking to Tinyurl.com and Bit.ly that are in the Alexa Top 1000:
  • Tinyurl - 386
  • Bit.ly - 9
The net result of this difference in number of highly ranked links is that Tinyurl has been doing well in search engines, while Bit.ly has not. Tinyurl gets an estimated 530K visits via search per month, while Bit.ly gets approximately 56K.

Bit.ly will soon have tens of millions of links being pointed to it, all because somebody typed some link into Twitter, Twitter turned it into a Bit.ly URL, and somebody shared that shortened URL on a page, whether Twitter, Facebook, Digg, a personal blog or other. Soon, all the search engines will see Bit.ly as an important Web presence, causing it to get even more traffic from search. It is a virtuous circle and Bit.ly is the beneficiary.

It is still way to early to call a winner here, but the next six months will be an interesting time as these URL shorteners reinvent what it means to be an URL shortener, fight over market share, and come up with business models that allow them to sustain their business for the long haul.

How To Increase The Traffic To Your Website

I get asked this all the time, whether via Alexa's forums, or after work by my friends: How do I get more traffic to my Web site? I wish there was just some simple button that I could tell people to push and that it would solve all their traffic issues. But it doesn't exist; if it did, everybody would already be using it.

But there are whole heaps of great advice, which if followed, will lead to more visitors to your site. What follows is a simple to follow list of best practices to help get you on your way.

1. On-Site Factors. Start with your site. You need to make it the best it can be. So that it will be attractive to visitors AND search engines.
  • Keywords. What is your site about? Find a few key words and phrases that you think describe your site and that people may actually enter into a search box on Google. If you pick very popular keywords and phrases, you might be disappointed. Millions of people will search for those keywords and phrases, but you will be way down the search results because lots of sites are optimized for those phrases. If you pick less popular keywords and phrases, you may have a shot of actually showing up in the search results because fewer sites have optimized for those keywords and phrases.
  • Optimize Your Site. Use your keywords and phrases on your site. Put them in the title of your page, in the H1 tags, metatags and throughout your site. Use them in the text of links that point to your page. Shoot for having keyword density of about 6%.
  • Have Good Content. You should strive to have something new on your site once per day. Don't let your site get stale... Google's algorithms will notice and so will visitors to your site. If you don't have a lot of time to create unique content every day, consider putting up a daily poll, creating a forum on your site, or leaving a comments field/Guest Book for visitors to fill out. If you use Twitter or Facebook, you can have your updates automatically appear on your site.
  • Unique Value Proposition. Give something away on your site to your visitors to remember you by. Otherwise people may forget your site and won't come back. You can find interesting content on widgetbox.com, or you can give them a custom Alexa Toolbar. Just give them something.
  • Create A Sitemap. Every time you update content on your site you should update your sitemap and submit the site map to Google, Yahoo, Bing, Ask, etc.. There are lots of free sitemap tools out there. Find one and get started. It is a great way to let Google know when your site is updated.
  • Return Visitors. How are you going to get people to return to your site after they have left? You may want to consider an e-mail newsletter. But don't spam... please. If people like your content let them sign up to get your newsletter. You should also allow people to subscribe to your updates via facebook or twitter. Most blogs offer easy plugins for this feature.
  • Link Bait. People love lists. Make lists of things that are relevant to your site and put them on your site, like top ten fishing sites. Then let the sites in your list know you have made your list. They may take that list and put it on their site... Or give out awards like "fishing site of the week." which brings us to...
2. Off-Site Factors. Once you have a great site you need to start thinking about other factors, mostly links. If nobody links to your site you are going to have a tough time getting seen in Google's results. More links = better placement in Google. So how do you get links?
  • Link Number One. The first link is easy. Alexa already has a link to your site, and Alexa's page rank is high, so the link from Alexa counts more than most. You just need to let Google know that Alexa has a link to your site. How do you do that? Install the Google Toolbar then visit Alexa. But be sure to put your Alexa Toolbar back!
  • Get Listed In Directories. Directories that are relevant to your site are generally more important than others, so if your site is about basket weaving, find a basket weaving directory and ask them to list your site. Get listed in as many as possible. And then find other general directories like DMOZ and get listed there. Are there Wikipedia articles that should list your site as a place for more information on a topic? Get listed.
  • Participate In Social Media. Find forums that are relevant to your content and participate... a lot. Update your signature footer on the forum to include a link to your site. Use Twitter, Facebook, Digg, but, in all cases, do not just post or write about your own site. Nobody cares. Write and post about things that you care about, sometimes your site, and people who like your posts may make their way over to your site.
  • Have Something Newsworthy. If you have something newsworthy, don't just blog about it. First post it as a press release on your site, then update your sitemap, then post it to the newswires, then submit it to ezine articles, Article Base and/or Go Articles, then blog about it, twitter about it, etc. If you do it right you will have at least a couple of new links to your site, and if you do it really right you could have dozens of new links.
  • Advertise. There are lots of great advertising solutions out there. Google AdWords is a great place to start and, if done well, can offer you a good deal on targeted traffic. Display advertising can be effective and affordable as well. The social networks are now offering do-it-yourself advertising at reasonable prices, and even Alexa allows you to advertise at inexpensive CPMs.
And, as always, install the Alexa Toolbar. It won't increase the traffic to your site, but it won't hurt and you will be helping Alexa to track your site and helping the entire Internet Community by contributing to Alexa's Traffic Data.

Getting more traffic to your site is a journey. Take the first steps today, and with a little hard work and some luck, you will be counting your visitors in the millions before too long.