What are dynamic websites?
Dynamic websites are websites whose pages are generated on the fly. Unlike static pages (primarily .htm/.html pages), dynamic pages are generated when a user triggers an action through that particular page.
Here is what Google says about indexing dynamic websites
Reasons your site may not be included: Your pages are dynamically generated. We are able to index dynamically generated pages. However, because our web crawler can easily overwhelm and crash sites serving dynamic content, we limit the amount of dynamic pages we index.
(Source – http://www.google.com/webmasters/)
What are the problems that search engines face in indexing dynamic URLs?
- Search engines often consider a dynamic URL an infinite set of links.
- Since dynamic URLs find maximum application in online shopping carts, there is a possibility of incorporating a session ID to a particular page in the site. As session IDs of that particular page change, the search engine spider needs to index an infinite number of copies of the same page, which is a Herculean task for them.
- Indexing the same dynamic page might overload the servers of the search engines and therefore prevent the search engines from showing the most relevant information in the fastest possible time.
What are the options to make a search engine index your dynamic URLs?
- A static page linked to an array of dynamic pages
- Place links to the dynamic pages on the static pages, effectively submitting the static pages to the major search engines manually and according to each search engine’s recommended guidelines.
- This technique is easily implemented with a site map that fully displays all the links to the dynamic pages across the web site.
- Use software – Change the dynamic URLs to static ones with the help of various software’s.
- Use CGI/Perl scripts – Path_Info or Script_Name is a variable in a dynamic application that contains the complete URL address (including the query string information). In order to fix this problem, you’ll need to write a script that will pull all the information before the query string and set the rest of the information equal to a variable. You can then use this variable in your URL address.
- Re-configuring your web server – Your web server enables you to turn URLs containing query strings into URLs that search engines can index.
- Optimize this static page for search engine rankings – Include a link title for all the product categories, place appropriate “alt” tag for the product images along with product description containing highly popular keywords relevant to your business. Submit this static page along with all the dynamic pages in various search engines, conforming to the search engine submission guidelines.