1/31/2000

WebCrawler News
The List
New Policy
AltaVista
Excite
HotBot
Go Network
Lycos
ODP
WebCrawler
Yahoo
Bill Speaks
Product Review
About Us

WebCrawler is the smallest of the major search engines.

Here is what they say about their submission policy:

It seems that more and more website owners and designers have been "spamming" -- including unsolicited, extra or irrelevant information on their pages, usually in the form of word lists -- in order to make search engines display them at the top of their listings. This practice is something that we strongly discourage. Searching the Internet is our business, and spamming actively interferes with providing everyone who uses the World Wide Web with the best search engine we possibly can.

In order to make our index cleaner and more navigable, and to foster a more level playing field for everyone, we've started removing these pages from our index and screening new submissions. If you load pages with long, repetitive word lists, or titles this will cause WebCrawler either to ignore the repetition or, in some cases, to ignore such documents entirely.

They index all text on a page up to 1 megabyte and do not provide support for frames or image maps. Their spider ignores comments and alt text.

If you neglect to create a meta description tag, WebCrawler will determine one for you, which is not always good or accurate.

Their relevance algorithm gives more weight to titles than to body text. WebCrawler specifically states that they prefer descriptive text.

For the pages that you submit to WebCrawler, they are not indexed by Excite, but instead other pages that you submit to Excite itself are there on WebCrawler; this means that you'd better to always submit your web pages to Excite, first, and then to WebCrawler.


  • What Will WebCrawler Index? page titles, meta tags, keyword frequency in text
  • How Long Will It Take? 3-5 weeks
  • How Many Pages Do I Submit? can submit more than one page
  • What Meta Tags Does WebCrawler Support? title and description
  • How Long Can I Make My Tags? Title: 60 characters, Description, 395 characters, Keyword, N/A
  • Does It Support Alt Tags? No
  • Are Searches on WebCrawler Case Sensitive? No

 

L10 Web Stats Reporter 3.15 L10 Hit Counter - Free Web Counters
LevelTen Professional Web Design Company - Flash, Web Designers