Search engine submission: what a site actually needs
[]Updated in 2026: Search engines and their webmaster tools have changed since this article first appeared in 2006. The basic distinction between discovery and paid “submission” still matters.
Ordinary web pages do not need a paid search-engine submission service. This article covers the site owner’s setup: crawlable links, sitemaps, webmaster tools and diagnosis when discovery fails.
The practical setup
For a normal website:
- Make every important page reachable through ordinary HTML links.
- Generate an XML sitemap containing canonical, indexable URLs.
- Verify the site in Google Search Console and Bing Webmaster Tools.
- Check that
robots.txt,noindexdirectives, authentication and server errors are not blocking access. - Use the tools’ inspection or recrawl features for a small number of important new or changed URLs.
A sitemap is a discovery aid, not an instruction to rank or even index every URL. Google’s explanation of how Search works separates crawling, indexing and serving results for that reason.
What submission does not do
Submitting a sitemap cannot make weak content competitive. Repeatedly submitting the same URL cannot force a faster decision. Nor can a third party buy “priority access” to ordinary organic results.
Be careful with claims about indexing APIs. Google’s Indexing API is restricted to pages containing JobPosting or livestream BroadcastEvent markup. It is not a general shortcut for articles, product pages or local landing pages.
When manual action is useful
Request recrawling after a substantial correction, a launch, or a time-sensitive update when the URL is otherwise accessible. For a large site, fix the internal linking, sitemap and server behaviour rather than submitting pages one at a time.
If a vendor’s paid service consists only of sending your homepage to a list of search engines, keep your money. Ask them to show the crawl problem they are solving, the tool they will use and the evidence that the problem is resolved.
