Infos zum Thema search_engine

Preview video on T2, the Twine successor. T2 incorporates a web search engine based on semantical information of web pages, which is automatically generated during the indexing process.

describes file Robots.txt used to control access of web-spiders / crawlers to a site.

XML file to give hints to web-spiders / crawlers to navigate through a site.

Article on the Wolfram Alpha search machine.

Article by Nova Spivack (Twine) on the innovative search machine Wolfram Alpha and the misleading exceeding anticipations on it which lead to disappointment.

Xapian is an Open Source Search Engine Library. It's written in C++, with bindings to Perl, Python, PHP, Java, Tcl, C#, Ruby. Add advanced indexing and search facilities to their own applications.