Boats/ Crawler in SEO
A search engine crawler or boats are same, it works is collect the data from website or indexing the website all content, image or link etc.
Bots name:
User-agent: Google # Google
User-agent: Googlebot # Google
User-agent: Slurp # Yahoo
User-agent: Teoma # Ask
User-agent: askjeeves # Ask
User-agent: MSNBot # MSN
User-agent: Grub # Wiki
User-agent: atn # All That Net
User-agent: digger # Diggit!
User-agent: informant # Search the web
User-agent: infoseek # Infoseek
User-agent: lycos # Lycos
User-agent: marvin # Infoseek
User-agent: robozilla # Mozilla
User-agent: scooter # AltaVista
User-agent: smartspider # Travel-Finder
User-agent: spider_monkey # MPRM Group
Search Engine Crawler/bots name
1. Google google bot
2. Yahoo yahoo slurp
3. MSN msn bot
4. ASK teoma
5. Altavista scooter
6. Excite Architext spider
7. Looksmart mantra agent
8. Bing bing bot
9. Alexa ia_archiver
10. Yandex yandex bot
11. Ink toni.com slurp
