web crawler - how to detect search engine bots with php? -


how can 1 detect search engine bots using php?

here's search engine directory of spider names

then use $_server['http_user_agent']; check if agent said spider.

if(strstr(strtolower($_server['http_user_agent']), "googlebot")) {     // } 

Comments