Glossary

AI crawler

An AI crawler is a bot an artificial intelligence company uses to download web pages, to train its models or to retrieve the sources of an answer.