Glossary

`robots.txt`

A standard text file at a website's root that specifies which paths automated bots may or may not access.

Learn More

Related Terms