So much of technical SEO involves telling search robots what to do (or not to do). Learn the difference between disallow, noindex, and nofollow commands, and the different methods available to communicate those commands, including the robots.txt file and the meta robots tag.