Make xml sitemap and include each of your site in it. You can submit to sitemap in Google and Bing website admin devices to make your site record soon.
ROBOTS.TXT
Upgraded: The robots.txt is a content record website admins make to train robots (normally internet searcher robots) how to creep and list pages on their site.