Use the robots txt file checker to make sure it is valid. An invalid robots text file can have an impact on your SEO.