Google’s John Mueller answered a question about why Google indexes pages that are disallowed from crawling by robots.txt and why the it’s safe to ignore the related Search Console reports about those ...
Review your robots.txt file: Ensure it contains only necessary directives and is free from potential errors or misconfigurations. Be cautious with spelling: While parsers may ignore misspellings, this ...