.Google limits robots.txt assistance to 4 fields, clarifying its own posture on in need of support regulations.Google just supports 4 specific robots.txt industries.Unsupported instructions in robots.txt will be ignored.Think about auditing your robots.txt data due to this upgrade.