Everything about dana
The value from the title attribute (robots) specifies that the rule relates to all crawlers. each the identify along with the information attributes are thailand case-insensitive. to handle a certain crawler, swap the robots value of the name attribute Using the consumer agent token of the crawler you are addressing. Google supports two consumer ag