Google has proposed an official internet standard for the rules included in robots.txt files.
The post Google Wants to Establish an Official Standard for Using Robots.txt via @MattGSouthern appeared first on Search Engine Journal.
from Search Engine Journal https://ift.tt/2NF8MWv
via IFTTT
No comments:
Post a Comment