7 lines
80 B
Plaintext
7 lines
80 B
Plaintext
|
#
|
||
|
|
# The Web Robots Pages (http://www.robotstxt.org/)
|
||
|
|
#
|
||
|
|
|
||
|
|
User-agent: *
|
||
|
|
Disallow:
|