API Reference
Class
RobotsTxtParser
Provides a simple robots.txt parser.
Inheritance
- Object
- RobotsTxtParser
Methods
public static RobotsFile Parse(String content) #Returns:
RobotsFileParses robots.txt content into a RobotsFile.
Parameters
- content System.String
Inherited Methods
public override Boolean Equals(Object obj) #Returns:
BooleanInherited from Object
Parameters
- obj Object