Five New Optimizely Certifications are Here! Validate your expertise and advance your career with our latest certification exams. Click here to find out more

AI OnAI Off

Class RobotsValidator

Inheritance
System.Object
RobotsValidator
Namespace: EPiServer.LinkAnalyzer.Robots.Internal
Assembly: EPiServer.LinkAnalyzer.dll
Version: 12.0.3
Syntax
public class RobotsValidator : Object

Constructors

RobotsValidator(String, IWebProxy)

Declaration
public RobotsValidator(string userAgent, IWebProxy proxy)
Parameters
Type Name Description
System.String userAgent
System.Net.IWebProxy proxy

Methods

Clear()

Declaration
public void Clear()

IsRequestAllowed(Uri)

Declaration
public bool IsRequestAllowed(Uri url)
Parameters
Type Name Description
System.Uri url
Returns
Type Description
System.Boolean

Extension Methods