November Happy Hour will be moved to Thursday December 5th.

AI OnAI Off

Connector crawl only pulls 1 document

Rob Pettigrew
Rob Pettigrew
Vote:
 

We have connector set up to crawl one of our company sites. We verified this site does not dis-allow ( via robots.txt) any such crawls. But the crawl returns only one docuement where it should be pulling many. How do we troubleshoot this? 

#192258
May 11, 2018 23:10
dada
dada
Vote:
 

Hi Rob,

Could you share URL to website and URL to document you expect crawler to find and index?

#192338
May 15, 2018 14:52
Rob Pettigrew
Rob Pettigrew
Vote:
 

Here is the site: http://qsupport.quantum.com/kb/flare/content. There are several files that would be indexed.

#192578
May 18, 2018 23:19
dada
dada
Vote:
 

Hi Rob,

First thing I react to is the redirect to http://www.quantum.com/support/

I am not sure Find crawler will follow a redirect to another domain/subdomain without specifically allowing it to.

Have you tried crawling http://www.quantum.com/support/ directly?

#192588
May 19, 2018 16:04
* You are NOT allowed to include any hyperlinks in the post because your account hasn't associated to your company. User profile should be updated.