November Happy Hour will be moved to Thursday December 5th.

AI OnAI Off

How can I make the Find Crawler ignore an HTML section?

Morten Felumb
Morten Felumb
Vote:
 

Hi,

We are using a Find connector to crawl an old site. This site has a pretty bad HTML structure and a large static section in the top of each page is messing up the excerpt text. We can't make any big changes to the old site, but can add a couple of HTML tags or headers to improve the search results.

Is there a way to add some hints to the Find crawler, like Google's appliance-tag , or some other suggestions?

Regards,
Morten

#175503
Feb 22, 2017 10:02
Vote:
 

Support is still very limited I think. We hid chunks of HTML based on Find crawler's User Agent string but then of course you need backend code access to the target site.

#175532
Feb 22, 2017 18:05
* You are NOT allowed to include any hyperlinks in the post because your account hasn't associated to your company. User profile should be updated.