I´m wondering if Find indexing new pages upon creation (before hitting Publish) is something new? We have a property where editors can set if the page is to be indexed or not (setting NOINDEX, NOFOLLOW) and then configuration in an Initialization Module to say that pages with this setting should not be indexed. Like this:
ContentIndexer.Instance.Conventions.ForInstancesOf().ShouldIndex(x => x.SearchEngineVisibility != "NOINDEX, NOFOLLOW");
This has worked well before as far as I know, but recently (not sure when) this seemed to be an issue and pages that have this setting are still indexed. When testing I saw that a page I created but not published was found in the Find index.
Does anyone have any insight? We´re running Find version 13.0.1 at the moment.