We have an index of about 500,000 items, when clearing the index and running the find indexing job, the CMS indexes in less than an hour, but it takes 3-5 days to finish indexing the catalog (which has about 80% of the index size due to the large number of languages we have).
Does anyone have any tips on how to make the site index faster?
Part of the reason this is an issue is because so many find events dont reach the index (intermittent publishes/deletes/new content items) so over the cource of a few months, the index becomes less actual.
How many languages do you have - because each and every language content will need to be index? We know about the problem with big catalogs and have been taking some actions to make it better, but of course for very big catalogs it will still take time
we have 115 languages enabled right now (though we are hitting some sql issues with activating more than 100 in Commerce).
Interesting. There should be no problem with activating more than 100 languages in Commerce. If you can share more information regarding that issue, I can look into it.
I have an open support ticket, in there i have detailed the issue, please take a lok if you get a chance, its an interesting issue
What is theticket number :)
Ofcourse! Its #204490
I see. So the problem was because one of our udtt(s) has Languages field which is NVARCHAR(512). Given that you have more than 100 languages and each might be in form of en-US which takes 5 bytes, so that means from the 103th languages the problem will appear.
The fix is quite obvious but it will require a newer version - the best I can is 12.11 or so. The only question is which version you are on and if you are willing to upgrade :)
Normally the support team will escalate the ticket and create a bug, but given that I am already in the contact with you I will create one myself to shorten waiting time
That would be great, thank you :), we are Ofcourse willing and able to upgrade. We are on 11.2 now but have an internal PR to upgrade to the latest version now.
Do you have an estimated release date for 12.11?
We are working on 12.10 right now, which might be finished at the end of this week (probably, who know for sure :) ). 12.11 (or 12.10.1 :) ) will take 1-2 weeks after that. So let's just say it will be released in November :)
Going back to the issue about slow indexing through, Commerce content takes so very much longer to index than CMS content, ofcourse that could be the languages as well, is there anything in the works that could help with that?
Each and every language needs to be indexed, so given you have 500.000 contents and 100 languages each, it would be 50.000.000 contents to index. I know Find 13.0.4 has some improvement on index queue and Find team is working on some improvements - but I don't know the detail.