Is it necessary to make a sitemap for a large site?
There is a large forum. Useful links look like this: https://forum.woodtools.ru/index.php?topic=65548.0
There are about 43 thousand such topics, plus the fact that the dot points to the pages of the topic, for example https://forum.woodtools.ru/index.php?topic=65548.25
The total number of useful links is > 50 thousand.
I couldn't create a sitemap using the standard SMF plugins (forum engine).
Question: do I have to do this? a sitemap or search bot Yandex/google handle this ?
In robots.txt I have banned all technical links. CNC no links
1 answers
When using the site map (sitemap.xml) it will be easier for robots to index existing / new site pages. If I had a large site (forum), I would definitely make a site map and index the site using cron (for example, once a week at 4 am).