Such a great post - this problem is massive in main stream search and is only going to get worse with AI content. Thanks Wil!

For websites that you control, Search Console will deliver this data - along with many more details about how many pages are indexed and any problems that Google found (redirects, 404, no-index etc.) so you know where the problems are. You can also see which pages in the sitemaps are not indexed.