As far as I know, pages that are gated can鈥檛 be scrapped, which is what Relume does to create sitemaps.
Think about, if you could do that, you鈥檇 be able to get all the pages on a subscription model website like The New York Times for free
The way you could do this (with python) is simulate a login by sending a POST request with the valid crendentials to the website鈥檚 endpoint and use a scrapper like Beautiful Soup.
I was thinking I could copy paste an image of the page or something, I can potentially disable authentication and make the entire site public but id rather not mess with auth
Adding Login-Restricted Pages to Sitemap and Wireframe | Relume Community
