Best Methods to Discover a Website's Pages: Projects, Case Studies, Work, Portfolio, Clients, Testimonials

Hi guys, What’s the best way to find out all the web pages a site has? Basically want to find out if they have any of the following pages: Projects, Case Studies, Work, Portfolio, Clients, Testimonials, etc and so far ClayAgent doesn’t prove to have great accuracy. So, I am looking for ways to extract all the pages they have and then use ChatGPT function to qualify people in or out. Thanks Andreas