Scrapegraph-ai is an open source library for scraping with the use of AI. You just need to activate the API keys and you can scrape thousands of web pages in seconds!
https://bxt.org/35ze0