How do I avoid captcha while scraping Google?

[jvsperling]

Hi there,

I’m trying to scrape Google Reviews, but keep running into the captcha when I attempt to use Website Crawler or AI Web Browsing.

Any best practices for getting around this?

Example URL

[Arslan]

Hey, have you tried using the “Website Scraper” node with “advanced” mode toggled? I tried and it seems like it’s able to scrape that example URL without issues. Let me know if that works on your end or fits in your workflow!

[jvsperling]

For sure. The Website Scraper node is the only one working for me here. It gets the job done in this case, but I’m curious whether there’s a way to make Website Crawler or AI Web Browsing work in cases like this.