How to set a prompt for website crawler

[devd]

Hi, I’m building a workflow that uses website crawler to compile a list of leads for me and then put those leads in google sheets. The problem I’m running into is the website crawler seems to be doing a huge crawl without using the context I’m giving it eg. real estate firms. Right now my flow is set up with input>website crawler> use AI>extract to table

Is there anyway to set up a prompt in the flow before website crawler to give it the searching paramters?
Failed run link: https://www.gumloop.com/pipeline?workbook_id=6BbqjnUi3xTXBcwgdJEG6c&run_id=2auQRXAfnfGYa6GgjyJduK

[Gumloop_Bot]

Hey @devd! If you’re reporting an issue with a flow or an error in a run, please include the run link and make sure it’s shareable so we can take a look.

1. Find your run link on the history page. Format: https://www.gumloop.com/pipeline?run_id={your_run_id}&workbook_id={workbook_id}

2. Make it shareable by clicking “Share” → ‘Anyone with the link can view’ in the top-left corner of the flow screen.
   

3. Provide details about the issue—more context helps us troubleshoot faster.

You can find your run history here: https://www.gumloop.com/history

[Wasay-Gumloop]

Hey @devd - You can’t add a prompt in the Website Crawler node since its not an AI node but you can try the Web Agent Scraper node with the Get All URLs action, this is much faster than the Website Crawler node.