Web Agent Scraper problem

[Lyes]

I am trying to use Web Agent Scraper to search information for multiple businesses indicated in my google sheets list, and I get this problem every time :

Web Agent Scraper Failed!
The element with the ‘attribute name’ and ‘attribute value’ specified could not be found on the page.

It might not exist, or the page might not have finished loading. Check if the attribute details are correct or try adding a ‘wait’ action.

Can any one hel me fix this.
workbook link: https://www.gumloop.com/pipeline?workbook_id=38uhFbTLGL9SoywvBVr2ZM&run_id=igiza4jAordUn6NT6nYkSe

[Wasay-Gumloop]

Hey @Lyes - Seems like incorrect ‘attribute name’ and ‘attribute value’ are being used in the node. You can use inspect element to find the appropriate element but in general it might be tough to get the scraper working dynamically for multiple steps like you’ve configured for different inputs.

I’d recommend formatting the URL dynamically to include the business name, you can use the ‘Combine Text’ node here and then scraping that URL.

[Lyes]

Thank you very much for your reply.

As for the URL formating, the main issue here is for exemple if I take the company name " VERANDAHLIA" and research it, I will get this :
(VERANDAHLIA (LA RUE-SAINT-PIERRE) Chiffre d'affaires, résultat, bilans sur SOCIETE.COM - 405294273)
As you may notice, there are figures in the URL that add to (https://www.societe.com/societe/verandahlia)
I think the ‘Combine Text’ will not fix this. don’t you think ?

[Wasay-Gumloop]

Ah I see. You can probably use a combine text node here to format a web search query with the company. Eg: {Company Name} site:https://www.societe.com/

You can then use the Web Search node to find the appropriate URL.

Here’s an example with VERANDAHLIA → https://www.gumloop.com/pipeline?workbook_id=pGn7mbAr5Yksgp9HhkU4PK&run_id=8KTEbduZZhfQ2VeEPLXHqu

Let me know if this makes sense and works for you.