Trying scrap for Personal Injury Lawyers

[Boxify]

I came across Gumloop and thought it would be a relatively easy way to scrap for content on a website. Simple scraps I can do but this was abit more complex for my skillset.

I am trying to get lawyers info from this url
Attorney Search - The State Bar of California

My Gumloop which failed
https://www.gumloop.com/pipeline?run_id=ajBVfc6kshrAZMuYQQi4Eq

Anyone experienced that can guide me?

[Wasay-Gumloop]

Hey @Boxify - On your workbook page, could you hit save and then under share button set the access to ‘anyone with the link can view’ and send over that link please? I’ll take a look at the failed run link for you

[Boxify]

Hi @Wasay-Gumloop , thank you for the reply back.
Here is the link
https://www.gumloop.com/pipeline?workbook_id=txRP7SGDCrajmnkEEF3bQ8

A brief explanation
It needs to loop through all pages and click on each name, scrap name, phone, email and save it to csv. Maybe I didn’t select the right html element?

I am fascinated by gumloop and what it can potentially do. Power Automate is great, but not that advanced.

[Wasay-Gumloop]

Hey @Boxify - Thank you for sharing! Here’s what I’d recommend - Instead of looping through all the links within one Web Agent Scraper node (which is not possible), divide the workflow in steps:

1. The first step can be to extract all the lawyer profile page links - You can do this by setting the Web Agent Scraper node action to ‘Get All URLs’ and passing that content to an Extract Data node with Extract List enabled to output a list of all lawyer page links.

• It would be hepful here if you can paste a sample link for the AI here.

2. You can loop through all the URLs using the ‘Website Scraper’ node and then Extract the data for each lawyer using the ‘Extract Data’ node. Similar structure to what you have currently.

Subflows will help here:
Subflow Tutorial: https://vimeo.com/1052111235/cb7e3a446b
Subflow Docs: https://docs.gumloop.com/core-concepts/subflows

Let me know if you get stuck or have questions. Gummie should also be able to point you in the right direction if you run into errors.