Web Scraper: Passing 'None' When Link is Not Found

[Harbuzova]

Hi

I am encountering an issue where the web scraper is unable to find a specific link. In such cases, I would like to pass the value as None to prevent the data from getting mixed up. Could you please advise on how I can achieve this or if there are any settings I need to adjust?

https://www.gumloop.com/pipeline?workbook_id=n6Csaqt7xDDSkSWiaZSzMp&tab=1

[Gumloop_Bot]

Hey @Harbuzova! If you’re reporting an issue with a flow or an error in a run, please include the run link and make sure it’s shareable so we can take a look.

1. Find your run link on the history page. Format: https://www.gumloop.com/pipeline?run_id={{your_run_id}}&workbook_id={{workbook_id}}

2. Make it shareable by clicking “Share” → ‘Anyone with the link can view’ in the top-left corner of the flow screen.
   

3. Provide details about the issue—more context helps us troubleshoot faster.

You can find your run history here: https://www.gumloop.com/history

[Wasay-Gumloop]

Hey @Harbuzova — you can use a Find & Replace node here and connect it with the Error output of the web agent scraper node. This lets you format a fallback message like "none" in case anything fails. Then, use a Join Paths node to merge the success and error paths, and write the result to Google Sheets.

Essentially, if the scraper works and returns the URL, it flows through Join Paths and writes that to the sheet. If the scraper fails, it goes through Find & Replace, formats the error output, and still writes to the sheet.

Example setup: Pipeline Link

[Harbuzova]

I’m not sure it’s working as it should…

[Harbuzova]

I tried it and the values are still different, the links don’t match what should be

[Harbuzova]

If he couldn’t open some link, that’s fine. None, and then proceed with the list, but I think it’s getting a bit confusing.

[Harbuzova]

The main problem is that he’s mixing up the data. The data he processed was outputted in the wrong order, and because of that, it’s still getting confused.

[Harbuzova]

Although he combines the data in the correct order and everything seems fine, for some reason, it still records them incorrectly.

Could you test it and take a look?

[Wasay-Gumloop]

Can you share the run link so I can view the inputs/outputs please? You can find the run link on the https://www.gumloop.com/history page or through the Previous Runs tab on the canvas.

[Harbuzova]

thomasnet.com

https://www.gumloop.com/pipeline?workbook_id=83e7KKMo2M7GmnJkigXTVy&tab=2&run_id=3rVgTBUBiGfoRQk7Y5CnNA

[Wasay-Gumloop]

Thanks for sharing the link and the sheet @Harbuzova – I’d recommend using the sheet updater node here so there’s a 1:1 correspondence and the flow updates the same row it processes.

Here’s a quick Loom walkthrough if helpful.

You can also check it out directly in this run link.

Let me know if that makes sense and works for you.

[Harbuzova]

Thanks!