# \#Website-Crawler

**URL:** https://forum.gumloop.com/tag/website-crawler/24.md

[Latest](https://forum.gumloop.com/latest.md) · [Categories](https://forum.gumloop.com/categories.md) · [Tags](https://forum.gumloop.com/tags.md)

---

## [Web Crawler hanging](https://forum.gumloop.com/t/web-crawler-hanging/3264)

<div class="topic-metadata">

**Author:** [@MarcMPSGC](https://forum.gumloop.com/u/MarcMPSGC)\
**Replies:** 4\
**Last updated:** [July 31, 2025, 5:05am UTC](https://forum.gumloop.com/t/web-crawler-hanging/3264 "2025-07-31T05:05:36Z")

</div>

Hello, I have a Tier 1 Web Crawler node that was working fine before but is now hanging on runs. I can see in the Node details that it’s having trouble crawling certain pages and skipping those pages, but winds up hangin…

---

## [2FA Login via SMS](https://forum.gumloop.com/t/2fa-login-via-sms/2154)

<div class="topic-metadata">

**Author:** [@SV80](https://forum.gumloop.com/u/SV80)\
**Replies:** 1\
**Last updated:** [March 26, 2025, 6:58pm UTC](https://forum.gumloop.com/t/2fa-login-via-sms/2154 "2025-03-26T18:58:19Z")

</div>

I would like to extract statistics from a website that is protected by a 2FA login, which works via SMS. Is there a best practice for this?

---

## [How to set a prompt for website crawler](https://forum.gumloop.com/t/how-to-set-a-prompt-for-website-crawler/1963)

<div class="topic-metadata">

**Author:** [@devd](https://forum.gumloop.com/u/devd)\
**Replies:** 2\
**Last updated:** [March 18, 2025, 1:32am UTC](https://forum.gumloop.com/t/how-to-set-a-prompt-for-website-crawler/1963 "2025-03-18T01:32:05Z")

</div>

Hi, I’m building a workflow that uses website crawler to compile a list of leads for me and then put those leads in google sheets. The problem I’m running into is the website crawler seems to be doing a huge crawl withou…

---

## [Crawling outside the domain](https://forum.gumloop.com/t/crawling-outside-the-domain/1530)

<div class="topic-metadata">

**Author:** [@shinobi](https://forum.gumloop.com/u/shinobi)\
**Replies:** 6\
**Last updated:** [March 1, 2025, 5:38am UTC](https://forum.gumloop.com/t/crawling-outside-the-domain/1530 "2025-03-01T05:38:34Z")

</div>

Even though I made sure the node is only run for same domain, the Run log showed it is crawling other URLs, and it was taking too long even for a single depth.

---

## [Consultant Inquiry](https://forum.gumloop.com/t/consultant-inquiry/880)

<div class="topic-metadata">

**Author:** [@kubben](https://forum.gumloop.com/u/kubben)\
**Replies:** 1\
**Last updated:** [February 8, 2025, 2:30am UTC](https://forum.gumloop.com/t/consultant-inquiry/880 "2025-02-08T02:30:06Z")

</div>

Hitting some roadblocks in learning as fast as I would like and curious if anyone could point me to a consultant that would be open to training. Cheers!