Start the Flow When New Posts Enter RSS Feed

[JenK]

I set up a simple flow using RSS Reader + time based trigger to write a Google Doc. It’s working. However, I only want this to happen when a new post hits my RSS Feed. Gummie, who is usually helpful, is making up suggestions that don’t exist (i.e., create a State Node to store post ids, before adding a Filter. I can’t find a State Node). Posting here to see if anyone has ideas.

Here is the workbook: https://www.gumloop.com/pipeline?workbook_id=6Ha4NitVLw5FK6oRKpryq7

[Wasay-Gumloop]

Hey @JenK - This is possible but slightly tricky to setup so let me know if you get stuck. Here’s what I’d recommend:

Option 1:

• At the end of your flow add a step to write the URL of the post that you processed onto a Google Sheet
• At the beginning of the flow add a Google Sheet Reader node that reads from the same sheet where the processed URLs are posted
• Create a custom de-duplicate node that takes URLs from your RSS Feed and the Google Sheet and only outputs the unique URLs (ie. the ones that are new and not processed).

Doc: https://docs.gumloop.com/nodes/custom_node_details
Video Tutorial: https://www.youtube.com/watch?v=yHjxbmdg-cI&ab_channel=Gumloop
Custom Node Workshop: https://www.youtube.com/watch?v=ovCCWfgWv4M

Option 2:

• You’ve the date output available on the RSS Feed node which we can use to filter for new posts
• Use the Filter node or a custom node to filter the posts using the current date as the conditional value.

Note; I’m not sure if the date output is the date the post is posted or the date the post enters your feed. Can you share your run link to confirm that?

[JenK]

@Wasay-Gumloop Super helpful tips. I went with Option #2 and got the filter working. However, your question about the dates sparked some investigation and it’s clear that it is the date that the alert enters in the feed and not when it was published. Since it is my goal to get this info as soon as it is published, I think I will try a custom node since there appears to be an API for this recall information. Then, perhaps I can bypass the RSS reader? I will see if I can make that happen via the tutorials and workshop links you provided. Thanks for the help.

[JenK]

@Wasay-Gumloop I just thought of one other thing, possibly scraping XML sitemaps and filtering on date. The thought is that as soon as something is published it enters the sitemap. Any reaction to that?

[JenK]

@Wasay-Gumloop Marking this solved and adding a resource here for others. I actually used the Call API Node and JSON Reader. Worked like a charm! Shout out to Shrikar for providing this helpful resource: https://www.youtube.com/watch?v=4ny-600PFYU

[Wasay-Gumloop]

Awesome, thank you for sharing the resource!