Back to Templates

Daily Website Data Extraction with Firecrawl and Telegram Alerts

Last update

Last update 15 hours ago

Share


🔥 Automated Daily Firecrawl Scraper with Telegram Alerts
Get structured insights scraped daily from the web using Firecrawl’s AI extraction engine — then send them directly to your Telegram chat.

🧰 What this workflow does:
This workflow automatically scrapes specific structured data from any webpage every day at a scheduled time using the Firecrawl API, checks if results are returned, and then sends the formatted results to Telegram.

For step-by-step video tutorials of n8n builds, check out my channel:
https://www.youtube.com/@Automatewithmarc

🧭 How It Works:
🕐 Schedule Trigger (Daily at 6PM)
Starts the workflow every day at a set time.

🌐 Firecrawl POST Request
Sends a custom extraction prompt and schema to Firecrawl, targeting any list of URLs you provide.

⏳ 30 Seconds Wait
Waits to give Firecrawl enough time to complete processing.

📥 GET Firecrawl Result
Fetches the extraction results using the request ID.

🔁 Loop with IF Node
Checks whether data is returned. If not, waits another 15 seconds and retries.

🧹 Format & Clean (Set Node)
Prepares and formats the extracted result into a readable message.

📲 Telegram Message Node
Delivers the structured data directly to your Telegram channel or group.

🔧 Requirements:
✅ Firecrawl API Key (Header Auth)

✅ Telegram Bot Token & Chat ID

💡 Use Cases:
Extract structured data (like product info or events) from niche websites
Automate compliance monitoring or intelligence gathering
Create market alert bots with real-time info delivery

🛠 Customization Ideas:
Swap Telegram with Gmail, Discord, or Slack

Expand schema to include more complex nested fields

Add a Google Sheet node to log daily scraped data

Integrate with a summarizer or language model for intelligent summaries

Ready to automate your web intelligence gathering?
🧠 Let Firecrawl do the scraping — and let this workflow do the rest.