Quick overview
This workflow runs daily or via chat to scrape Tunisia-focused IT job listings from predefined company career pages using Firecrawl, saves results into Airtable tables, and emails a daily digest through Resend, with job parsing and orchestration handled by a Groq-powered AI agent.
How it works
- Triggers either on a daily 7AM schedule or when an n8n Chat message is received.
- On scheduled runs, rotates through a fixed list of companies, builds a prompt for the chosen company (including pagination rules), and sets the Airtable table name.
- Uses a Groq (Llama 3.3 70B) AI agent to decide which allowed career-page URLs to scrape and how to extract job listings into structured fields.
- Scrapes the requested career pages via the Firecrawl API and parses the returned main content into jobs with title, company, location, description, and URL.
- When saving is requested, uses Airtable’s API to check for the target table, create it if missing, and insert the job records.
- For scheduled runs, emails the AI-generated job digest to the configured recipient using the Resend API; otherwise it outputs the response for the chat session.
Setup
- Add credentials and values for Firecrawl (API key), Airtable (API key and Base ID), Groq (API key), and Resend (API key, from address, and recipient email).
- Ensure your Airtable base allows table creation via the Metadata API and that your API key has permission to create tables and insert records.
- If using the chat trigger, copy the chat webhook URL and configure it in the client or tool that sends chat messages to this workflow.