Quick overview
This workflow pulls companies from Supabase, uses an OpenAI (GPT-4o) agent to crawl each company website and collect social media profile URLs via HTTP requests and HTML parsing, and then writes the enriched company record (name, website, and social links) back to Supabase.
How it works
- Runs manually and loads all company records from a Supabase
companies_input table.
- Keeps only each company’s
name and website fields and sends the website to an OpenAI (GPT-4o) agent.
- The agent fetches page text (HTML converted to Markdown) and extracts links from pages (anchor hrefs), following additional URLs as needed to find social profiles.
- The agent returns a structured JSON object of social media platforms and their profile URLs.
- The workflow combines the extracted social links with the original company name and website.
- Inserts the enriched record into the Supabase
companies_output table.
Setup
- Add a Supabase credential and set the correct workspace/project so the workflow can read from
companies_input and write to companies_output.
- Add an OpenAI API key in the OpenAI Chat Model node (configured for GPT-4o).
- Ensure your input table contains
name and website fields (or update the field mapping to match your schema).