in other news I installed @n8n_io tonight and holy moly it’s good
it’s compatible with EVERYTHING
Back to Integrations
Integrate Remove Duplicates with 500+ apps and services
Unlock Remove Duplicates’s full potential with n8n, connecting it to similar Core Nodes apps and over 1000 other services. Create adaptable and scalable workflows between Remove Duplicates and your stack. All within a building experience you will love.
Popular ways to use Remove Duplicates integration
+20
API Schema Extractor
This workflow automates the process of discovering and extracting APIs from various services, followed by generating custom schemas. It works in three distinct stages: research, extraction, and schema generation, with each stage tracking progress in a Google Sheet.
🙏 Jim Le deserves major kudos for helping to build this sophisticated three-stage workflow that cleverly automates API documentation processing using a smart combination of web scraping, vector search, and LLM technologies.
How it works
Stage 1 - Research:
Fetches pending services from a Google Sheet
Uses Google search to find API documentation
Employs Apify for web scraping to filter relevant pages
Stores webpage contents and metadata in Qdrant (vector database)
Updates progress status in Google Sheet (pending, ok, or error)
Stage 2 - Extraction:
Processes services that completed research successfully
Queries vector store to identify products and offerings
Further queries for relevant API documentation
Uses Gemini (LLM) to extract API operations
Records extracted operations in Google Sheet
Updates progress status (pending, ok, or error)
Stage 3 - Generation:
Takes services with successful extraction
Retrieves all API operations from the database
Combines and groups operations into a custom schema
Uploads final schema to Google Drive
Updates final status in sheet with file location
Ideal for:
Development teams needing to catalog multiple APIs
API documentation initiatives
Creating standardized API schema collections
Automating API discovery and documentation
Accounts required:
Google account (for Sheets and Drive access)
Apify account (for web scraping)
Qdrant database
Gemini API access
Set up instructions:
Prepare your Google Sheets document with the services information. Here's an example of a Google Sheet – you can copy it and change or remove the values under the columns. Also, make sure to update Google Sheets nodes with the correct Google Sheet ID.
Configure Google Sheets OAuth2 credentials, required third-party services (Apify, Qdrant) and Gemini.
Ensure proper permissions for Google Drive access.
Polina Medvedieva
Verifying Email deliverability using google sheets and Effibotics API
This workflow helps marketers verify and update data using EffiBotics Email Verifier API.
Copy and create a list with emails as on this one https://docs.google.com/spreadsheets/d/1rzuojNGTaBvaUEON6cakQRDva3ueGg5kNu9v12aaSP4/edit#gid=0
The trigger checks for any updates in the number of rows that are present in a sheet and updates the verified emails on Google sheets
Once you update a new cell, the new data is read, and the email is checked for its validity before. The results are then updated in real-time on the sheet.
Happy Emailing!
Imperol
+8
Scrape business emails from Google Maps without the use of any third party APIs
Who is this template for?
This workflow template is designed for sales, marketing, and business development professionals who want a cost-effective and efficient way to generate leads. By leveraging n8n core nodes, it scrapes business emails from Google Maps without relying on third-party APIs or paid services, ensuring there are no additional costs involved.
Ideal for small business owners, freelancers, and agencies, this template automates the process of collecting contact information for targeted outreach, making it a powerful tool for anyone looking to scale their lead generation efforts without incurring extra expenses.
How it works
This template streamlines email scraping from Google Maps using only n8n core nodes, ensuring a completely free and self-contained solution. Here’s how it operates:
Input Queries
You provide a list of queries, each consisting of keywords related to the type of business you want to target and the specific region or subregion you’re interested in.
Iterates through Queries
The workflow processes each query one at a time. For each query, it triggers a sub-workflow dedicated to handling the scraping tasks.
Scrapes Google Maps for URLs
Using these queries, the workflow scrapes Google Maps to collect URLs of business listings matching the provided criteria.
Fetches HTML Content
The workflow then fetches the HTML pages of the collected URLs for further processing.
Extracts Emails
Using a Code Node with custom JavaScript, the workflow runs regular expressions on the HTML content to extract business email addresses.
Setup
Add Queries:
Open the first node, "Run Workflow" and input a list of queries, each containing the business keywords and the target region.
Configure the Google Sheets Node:
Open the Google Sheets node and select a document and specific sheet where the scraped results will be saved.
Run the workflow:
Click on "Test workflow" and watch your Google Sheets document gradually receive business email addresses.
Customize as Needed:
You can adjust the regular expressions in the Code Node to refine the email extraction logic or add logic to extract other kinds of information.
Akram Kadri
+11
Autonomous AI crawler
This workflow with AI agent is designed to navigate through the page to retrieve specific type of information (in this example: social media profile links).
The agent is equipped with 2 tools:
text tool:** to retrieve all the text from the page,
URLs tool:** to extract all possible links from the page.
💡 You can edit prompt and JSON schema connected to the agent in order to return other data then social media profile links.
👉 This workflow uses Supabase as storage (input/output). Feel free to change it to any other database of your choice.
🎬 See this workflow in action in my YouTube video.
How it works?
The workflow uses the input URL (website) as a starting point to retrieve the data (e.g. example.com). Using the "URLs tool", the agent is able to retrieve all links from the page and navigate to them.
For example, if you want to retrieve contact information, agent will try to find a subpage that might contain this information (e.g. example.com/contact) and extract the information using the text tool.
Set up steps
Connect database with input data (website addresses) or pin sample data to trigger node.
Configure the crawling agent to retrieve the desired data (e.g. modify prompt and/or parsing schema).
Set credentials for OpenAI.
Optionally: split agent tools to separate workflows.
If you like this workflow, please subscribe to my YouTube channel and/or my newsletter.
Oskar
+3
Extract emails from website HTMLs
How to scrap emails from websites
This workflow shows how to quickly build an Email scraping API using n8n.
Email marketing is at the core of most marketing strategies, be it content marketing, sales, etc. As such, being able to find contacts in bulk for your business on a large scale is key.
There are available tools available in the market that can do this, but most are premium; why not build a custom one with n8n?
Usage
The workflow gets the data from a website and performs an extraction based on the date around on the website
Copy the webhook URL to your browser
Add a query parameter eg ?Website=https://mailsafi.com . This should give you a URL like this {{$n8nhostingurl/webhook/ea568868-5770-4b2a-8893-700b344c995e?Website=https://mailsafi.com
Click on the URL and wait for the extracted email to be displayed.
This will return the email address on the website, or if there is no email, the response will be "workflow successfully executed."
Make sure to use HTTP:// for your domains
Otherwise, you may get an error.
Imperol
+12
Import workflows and map their credentials using a Multi-Form
Purpose
This workflow allows you to import any workflow from a file or another n8n instance and map the credentials easily.
How it works
A multi-form setup guides you through the entire process
At the beginning you have two options:
Upload a workflow file (JSON)
Copy workflow from a remote n8n instance
If you choose the second option, you get to choose one of your predefined (in the Settings node) remote instances first, then it retrieves a list of all the workflows using the n8n API which you then can choose a workflow from.
Now both initial options come together - the workflow file is being processed
In parallel all credentials of the current instance are being retrieved using the Execute Command node
The next form page enables a mapping of all the credentials used in the workflow. The matching happens between the names (because one workflow can contain different credentials of the same type) of the original credentials and the ones available on the current instance. Every option then shows all available credentials of the same type. In addition the user has always the choice to create a new credential on the fly.
For every option which was set to create a new credential, an empty credential is being created on the current instance using the n8n API. An emoji is being appended to the name, which indicates that it needs to be populated.
Finally the workflow gets updated with the new credential ID’s and created on the current instance using the n8n API. Then the user gets a message, if the process has succeeded or not.
Setup
Select your credentials in the nodes which require those
Configure your remote instance(s) in the Settings node. (You can skip this step, if you only want to use the File Upload feature)
Every instance is defined as object with the keys name, apiKey and baseUrl. Those instances are then wrapped inside an array. You can find an example described within a note on the workflow canvas.
How to use
Grab the (production) URL of the Form from the first node
Open the URL and follow the instructions given in the multi-form
Disclaimer
Security: Beware, that all credentials are being decrypted and processed within the workflow. Also the API keys to other n8n instances are stored within the workflow.
This solution is primarily meant for transferring data between testing environments. For production use consider the n8n enterprise edition which provides a reliable way to deploy workflows between different environments without the need of manual credential mapping.
Mario
Load More Workflows
Documents
Remove Duplicates Node Docs + Examples
Over 3000 companies switch to n8n every single week
Connect Remove Duplicates with your company’s tech stack and create automation workflows
aaron
@acar321
qupaya technologies
@qupaya
We're using the @n8n_io cloud for our internal automation tasks since the beta started. It's awesome! Also, support is super fast and always helpful. 🤗
Cris
Last week I automated much of the back office work for a small design studio in less than 8hrs and I am still mind-blown about it.
n8n is a game-changer and should be known by all SMBs and even enterprise companies.
