HTTP Request node
Item Lists node

Pulling data from services that n8n doesn’t have a pre-built integration for

Published 1 year ago

Created by

jon-n8n
Jonathan

Categories

Building Blocks

Template description

You still can use the app in a workflow even if we don’t have a node for that or the existing operation for that. With the HTTP Request node, it is possible to call any API point and use the incoming data in your workflow

Main use cases:

  • Connect with apps and services that n8n doesn’t have integration with
  • Web scraping

How it works
This workflow can be divided into three branches, each serving a distinct purpose:

1.Splitting into Items (HTTP Request - Get Mock Albums):

  • The workflow initiates with a manual trigger (On clicking 'execute').
  • It performs an HTTP request to retrieve mock albums data from "https://jsonplaceholder.typicode.com/albums."
  • The obtained data is split into items using the Item Lists node, facilitating easier management.

2.Data Scraping (HTTP Request - Get Wikipedia Page and HTML Extract):

3.Handling Pagination (The final branch deals with handling pagination for a GitHub API request):

  • It sends an HTTP request to "https://api.github.com/users/that-one-tom/starred," with parameters like the page number and items per page dynamically set by the Set node.
  • The workflow uses conditions (If - Are we finished?) to check if there are more pages to retrieve and increments the page number accordingly (Set - Increment Page).
  • This process repeats until all pages are fetched, allowing for comprehensive data retrieval.

Share Template

Implement complex processes faster with n8n

red icon yellow icon red icon yellow icon