Kafka and Shuffler integration

Save yourself the work of writing custom integrations for Kafka and Shuffler and use n8n instead. Build adaptable and scalable Development, and Cybersecurity workflows that work with your technology stack. All within a building experience you will love.

Get started

See n8n in action

How to connect Kafka and Shuffler

Step 1: Create a new workflow
Step 2: Add and configure nodes
Step 3: Connect
Step 4: Customize and extend your integration
Step 5: Test and activate your workflow

Step 1: Create a new workflow and add the first step

In n8n, click the "Add workflow" button in the Workflows tab to create a new workflow. Add the starting point – a trigger on when your workflow should run: an app event, a schedule, a webhook call, another workflow, an AI chat, or a manual trigger. Sometimes, the HTTP Request node might already serve as your starting point.

Kafka and Shuffler integration: Create a new workflow and add the first step

Step 2: Add and configure Kafka and Shuffler (using the HTTP Request node)

You can find Kafka and Shuffler nodes in the nodes panel and drag them onto your workflow canvas. Kafka node comes with pre-built credentials and supported actions. Shuffler can be set up with the HTTP Request node using a pre-configured credential type. The HTTP Request node makes custom API calls to Shuffler. Configure Kafka and Shuffler nodes one by one: input data on the left, parameters in the middle, and output data on the right.

Kafka and Shuffler integration: Add and configure Kafka and Shuffler nodes

Step 3: Connect Kafka and Shuffler

A connection establishes a link between Kafka and Shuffler (or vice versa) to route data through the workflow. Data flows from the output of one node to the input of another. You can have single or multiple connections for each node.

Kafka and Shuffler integration: Connect Kafka and Shuffler

Step 4: Customize and extend your Kafka and Shuffler integration

Use n8n's core nodes such as If, Split Out, Merge, and others to transform and manipulate data. Write custom JavaScript or Python in the Code node and run it as a step in your workflow. Connect Kafka and Shuffler with any of n8n’s 1000+ integrations, and incorporate advanced AI logic into your workflows.

Kafka and Shuffler integration: Customize and extend your Kafka and Shuffler integration

Step 5: Test and activate your Kafka and Shuffler workflow

Save and run the workflow to see if everything works as expected. Based on your configuration, data should flow from Kafka to Shuffler or vice versa. Easily debug your workflow: you can check past executions to isolate and fix the mistake. Once you've tested everything, make sure to save your workflow and activate it.

Kafka and Shuffler integration: Test and activate your Kafka and Shuffler workflow

Build your own Kafka and Shuffler integration

Create custom Kafka and Shuffler workflows by choosing triggers and actions. Nodes come with global operations and settings, as well as app-specific parameters that can be configured. You can also use the HTTP Request node to query data from any app or service with a REST API.

Supported API Endpoints for Shuffler

Workflows
Triggers
Actions
Events

GetWorkflow

Retrieve details of a specific workflow.

GET

/workflows/{workflow_id}

CreateWorkflow

Create a new workflow.

POST

/workflows

UpdateWorkflow

Update an existing workflow.

PUT

/workflows/{workflow_id}

DeleteWorkflow

Delete a specific workflow.

DELETE

/workflows/{workflow_id}

ListWorkflows

Retrieve a list of all workflows.

GET

/workflows

To set up Shuffler integration, add the HTTP Request node to your workflow canvas and authenticate it using a predefined credential type. This allows you to perform custom operations, without additional authentication setup. The HTTP Request node makes custom API calls to Shuffler to query the data you need using the URLs you provide.

See the example here

Take a look at the Shuffler official documentation to get a full list of all API endpoints

GetTrigger

Retrieve details of a specific trigger.

GET

/triggers/{trigger_id}

CreateTrigger

Create a new trigger.

POST

/triggers

UpdateTrigger

Update an existing trigger.

PUT

/triggers/{trigger_id}

DeleteTrigger

Delete a specific trigger.

DELETE

/triggers/{trigger_id}

ListTriggers

Retrieve a list of all triggers.

GET

/triggers

See the example here

Take a look at the Shuffler official documentation to get a full list of all API endpoints

GetAction

Retrieve details of a specific action.

GET

/actions/{action_id}

CreateAction

Create a new action.

POST

/actions

UpdateAction

Update an existing action.

PUT

/actions/{action_id}

DeleteAction

Delete a specific action.

DELETE

/actions/{action_id}

ListActions

Retrieve a list of all actions.

GET

/actions

See the example here

Take a look at the Shuffler official documentation to get a full list of all API endpoints

GetEvent

Retrieve details of a specific event.

GET

/events/{event_id}

CreateEvent

Create a new event.

POST

/events

UpdateEvent

Update an existing event.

PUT

/events/{event_id}

DeleteEvent

Delete a specific event.

DELETE

/events/{event_id}

ListEvents

Retrieve a list of all events.

GET

/events

See the example here

Take a look at the Shuffler official documentation to get a full list of all API endpoints

Kafka and Shuffler integration details

Kafka is an open-source platform for distributed event streaming that may be used for mission-critical applications, high-performance data pipelines, streaming analytics, and data integration. The largest companies in the world, in different sectors, are using Kafka.

Kafka node docs + examples

Kafka credential docs

See Kafka integrations

Related categories

Development

Shuffler is a platform that offers cloud-based deployment and management of Jupyter notebooks, a popular tool for data analysis and machine learning. It provides collaboration features, version control, and automation for data science teams, simplifying workflow and enhancing productivity in data-related projects.

Shuffler credentials docs

Using predefined credential types

See Shuffler integrations

Related categories

Cybersecurity

Other integrations with Kafka