Chat with local LLMs using n8n and Ollama
This n8n workflow allows you to seamlessly interact with your self-hosted Large Language Models (LLMs) through a user-friendly chat interface. By connecting to Ollama, a powerful tool for managing local LLMs, you can send prompts and receive AI-generated responses directly within n8n.
Use cases
- Private AI Interactions
Ideal for scenarios where data privacy and confidentiality are important. - Cost-Effective LLM Usage
Avoid ongoing cloud API costs by running models on your own hardware. - Experimentation & Learning
A great way to explore and experiment with different LLMs in a local, controlled environment. - Prototyping & Development
Build and test AI-powered applications without relying on external services.
How it works
- When chat message received: Captures the user's input from the chat interface.
- Chat LLM Chain: Sends the input to the Ollama server and receives the AI-generated response.
- Delivers the LLM's response back to the chat interface.
Set up steps
- Make sure Ollama is installed and running on your machine before executing this workflow.
- Edit the Ollama address if different from the default.