Ollama

Bundles contain custom components that support specific third-party integrations with Langflow.

This page describes the components that are available in the Ollama bundle.

For more information about Ollama features and functionality used by Ollama components, see the Ollama documentation.

Ollama text generation

This component generates text using Ollama's language models.

To use the Ollama component in a flow, connect Langflow to your locally running Ollama server and select a model:

1. Add the Ollama component to your flow.

2. In the Base URL field, enter the address for your locally running Ollama server.

   This value is set as the OLLAMA_HOST environment variable in Ollama. The default base URL is http://127.0.0.1:11434.

3. Once the connection is established, select a model in the Model Name field, such as llama3.2:latest.

   To refresh the server's list of models, click Refresh.

4. Optional: To configure additional parameters, such as temperature or max tokens, click Controls in the component's header menu.

5. Connect the Ollama component to other components in the flow, depending on how you want to use the model.

   Language model components can output either a Model Response (Message) or a Language Model (LanguageModel). Use the Language Model output when you want to use an Ollama model as the LLM for another LLM-driven component, such as a Language Model or Smart Function component. For more information, see Language Model components.

   In the following example, the flow uses LanguageModel output to use an Ollama model as the LLM for an Agent component.

   

Ollama Embeddings

The Ollama Embeddings component generates embeddings using Ollama embedding models.

To use this component in a flow, connect Langflow to your locally running Ollama server and select an embeddings model:

1. Add the Ollama Embeddings component to your flow.

2. In the Ollama Base URL field, enter the address for your locally running Ollama server.

   This value is set as the OLLAMA_HOST environment variable in Ollama. The default base URL is http://127.0.0.1:11434.

3. Once the connection is established, select a model in the Ollama Model field, such as all-minilm:latest.

   To refresh the server's list of models, click Refresh.

4. Optional: To configure additional parameters, such as temperature or max tokens, click Controls in the component's header menu. Available parameters depend on the selected model.

5. Connect the Ollama Embeddings component to other components in the flow. For more information about using embedding model components in flows, see Embedding Model components.

   This example connects the Ollama Embeddings component to generate embeddings for text chunks extracted from a PDF file, and then stores the embeddings and chunks in a Chroma DB vector store.