AI/ML API

tip

If you installed lfx directly with uv pip install lfx, install this provider from the long-tail metapackage:

uv pip install "lfx-bundles[<bundle>]"

Replace <bundle> with this page's provider name, for example qdrant. To install every long-tail provider at once, run uv pip install "lfx[bundles]". See the Bundle list for the exact extra name.

If you installed Langflow with uv pip install langflow, these bundle components are already included.

Bundles contain custom components that support specific third-party integrations with Langflow.

This page describes the components that are available in the AI/ML bundle.

AI/ML API text generation

This component creates a ChatOpenAI model instance using the AI/ML API. The output is exclusively a Language Model (LanguageModel) that you can connect to another LLM-driven component, such as a Smart Transform component.

For more information, see the AI/ML API Langflow integration documentation and Language model components.

AI/ML API text generation parameters

Some parameters are hidden by default in the visual editor. You can modify all component parameters through the component inspection panel that appears when you select a component.

Name	Type	Description
max_tokens	Integer	Input parameter. The maximum number of tokens to generate. Set to 0 for unlimited tokens. Range: 0-128000.
model_kwargs	Dictionary	Input parameter. Additional keyword arguments for the model.
model_name	String	Input parameter. The name of the AIML model to use. Options are predefined in AIML_​CHAT_​MODELS.
aiml_api_base	String	Input parameter. The base URL of the AIML API. Defaults to https://api.aimlapi.com.
api_key	SecretString	Input parameter. The AIML API Key to use for the model.
temperature	Float	Input parameter. Controls randomness in the output. Default: 0.1.

AI/ML API Embeddings

The AI/ML API Embeddings component generates embeddings using the AI/ML API.

The output is Embeddings. Specifically, an instance of AIMLEmbeddingsImpl.

For more information about using embedding model components in flows, see Embedding model components.

AI/ML API Embeddings parameters

Some parameters are hidden by default in the visual editor. You can modify all component parameters through the component inspection panel that appears when you select a component.

Name	Type	Description
model_name	String	Input parameter. The name of the AI/ML embedding model to use.
aiml_api_key	SecretString	Input parameter. The API key required for authenticating with the AI/ML service.