Use Mistral with Lumen AI#

Lumen AI ships with the lumen.ai.llm.MistralAI wrapper for Mistral LLM models. Lumen picks between a default and a reasoning model to solve different tasks, by default it will invoke the following models:

  • default: mistral-small-latest

  • reasoning: mistral-large-latest

For information on configuring the models being used find the configuring LLMs how-to guide.

Prerequisites#

  • Lumen AI installed in your Python environment.

  • An Mistral API Key. You can obtain this from the Mistral Dashboard.

Using Environment Variables#

  1. Set the Environment Variable

Set the MISTRAL_API_KEY environment variable in your system. This allows Lumen AI to automatically detect and use Mistral as the provider.

export MISTRAL_API_KEY='your-mistral-api-key'

set MISTRAL_API_KEY=your-mistral-api-key

  1. Simply run your Lumen AI application, and it will automatically use Anthropic as the LLM provider. If you have environment variables for multiple providers override it.

lumen-ai serve <your-data-file-or-url> [--provider mistral]

Using CLI Arguments#

Alternatively you can also provide the API key as a CLI argument:

lumen-ai serve <your-data-file-or-url> --provider mistral --api-key <your-mistral-api-key>

Using Python#

In Python, simply import the LLM wrapper lumen.ai.llm.MistralAI and pass it to the lumen.ai.ui.ExplorerUI:

import lumen.ai as lmai

mistral_llm = lmai.llm.Mistral(api_key='your-mistral-api-key')

ui = lmai.ui.ExplorerUI('<your-data-file-or-url>', llm=mistral_llm)
ui.servable()

Configuring the Model#

If you want to override the default and/or reasoning models, which use mistral-small-latest and mistral-large-latest respectively, a model configuration can be provided via the model_kwargs parameter. Lumen will use different models for different scenarios, currently a default and a reasoning model can be provided. If no reasoning model is provided it will always use the default model.

You can find the latest list of Mistral models in their documentation. To swap mistral-small-latest for ministral-8b-latest as the default model simply override the default model_kwargs:

import lumen.ai as lmai

config = {
    "default": "ministral-8b-latest",
    "reasoning": "mistral-large-latest"
}

llm = lmai.llm.MistralAI(model_kwargs=config)

lmai.ui.ExplorerUI('<your-data-file-or-url>', llm=llm).servable()