Introduction

Generators are replacement for local LLMs. They act like a token source. When a plugin with a generator is used, LM Studio will no longer use the local model to generate text. The generator will be used instead.

Generators are useful for implementing adapters for external models, such as using a remote LM Studio instance or other online models.

If a plugin contains a generator, it will no longer show up in the plugins list. Instead, it will show up in the model dropdown and act as a model. If your plugins contains Tools Provider or Prompt Preprocessor, they will be used when your generator is being selected.

Examples

The following are some plugins that make use of generators:

• lmstudio/remote-lmstudio

  Basic support for using a remote LM Studio instance to generate text.

• lmstudio/openai-compat-endpoint

  Use any OpenAI-compatible API in LM Studio.