KoboldAI

KoboldAI is a free, open-source project that allows users to run AI models locally on their own computer. It's a browser-based front-end that can be used for writing or role playing with an AI. KoboldAI is a "a browser-based front-end for AI-assisted writing with multiple local & remote AI models...". It has a public and local API that can be used in LangChain.

安装与设置

查看 安装指南。

LLMs

查看一个 使用示例。

from langchain_community.llms import KoboldApiLLM

API 参考：KoboldApiLLM