llamafile

llamafile lets you distribute and run LLMs with a single file.

llamafile makes open LLMs much more accessible to both developers and end users. llamafile is doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation.

安装与设置

查看 安装说明。

LLMs

查看一个 使用示例。

from langchain_community.llms.llamafile import Llamafile

API 参考：Llamafile

嵌入模型

查看一个 使用示例。

from langchain_community.embeddings import LlamafileEmbeddings

API 参考：LlamafileEmbeddings