Groq
Groqdeveloped the world's first Language Processing Unit™, or
LPU. TheGroq LPUhas a deterministic, single core streaming architecture that sets the standard for GenAI inference speed with predictable and repeatable performance for any given workload.Beyond the architecture,
Groqsoftware is designed to empower developers like you with the tools you need to create innovative, powerful AI applications.With Groq as your engine, you can:
- Achieve uncompromised low latency and performance for real-time AI and HPC inferences 🔥
- Know the exact performance and compute time for any given workload 🔮
- Take advantage of our cutting-edge technology to stay ahead of the competition 💪
安装与设置
安装集成包:
pip install langchain-groq
请求一个 API密钥 并将其设置为环境变量:
export GROQ_API_KEY=gsk_...
聊天模型
查看一个 使用示例。
from langchain_groq import ChatGroq
API 参考:ChatGroq