ading2210/vercel-llm-api

A reverse engineered Python API wrapper for the Vercel AI Playground, which provides free access to many large language models without needing an account.

# Python Vercel LLM API [](https://pypi.org/project/vercel-llm-api/) This is a reverse engineered API wrapper for the [Vercel AI Playground](https://play.vercel.ai/), which allows for free access to many LLMs, including OpenAI's ChatGPT, Cohere's Command Nightly, as well as some open source models. ## Table of Contents: - [Features](#features) - [Limitations](#limitations) - [Installation](#installation) - [Documentation](#documentation) * [Using the Client](#using-the-client) + [Downloading the Available Models](#downloading-the-available-models) + [Generating Text](#generating-text) + [Generating Chat Messages](#generating-chat-messages) * [Misc](#misc) + [Changing the Logging Level](#changing-the-logging-level) - [Copyright](#copyright) * [Copyright Notice](#copyright-notice) *Table of contents generated with [markdown-toc](http://ecotrust-canada.github.io/markdown-toc).* ## Features: - Download the available models - Generate text - Generate chat messages - Set custom parameters - Stream the responses ## Limitations: - User-agent is hardcoded - No auth support - Can't use "pro" or "hobby" models ## Installation: You can install this library by running the following command: ``` pip3 install vercel-llm-api ``` ## Documentation: Examples can be found in the `/examples` directory. To run these examples, simply execute the included Python files from your terminal. ``` python3 examples/generate.py ``` ### Using the Client: To use this library, simply import `vercel_ai` and create a `vercel_ai.Client` instance. You can specify a proxy using the `proxy` keyword argument. Normal example: ```python import vercel_ai client = vercel_ai.Client() ``` Proxied example: ```python import verce