Gemini ➜ OpenAI API proxy. Serverless!
The Gemini API is free, but there are many tools that work exclusively with the OpenAI API.
This project provides a personal OpenAI-compatible endpoint for free.
Although it runs in the cloud, it does not require server maintenance. It can be easily deployed to various providers for free (with generous limits suitable for personal use).
[!TIP] Running the proxy endpoint locally is also an option, though it's more appropriate for development use.
You will need a personal Google API key.
[!IMPORTANT] Even if you are located outside of the supported regions (e.g., in Europe), it is still possible to acquire one using a VPN.
Deploy the project to one of the providers, using the instructions below. You will need to set up an account there.
If you opt for “button-deploy”, you'll be guided through the process of forking the repository first, which is necessary for continuous integration (CI).
vercel deploy
vercel dev
netlify deploy
netlify dev
src/worker.mjs
to https://workers.cloudflare.com/playground (see there Deploy
button).wrangler deploy
wrangler dev
If you open your newly-deployed site in a browser, you will only see a 404 Not Found
message. This is expected, as the API is not designed for direct browser access.
To utilize it, you should enter your API address and your Gemini API key into the corresponding fields in your software settings.
[!NOTE] Not all software tools allow overriding the OpenAI endpoint, but many do (however these settings can sometimes be deeply hidden).
Typically, you should specify the API base in this format:
https://my-super-proxy.vercel.app/v1
However, some software may expect it without the /v1
ending:
https://my-super-proxy.vercel.app
The relevant field may be labeled as "OpenAI proxy". You might need to look under "Advanced settings" or similar sections. Alternatively, it could be in some config file (check the relevant documentation for details).
For some command-line tools, you may need to set an environment variable, e.g.:
set OPENAI_BASE_URL=https://my-super-proxy.vercel.app/v1
..or:
set OPENAI_API_BASE=https://my-super-proxy.vercel.app/v1
chat/completions
Currently, most of the parameters that are applicable to both APIs have been implemented, with the exception of function calls.
messages
content
role
system
(=>system_instruction
)user
assistant
tool
(v1beta)name
tool_calls
model
(value ignored, model is set to gemini-1.5-pro-latest
)
frequency_penalty
logit_bias
logprobs
top_logprobs
max_tokens
n
(candidateCount
<8) n.b.: atm api does not accept >1
presence_penalty
response_format
seed
stop
: string|array (stopSequences
[1,5])temperature
(0.0..2.0 for OpenAI, but Gemini supports up to infinity)top_p
tools
(v1beta)tool_choice
(v1beta)user
completions
embeddings
models