Skip to contents

Find updated rate limits for API models

Source: R/rate_limits.R
rate_limits_per_minute.Rd

[Stable]

rate_limits_per_minute reports the rate limits for a given API model. The function returns the available requests per minute (RPM) as well as tokens per minute (TPM). Find general information at https://developers.openai.com/api/docs/models/model-endpoint-compatibility.

Usage

rate_limits_per_minute(
  model = "gpt-4o-mini",
  AI_tool = "OpenAI",
  api_key = NULL
)

Arguments

model

Character string with the name of the completion model. Default is "gpt-4o-mini". Can take multiple values. For OpenAI models, find available models at https://developers.openai.com/api/docs/models/model-endpoint-compatibility. For Groq models, find available models at https://console.groq.com/docs/models.

AI_tool

Character string specifying the AI tool from which the API is issued. Currently supports "OpenAI" (default) and "Groq".

api_key

Character string with the API key. For OpenAI, use get_api_key(). For Groq, use get_api_key_groq().

Value

A tibble including variables with information about the model used, the number of requests and tokens per minute.

Examples

if (FALSE) { # \dontrun{
set_api_key()

rate_limits_per_minute(
  model = "gpt-4o-mini",
  AI_tool = "OpenAI",
  api_key = get_api_key()
)

# Groq example
rate_limits_per_minute(
  model = "llama3-70b-8192",
  AI_tool = "Groq",
  api_key = get_api_key_groq()
)
} # }