Skip to main content

Tokenize

POST 

/tokenize

Tokenize a prompt for a specific model. To obtain a valid model, use GET /models_available.

Request

Body

required
    model stringrequired
    prompt stringrequired
    tokens booleanrequired
    token_ids booleanrequired

Responses

OK

Schema
    tokens string[]
    token_ids integer[]
Loading...