Skip to main content

Settings of models.

GET 

/model-settings

Only models available to the client will be listed.

Responses

OK

Schema
  • Array [
  • namestring
    descriptionstring
    max_context_sizenumber

    The maximum context size of this model.

    alignedboolean

    Specifies whether the model is aligned s.t. end users can be warned about the model's limitations.

    semantic_embeddingboolean

    True if this model supports semantic embeddings.

    advanced_samplingboolean

    Flag to differentiate between the sampling capabilities of the luminous vs the vllm worker. True corresponds to models served by luminous and is the default setting. If set to false, the scheduler will return an error in case unsupported sampling parameters are used.

    multimodalboolean

    Feature flag for whether or not multimodal prompts are available to users.

    chatboolean

    True if this model is supported by the chat endpoint.

    prompt_templatestring

    A prompt template that can be used for this model.

  • ]

Authorization: http

name: tokentype: httpscheme: bearerdescription: Can be generated in your [Aleph Alpha profile](https://app.aleph-alpha.com/profile)
var client = new HttpClient();
var request = new HttpRequestMessage(HttpMethod.Get, "https://docs.aleph-alpha.com/model-settings");
request.Headers.Add("Accept", "application/json");
request.Headers.Add("Authorization", "Bearer <token>");
var response = await client.SendAsync(request);
response.EnsureSuccessStatusCode();
Console.WriteLine(await response.Content.ReadAsStringAsync());
Request Collapse all
Auth