Dynamic model management

With PhariaOS dynamic model management, you can deploy and manage Aleph Alpha-supported and open-source models without needing to modify your infrastructure. A unified interface allows you to explore, install, and control models in one place, reducing the risk of deployment errors.

Model support is limited to the following:

  • Aleph Alpha-supported models, which are currently:

    • Pharia 1 LLM 7B Control

    • Llama 3.1 8B

    • Llama 3.3 70B

    • Llama Guard 3 8B

    • Luminous base

  • vLLM-compatible models from Hugging Face.

GPU resource prediction and adapter support will be included in future versions of PhariaOS!