Available Models #
Ektos AI offers the most popular and trending open source models. We add new models on our platform as soon as they are made available.
If you would like to use a model that is not currently supported, please let us know on Discord!
Model Types #
- LLM: Large Language Model
- STT: Speech To Text
- TEBD: Text Embedding
| Name | String in API | Type | Size | Context window | Quantization | Source URL |
|---|---|---|---|---|---|---|
| Mistral 7B Instruct | mistral-7b-instruct-v0.3 | LLM | 7.24B parameters | 32k | BF16 | Link |
| Mistral 8x7B Instruct | mixtral-8x7b-instruct-v0.1 | LLM | 46.7B parameters | 32k | BF16 | Link |
| Mistral 8x22B Instruct | mixtral-8x22b-instruct-v0.1 | LLM | 141B parameters | 65k | BF16 | Link |
| Llama 3.1 8B Instruct | meta-llama-3.1-8b-instruct | LLM | 8.03B parameters | 8k | BF16 | Link |
| Llama 3.1 70B Instruct | meta-llama-3.1-70b-instruct | LLM | 70.6B parameters | 8k | BF16 | Link |
| Phi 3.5 Mini 4K Instruct | phi-3.5-mini-4k-instruct | LLM | 3.92B parameters | 4k | FP16 | Link |
| Qwen2 7B Instruct | qwen2-7b-instruct | LLM | 7.62B parameters | 131k | BF16 | Link |
| Whisper Large V3 Turbo | whisper-large-v3-turbo | STT | 0.809B parameters | - | FP16 | Link |
| GTE Multilingual base | gte-multilingual-base | TEBD | 0.305B parameters | 8k | FP16 | Link |
| GTE Large EN V1.5 | gte-large-en-v1.5 | TEBD | 0.434B parameters | 8k | F32 | Link |
The source code and associated weights of models we offer are available on https://huggingface.co/.
Next steps #
- Use text models.
- Use audio models.
- Get in touch and interact with our community on our Discord.