Mixtral 8x7B Instruct v0.1 · 4× NVIDIA GeForce RTX 3090 · fp8

$/hr: $0.80
Weights / VRAM: 47 / 96 GB
FP16 TFLOPS: 284
Params: 46.7B · mixtral
Context: 32,768
License: apache-2.0

← all offerings · deployments