Llama 3.3 70B Instruct · 2× NVIDIA L40S · fp8

$/hr: $1.10
Weights / VRAM: 71 / 96 GB
FP16 TFLOPS: 724
Params: 70.6B · llama
Context: 131,072
License: llama3.3

← all offerings · deployments