NVL40STCGPU-KIT
NVIDIA L40S
Description
Specifications1
GPU Architecture |
NVIDIA Ada Lovelace Architecture |
|---|---|
GPU Memory |
48GB GDDR6 with ECC |
Memory Bandwidth |
864 GB/s |
CUDA® Cores |
18,176 |
RT Cores |
142 |
Tensor Cores |
568 |
RT Core Performance |
212 TFLOPS |
FP32 |
91.6 TFLOPS |
TF32 Tensor Core |
366 TFLOPS |
BFLOAT16 Tensor Core |
366 I 7332 TFLOPS |
FP16 Tensor Core |
366 I 7332 TFLOPS |
FP8 Tensor Core |
733 I 14662 TFLOPS |
Peak INT8 Tensor |
733 I 14662 TOPS |
Peak INT4 Tensor |
733 I 14662 TOPS |
Form Factor |
4.4" (H) x 10.5" (L), dual slot |
Display Ports |
4 x DisplayPort 1.4a |
Max Power Consumption |
350W |
Power Connector |
16-pin |
Thermal |
Passive |
Virtual GPU (vGPU) Software Support |
Yes |
NVENC I NVDEC |
3x l 3x (Includes AV1 Encode and Decode) |
Secure Boot with Root of Trust |
Yes |
NEBS Ready |
Level 3 |
MIG Support |
No |