Inference acceleration card 106B

The 106B is a PCIe board with a peak power consumption of 300W. It provides flexible deployment of powerful universal computing power for PCIe GPU servers widely used in data centers.

Application scenario

  • Natural Language processing

  • Large-scale search recommendations

  • Scientific calculation
    Technical specification
    Name Specifications
    Accuracy INT8/BF16/TF32
    Memory 32GB HBM2E
    Memory bandwidth 819 GB/s
    Encoding/decoding capability 32 HEVC/H.264 encoding, 256 HEVC/H.264 decoding
    Power consumption 300W
    Size Full height Full length Double slot
    Operating temperature 0℃-45℃