NEXT-LEVEL ACCELERATION HAS ARRIVEDWe re racing toward the future where every customer interaction, every product, and every service offering will be touched and improved by AI. Realizing that the future requires a computing platform that can accelerate the full diversity of modern AI, enabling businesses to create new customer experiences, reimagine how they meet and exceed customer demands, and cost-effectively scale their AI-based products and services.The NVIDIA® T4 GPU accelerates diverse cloud workloads, including high-performance computing, deep learning training and inference, machine learning, data analytics, and graphics. Based on the new NVIDIA Turing architecture and packaged in an energy-efficient 70-watt, small PCIe form factor, T4 is optimized for scale-out computing environments and features multi-precision Turing Tensor Cores and new RT Cores. Combined with accelerated containerized software stacks from NGC, T4 delivers revolutionary performance at scale.BREAKTHROUGH PERFORMANCET4 introduces the revolutionary Turing Tensor Core technology with multi-precision computing to handle diverse workloads. Powering breakthrough performance from FP32 to FP16 to INT8, as well as INT4 precisions, T4 delivers up to 40X higher performance than CPUs.STATE-OF-THE-ART INFERENCE IN REAL-TIMEResponsiveness is key to user engagement for services such as conversational AI, recommender systems, and visual search. As models increase in accuracy and complexity, delivering the right answer right now requires exponentially larger compute capability. T4 delivers up to 40X times better low-latency throughput, so more requests can be served in real time.
| Processor | |
| Graphics processor family: | NVIDIA |
| Graphics processor: | Tesla T4 |
| CUDA: |  |
| CUDA cores: | 2560 |
| Peak floating point performance (single precision): | 8100 Gflops |
| Memory | |
| Discrete graphics card memory: | 16 GB |
| Graphics card memory type: | GDDR6 |
| Memory bus: | 256 bit |
| Memory bandwidth (max): | 320 GB/s |
| Ports & interfaces | |
| Interface type: | PCI Express x16 3.0 |
| Design | |
| Cooling type: | Passive |
| Form factor: | Half-Height/Half-Length (HH/HL) |
| Power | |
| Power consumption (max): | 70 W |
| Technical details | |
| Sustainability certificates: | RoHS |
| Logistics data | |
| Harmonized System (HS) code: | 84733020 |
