ROGER FIBREOPTICAL NETWORK DOSSIERS Build a Fiber Brief

Relationship between optical modules and GPUs

NVIDIA GPUs use high-speed optical modules, including 400G, 800G, and 1. 6T transceivers, to enable multi-terabit-per-second connectivity between GPUs, servers, and storage in AI and HPC systems.

Types and Speeds

Optical modules for GPUs are designed to handle extremely high bandwidth requirements. Common types include: 400G Optical Modules: Support up to 400 Gbps, widely used for AI inferencing, mid-range model training, and connecting DGX systems to servers and storage. 800G Optical Modules: Deliver up to 800 Gbps, suitable for large-scale AI model training, real-time simulations, and massive data analytics.

1. 6T Modules: Emerging high-capacity modules for hyperscale GPU clusters, enabling ultra-fast interconnects across racks. These modules are available in QSFP, QSFP-DD, OSFP, and SFP form factors, supporting both NRZ and PAM4 modulation for multi-mode and single-mode fiber connections.

Applications in GPU Systems

Optical modules are critical for: Data Center Interconnects: Linking GPUs across racks and pods to maintain low latency and high throughput.

AI and HP

C Workloads: Enabling fast communication for deep learning, transformer models, and scientific simulations. Storage Networks: Connecting GPU-based systems to high-speed storage fabrics for efficient data transfer. In NVIDIA's ecosystem, optical modules are used in DGX SuperPODs, NVLink clusters, and AI supercomputers, ensuring seamless communication between multiple GPUs and nodes.

Emerging Technologies

Recent innovations include co-packaged optics (CPO) and on-package optical interconnects, which integrate photonic modulators directly onto GPU or switch substrates. This reduces energy consumption, increases bandwidth, and extends communication distances up to 2 km using microring resonators and wavelength-division multiplexing. Startups like Ayar Labs are implementing optical chiplets that interface with GPUs via the UCIe protocol, achieving up to 8 Tbps per GPU pair.

Deployment Considerations

The number of optical modules per GPU depends on: GPU Bandwidth: H100 GPUs with 900 GB/s NVLink require multiple optical links for inter-rack scaling. Cluster Size: Small clusters (8–16 GPUs) may need 16–32 modules, while hyperscale clusters with hundreds of GPUs may require thousands. Redundancy and Reliability: Data centers often deploy redundant links to maintain low latency and fault tolerance, effectively doubling module requirements.

Optical modules are therefore a key enabler for scaling GPU-based AI and HPC systems, providing the high-speed, low-latency connectivity that traditional copper interconnects cannot achieve.

Relationship between optical modules and GPUs

Optical Interconnect Technology Analysis: LPO, NPO, CPO

Exploring optical interconnects for AI data centers: LPO for low-power, short-distance links, NPO for high-density, near-package connections, and CPO for ultra-high-bandwidth co

Understanding the Ratio of Optical Modules to GPUs in Different

Explore the factors influencing the number of optical modules required for GPUs in various networking architectures. Learn about different network card and switch models, the scalable unit

Start-ups Replace Copper with Optical Links for GPUs

Startups are unveiling demonstrations of how GPUs can shed their copper interconnects, replacing them with optical links. Optical links are no

Can optical modules and optical chips replace GPUs?

It is expected that optical modules and GPUs will coexist in a complementary manner: GPUs provide computational power, while optical modules provide high-speed communication,

How many optical modules are required for NVIDIA chips?

Key Insight: As AI model sizes and GPU cluster sizes grow, the demand for optical modules scales exponentially, underscoring their strategic importance in next-generation AI

Optical Modules for GPU Clusters | AI Training Network Infrastructure

This article explores how optical modules enable GPU cluster architectures, the specific requirements of GPU interconnects, and best practices for designing high-performance AI training

Optical Module Requirements for A100 and H100 GPUs in HPC

This article discusses how different architectures and components in high-performance computing (HPC) networks affect the number of optical modules required for GPUs.

From AI Chips to the Ultimate CPO Positioning Battle: NVIDIA vs

Optical communication dominates here, with key interconnect technologies including InfiniBand and Ethernet, driving the optical module market. InfiniBand and Ethernet form two major

NVIDIA Optical Interconnects Replace Copper for AI Scaling in New

Recent research from TrendForce shows that GPU developers are now designing their future chips with increased interconnect density to achieve the extensive data transfer requirements

Optically Connected and Reconfigurable GPU Architecture for

Specifically, this paper investigates how re-configurable optical links between GPUs in multi-GPU servers can allow for minimized memory transfer latencies for given machine learning applications.

What Is A Single-Fiber BiDi Transceiver?--ETU-LINK

When planning a fiber optic network,one key decision is choosing between single-fiber (BiDi) and dual-fiber optical transceivers. This guide from ETU-Link explains their differences,advantages,and how to

Intel® Core™ Processors, FPGAs, GPUs, Networking,

Browse Intel product information for Intel® Core™ processors, Intel® Xeon® processors, Intel® Arc™ graphics and more.

OSFP vs QSFP-DD Comparison | 800G Optical Module Form Factors

Detailed analysis of OSFP and QSFP-DD form factors for 800G optical modules. Compare specifications, thermal management, backward compatibility, and choose the right solution

Nvidia outlines plans for using light for communication

The extreme demands of passing communication between ever-growing clusters of AI GPUs is fueling a move towards using light for

NVIDIA Strategic Investments in Optical Interconnects

NVIDIA has established early-mover advantage in securing optical supply relationships, but competitors and hyperscale cloud providers are not

Vivo X300 vs X300 Pro: Full specs comparison

Vivo X300 vs X300 Pro: Full specs comparison including display, performance, cameras, and battery Vivo X300 and X300 Pro showing front and

How Many Optical Transceivers are Needed for A GPU?

In the market, there are different versions of the ratio of optical transceivers to the number of GPUs, and the figures of various versions are not consistent mainly because the amount of optical

Optically Connected and Reconfigurable GPU Architecture for

Increasing industry interest in the optimization of inter-GPU com-munication has motivated this work to explore new ways to enable peer-to-peer access. Specifically, this paper investigates how re

Technical note

This reference is intended for preliminary fiber and communications infrastructure research. Optical interface, fiber type, port or core capacity, electrical input and output, enclosure protection, cooling, installation limits and applicable standards must be verified for the specific project.

Still Have a Technical Question?

Use the inquiry form to describe the product category, application, interfaces, capacity and installation environment.

Start a Project Inquiry