QAM (Quadrature Amplitude Modulation)

QAM (Quadrature Amplitude Modulation) is a modulation format that encodes data in both the amplitude and phase of the optical field — equivalently, in the in-phase (I) and quadrature (Q) components of the complex field amplitude. The number after the QAM label indicates the constellation size: 16-QAM has 16 distinct symbols, 64-QAM has 64, etc.

Constellation representation. QAM signals are visualized as constellation diagrams in the I-Q plane, where each symbol is a complex point $(I, Q)$ representing the field amplitude:

Format	Constellation	Bits/symbol	Use
BPSK	2 points on the I axis	1	Coherent simple
QPSK	4 points in a square (45° offset)	2	Submarine, long-haul
8-PSK	8 points on a circle	3	Rare
8-QAM	4 inner + 4 outer points	3	Specialty
16-QAM	4×4 square grid	4	Metro, long-haul
32-QAM	Cross constellation	5	Bridge to 64-QAM
64-QAM	8×8 square grid	6	Metro, short-haul subsea
128-QAM	Cross constellation	7	High-rate metro
256-QAM	16×16 grid	8	Short metro, recent
512-QAM	Cross	9	Research
1024-QAM	32×32 grid	10	Research

For optical communications, the standard format is dual-polarization QAM (DP-QAM): two independent QAM streams on the two orthogonal polarizations of the single-mode fiber, doubling the bit rate without doubling bandwidth.

Spectral efficiency. For DP-QAM:

Format	Bits per symbol per channel	Spectral efficiency (max)
DP-QPSK	4	4 bit/Hz
DP-8QAM	6	6 bit/Hz
DP-16QAM	8	8 bit/Hz
DP-32QAM	10	10 bit/Hz
DP-64QAM	12	12 bit/Hz
DP-256QAM	16	16 bit/Hz

Higher QAM order yields more bits per symbol but at the cost of needing higher SNR — the spectral-efficiency-vs-reach trade-off is the fundamental engineering choice in long-haul system design.

OSNR requirements. The SNR required for the same BER increases exponentially with QAM order:

Format @ 100 Gb/s	OSNR threshold (pre-FEC, BER = 2×10⁻²)	OSNR threshold (post-FEC, BER = 10⁻¹⁵)
DP-QPSK (25 GBaud)	12 dB/0.1nm	17 dB/0.1nm
DP-8QAM	14 dB/0.1nm	19 dB/0.1nm
DP-16QAM	17 dB/0.1nm	22 dB/0.1nm
DP-32QAM	20 dB/0.1nm	25 dB/0.1nm
DP-64QAM	23 dB/0.1nm	28 dB/0.1nm
DP-256QAM	29 dB/0.1nm	34 dB/0.1nm

Each doubling of constellation size adds approximately 3 – 4 dB to the OSNR threshold. This is the well-known trade-off: higher capacity requires higher SNR.

Coherent detection required. QAM signals fundamentally require coherent detection — direct detection cannot distinguish symbol phase. A coherent receiver:

1. Mixes the incoming signal with a continuous-wave local oscillator (LO) of similar wavelength
2. Beat between signal and LO produces I and Q electrical signals proportional to the signal's complex field
3. Digital signal processing (DSP) demodulates the I/Q samples into symbol decisions

The local oscillator typically uses an ECDL (external-cavity diode laser) or similar narrow-linewidth source. Source linewidth must be $\ll 1\%$ of the symbol rate to limit phase noise penalty.

Symbol rate × constellation rates. The total bit rate is:

$$R \;=\; B \cdot k_\text{mod} \cdot 2 \cdot (1 - \text{FEC overhead}),$$

where $B$ is the symbol rate (baud), $k_\text{mod}$ is bits per QAM symbol, the factor of 2 is for dual-polarization, and FEC overhead is typically 20 – 25%.

For example, 400G with DP-16QAM at 32 GBaud (after FEC):

$$R \;=\; 32 \text{ GBaud} \times 4 \text{ bits/sym} \times 2 \text{ pol} \times 0.8 \text{ (FEC)} \;\approx\; 205 \text{ Gb/s net}, \;\;\sim 256 \text{ Gb/s gross}.$$

To exceed 200G net per channel, you need either higher baud or higher constellation.

Reach vs constellation choice.

Reach	Recommended DP-QAM
6500+ km (transoceanic)	DP-QPSK
1500 – 6500 km	DP-QPSK, sometimes PCS-QPSK
800 – 1500 km	DP-16QAM, PCS-shaped 16QAM
200 – 800 km	DP-16QAM, DP-32QAM
80 – 200 km	DP-64QAM
< 80 km (metro)	DP-64QAM, DP-256QAM

Probabilistic constellation shaping (PCS). Modern coherent systems use PCS to fine-tune the trade-off between rate and reach. Instead of using all constellation points equally, inner points are used more often than outer points (Maxwell-Boltzmann distribution). PCS provides:

• 1 – 1.5 dB of SNR gain at the same modulation order
• Continuous rate adjustment (without changing constellation)
• Better adaptation to varying channel conditions

For a single hardware design, PCS allows the same transceiver to operate at 200 G or 400 G or 500 G or 600 G depending on the SNR available.

Standards and product offerings.

Generation	Format	Per-channel rate	Distance
First-gen coherent (2010s)	DP-QPSK	100 G	1500 – 6500 km
Second-gen (mid-2010s)	DP-16QAM	200 G	500 – 1500 km
Third-gen (late 2010s)	DP-16QAM, DP-32QAM	400 G	500 – 1500 km
Fourth-gen (2020s)	DP-64QAM, PCS-shaped	600 – 800 G	80 – 800 km
Fifth-gen (mid-2020s)	DP-256QAM, PCS	1.2 – 1.6 T	100 – 500 km

The bit rate per coherent transceiver has approximately doubled every 2 – 3 years, driven by improvements in DSP, ADC bandwidth, and DAC linearity.

Why QAM enables capacity scaling. Capacity is the product of symbol rate and bits per symbol. Symbol rate is bandwidth-limited (today's ADCs/DACs cap at ~ 100 – 130 GBaud); bits per symbol scales with SNR. Modern transmission systems push both axes:

• Higher baud rate: 100 – 130 GBaud in 2024 – 2026 systems
• Higher constellation: 64-QAM, 256-QAM with PCS

The combination doubles capacity each generation.

DSP requirements at the receiver.

Function	Purpose
Front-end I/Q imbalance correction	Compensate for analog hardware imperfections
Adaptive equalizer	Compensate for residual dispersion and PMD
Frequency offset correction	Compensate for LO-signal frequency difference
Carrier phase recovery	Track signal phase relative to LO
Symbol decision	Map equalized signal to QAM constellation
FEC decoding	Correct errors using soft-decision algorithms

For DP-64QAM at 100 GBaud, the DSP IC runs at $\sim 500$ Gops/s and consumes 15 – 25 W.

References: Agrawal, Fiber-Optic Communication Systems (4th ed., 2010), Ch. 8 for the modulation-format treatment; Roberts et al., "Beyond 100 Gb/s with coherent transponders" and follow-on papers in Optics Express for modern QAM coherent transmission; ITU-T G.709 / OTN for standardized formats.