100 Gigabit Ethernet

Article Copyright Wikipedia - Back to Knowledge Base

100 Gigabit Ethernet (or 100GbE) and 40 Gigabit Ethernet (or 40GbE) are high-speed computer network standards developed by the Institute of Electrical and Electronics Engineers (IEEE).[1] They support sending Ethernet frames at 40 and 100 gigabits per second over multiple 10 Gbit/s or 25 Gbit/s lanes. Previously, the fastest published Ethernet standard was 10 Gigabit Ethernet. They were first studied in November 2007, proposed as IEEE 802.3ba in 2008, and ratified in June 2010.[2] Another variant was added in March 2011.


In June 2007, a trade group called "Road to 100G" was formed after the NXTcomm trade show in Chicago.[3] Official standards work was started by IEEE 802.3 Higher Speed Study Group.[4] The P802.3ba Ethernet Task Force commenced on December 5, 2007[5] with the following project authorization request:

The purpose of this project is to extend the 802.3 protocol to operating speeds of 40 Gb/s and 100 Gb/s in order to provide a significant increase in bandwidth while maintaining maximum compatibility with the installed base of 802.3 interfaces, previous investment in research and development, and principles of network operation and management. The project is to provide for the interconnection of equipment satisfying the distance requirements of the intended applications.

Physical standards

The 40/100 Gigabit Ethernet standards encompass a number of different Ethernet physical layer (PHY) specifications. A networking device may support different PHY types by means of pluggable modules. Optical modules are not standardized by any official standards body but are in multi-source agreements (MSAs). One agreement that supports 40 and 100 Gigabit Ethernet is the C Form-factor Pluggable (CFP) MSA[6] which was adopted for distances of 100+ meters. QSFP and CXP connector modules support shorter distances.[7]

The standard supports only full-duplex operation.[8] Other electrical objectives include:

The 100 m laser optimized multi-mode fiber (OM3) objective was met by parallel ribbon cable with 850 nm wavelength 10GBASE-SR like optics (40GBASE-SR4 and 100GBASE-SR10). The backplane objective with 4 lanes of 10GBASE-KR type PHYs (40GBASE-KR4). The copper cable objective is met with 4 or 10 differential lanes using SFF-8642 and SFF-8436 connectors. The 10 and 40 km 100G objectives with four wavelengths (around 1310 nm) of 25G optics (100GBASE-LR4 and 100GBASE-ER4) and the 10 km 40G objective with four wavelengths (around 1310 nm) of 10G optics (40GBASE-LR4).[10]

In January 2010 another IEEE project authorization started a task force to define a 40 gigabit per second serial single-mode optical fiber standard (40GBASE-FR). This was approved as standard 802.3bg in March 2011.[11] It used 1550 nm optics, had a reach of 2 km and was capable of receiving 1550 nm and 1310 nm wavelengths of light. The capability to receive 1310 nm light allows it to inter-operate with a longer reach 1310 nm PHY should one ever be developed. 1550 nm was chosen as the wavelength for 802.3bg transmission to make it compatible with existing test equipment and infrastructure.[12]

In December 2010, a 10x10 Multi Source Agreement (10x10 MSA) began to define an optical Physical Medium Dependent (PMD) sublayer and establish compatible sources of low-cost, low-power, pluggable optical transceivers based on 10 optical lanes at 10 gigabits/second each.[13] The 10x10 MSA was intended as a lower cost alternative to 100GBASE-LR4 for applications which do not require a link length longer than 2 km. It was intended for use with standard single mode G.652.C/D type low water peak cable with ten wavelengths ranging from 1523 to 1595 nm. The founding members were Google, Brocade Communications, JDSU and Santur.[14] Other member companies of the 10x10 MSA included MRV, Enablence, Cyoptics, AFOP, OPLINK, Hitachi Cable America, AMS-IX, EXFO, Huawei, Kotura, Facebook and Effdon when the 2 km specification was announced in March 2011.[15] The 10X10 MSA modules were intended to be the same size as the C Form-factor Pluggable specifications.


NetLogic Microsystems announced backplane modules in October 2010.[16] This industry trend is important because standards-based 100GE interconnects may allow building optical backplanes at a fraction of price currently required by VCSEL based implementations – such as those found in multichassis systems from Cisco (CRS) and Juniper Networks (T-series).

Copper cables

Quellan announced a test board,[17] but no module is available.

Multimode fiber

In 2009, Mellanox[18] and Reflex Photonics[19] announced modules based on the CFP agreement.

Single mode fiber

Finisar,[20] Sumitomo Electric Industries,[21] and OpNext[22] all demonstrated singlemode 40 or 100 Gigabit Ethernet modules based on the C Form-factor Pluggable agreement at the European Conference and Exhibition on Optical Communication in 2009.


Optical domain IEEE 802.3ba implementations were not compatible with the numerous 40G and 100G line rate transport systems which feature different optical layer and modulation formats. In particular, existing 40 Gigabit transport solutions that used dense wavelength-division multiplexing to pack four 10 Gigabit signals into one optical medium were not compatible with the IEEE 802.3ba standard, which used either coarse WDM in 1310 nm wavelength region with four 25 Gigabit or four 10 Gigabit channels, or parallel optics with four or ten optical fibers per direction.

Test and Measurement

Ixia developed Physical Coding Sublayer Lanes[23] and demonstrated a working 100GbE link through a test setup at NXTcomm in June 2008.[24] Ixia announced test equipment in November 2008.[25][26]

Discovery Semiconductors introduced optoelectronics converters for 100 gigabit testing of the 10 km and 40 km Ethernet standards in February 2009.[27]

JDS Uniphase introduced test and measurement products for 40 and 100 Gigabit Ethernet in August 2009.[28]

Spirent Communications introduced test and measurement products in September 2009.[29]

EXFO demonstrated interoperability in January 2010.[30]

Xena Networks demonstrated test equipment at the Technical University of Denmark in January 2011.[31][32]

These products verify Ethernet protocol implementation but do not test physical layer compliance to IEEE PMD specifications.

First commercial 100GE trials and deployments

Although 100GE is a commodity interface in 2012 and beyond, it helps to understand the timeline and drivers behind the commercial adoption of technology.

Unlike the "race to 10Gbps" that was driven by the imminent needs to address growth pains of Internet in late 1990s, customer interest in 100Gbit/s technologies was mostly driven by economic factors. Among those, the common reasons to adopt 100GE were:[33]

Considering that 100GE technology is natively compatible with OTN hierarchy and there is no separate adaptation for SONET/SDH and Ethernet networks, it was widely believed that 100GE technology adoption will be driven by products in all network layers, from transport systems to edge routers and datacenter switches. Nevertheless, in 2011 components for 100GE networks were not a commodity and most vendors entering this market relied on both internal R&D projects and extensive cooperation with other companies.

Optical Transport Systems

Solving the challenges of optical signal transmission over a nonlinear medium is principally an analog design problem. As such, it has evolved at a slower rate relative to digital circuit lithography advances (which have generally progressed in step with Moore's law.) This explains why 10Gbit/s transport systems have existed since the mid-1990s, while the first forays into 100Gbit/s transmission happened about 15 years later – a 10x speed increase over 15 years is far slower than the 2x speed per 1.5 years typically cited for Moore's law tracking technologies. Nevertheless, as of Aug 2011 at least five firms (Ciena, Alcatel-Lucent, MRV, ADVA Optical and Huawei) have made customer announcements for 100Gbit/s transport systems[34] – although with varying degrees of capabilities. Although most vendors claim that 100Gbit/s lightpaths can utilize existing analog optical infrastructure, in practice deployment of new, high-speed lambdas remains tightly controlled and extensive interoperability tests are required before moving new capacity into service.

Routers and switches with 100GbE interfaces

Design of router or switch with support for 100Gbit/s interfaces is not an easy feat for multiple reasons. One of them is the need to process a 100Gbit/s stream of packets at line rate without reordering within IP/MPLS microflows. As of 2011, most components in the 100Gbit/s packet processing path (PHY chips, NPUs, memories) were not readily available off-the-shelf or require extensive qualification and co-design. Another problem is related to the low-output production of 100Gbit/s optical components, which were also not easily available – especially in pluggable, long-reach or tunable laser flavors.


Alcatel-Lucent first announced 100GbE interfaces for their 7450 ESS/7750 SR platform in June 2009, with field trials following in June–September 2010.[35] However, in April 2011 presentation, James Watt (ALU optical division president) still mentioned 100GbE technology as "demo" staged for T-Systems and Portugal Telecom.[36] Later, in a June 2011 press-release with Verizon, the company again referenced 100GbE as "trial"[37] Thus, despite of being able to bundle the self-developed optical and routing system, Alcatel apparently missed the chance to book early revenue with 100GbE deployments.

In a separate press release from June 2011, Alcatel-Lucent announced a packet processing architecture dubbed FP3.[38]

P&T Luxembourg took in service 100G circuits between Luxemburg and Frankfurt in September 2011 on 1830 from Alcatel-Lucent. [39] [40] [41]

Brocade Communications Systems

In September 2010, Brocade announced their first 100GbE products to be based on the former Foundry Networks hardware (MLXe).[42] In June 2011, the new product went live at AMS-IX traffic exchange point in Amsterdam,[43] bringing first-ever 100GbE revenue for Brocade.

Cisco Systems

The joint Cisco-Comcast press release on their first 100GbE trials was released in June 2008,[44] however it is doubtful this transmission could approach 100Gbit/s speeds when using a 40Gbit/s/per slot CRS-1 platform for packet processing. Cisco's first deployment of 100GbE at AT&T and Comcast occurred in April 2011.[45] Later in the same year, Cisco tested the 100GbE interface between CRS-3 and a new generation of their ASR9K edge router.[46]


In October 2008, the Chinese vendor presented their first 100GbE interface for their flagship router, NE5000e.[47] In September 2009, Huawei also presented an end-to-end 100G solution consisting of OSN6800/8800 optical transport and 100GbE ports on NE5000e.[48] This time, it was also mentioned that Huawei's products had the new self-developed NPU "Solar 2.0 PFE2A" onboard and was using pluggable optics in CFP form-factor. In a mid-2010 product brief, the new NE5000e linecards were given commercial name (LPUF-100) and were credited with using two Solar-2.0 NPUs per 100GbE port in opposite (ingress/egress) configuration.[49] Nevertheless, in October 2010, the company referenced shipments of NE5000e to Russian cell operator "Megafon" as "40Gbps/slot" solution, with "scalability up to" 100Gbit/s.[50]

In April 2011, Huawei announced that the NE5000e platform was updated to carry 2x100GbE interfaces per slot using LPU-200 linecards.[51] In a related solution brief, Huawei reported 120 thousand 20G/40G Solar 1.0 chips as shipped to customers, but no Solar 2.0 numbers were given.[52] Also, following the August 2011 100G trial in Russia, Huawei reported paying 100G DWDM customers, but no 100GbE shipments on NE5000e.[53]

Juniper Networks

Juniper first announced that 100GbE would come to its T-series routers in June 2009.[54] The 1x100GbE option followed in Nov 2010, when a joint press release with academic backbone network Internet2 marked the first production 100GbE interfaces going live in real network.[55] Later in the same year, Juniper demonstrated 100GbE operation between core (T-series) and edge (MX 3D) routers.[56] Juniper, in March 2011, announced first shipments of 100GbE interfaces to a major North American service provider (Verizon[57]). In April 2011, Juniper successfully deployed a 100GbE system to an operator in the UK.(JANET [58]).

Click here for original article.