–– 100GbE / 56GbE / 50GbE / 40GbE / 25GbE / 10GbE / 1GbE
–– IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet
–– 25G Ethernet Consortium 25, 50 Gigabit Ethernet
–– IEEE 802.3ba 40 Gigabit Ethernet
–– IEEE 802.3ae 10 Gigabit Ethernet
–– IEEE 802.3az Energy Efficient Ethernet
–– IEEE 802.3ap based auto-negotiation and KR startup
–– Proprietary Ethernet protocols (20/40GBASE-R2, 50/56GBASE-R4)
–– IEEE 802.3ad, 802.1AX Link Aggregation
–– IEEE 802.1Q, 802.1P VLAN tags and priority
–– IEEE 802.1Qau (QCN) – Congestion Notification
–– IEEE 802.1Qaz (ETS)
–– IEEE 802.1Qbb (PFC)
–– IEEE 802.1Qbg
–– IEEE 1588v2
–– Jumbo frame support (9.6KB)
ENHANCED FEATURES
–– Hardware-based reliable transport
–– Collective operations offloads
–– Vector collective operations offloads
–– PeerDirect RDMA (aka GPUDirect) communication acceleration
–– 64/66 encoding
–– Hardware-based reliable multicast
–– Extended Reliable Connected transport (XRC)
–– Dynamically Connected transport (DCT)
–– Enhanced Atomic operations
–– Advanced memory mapping support, allowing user mode registration and remapping of memory (UMR)
–– On demand paging (ODP) – registration free RDMA memory access
STORAGE OFFLOADS
–– RAID offload - erasure coding (Reed-Solomon) offload
–– T10 DIF - Signature handover operation at wire speed, for ingress and egress traffic
OVERLAY NETWORKS
–– Stateless offloads for overlay networks and tunneling protocols
–– Hardware offload of encapsulation and decapsulation of NVGRE and VXLAN overlay networks
HARDWARE-BASED I/O VIRTUALIZATION
–– Single Root IOV
–– Multi-function per port
–– Address translation and protection
–– Multiple queues per virtual machine
–– Enhanced QoS for vNICs
–– VMware NetQueue support
VIRTUALIZATION
–– SR-IOV: Up to 512 Virtual Function
–– SR-IOV: Up to 16 Physical Functions
–– Virtualization hierarchies (e.g. NPAR)
»» Virtualizing Physical Functions on a physical port
»» SR-IOV on every Physical Function
–– 1K ingress and egress QoS levels
–– Guaranteed QoS for VMs
CPU OFFLOADS
–– RDMA over Converged Ethernet (RoCE)
–– TCP/UDP/IP stateless offload
–– LSO, LRO, checksum offload
–– RSS (can be done on encapsulated packet), TSS, HDS, VLAN insertion / stripping, Receive flow steering
–– Intelligent interrupt coalescence
REMOTE BOOT
–– Remote boot over Ethernet
–– Remote boot over iSCSI
–– PXE and UEFI
PROTOCOL SUPPORT
–– OpenMPI, IBM PE, OSU MPI (MVAPICH/2), Intel MPI
–– Platform MPI, UPC, Open SHMEM
–– TCP/UDP, MPLS, VxLAN, NVGRE, GENEVE
–– iSER, NFS RDMA, SMB Direct
–– uDAPL
MANAGEMENT AND CONTROL INTERFACES
–– NC-SI, MCTP over SMBus and MCTP over PCIe - Baseboard Management Controller interface
–– SDN management interface for managing the eSwitch
–– I2C interface for device control and configuration
–– General Purpose I/O pins
–– SPI interface to Flash
–– JTAG IEEE 1149.1 and IEEE 1149.6
