Dell INFINISCALE III M2401G manual

Mellanox T echnologies Third party informatio n brought to you courtesy of Dell. InfiniScale® III M2401G 20Gb/s InfiniBand Blade Switch I/O Module for PowerEdge M-Series User Manual PN: M2401G Rev 1.8[...]

Rev 1.8 Mellanox Technologies 2 Copyright 2008. Mellanox T echno logies, Inc. All Rights Reserved. Mellanox T echnologies ConnectX, In finiBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and InfiniPCI are registered trad emarks of Mellanox T echnolo gies, Ltd. V irtual Protocol Intercon - nect is a trademark of Mellanox T echnologies, Ltd[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 3 Content s Contents 3 About this Manual 4 Revision History 5 Chapter 1 Overview 6 1.1 InfiniBand Connectors 7 1.2 Switch Status Lights 7 Chapter 2 Installation and Basic Operation 9 2.1 Installation Safety Warnings 10 2.2 Mechanic al Installation 11 2.2.1 [...]

Rev 1.8 Mellanox Technologies 4 About this Manual This manual describes the installation and basic use of the Infin iScale® III M2401G 20Gb/s Infini - Band blade switch I/O module for PowerEdge M-Series. Intended Audience This manual is intended fo r users and system admi nistrators responsible for instal ling and setting up the switch platforms l[...]

M2401G 20Gb/s In finiBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 5 Revision History T able 2 - Revision History T able Date Revision Description Mar . 200 9 Rev 1.8 Modified product description and document title Mar . 200 9 Rev 1.7 Added Dell flat black Logo Dec. 2008 Rev 1.6 Minor fixes to Rev 1.5 Dec. 2008 Rev 1.5 Min[...]

Rev 1.8 Mellanox Technologies 6 1 Overview The InfiniScale® III M2401G 20Gb/s InfiniBand blade switch I/O modu le for PowerEdge M- Series provides a high bandwidth, low laten cy , lo w power fabric for Enterprise Data Center and High-Performance Computing environ ments. Based on the third generation In fi niScale® III Infini - Band switch device,[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 7 1.1 InfiniBand Connectors InfiniBand connectivity has 8 mi croGiGa connectors through t he front panel. The remaining 16 interfaces are through the AirMax Midplane Connector out the ba ck of the switch. Figure 1 shows the front 8 ports. Each of the Infini[...]

Rev 1.8 Mellanox Technologies 8 T able 3 - IOM states and LE D configurations: LED Switch S tatus Indication Green Sta t u s OFF OFF OFF ON OFF Boot in Progress Switch not ready Bl inking Blue ON BLINKING BLUE The CMC is identifying the newly installed switch ON ON BLUE Switch is on and operating Normally ON ON or BLINKING AMBER Fault in System Sel[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 9 2 Installation and Basic Operation Installation and in itialization of the switch platform are straightfo rward processes, requiring atten - tion to the normal mechanical, power , and thermal precautions for rack-mounted eq uipment. The switch platform do[...]

Rev 1.8 Mellanox Technologies 10 2.1 Installation Safety W arnings 1. Installation Instructions 2. Over -temperatur e 3. S tacking the Chassis 4. During Lightning - Electrical Hazard 5. Copper InfiniBand Cable Connecting/Disconnecting 6. Rack Mounting and Servicing 7. Equipment In sta llation Read all installation instructions before connecting the[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 11 8. Equipment Disposal 9. Local and National Electrical Codes 2.2 Mechanical Installation These switches are hot pluggable. It is not necessary to power down the Dell Chassis to inst all a new switch or to replace an old switch with a new one. Figure 4: R[...]

Rev 1.8 Mellanox Technologies 12 3. Unlock the switch from the chassis by pu shing the red latch release button. 4. Pull the l ocking arm down to a positio n perpendicular to the front of the chassis. 5. Pull the switch out of the chassis using the locking arm. 6. Install either a new switch or a blank IOM within one minute. 2.2.2 Removing a Blank [...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 13 2.4 InfiniBand Cable Installation All cables can be inserted or removed wi th the uni t pow er on. T o insert a cable, press the connector into the port receptacle until the connector is firmly seated . The green LED in dicator below each port will light[...]

Rev 1.8 Mellanox Technologies 14 3 Cluster Management and Firmwar e 3.1 Network Management and Clustering Software Download and install, on all nodes, the Mellanox OpenFabric software pack age for Linux, W in - dows, or other operating systems from the Mellanox software website: http://www .mellanox.com > Downloads > InfiniBan d SW/Drivers Th[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 15 Reports regarding cluster links will use direct routes. Loading IBDM from: /usr/local/lib/ibdm1.2 -I- Using port 1 as the local port. -I- Discovering ... 3 nodes (2 Switches & 1 CA-s) discovered. -I--------------------------------------------------- [...]

Rev 1.8 Mellanox Technologies 16 II. Using the ibnetdiscover tool: Run: [root@mymach]# ibnetdi scover | grep 00000006660 abcd0 | grep -w Switch Switch 24 "S-0000 0006660abcd0" "MT4 7396 Infiniscale -III Mellanox Technol ogies" base port 0 lid 17 lmc 0 Note: The resulting LID is given as a decimal number. 4. Run mlxburn with the [...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 17 4 T r oubleshooting As soon as a switch is plugged in ma ke sure that the power LED comes on. The power LED for the switch does not come on: 1. Check that the chassis has power . 2. Remove and reinstall the switch. The status LED for the sw itch is blink[...]

Rev 1.8 Mellanox Technologies 18 Appendix A: Specifications T able 4 - M2401G Specification Data Physical Power and Environmental H x W x D: We i g h t : Mounting: SerDes Speeds Connectors: 1.16 x 10.04 inches 272.50 x 29.45 x 255.20 mm 1.5 Kg fully configu red V ertically mounted rack 10, 20 Gb/s p er port microGiGaCN 8 external CX4 connectors 4x4[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 19 Appendix B: Mechanical Drawing Figure 4 Mechanic al Drawing of th e Switch[...]

Rev 1.8 Mellanox Technologies 20 Appendix C: EMC Certification S tatement s C.1: FCC S tatement s (USA) Class A S tatements: § 15.21 Statement Warning! Changes or modifications to this equi pment not expressly approved by the party responsible for compliance (Mellanox T echnologies ) could void the user's authority to operate the equipment. ?[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 21 C.1.3 VCCI S tatements (Japan) Class A S tatement: (T ranslation - "This is a Class A product based on the standard of the V oluntary Contr ol Council for Interference by I nformation T echnolo gy Equipment (VCCI). If this equipment is used in a dom[...]

Rev 1.8 Mellanox Technologies 22 . Appendix D: InfiniBand Connector Pinout Figure 5: InfiniBand Connector Pinout T able 5 - Connector Pin to Signal Name Correspondence Connector Pin Number Connector Pin Name Signal Name S1 IBtxIp(0) IB_Px_R1_P S2 IBtxIn(0) IB_Px_R1_N S3 IBtxIp(1) IB_Px_R2_P S4 IBtxIn(1) IB_Px_R2_N S5 IBtxIp(2) IB_Px_R3_P S6 IBtxIn([...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 23 Px in the signal name signifies Port # x. This switch has 8 external ports. Figure 6: Pinout Connector V iew S12 IBtxOp(2) IB_Px_ T3_P S13 IBtxOn(1) IB_Px_ T2_N S14 IBtxOp(1) IB_Px_ T2_P S15 IBtxOn(0) IB_Px_ T1_N S16 IBtxOp(0) IB_Px_ T1_P G1-G6, G9, H1- [...]

Rev 1.8 Mellanox Technologies 24 Appendix E: A vertissements de sécurité d’installation 1. Instructions d’installation 2. T empérature excessive 3. Empilage du châssis 4. Orages – dangers électriques 5. Branchement/débranchement des câ bles InfiniBand en cuivr e 6. Montage et entret ien sur baie 7. Installation du matériel Lisez toute[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 25 8. Elimination du matériel 9. Codes électriques loca ux et nationaux L ’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationale s en vi gueur . Ce matériel doit être installé dans l[...]

Rev 1.8 Mellanox Technologies 26 Appendix F: Installation - Sicherheit shinweise 1. Installationsanl eitungen 2. Übertemperatur 3. S tapeln des C hassis 4. Bei Gewitter - Elektrische Gefahr 5. Anschließen/T rennen von InfiniBand- Kupferkabel 6. Rack-Montage und W artung 7. Geräteinstallation Lesen Sie alle Installationsanlei tungen, bevor Sie da[...]

M2401G 20Gb/s Infi niBand Blade Switch I/O M odule User Manual Mellanox Technologies Rev 1.8 27 8. Geräteentsorgung 9. Regionale und nationale elektrische Bestimmungen Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrische[...]