Sun Microsystems 5945532 manual

Sun Microsystems, Inc. www .sun.com Submit comments about this document at: http://www.sun.com/hwdocs/feedback Sun ™ Dual 10GbE SFP+ PCIe ExpressModule User’ s Guide P ar t No . 820-4979-10 August 2008, Re vision A[...]

Copyright © 2008 Sun Microsystems, Inc., 4150 Network Cir cle, Santa Clara, California 95054, U.S.A. All rights reserved. This distribution may include materials developed by third parties. Sun, Sun Microsystems, the Sun logo, SunSolve, Sun Fir e, and Solaris are trademarks or register ed trademarks of Sun Microsystems, Inc., or its subsidiaries, [...]

iii Contents Preface xv 1. Sun Dual 10GbE SFP+ PCIe ExpressModule Overview 1 Shipping Kit Contents 1 ExpressModule Hardware Overview 1 ExpressModule Featur es 2 Indicator Lights on the ExpressModule 3 Hardware and Software Requirements 5 Patch Requirements 5 Patches and Updates 6 2. Installing and Setting Up the Device Driver Software 7 Downloading[...]

iv Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Installing an Optical Transceiver 13 ▼ T o Install an Optical T ransceiver 13 Installing the ExpressModule 16 ▼ T o Install the ExpressModule W ith the Power Off 16 Verifying the Installation 19 ▼ T o V erify the Installation in a Linux System 19 ▼ T o V erify the Inst[...]

Contents v Physical Characteristics 37 Power and Environmental Requir ements 38 Index 39[...]

vi Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008[...]

vii Regulatory Compliance Statements Y our Sun product is marked to indicate its compliance class: • Federal Communications Commission (FCC) — USA • Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada • V oluntary Control Council for Interfer ence (VCCI) — Japan • Bureau of Standar ds Metrology and Inspection [...]

viii Sun Dual 10GbE SFP+ PCIe ExpressModule User’ s Guide • August 2008 BSMI Class A Notice The following statement is applicable to products shipped to T aiwan and marked as Class A on the product compliance label. CCC Class A Notice The following statement is applicable to products shipped to China and marked with “Class A” on the pr oduc[...]

ix Safety Agency Compliance Statements Read this section before beginning any procedure. The following text provides safety precautions to follow when installing a Sun Microsystems product. Safety Precautions For your protection, observe the following safety precautions when setting up your equipment: ■ Follow all cautions and instructions marked[...]

x Sun Dual 10GbE SFP+ PCIe ExpressModule User’ s Guide • August 2008 Conformité aux normes de sécurité Veuillez lire attentivement cette section avant de commencer. Ce texte traite des mesures de sécurité qu’il convient de prendre pour l’installation d’un produit Sun Microsystems. Mesures de sécurité Pour votre sécurité, nous vou[...]

Safety Agency Compliance Statements xi Einhaltung sicherheitsbehördlicher Vorschriften Lesen Sie vor dem Ausführen von Arbeiten diesen Abschnitt. Im folgenden Text werden Sicherheitsvor- kehrungen beschrieben, die Sie bei der Installation eines Sun Microsystems-Produkts beachten müssen. Sicherheitsvorkehrungen Treffen Sie zu Ihrem eigenen Schutz[...]

xii Sun Dual 10GbE SFP+ PCIe ExpressModule User’ s Guide • August 2008 Normativas de seguridad Lea esta sección antes de realizar cualquier operación. En ella se explican las medidas de seguridad que debe tomar al instalar un producto de Sun Microsystems. Medidas de seguridad Para su protección, tome las medidas de seguridad siguientes duran[...]

xiii Declaration of Conformity EMC USA—FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This equipment may not cause harmful interference. 2. This equipment must accept any interference that may cause undesired operation. Canada This Class A digital apparatus complies with[...]

xiv Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008[...]

xv Pr eface This user ’s guide provides har dware and softwar e installation instructions for the Sun™ Dual 10GbE SFP+ PCIe Express Module. This document also describes how to configur e the driver software for the ixgbe driver for Linux operating systems and Microsoft W indows Server 2003. These instructions are designed for enterprise system [...]

xvi Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Chapter 6 explains virtual local area networks (VLANs), and provides conf iguration instructions and examples. Appendix A lists the specifications for the Sun 10GbE XFP SR PCI Express Car d. T ypographic Conventions Shell Pr ompts T ypeface * * The settings on your browser mi[...]

Preface xvii Related Documentation The documents listed as online are available at: http://docs.sun.com/app/docs/prod/dual.sfp.pcie Documentation, Support, and T raining Thir d-Party W eb Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for a[...]

xviii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Sun W elcomes Y our Comments Sun is interested in impr oving its documentation and welcomes your comments and suggestions. Y ou can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedb[...]

1 CHAPTER 1 Sun Dual 10GbE SFP+ PCIe Expr essModule Overview This chapter describes the Sun 10GbE XFP SR PCI Express Card har dware and software, and includes the following sections: ■ “Shipping Kit Contents” on page 1 ■ “ExpressModule Hardwar e Overview” on page 1 ■ “Hardwar e and Software Requir ements” on page 5 ■ “Patch Re[...]

2 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 The ExpressModule is optimized for Intel I/O Acceleration T echnology (I/OA T), which is designed to optimize network I/O. The ExpressModule is a high- performance, highly integrated 10 Gigabit Ethernet LAN card with PCIe host interface and fiber LAN connectors on the optical m[...]

Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview 3 ■ Compatible with x8 standard and low-pr ofile PCI Expr ess slots ■ Support for most network operating systems (NOS) ■ Remote management support ■ Support for SFP+ form factor transceivers ■ RoHS compliant, lead-free technology ■ Intel PROSet Utility for W indows Device Manager[...]

4 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 T wo LEDs are on the ExpressModule next to the Attention switch. One LED emits green light, the LED other emits amber light. Each light can be on, of f, or blinking. T ABLE 1-2 explains the meaning of these lights. Note – The Attention switch currently is not supported. T ABL[...]

Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview 5 Har dware and Softwar e Requir ements Before using the Sun 10GbE XFP SR PCI Express Car d, ensure that your system meets the hardwar e and software r equirements in T ABLE 1-3 . Note – The preceding information is up-to-date at the time this manual was written. Go to http://www.sun.com/ [...]

6 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Patches and Updates Check the Sun Update Connection to ensure that you have the latest r ecommended patch clusters and security patches. Y ou can download the latest recommended patch clusters and security patches at: http://sunsolve.sun.com/pub-cgi/show.pl?target=patchpage[...]

7 CHAPTER 2 Installing and Setting Up the Device Driver Softwar e This chapter explains how to install and remove the ixgbe driver on Linux and Microsoft W indows systems. This chapter contains the following sections: ■ “Downloading and Installing the Driver on a Linux Platform” on page 7 ■ “Downloading and Installing the Driver on a Micr[...]

8 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 4. Select this option: Download drivers and software 5. Select Linux as the operating system. 6. Locate the following driver and select Download: Network Adapter Driver for 10 GbE PCI-E Based Network Connections for Linux 7. Review and accept the software license agreement. 8. [...]

Chapter 2 Installing and Setting Up the Device Driv er Software 9 6. V erify that the ixgbe driver has been successfully installed with this lsmod command: The output should be similar to the following: 7. Check the ixgbe driver version with this modinfo command: For example, the output might be the following: ▼ T o Remove the Driver Fr om a Linu[...]

10 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Downloading and Installing the Driver on a Micr osoft W indows Platform If your system uses the Microsoft W indows Server 2003 operating system, perform the following procedur es to download and install the device driver . ▼ T o Download and Install the Driver on a Micr osof[...]

Chapter 2 Installing and Setting Up the Device Driv er Software 11 9. Click on the following exe f iles to install the driver: ■ For a 64-bit driver: PROEM64T.exe ■ For a 32-bit driver: PRO2KXP.exe 10. Follow the instructions in the installation wizard. 1 1. If the Found New Hardware Wizard screen is displayed, click Cancel. The autorun automat[...]

12 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008[...]

13 CHAPTER 3 Installing the Expr essModule This chapter describes how to install the ExpressModule in your system and verify that it is recognized by the operating system. This chapter contains the following sections: ■ “Installing an Optical T ransceiver” on page 13 ■ “Installing the Expr essModule” on page 16 ■ “V erifying the Ins[...]

14 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 2. Holding the optical transceiver by the edges, align the transceiver with the slot in the ExpressModule and slide the transceiver into the opening. 3. Applying even pressure at both corners of the transceiver , push the transceiver until it is f irmly seated in the slot. 4. [...]

Chapter 3 Installing the ExpressModule 15 5. Repeat Step 1 through Step 4 to install the second optical transceiver . Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver entirely and r einstall it. The handle operates an internal lock. Pulling the handle down can disconnect the o[...]

16 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Installing the Expr essModule The following instructions describe the basic tasks required to install the ExpressModule. Refer to your system installation or service manual for detailed ExpressModule installation instructions. Note – T o maintain proper cooling for the Expre[...]

Chapter 3 Installing the ExpressModule 17 6. Align the ExpressModule with the vacant ExpressModule slot (1 in the following f igure). Ensure that the Expr essModule’s indicator lights on the front panel ar e facing toward you and that the Expr essModule ejector lever on the bottom is fully opened.[...]

18 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 7. Slide the ExpressModule into the vacant ExpressModule chassis slot until the ejector lever engages and starts to close (2 in the preceding f igure). Failure to align the Expr essModule correctly can r esult in damage with the ExpressModule’s internal connection to the cha[...]

Chapter 3 Installing the ExpressModule 19 V erifying the Installation After you have installed the Sun 10GbE XFP SR PCI Express Card, perform the following tasks to verify the installation. ▼ T o V erify the Installation in a Linux System ● V erify the new network interface instances corresponding to the Sun 10GbE XFP SR PCI Express Card: ▼ T[...]

20 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 2. Click on Network Connection. The Ethernet adapter interfaces labeled as "Intel(R) 82598EB 10 Gigabit AF Dual Port Network Connection" will be displayed at the Network Connection window screen, if the driver is installed successfully . 3. T o check the driver versi[...]

21 CHAPTER 4 Network Conf iguration This chapter describes how to edit the network host files after the card has been installed on your system. This chapter contains the following section: ■ “Configuring the Network Host Files for Booting Over the Gigabit Ethernet Network for Linux Systems” on page 21 Note – T o do a PXE boot (or netboot) o[...]

22 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 4. Plug the Ethernet cable into the card port. 5. Power on the system. 6. Press the F2 key or the Control-E keys to go to the BIOS. 7. Check and ensure that the boot order of the network devices is higher than the hard drive. 8. Press the F10 key to save the boot conf iguratio[...]

23 CHAPTER 5 Conf iguring the Driver Parameters The ixgbe device driver controls the Sun 10GbE SFP+ PCIe Expr essModule interfaces. Y ou can manually set the ixgbe device driver parameters to customize each device in your system. This chapter lists the available device driver parameters and describes how you can set these parameters. ■ “Driver [...]

24 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Driver Parameters for Linux Systems T ABLE 5-1 lists the tunable ixgbe driver parameters for Linux operating systems and describes their function. T ABLE 5-1 T unable ixgbe Driver Parameters for Linux Operating Systems Keyw ord V alid Range Default V alue Description FlowContr[...]

Chapter 5 Configuring the Dr iver P arameters 25 Setting ixgbe Driver Parameters in Linux Systems ▼ T o Conf igure Jumbo Frames Jumbo Frames can support up to 15000 MTU. The default value is 1500 MTU. ● Use the ifconfig command to increase MTUs to allow transmission of Jumbo Frames. For example, where the IP addr ess for eth7 is 192.1.1.200 , t[...]

26 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008[...]

27 CHAPTER 6 Conf iguring VLANs This chapter describes how to configure virtual local ar ea networks (VLANs). This chapter contains the following sections: ■ “VLAN Overview” on page 27 ■ “Configuring VLANs” on page 30 ■ “Configuring Bonding for Multiple Interfaces” on page 32 Note – If you change any of the VLAN configuration pa[...]

28 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 VLANs are commonly used to separate gr oups of network users into manageable broadcast domains, to cr eate logical segmentation of workgroups, and to enforce security policies among each logical segment. Each defined VLAN behaves as its own separate network, with its traffic a[...]

Chapter 6 Configuring VLANs 29 The physical LAN network consists of a switch, two servers, and five clients. The LAN is logically organized into thr ee differ ent VLANs, each representing a dif ferent IP subnet. ■ VLAN 1 is an IP subnet consisting of the Main Server , Client 3, and Client 5. This repr esents an engineering group. ■ VLAN 2 inclu[...]

30 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Conf iguring VLANs VLANs can be created accor ding to various criteria, but each VLAN must be assigned a VLAN tag or VLAN ID (VID). The VID is a 12-bit identifier between 1 and 4094 that identifies a unique VLAN. For each network interface ( ixgbe0 , ixgbe1 , ixgbe2, and so on[...]

Chapter 6 Configuring VLANs 31 2. Plumb the Sun 10GbE XFP SR PCI Express Card interface: where xxx.xxx.xx.xxx = the IP addr ess of the interface. 3. Add the VLAN instance (VID). For example: where eth6 is the interface and 5 is the VID. Note – In Linux systems, you can use any single digit as the VID. 4. Conf igure the ixgbe VLAN ( eth2 in this e[...]

32 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 1 1. Click Subnet Mask. The value 255.255.255.0 is displayed. 12. Click OK. 13. Repeat Step 3 through Step 10 until all the network ports are VLAN conf igured. Note – Ensure that the f irewall is configur ed to allow VLAN traff ic. Otherwise, the VLAN might not operate prope[...]

Chapter 6 Configuring VLANs 33 In this example, two bonds ( bond0 and bond1 ) are conf igured: Refer to Linux documentation for more information. ▼ T o Remove Bonding ● Use the rmmod command to remove bonding: # modprobe bonding mode=balance-rr miimon=100 max_bonds=2 # ifconfig bond0 192.2.2.15 netmask 255.255.255.0 broadcast 192.2.2.255 # ifen[...]

34 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008[...]

35 APPENDIX A Sun Dual 10GbE SFP+ PCIe Expr essModule Specifications This appendix lists the specifications for the Sun 10GbE XFP SR PCI Expr ess Card. This appendix contains the following sections: ■ “Connectors” on page 36 ■ “T echnical Features” on page 37 ■ “Physical Characteristics” on page 37 ■ “Power and Envir onmental [...]

36 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Connectors FIGURE A-1 shows the connectors for the Sun 10GbE XFP SR PCI Express Card. FIGURE A-1 Sun Dual 10GbE SFP+ PCIe ExpressModule Connectors[...]

Appendix A Sun Dual 10GbE SFP+ PCIe ExpressModule Specifications 37 T echnical Featur es Physical Characteristics T ABLE A-1 Performance Specif ications Feature Specification Data rate supported per port 10 Gigabit (Gb) Bus type PCI Express 2.0 Bus width x8 lane PCI Express Conforms to Ethernet Standard 802.3 Boot R OM 2 Mbit SPI Flash Electromagne[...]

38 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Power and Envir onmental Requirements T ABLE A-3 Card Power Requirements Specification Measurement T ypical po wer consumption 14W (1.17A at 12V) dual port Main host power supply 12 V ± 15% Operating temperature 35 to 70 ° C (95 to 158 ° F) module inlet temperature Storage [...]

39 Index B bonding for multiple interfaces, 3 2 booting over the network on Linux systems, 2 1 C configuring bonding, 3 2 configuring the network host files, 2 1 configuring VLANs, 3 0 in Linux environments, 30 connectors, 36 D driver parameters tunable for Linux OS, 2 4 E editing the network host files, 2 1 Ethernet adapter features, 2 H hard[...]

40 Sun Dual 10GbE SFP+ PCIe ExpressModule User’ s Guide • August 2008[...]