HP (Hewlett-Packard) HSC/PCI 1000Base-SX manual

Using PCI 1000Base-T and HSC/PCI 1000Base-SX (Gigabit Ethernet) Manufacturing P art Number : J5683-90002 E0602 U .S .A. © Copyright 2002, Hewlett-P ackard Company .[...]

2 Legal Notices The information in this document is subject to change without notice. Hewlett-P ackard makes no warranty of any kind with regard to this manual, including , but not limited to , the implied warranties of merchantability and fitness for a particular purpose . Hewlett-Pac kard shall not be held liable for errors contained herein or d[...]

3 OSF/Motif is a trademark of the Open Software F oundation, Inc . in the U .S. and other countries.[...]

4[...]

3 Preface The information in this manual is intended for network managers who administer Gigabit Ethernet networks. It is assumed that the Gigabit Ethernet hardw are and software ha ve been installed and configured. F or instructions on how to install and configure Gigabit Ethernet hardware and softw are, refer to the Quick Installation Guide , a[...]

4[...]

Chapter 1 5 1 Introduction This chapter gives an overview of the Gigabit Ethernet products and lists its features .[...]

Introduction Product Overview Chapter 1 6 Product Overview Gigabit Ethernet is a high-performance Ethernet networking solution for HP servers and workstations . The LAN adapters are data link adapters that support the IEEE 802.3z standard for 1000Base-SX operation over multimode fiber , and the IEEE 802.3ab standard for 1000Base-T operation over 4[...]

Introduction Product Overview Chapter 1 7 • Jumbo F rame support — Large 9000 byte maximum transfer unit (MTU) for improved efficiency and performance with bulk data transfer — Supported only at 1000Mbps interface (link partner must also support Jumbo Frames) • SNMP (MIB-II) support • MC/ServiceGuard and Auto-P ort Aggregation (AP A) sup[...]

Introduction About this Manual Chapter 1 8 About this Manual The information in this manual applies to the following Gigabit Ethernet products: T able 1-1 List of Gigabit Ethernet Products Product Description Driver Name Supported Systems Operating System A4924A HSC 1000Base-SX for K-Class gelan K-Class server 10.20, 11.0, and 11i A4925A HSC 1000Ba[...]

Introduction About this Manual Chapter 1 9 This manual does not include step-by-step instructions on how to install and configure the Gigabit Ethernet hardware and softw are. Those instructions are provided in the Quick Installation Guide , which is available in the /opt/networkdocs directory on your system and on the web (see “Manuals A vailabl[...]

Introduction About this Manual Chapter 1 10[...]

Chapter 2 11 2 Configuring Gigabit Ethernet P arameters This chapter describes how to configure the Gigabit Ethernet parameters using the lanadmin(1M) command line interface.[...]

Configuring Gigabit Ether net P arameters Understanding the Gigabit Ethernet P arameters Chapter 2 12 Understanding the Gigabit Ethernet P arameters Several parameters can be configured using either the lanadmin(1M) command line interface or the graphical user interface provided by the System Administration Manager (SAM). Refer to the next sectio[...]

Configuring Gigabit Ether net P arameters Understanding the Gigabit Ethernet P arameters Chapter 2 13 *When autonegotiation is on, 1000Base-T will autonegotiate with its link partner; then, if its partner also autonegotiates and can attain a speed of 1000 Mbps, 1000Base-T will operate at 1000 Mpbs full-duplex (it is not designed to operate at 1000[...]

Configuring Gigabit Ether net P arameters Understanding the Gigabit Ethernet P arameters Chapter 2 14 in all. One of the two parameters specifies the number of data buffers that the card must transmit (or receive) before interrupting and the other specifies the number of system clock ticks that must elapse before interrupting . The four tuning p[...]

Configuring Gigabit Ether net P arameters Using the lanadmin T ool with Gigabit Ethernet Chapter 2 15 Using the lanadmin T ool with Gigabit Ethernet This section explains the options available in lanadmin to support the Gigabit Ethernet driver and how to use them. The lanadmin(1M) tool is used to display and set parameters , as specified by the f[...]

Configuring Gigabit Ether net P arameters Using the lanadmin T ool with Gigabit Ethernet Chapter 2 16 Displaying V alues The command $ lanadmin -x (or -X) help nmid/ppa displays a list of valid options used to display values . NO TE If option is not specified, then the speed, duplexity , and autonegotiation settings are displayed. Examples Card I[...]

Configuring Gigabit Ether net P arameters Using the lanadmin T ool with Gigabit Ethernet Chapter 2 17 Card Statistics T o display the card statistics, execute: $ lanadmin -x stats drv nmid/ppa NO TE See Appendix B for a sample output and explanation of the card statistics. Send Buffer Coalescing T o display the send buffer coalescing threshold, ex[...]

Configuring Gigabit Ether net P arameters Using the lanadmin T ool with Gigabit Ethernet Chapter 2 18 Examples Speed T o set the speed to 100 Mbps full-duplex on 1000Base-T , execute: $ lanadmin -X 100fd nmid/ppa NO TE The lanadmin -S option to set the speed is not supported on Gigabit Ethernet. Stats Clear T o clear all driver and card statistics[...]

Chapter 3 19 3 Gigabit Ethernet Resources This chapter provides references to other useful tools for installing , configuring , and maintaining Gigabit Ethernet.[...]

Gigabit Ether net Resources HP-UX Manual Reference P ages Chapter 3 20 HP-UX Manual Reference P ages While installing, configuring , or troubleshooting Gigabit Ethernet, you may need to refer to any of the following online manual reference pages (man pages) for useful HP-UX operating system or Gigabit Ethernet commands. T o display a man page, typ[...]

Gigabit Ether net Resources Manuals A vailable f or Gigabit Ethernet Chapter 3 21 Manuals A vailable for Gigabit Ethernet Refer to the following Quick Install Guide for step-by-step instructions on how to install and configure Gigabit Ethernet hardware and softw are. This guide is available on the web at http://docs.hp.com under “Networking and [...]

Gigabit Ether net Resources Error Messa ges Chapter 3 22 Error Messages Gigabit Ethernet comes with an online message catalog that is used to report networking problems. Y ou must use the nettl logging and tracing utility to display the probable cause and action for a message. Logging Messages Gigabit Ethernet uses the nettl(1M) logging and tracing[...]

Gigabit Ether net Resources Logging Messages Chapter 3 23 nettl -status • T o start Gigabit Ethernet tracing to the file /tmp/tracefile.TRC0 , execute: nettl -traceon all -entity gelan -file /tmp/tracefile or nettl -traceon all -entity igelan -file /tmp/tracefile Note: nettl (1m) adds the .TRC0 postfix for you. • T o stop Gigabit Ethernet tra[...]

Gigabit Ether net Resources Contacting Y our HP Representative Chapter 3 24 Contacting Y our HP Representative If you have no service contract with HP , you may follow the procedure described below , but you will be billed accordingly for time and materials. If you have a service contract with HP , document the problem as a Service Request (SR) and[...]

Gigabit Ether net Resources Contacting Y our HP Representative Chapter 3 25 Make sure that ERROR and DISASTER log classes are enabled when log files are collected. Prepare the formatted output and a copy of the log file for your HP representative to further analyze. • Prepare a listing of the HP-UX I/O configuration you are using for your HP r[...]

Gigabit Ether net Resources Contacting Y our HP Representative Chapter 3 26[...]

Chapter 4 27 4 T roubleshooting This chapter provides flowcharts that will help diagnose Gigabit Ethernet hardw are and software problems .[...]

T roubleshooting T roubleshooting Overview Chapter 4 28 T roubleshooting Overview As with any troubleshooting, a systematic approac h is helpful. The following table and flowcharts provide a logical sequence of steps to follow when troubleshooting Gigabit Ethernet. Using the diagnostic flowcharts , identify whether the problem is with Gigabit Eth[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 29 Diagnostic Flowcharts The following table summarizes the types of network tests in the diagnostic flowcharts. T able 4-1 Chart Type of T est Purpose 1 Cable and LED T est Checks that hardw are, cables , and connectors between your system and card are operational. 2 Link Level T est Checks commun[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 30 Flowchart 1: Cable and LED T est Checks that hardware , cables, and connectors between your system and card are operational. Figure 4-1 Flowchart 1 Cable installation, reset NO Test Check card and/or reseat card or 1000Base-T All speed LEDS = ON 1000Base-SX Link NO YES Link Level Test Check for i[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 31 Flowchart 1 Procedures • Check dmesg/syslog output and look for error messages pertaining to gelan/igelan. Also, chec k nettl log messages. If errors , check card installation and reset and/or reseat card. • V erify LEDs. If 1000Base-SX link LED = OFF or for gelan, 1000Base-T all speed LEDs =[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 32 Flowchart 2: Link Level T est Checks communications between link levels on source and target host using linkloop(1M) . Figure 4-2 Flowchart 2 Link Level YES Linkloop successful? NO Test Execute NO Re-check remote YES Network Level Configuration Tests Loopback FAILED: Address has bad format or Not[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 33 Flowchart 2 Procedures • Execute linkloop(1M) to remote host. If linkloop is successful, continue to Network Level T ests. Otherwise , note which error was returned. • If loopback failed error = “ Address has bad format” or “Not an individual address, ” correct link level address with[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 34 Flowchart 3: Network Level T ests V alidates arp(1M) entries and remote host availability . Checks communication between network layers on source and target host using ping(1M) . Figure 4-3 Flowchart 3 Flowchart 3 Procedures • See Flowchart 3a to validate arp(1M) entries and remote host availab[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 35 Flowchart 3a: ARP T est V alidates arp(1M) entries and remote host availability . Figure 4-4 Flowchart 3a Flowchart 3a Procedures • Execute ping(1M) to remote host so that ARP entry is added. Whether or not ping is successful, proceed to the next step. • Use arp(1M ) to verify that an entry e[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 36 Flowchart 3b: ping T est Checks communication between network layers on source and target host using ping(1M) . Figure 4-5 Flowchart 3b ping Test Are you frames? NO NO YES Execute Execute Successful? local and remote hosts Ensure speed is 1000 Mbps on YES YES (1000Base-T only) Is speed ping <r[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 37 Flowchart 3b Procedures • Execute ping(1M) to remote host. If ping is successful, continue to Transport Level T est. • If ping is not successful, execute netstat -in to verify MTU size. Ensure MTU size is the same on both local and remote hosts (9000 for jumbo frames and 1500 for standard fra[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 38 Flowchart 3b (continued) Figure 4-6 Flowchart 3b (continued) YES Are you using jumbo frames? NO NO YES Network NO Correct BIND, YP, Reconfigure Call HP YES successful ping not unreachable? error? No response from ping? Unknown host error? No route to host error? Repeat Test network or /etc/hosts [...]

T roubleshooting Diagnostic Flowc harts Chapter 4 39 Flowchart 3b (continued) Procedures • If network unreachable error , go to Configuration T ests. • If there is no response from ping, and using jumbo frames , validate that switches in the path support jumbo frames, making sure path MTU is 9000 from source host to destination host. Otherwise[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 40 Flowchart 4: Transport Level T est Checks communications between transport layers on source and target host using telnet and ftp sessions. Figure 4-7 Flowchart 4 Transport NO NO YES Network Configure TCP telnet Is NO Execute ftp to congested Execute telnet to Call HP YES Level Test successful? re[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 41 Flowchart 4 Procedures • Execute telnet(1M) to a remote host. If successful, stop. • If not successful, try to establish an ftp to a remote host. Unlike telnet, ftp does not use a pseudoterminal (pty) driver on your system. This will determine if pty is why telnet failed. If ftp is successful[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 42 Flowchart 5: Bridge/Gateway Loopback T est Checks general network connections through a gatewa y . Figure 4-8 Flowchart 5 Bridge/ YES NO Network YES NO Examine gateway interface Execute ping from a YES Gateway Test Successful? Refer to non-HP documentation or if HP, known good host through a gate[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 43 Flowchart 5 Procedures • Execute ping(1M) from a known good host through a gatewa y to another known good host. This will test connectivity through bridge/gatewa y level. If successful, execute netstat -r and examine route table on problem host and all hosts in path. If necessary , correct rout[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 44 Flowchart 6: Configuration T ests V erifies configuration of network interface on a host using ioscan(1M) , lanscan(1M) , netfmt(1M) , lanadmin(1M), and ifconfig(1M) . Figure 4-9 Flowchart 6 Configuration ioscan and lanscan netfmt and lanadmin Tests Test Test ifconfig Test[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 45 Flowchart 6 Procedures • V erify configuration of network interface on a host using ioscan(1M) , lanscan(1M) , netfmt(1M) , lanadmin(1M) , and ifconfig(1M) .[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 46 Flowchart 6a: ioscan and lanscan T est V erifies configuration of network interface on a host using ioscan(1M) and lanscan(1M) . Figure 4-10 Flowchart 6a ioscan NO YES YES Execute Install driver using Is the card Call HP NO lanscan Test claimed by the system as shown by executing ioscan? Does Y[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 47 Flowchart 6a Procedures • Execute ioscan(1M) as follows: ioscan -kfd drivername, where drivername is either gelan or igelan (refer to T able 1-1, “List of Gigabit Ethernet Products”). V erify output from ioscan shows card “CLAIMED” by the system. • If card is claimed, execute lanscan([...]

T roubleshooting Diagnostic Flowc harts Chapter 4 48 Flowchart 6b: netfmt and lanadmin T est V erifies configuration of network interface on a host using netfmt(1M) and lanadmin(1M) . Figure 4-11 Flowchart 6b netfmt YES Reset successful? YES YES NO Execute netfmt. actions in the log Check causes and Problem Reset card lanadmin Test output NO solv[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 49 Flowchart 6b Procedures • Execute netfmt(1M) and view error and disaster log messages. Example: netfmt -vf /var/adm/nettl.LOG00 It will help to use the time stamp to find proper logs. Ensure you are looking at 1000Base-SX/T information. • If problem is solved, continue to ifconfig T est. ?[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 50 Flowchart 6c: ifconfig T est V erifies configuration of network interface on a host using ifconfig(1M) . Figure 4-12 Flowchart 6c ifconfig entry in /etc/rc.config.d/netconf YES YES NO Execute ifconfig ifconfig Test NO successful Add network config ifconfig <interface> <IP address> [...]

T roubleshooting Diagnostic Flowc harts Chapter 4 51 Flowchart 6c Procedures • Execute ifconfig(1M) on the interface you want to configure to ensure that interface is enabled. Example: ifconfig lan1 192.6.1.17 netmask 255.255.255.0 up Next, execute ifconfig interface to test and verify flag setting is UP and correct IP address is displayed. Exa[...]

T roubleshooting Diagnostic Flowc harts Chapter 4 52[...]

Appendix A 53 A Gigabit Ethernet lanadmin Display This appendix defines the terms listed in the lanadmin(1M) command display .[...]

Gigabit Ether net lanadmin Displa y LAN Interface Status Display Appendix A 54 LAN Interface Status Display The following is a sample of a lanadmin(1M) command display . The fields are defined in the section that follows. HP-UX 10.20 lanadmin output: LAN INTERFACE STATUS DISPLAY Sun, Jun 21,1998 14:39:36 Network Management ID = 5 Description = la[...]

Gigabit Ether net lanadmin Displa y LAN Interface Status Display Appendix A 55 HP-UX 11.0 lanadmin output: LAN INTERFACE STATUS DISPLAY Sun, Jun 21,1998 14:49:43 PPA Number = 3 Description = lan3 HP 1000Base-SX Adapter HW Rev A-3814 Type (value) = ethernet-csmacd(6) MTU Size = 1500 Speed = 1000000000 Station Address = 0x60b0c401d4 Administration St[...]

Gigabit Ether net lanadmin Displa y RFC 1213 MIB II Appendix A 56 RFC 1213 MIB II F ollowing are descriptions of the statistics fields in the lanadmin(1M) command display . F or more detailed information about the fields, refer to RFC 1213. Field Description Network Management ID A unique ID assigned by the system for the network management of ea[...]

Gigabit Ether net lanadmin Displa y RFC 1213 MIB II Appendix A 57 Inbound Octets The total number of octets received on the interface, including framing characters . Inbound Unicast P ackets The number of subnetwork-unicast packets delivered to a high-layer protocol. Inbound Non-Unicast P ackets The number of non-unicast (subnetwork-broadcast or su[...]

Gigabit Ether net lanadmin Displa y RFC 1284 Ethernet-Like Interface Statistics Appendix A 58 RFC 1284 Ethernet-Like Interface Statistics F ollowing are descriptions of the Ethernet-like statistics fields in the lanadmin(1M) command display . Field Description Index A value that uniquely identifies an interface to an 802.3 medium. Alignment Error[...]

Appendix B 59 B Gigabit Ethernet Card Statistics This appendix defines the card statistics that are output from the lanadmin(1M) command.[...]

Gigabit Ether net Card Statistics Card Statistics Output Appendix B 60 Card Statistics Output The following is a sample card statistics output. An explanation of the statistics is in the section that follows. ****** Driver Statistics ****** In Packet Error 0 Out Packet Error 0 Loopback packets 0 Link down events 0 ****** Host Command Statistics ***[...]

Gigabit Ether net Card Statistics Explanation of Card Statistics Appendix B 61 Explanation of Card Statistics F ollowing are descriptions of the card statistics that are output from the lanadmin(1M) command. Field Description Driver Statistics In P acket Error Number of inbound packets discarded because they were received when the driver was not op[...]

Gigabit Ether net Card Statistics Explanation of Card Statistics Appendix B 62[...]

Appendix C 63 C Hardware Reference Information This appendix contains information about the card LEDs, cabling requirements , and card specifications .[...]

Hardware Ref erence Information The Meaning of the LEDs Appendix C 64 The Meaning of the LEDs The Link LED indicates the card’s status and must be on for the card to function properly . Note that there is no Link LED on the 1000Base-T card. In its place are three LEDs which indicate what speed (10, 100, or 1000 Mbps) the link has been established[...]

Hardware Ref erence Information Cabling Requirements Appendix C 65 Cabling Requirements Connectors on LAN cards adhere to appropriate standards agreed upon by various standards bodies and are widely available . The 1000Base-SX port is compatible with the IEEE 802.3z standard and uses a single duplex SC connector . The 1000Base-T port is compatible [...]

Hardware Ref erence Information Card Specifications Appendix C 66 Card Specifications F or compliance to European directives and related specifications, see the Dec laration of Conformity statement in Appendix D . A4924A/A4925A/A4926A Physical Electrical Environmental T emperature Degrees F = (1.8 x Degrees C) + 32 Humidity Altitude Electromagne[...]

Hardware Ref erence Information Card Specifications Appendix C 67 A4929A Physical Electrical Environmental T emperature Degrees F = (1.8 x Degrees C) + 32 Humidity Altitude Electromagnetic Compatibility VCCI Class A (PCI card only) Japan Dimensions: 6.73 in by 4.75 in P ower requirement: +14 watts max Operating T emperature: 0 o C to 45 o C Storag[...]

Hardware Ref erence Information Card Specifications Appendix C 68 A6825A/A6847A Physical Electrical Environmental T emperature Degrees F = (1.8 x Degrees C) + 32 Humidity Altitude Electromagnetic Compatibility Dimensions: 6.6 in by 2.5 in P ower requirement: +8 watts max Operating T emperature: 0 o C to 50 o C Storage T emperature: -40 o C to 60 o[...]

Appendix D 71 D Hardware Regulatory Statements This appendix contains regulatory statements for the United States, Canada, Australia/New Zealand, Japan, and the European community .[...]

Hardware Regulatory Statements FCC Statement (For U .S.A.) Appendix D 72 FCC Statement (F or U.S .A.) F ederal Communications Commission Radio Frequency Interference Statement W ARNING This device complies with P art 15 of the FCC rules. Operation is subject to the following two conditions: (1) This device may not cause harmful interference and (2)[...]

Hardware Regulatory Statements EMI (A ustralia and New Zealand) Appendix D 73 EMI (Australia and New Zealand) This product meets the applicable requirements of the Australia and New Zealand EMC Framework. VCCI (J apan) (PCI Card Only) This equipment complies with the Class A category for information technology equipment based on the rules of V olun[...]

Hardware Regulatory Statements Laser Safety Statements Appendix D 74 Laser Safety Statements Laser Safety Statements - U.S . FDA/CDRH - Optical (laser) Transceiver CA UTION The optical transceiver provided on the network interface card contains a laser system and is classified as a “Class-I Laser Product” under a U .S. Department of Health and[...]

Hardware Regulatory Statements Laser Safety Statements Appendix D 75[...]

Hardware Regulatory Statements Laser Safety Statements Appendix D 76[...]

Hardware Regulatory Statements Laser Safety Statements Appendix D 77[...]

Hardware Regulatory Statements Laser Safety Statements Appendix D 78[...]

Glossary 79 Glossary Numerics 1000Base-SX: A specific implementation of 1000Mbps operating over two multimode fiber cables , as specified in Standard IEEE 802.3z/D .50-1998. 1000Base-T: A specific implementation of 1000 Mbps operating over four -pair Cat-5 or Cat-5e UTP cables , as specified in IEEE 802.3ab standards. A Alias: Name of the inte[...]

Glossar y Glossary 80 80 Internet Address: The network address of a computer node. This address identifies both which network the host is on and which host it is . Refer to the Installing and Administering LAN/9000 Software manual for detailed information about network addressing. IP Address: See Internet Address . L LAN: See Local Area Network. L[...]

Glossar y Glossary 81 in the subnet address. Refer to Installing and Administering LAN/9000 Software for detailed information about subnet masks. Switch: A network interconnection device that allows multiple connected senders and receivers to communicate simultaneously in contrast to a hub (repeater) where only one device can send at a time. Some s[...]