IBM Switch 9077 Manuel d'utilisateur

IBM 9077 SP Switch Router:Get Connected to the SP SwitchSG24-5157-00International Technical Support Organizationhttp://www.redbooks.ibm.comHajo Kitzhö

viii IBM 9077 SP Switch Router: Get Connected to the SP SwitchAppendix D. Special Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Installation and Configuration 823.5.1 Determining the Switch Connection for a Dependent NodeThe SP Switch Router Adapter connection replaces an SP

Installation and Configuration 83Figure 32. Switch Port Assignments in Supported Frame ConfigurationsSwitchFrame nSwitchFrame nNo SwitchFrame n+1Swi

Installation and Configuration 84Figure 33. Node Numbering for an SP System3.5.2 Procedure to Get the Jack NumberFollowing are the steps required t

Installation and Configuration 85In this case, the primary node host name is sp21n01.4. Log into the primary node by entering telnet node_hostname, w

Installation and Configuration 86 • The SP Switch Router card connected to port J31 of SP Switch A2 is node number 25. • The SP Switch Router card

Installation and Configuration 873.7.1.1 Overview of the Steps to Configure a Media CardA detailed discussion of these steps follows this overview.1

Installation and Configuration 88 • As an alternative, you can log on to the SP Switch Router and use a UNIX editor to enter the parameters in the /

Installation and Configuration 893.9 Put SNMP Changes into EffectTo have changes to /etc/snmpd.conf take effect, kill snmpd. It will be automaticall

Installation and Configuration 90Note: The Extension Node Identifier (the number of the slot in the GRF, the SP Switch Router Adapter card is seated)

Installation and Configuration 91 • Command: smitty annotator/etc/SP/expected.top.annotated now has a new line: COMM

© Copyright IBM Corp. 1998 ixFigures1. SP Switch Router. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62. F

Installation and Configuration 92 • Command: smitty manage_extnodeUse SDRGetObjects switch_responds to see the actual status of the SP Switch:Before

Installation and Configuration 933.10.2 Method 2: Edit /etc/grifconfig.conf - OptionalEdit the /etc/grifconfig.conf file to assign an IP address to

Installation and Configuration 94Internet addressThe Internet address is the 32-bit IP address for the specified logical interface. The address is in

Installation and Configuration 95Default MTUs for framing protocols are: • Frame Relay: 4352 bytes • HDLC: 4352 bytes • Point-to-Point Protocol: 1

Installation and Configuration 96Nevertheless, check the file /etc/grdev1.conf. It must contain an entry for the slot in which the media card is inst

Installation and Configuration 97To save an alternate configuration on the internal flash based upon the currently running configuration on the inter

Installation and Configuration 982. Enter a ping command. Specify the appropriate media card by its chassis slot number; for example, to act on the S

Installation and Configuration 993.14.3 Reset Media Card Using grresetUse the grreset command to reset a media card from the UNIX prompt:1. Log in a

Installation and Configuration 100Below is an actual example:# grstat -w70 all gt030gt030ipstat count description 11095886 total packets rec

Installation and Configuration 101one of the following actions to bring the SP Switch Router Adapter card online: • A switch initialization • An un

x IBM 9077 SP Switch Router: Get Connected to the SP Switch41. Master/Slave Connectors for SAS Interfaces . . . . . . . . . . . . . . . . . . . . .

Installation and Configuration 102Each SP Switch Router Adapter media card is considered a dependent node for the SP System. Each dependent node has

Installation and Configuration 103Maintenance Information Manual Dependent Node MAP, return to that procedure.For more information about configuratio

Installation and Configuration 104

© Copyright IBM Corp. 1998 105Chapter 4. Configuration of IP-Forwarding Media CardsThis chapter covers the installation and configuration of selected

106 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 36. Components of the Ethernet Interface NameThe interface name is used in the /

Configuration of IP-Forwarding Media Cards 107 • Change run-time binaries • Change dump variables3. Load profileGlobal executable binaries are set

108 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.1.5 Specify Ethernet Card ParametersAs already mentioned, modifying the following pro

Configuration of IP-Forwarding Media Cards 109if-config:Ethernet interface configuration.Enumerated field, values:autonegotiate: autonegotiate10-half

110 IBM 9077 SP Switch Router: Get Connected to the SP Switchyou see the output for all eight. The input port side is reported on first.maint 5 -to r

Configuration of IP-Forwarding Media Cards 111See Figure 38 for the naming conventions of an ATM interface.Figure 38. Components in the ATM OC-3c In

© Copyright IBM Corp. 1998 xiTables1. Memory Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 352. Depend

112 IBM 9077 SP Switch Router: Get Connected to the SP SwitchVPIs 0 through 15 are available for configuration use. VPIs are assigned in the /etc/gra

Configuration of IP-Forwarding Media Cards 1134.2.2 Installing Configurations or ChangesIn the command line interface (CLI), use set and write comma

114 IBM 9077 SP Switch Router: Get Connected to the SP Switch4. Load profile (optional).Global executable binaries are set in the Load profile in the

Configuration of IP-Forwarding Media Cards 115interface basis. This field is also used to specify ISO when an ISO address is being added to an interf

116 IBM 9077 SP Switch Router: Get Connected to the SP Switch • Interface sectionDefine the traffic shaping profile for the logical interface to whi

Configuration of IP-Forwarding Media Cards 117The following message is returned along with the changed prompt:Current port card is 3GR 3> . • To

118 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.2.8 Using grrt to Display the Route TableUse the grrt -S -p<slot> command to di

Configuration of IP-Forwarding Media Cards 1194.2.9 Using grstat to Display GRF StatisticsUse the grstat -w70 all <interface> command to displ

120 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 40. ATM OC-12c Physical and Logical InterfacesPhysical InterfacesThe ATM OC-12c

Configuration of IP-Forwarding Media Cards 1211. Identify each logical interface.Edit /etc/grifconfig.conf, to identify each logical interface by ass

xii IBM 9077 SP Switch Router: Get Connected to the SP Switch41. Software Levels on CWS and All Nodes Part 10 of14. . . . . . . . . . . . . . . 24842

122 IBM 9077 SP Switch Router: Get Connected to the SP SwitchIt might be useful to give a short overview of possible FDDI connection options, namely

Configuration of IP-Forwarding Media Cards 123Figure 42. A/B Connectors for DAS InterfacesConfiguring SAS versus DASOnly the top or bottom pair of F

124 IBM 9077 SP Switch Router: Get Connected to the SP Switchsuper> list ports 0port_num = 0cisco-hdlc = { off on 10 3 }fddi = { single off }sonet

Configuration of IP-Forwarding Media Cards 125super> writeCARD/0 writtensuper> Optical bypassOptical bypass capability has to be provided exter

126 IBM 9077 SP Switch Router: Get Connected to the SP SwitchConfigure the FDDI media card for dual attach, but use two single attach (SAS) cables to

Configuration of IP-Forwarding Media Cards 127 • By a logical interface number assigned after the SAS/DAS settings are numbered (used in the /etc/gr

128 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 47. Physical Interface Numbering on the FDDI Media CardThe diagram shows physica

Configuration of IP-Forwarding Media Cards 129Edit /etc/grifconfig.conf to identify each logical interface by assigning: • An IP address • The GRF

130 IBM 9077 SP Switch Router: Get Connected to the SP SwitchThe arguments field is also used to specify ISO when an ISO address is being added to an

Configuration of IP-Forwarding Media Cards 131This completes the procedure to configure FDDI cards, and as with the ATM card, we would like to introd

© Copyright IBM Corp. 1998 xiiiPrefaceThe GRF is a high-performance switched IP Router which provides high-speed data communication links between IBM

132 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.4.10 Using grrt to Display the Route TableUse the grrt -S -p<slot> command to d

Configuration of IP-Forwarding Media Cards 1334.4.11 Using grstat to Display GRF StatisticsUse the grstat -w70 all <interface> command to disp

134 IBM 9077 SP Switch Router: Get Connected to the SP Switchthese modes. Hosts must pass on the appropriate information for the GRF media cards and

Configuration of IP-Forwarding Media Cards 135header. The media card reads the header only if told to do so by information in the HIPPI I-field. If t

136 IBM 9077 SP Switch Router: Get Connected to the SP Switch01 Logical AddressWhen PS is set to 01, that is, logical address, the host does not know

Configuration of IP-Forwarding Media Cards 1374.5.1.6 Direction BitHIPPI hosts set the direction bit (D). This bit determines how a switch or router

138 IBM 9077 SP Switch Router: Get Connected to the SP Switchof this address to slot 64 in the file /etc/grlamap.conf indicates the IP connection to

Configuration of IP-Forwarding Media Cards 139Section 7.3, “HIPPI Backbone Connection” on page 227, describes the steps to configure the GRF’s HIPPI

140 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.5.4 Configuration Files and ProfilesThe following are the steps to configure HIPPI ca

Configuration of IP-Forwarding Media Cards 1414.5.5 Installing Configurations or ChangesIn the command line interface (CLI), which is the working en

xiv IBM 9077 SP Switch Router: Get Connected to the SP Switchfor eight years. His areas of expertise include RS/6000 SP, SMP, and Benchmarks. He now

142 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.6 Configuring BridgingThis Chapter describes the GRF bridging implementation and prov

Configuration of IP-Forwarding Media Cards 1434.6.2 Simultaneous Routing and BridgingAscend’s transparent bridging does not preclude the use of IP p

144 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.6.4 InteroperabilityThe following table gives an overview of the GRFs interoperabilit

Configuration of IP-Forwarding Media Cards 145A frame may be too large for the maximum transmission unit (MTU) of the sending GRF interface. One exam

146 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.6.9.3 Editing Utility – BreditThe bredit utility is used to access and edit the /etc/

Configuration of IP-Forwarding Media Cards 147 Interface Port ID Con State Cost Cost Bridge Port --------- ------- --- --

148 IBM 9077 SP Switch Router: Get Connected to the SP Switch Flags: 0xb043 up broadcast running link0 link1 multicast Bridging medi

Configuration of IP-Forwarding Media Cards 149If you are going to configure an encapsulated bridge on an ATM circuit, edit the /etc/gratm.conf file t

150 IBM 9077 SP Switch Router: Get Connected to the SP Switch4.6.11.2 Creating Bridge Groups in bridged.confThe only required parameter is the list

Configuration of IP-Forwarding Media Cards 151 • VC-Based Multiplexing (RFC 1483, section 5)When LLC Encapsulation is used, a single PVC is configur

xvComments WelcomeYour comments are important to us!We want our redbooks to be as helpful as possible. Please send us your comments about this or ot

152 IBM 9077 SP Switch Router: Get Connected to the SP SwitchA bridging PVC is assigned a protocol value. This value must be consistent with the brid

Configuration of IP-Forwarding Media Cards 153Following are some PVC configuration examples:LLC Encapsulated:# Traffic shapeTraffic_Shape name=high_s

154 IBM 9077 SP Switch Router: Get Connected to the SP SwitchPVC ga030 0/32 proto=vcmux_bridge,etherPVC ga030 0/33 proto=vcmux_bridge,ether_fcs PVC g

Configuration of IP-Forwarding Media Cards 1554.6.13 Bridging FDDITransparent bridging is especially useful for day-to-day customer environments, wh

156 IBM 9077 SP Switch Router: Get Connected to the SP Switch

© Copyright IBM Corp. 1998 157Chapter 5. Single RS/6000 SP and Single SP Switch RouterThis section provides several sample configurations that are po

158 IBM 9077 SP Switch Router: Get Connected to the SP SwitchConfiguration assumptions: • The SP Switch Router Ethernet media card has been installe

Single RS/6000 SP and Single SP Switch Router 159Table 14. Configuration of SP Switch - Ethernet ConnectionTo successfully run this configuration, n

160 IBM 9077 SP Switch Router: Get Connected to the SP Switch-mtu 1500 10.20.30.12. Check for correct routing entry:3. On the nodes in SP21 that are

Single RS/6000 SP and Single SP Switch Router 161On the chosen nodes in SP21, ping the ATM interface of the F50:If these ping commands fail, check ro

xvi IBM 9077 SP Switch Router: Get Connected to the SP Switch

162 IBM 9077 SP Switch Router: Get Connected to the SP SwitchAs you see in the screen shot, the F50’s 9.2 MB/s comes very close to the theoretical ma

Single RS/6000 SP and Single SP Switch Router 163 • If ARP is disabled on the SP Switch network, the IP addresses assigned to the nodes must be dete

164 IBM 9077 SP Switch Router: Get Connected to the SP Switchthough. To add the needed routing information and check for proper work, follow these st

Single RS/6000 SP and Single SP Switch Router 1656. On the CWS of SP2 check if the SP Switch Router Adapter card is configured. See if the SP Switch

166 IBM 9077 SP Switch Router: Get Connected to the SP SwitchBRL, and ported to AIX by Prof. Peter Haas, University of Stuttgart). tsock is a program

Single RS/6000 SP and Single SP Switch Router 1675.1.3 SP Switch - ATM ConnectionThis scenario might be used quite often to attach a single computer

168 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 55. SP Switch - ATM ConnectionTable 16 shows the IP addresses used in our config

Single RS/6000 SP and Single SP Switch Router 169of the lack of an ARP server; signaling protocols should only matter with SVCs and not with PVCs.3.

170 IBM 9077 SP Switch Router: Get Connected to the SP Switch5. Have smitty carry out its work, exit smitty and then run smitty mkatmpvc:In the optio

Single RS/6000 SP and Single SP Switch Router 171To add the needed routing information, follow these steps:1. On the F50, add the following route to

© Copyright IBM Corp. 1998 1Part 1. Introducing and Installing the GRF

172 IBM 9077 SP Switch Router: Get Connected to the SP SwitchThe -mtu parameter is optional but should be set to ensure optimal packet size on this r

Single RS/6000 SP and Single SP Switch Router 173If these ping commands fail, check routing settings again. If everything is as it should be, try to

174 IBM 9077 SP Switch Router: Get Connected to the SP SwitchAn ATM adapter establishes a duplex connection to its partner, so the 16.5 MB/s write th

Single RS/6000 SP and Single SP Switch Router 175page 175 and Table 17 on page 175. The netmask for all interfaces is 255.255.255.0.Figure 56. SP Sw

176 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTo successfully run this configuration, all four ports of the SP Switch Router FDDI medi

Single RS/6000 SP and Single SP Switch Router 1773. On the nodes in SP21 that are supposed to communicate with the different FDDI backbones, add the

178 IBM 9077 SP Switch Router: Get Connected to the SP Switch7. On the CWS of SP21, check if the SP Switch Router Adapter card is configured. To perf

Single RS/6000 SP and Single SP Switch Router 179If these ping commands fail, check routing settings and IP address assignment again. If everything i

180 IBM 9077 SP Switch Router: Get Connected to the SP SwitchConfiguration assumptions: • An SP Switch Router FDDI media card has been installed acc

Single RS/6000 SP and Single SP Switch Router 181Table 18 shows the IP addresses used in our configuration.Table 18. Configuration of SP Switch - FD

2 IBM 9077 SP Switch Router: Get Connected to the SP Switch

182 IBM 9077 SP Switch Router: Get Connected to the SP Switchbridge_group bg0 {port gf000 gf001 gf002 gf003;};This is the simplest bridge definition

Single RS/6000 SP and Single SP Switch Router 1833. Add the route to the Switch network of SP21 on all four nodes of SP2 with an FDDI interface.On no

184 IBM 9077 SP Switch Router: Get Connected to the SP Switch7. On the CWS of SP21, check if the SP Switch Router Adapter card is configured. To perf

Single RS/6000 SP and Single SP Switch Router 185vice versa. We sent these files to /dev/null to eliminate any hard disk influence on the receiver si

186 IBM 9077 SP Switch Router: Get Connected to the SP SwitchConfiguration assumptions: • The SP Switch Router FDDI media card has been installed ac

Single RS/6000 SP and Single SP Switch Router 1875.2 Single SP Partition and Multiple SP Switch Router Adapter CardsIt is frequently necessary to ma

188 IBM 9077 SP Switch Router: Get Connected to the SP Switch1. Each SP Switch Router Adapter card interface has to be in a different subnet.2. Netma

Single RS/6000 SP and Single SP Switch Router 189If the SP Switch Router Adapter cards work, the can both be used to route IP traffic from the SP Swi

190 IBM 9077 SP Switch Router: Get Connected to the SP Switch5.2.2 Complex ConfigurationIn this section, we describe the setup of a complete scenari

Single RS/6000 SP and Single SP Switch Router 191Table 20. Configuration of a Dual SP Switch Router - SP Switch ConnectionConfiguration:For this sce

© Copyright IBM Corp. 1998 3Chapter 1. Dependent NodeThis chapter provides an overview of a dependent node in RS/6000 SP. We start by defining the de

192 IBM 9077 SP Switch Router: Get Connected to the SP Switch3. On node 6 in SP21, add the following route to the Switch network of SP2:route add -ne

Single RS/6000 SP and Single SP Switch Router 1938. Check for correct routing entry:9. On GRF 1600, check /etc/grifconfig.conf for the following entr

194 IBM 9077 SP Switch Router: Get Connected to the SP SwitchOn node 1 in SP2, ping the SP Switch interfaces of the chosen nodes in SP21, for example

Single RS/6000 SP and Single SP Switch Router 195Figure 61. IP Traffic Flow When Issuing ping 192.168.13.1 on Node 6Figure 63 on page 196 shows the

196 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 63 shows the IP traffic flow when issuing ping 192.168.13.1 on node 8 in SP21. Al

Single RS/6000 SP and Single SP Switch Router 197To recover from a failing SP Switch Adapter card, you have to define an alias IP address for the sur

198 IBM 9077 SP Switch Router: Get Connected to the SP SwitchConfiguration assumptions: • The RS/6000 SP is partitioned in to two or more partitions

Single RS/6000 SP and Single SP Switch Router 199Table 21 shows the IP addresses used in our configuration.Table 21. Configuration of a Partition -

200 IBM 9077 SP Switch Router: Get Connected to the SP SwitchThe -mtu parameter is again optional but should be set to ensure optimal packet size on

Single RS/6000 SP and Single SP Switch Router 201If these ping commands fail, check routing settings again. If everything is as it should be try to p

4 IBM 9077 SP Switch Router: Get Connected to the SP Switch • The fault service daemon runs on all switch nodes in the RS/6000 SP, but not on the de

202 IBM 9077 SP Switch Router: Get Connected to the SP Switch

© Copyright IBM Corp. 1998 203Chapter 6. Multiple RS/6000 SPs and One SP Switch RouterIn this configuration, two RS/6000 SP systems are connected to

204 IBM 9077 SP Switch Router: Get Connected to the SP Switch/etc/snmpd.conf on the GRF 1600. To check, open this file and look for a stanza similar

Multiple RS/6000 SPs and One SP Switch Router 205route add -net 192.168.13 -netmask 255.255.255.0 -mtu 65280 \ 192.168.14.42. Check for correct routi

206 IBM 9077 SP Switch Router: Get Connected to the SP Switchcards shows up green in perspectives or enter SDRGetObjects switch_responds. Use Eunfenc

Multiple RS/6000 SPs and One SP Switch Router 207With this scenario and without further tuning (refer to Appendix A, “Laboratory Hardware and Softwar

208 IBM 9077 SP Switch Router: Get Connected to the SP Switchinterference between data transfers from each SP to different SP Switch Router Adapter m

© Copyright IBM Corp. 1998 209Chapter 7. Multiple RS/6000 SPs and Multiple GRFsIn this section, sample configurations with two SP systems connected w

210 IBM 9077 SP Switch Router: Get Connected to the SP Switchfast network. (The spare second port might be in use for example for a connection to an

Multiple RS/6000 SPs and Multiple GRFs 211 • If ARP is disabled on the SP Switch network, the IP addresses assigned to the nodes must be determined

© Copyright IBM Corp. 1998 5Chapter 2. Router NodeThe first dependent node is actually a new SP Switch Router Adapter in a router. This chapter offer

212 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 23. Configuration of SP Switch - ATM - SP SwitchTo successfully run this configur

Multiple RS/6000 SPs and Multiple GRFs 2131. The file /etc/gratm.conf needs the configuration statements for the port used:Traffic_Shape name=high_sp

214 IBM 9077 SP Switch Router: Get Connected to the SP Switch6. Check for correct routing entries on all nodes in SP2:7. Issue some ping commands to

Multiple RS/6000 SPs and Multiple GRFs 215Performance:To get a rough overview of the data transfer rates that can be achieved in this scenario, the f

216 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 24 shows the IP addresses used in our configuration.Table 24. Configuration of SP

Multiple RS/6000 SPs and Multiple GRFs 217Router, so there was no technical reason for it. The :wq! in the screen shot is there to remind you how to

218 IBM 9077 SP Switch Router: Get Connected to the SP SwitchNow it is time to look at the GRF 400:1. The following screen shot gives you the minimum

Multiple RS/6000 SPs and Multiple GRFs 219This two lines were changed from the basic configuration!PVC ga020 0/132 proto=llc,bridgingPVC ga0280 0/134

220 IBM 9077 SP Switch Router: Get Connected to the SP SwitchIssue some ping commands to check the connection:On the SP21 nodes, ping the SP Switch i

Multiple RS/6000 SPs and Multiple GRFs 221So what happened to the expected doubling of the aggregate throughput?As it turns out, even with bridging a

6 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 1. SP Switch RouterThe RS/6000 SP software treats this adapter as an extension nod

222 IBM 9077 SP Switch Router: Get Connected to the SP SwitchWhen port 0 is plugged in again, it resumes and takes over port 1, which in turn falls b

Multiple RS/6000 SPs and Multiple GRFs 223Configuration assumptions: • The SP Switch Router ATM media card has been installed according to Section 4

224 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 25 shows the IP addresses used in our configuration.Table 25. Configuration of SP

Multiple RS/6000 SPs and Multiple GRFs 2251. The file /etc/gratm.conf needs the configuration statements for the port used:Traffic_Shape name=bigg_sp

226 IBM 9077 SP Switch Router: Get Connected to the SP Switch5. Check for correct routing entries on all nodes in SP2:6. Issue some ping commands to

Multiple RS/6000 SPs and Multiple GRFs 227Performance:To get a rough overview of the data transfer rates that can be achieved in this scenario, the f

228 IBM 9077 SP Switch Router: Get Connected to the SP SwitchConfiguration:In this scenario, we have the SP Switch of SP21 connected to an GRF 1600.

Multiple RS/6000 SPs and Multiple GRFs 229The media card adapters on the GRF routers should already be up and running (according to Section 3.7, “Ste

230 IBM 9077 SP Switch Router: Get Connected to the SP Switch5. The SP Switch Router Adapter card is connected to the SP Switch and configured. Check

Multiple RS/6000 SPs and Multiple GRFs 2315. Issue some ping commands to check the connection:On the SP21 nodes, ping the SP Switch interface of node

Router Node 7packet size. This would only enable a wide node to handle approximately 7.5 MB/s of IP traffic.Since Ascend’s business depends on keepin

232 IBM 9077 SP Switch Router: Get Connected to the SP SwitchWe saw up to about 48 MB/s with just one side sending data. With all nodes sending and r

© Copyright IBM Corp. 1998 233Appendix A. Laboratory Hardware and Software ConfigurationThis appendix contains a detailed description of the hardware

234 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 27. Configuration of SP 21Node Node Type Hostname Adapter IP addressNode0 (CWS) R

Laboratory Hardware and Software Configuration 235Table 28. Configuration of SP 2A.1.1 Hard DisksAll nodes and CWSs include one or more internal SC

236 IBM 9077 SP Switch Router: Get Connected to the SP Switchselected nodes. Refer to the scenario descriptions in second part of this redbook to see

Laboratory Hardware and Software Configuration 237Table 30. Hard Disk Equipment of SP 2 Part 1 of 2Node Disks DescriptionNode0 (CWS) hdisk0hdisk1hdi

238 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 31. Hard Disk Equipment of SP 2 Part 2 of 2Node Disks DescriptionNode13 hdisk0hdi

Laboratory Hardware and Software Configuration 239A.1.2 Software Configuration Both CWSs and every SP node are installed with AIX 4.3.1, including a

240 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 33. Software Levels on CWS and All Nodes Part 2 of 14Fileset Level DescriptionX11

Laboratory Hardware and Software Configuration 241Table 34. Software Levels on CWS and All Nodes Part 3 of 14Fileset Level Descriptionbos.adt.includ

8 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.1.2 Design ObjectivesBecause the dependent node is part of the RS/6000 SP, it had to be

242 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 35. Software Levels on CWS and All Nodes Part 4 of 14Fileset Level Descriptionbos

Laboratory Hardware and Software Configuration 243Table 36. Software Levels on CWS and All Nodes Part 5 of 14Fileset Level Descriptionbos.rte.bind_c

244 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 37. Software Levels on CWS and All Nodes Part 6 of 14Fileset Level Descriptionbos

Laboratory Hardware and Software Configuration 245Table 38. Software Levels on CWS and All Nodes Part 7 of 14Fileset Level Descriptionbos.txt.spell

246 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 39. Software Levels on CWS and All Nodes Part 8 of 14Fileset Level Descriptiondev

Laboratory Hardware and Software Configuration 247Table 40. Software Levels on CWS and All Nodes Part 9 of 14Fileset Level Descriptiondevices.mca.8f

248 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 41. Software Levels on CWS and All Nodes Part 10 of14Fileset Level Descriptiondev

Laboratory Hardware and Software Configuration 249Table 42. Software Levels on CWS and All Nodes Part 11 of 14Fileset Level Descriptiondevices.ssa.n

250 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 43. Software Levels on CWS and All Nodes Part 12 of 14Fileset Level Descriptionpr

Laboratory Hardware and Software Configuration 251Table 44. Software Levels on CWS and All Nodes Part 13 of 14Fileset Level Descriptionprinters.lexO

Router Node 9Figure 3. Typical Router ConfigurationRouters help to reduce the amount of processing required on local systems, since they perform the

252 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 45. Software Levels on CWS and All Nodes Part 14 of 14Fileset Level Descriptionsy

Laboratory Hardware and Software Configuration 253A.1.3 Network Options and TuningTable 46 shows the network options on the CWS and all participatin

254 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 47. Network Options of CWS and All Nodes Part 2 of 3Parameters Valuemedthresh 95p

Laboratory Hardware and Software Configuration 255Table 48. Network Options of CWS and All Nodes Part 3 of 3A.2 SP Switch Pool Size SettingsTwo imp

256 IBM 9077 SP Switch Router: Get Connected to the SP SwitchA.3 7025-F50 ConfigurationA 7025-F50 was used for some ATM and Ethernet network tests.

Laboratory Hardware and Software Configuration 257Table 50. Network Options of 7025-F50 Part 2 of 3Parameter Valuepsebufcalls 20strturncnt 15pseintr

258 IBM 9077 SP Switch Router: Get Connected to the SP SwitchTable 51. Network Options of 7025-F50 Part 3 of 3A.4 SP IP Switch Router Configuration

Laboratory Hardware and Software Configuration 259The applied IP addresses vary with the scenario and are specified in the corresponding chapter. For

260 IBM 9077 SP Switch Router: Get Connected to the SP Switch

© Copyright IBM Corp. 1998 261Appendix B. GRF Configuration FilesThis appendix contains relevant SP Switch Router configuration files.Some of them ar

10 IBM 9077 SP Switch Router: Get Connected to the SP Switch • Minimal routingA network completely isolated from all other TCP/IP networks requires

262 IBM 9077 SP Switch Router: Get Connected to the SP Switch# that we may consider enhancing it in future software# releases to suppor

GRF Configuration Files 263#if [ -t 0 ]then # # Ask for a terminal type; the default is the canonical "vt100". #

264 IBM 9077 SP Switch Router: Get Connected to the SP SwitchB.3 /etc/bridged.confThis file holds the configuration data for transparent bridging. I

GRF Configuration Files 265 # to be a lead or at least low in the spanning tree. # The closer a LAN is to b

266 IBM 9077 SP Switch Router: Get Connected to the SP Switch # turned on. # # Setting the forward delay too small w

GRF Configuration Files 267# For ATM - ATM two ports Test Chap.7.1.2bridge_group bg1 { port ga010 ga0180;# spanning_tree disabled;};B.4

268 IBM 9077 SP Switch Router: Get Connected to the SP Switch# following formats:## 48-bit MAC address for#

GRF Configuration Files 269# The PVC section is where Permanent Virtual Circuits are defined,# using traffic shapes defined in the Traffic Shap

270 IBM 9077 SP Switch Router: Get Connected to the SP Switch#Service name=bc0 type=bcast addr=198.174.20.1 addr=198.174.22.1 \# addr=198.174.2

GRF Configuration Files 271# [mode=SDH|SONET] [clock=Ext|Int]## The ’card’ and ’connector’ specification are mandatory.## The card should be id

Router Node 11situations more quickly and accurately than a system administrator can do. Routing protocols are designed not only to switch to a backu

272 IBM 9077 SP Switch Router: Get Connected to the SP Switch# the protocol## vc_multiplexed - Use a s

GRF Configuration Files 273# (except for RFC 1483 bridging)# ’llc,bridging’ any LLC-encapsulated protocol, including RF

274 IBM 9077 SP Switch Router: Get Connected to the SP Switch peak=622000 sustain=622000 burst=2048 qos=highSignalling card=1 connector=top pr

GRF Configuration Files 275# DEFAULTS sets all of the above keywords to the above defaults.#####################################################

276 IBM 9077 SP Switch Router: Get Connected to the SP Switch# Log files that used to be archived by the /etc/{daily|weekly|monthly}# scripts.#######

GRF Configuration Files 277DEFAULTShold=2local=ysize=10000logfile=/var/log/grclean.logB.9 /etc/grdev1.confThis file normally gets updated automatica

278 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.21.2.1.1.12 2 # Node State2.21.2.1.1.13 0

GRF Configuration Files 2792.21.6.1.1.3 "00:00:00:01:00:00:00:07:00:03" # Switch Token2.21.6.1.1.4 2

280 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.21.9.1.1.12 2 # Node State2.21.9.1.1.13 0

GRF Configuration Files 2812.21.13.1.1.3 "00:00:00:00:00:00:00:00:00:00" # Switch Token2.21.13.1.1.4 2

IBM 9077 SP Switch Router:Get Connected to the SP Switch November 1998SG24-5157-00International Technical Support Organization

12 IBM 9077 SP Switch Router: Get Connected to the SP SwitchThe second case has proven to be very expensive as well. The RS/6000 SP node was not desi

282 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.21.16.1.1.12 2 # Node State2.21.16.1.1.13 0

GRF Configuration Files 283# FDDI card. NOTE: The logical interface number# may be different from the physical interfac

284 IBM 9077 SP Switch Router: Get Connected to the SP Switch#gt020 0.0.0.0 255.255.255.0 - mtu 65520gt030 192.168.14.4 255.255

GRF Configuration Files 285# exit.# If only 3 values are designated, the first value will be repeated as the# fourth value.## No whitespace is allowe

286 IBM 9077 SP Switch Router: Get Connected to the SP Switch# A netmask is required for all entries in this configuration file.## The netmask is nor

GRF Configuration Files 287#uucpd stream tcp nowait root /usr/libexec/tcpd uucpd#finger stream tcp nowait nobody /usr/libexec/

288 IBM 9077 SP Switch Router: Get Connected to the SP Switch#c and is protected by U.S. and other copyright laws and the#c laws protecting

GRF Configuration Files 289# [SNMP | SMUX]# [OVER [UNIX | UDP | TCP] [SOCKET | TLI]]#

290 IBM 9077 SP Switch Router: Get Connected to the SP Switch# UNSPECIFIED SUBAGENTS## <hostSpec> ::= HOST <h

GRF Configuration Files 291B.18 /etc/syslog.confUse this file to specify the type of logging in the system. If no additional hard disk is installed,

Router Node 13The GRF uses a crosspoint switch (see Figure 7) instead of an I/O bus to interconnect its adapters. This switch is capable of 4 or 16 G

292 IBM 9077 SP Switch Router: Get Connected to the SP Switch#net#cron.info @server.domain.com#net#local0.info

GRF Configuration Files 293# Changes to the order of entries or number of ttys should only be made in# single-user mode.## name getty

294 IBM 9077 SP Switch Router: Get Connected to the SP Switchttyr9 none networkttyra none n

© Copyright IBM Corp. 1998 295Appendix C. Hardware and Software InformationAppendix C gives an overview of the LEDs on the front panel of the SP Swit

296 IBM 9077 SP Switch Router: Get Connected to the SP SwitchC.2 SP Switch Router Adapter Media Card LEDsLED activities during operations are listed

Hardware and Software Information 297C.3 SP Switch Router Adapter Media Card - BootupTable 54 shows the settings for the Switch Router Adapter Media

298 IBM 9077 SP Switch Router: Get Connected to the SP SwitchC.4 Connectors and Receptacles for Different MediaTable 55 gives you a comprehensive ov

Hardware and Software Information 299Figure 73. The SP Switch BoardC.6 Updating Router SoftwareThis part provides general information about obtaini

300 IBM 9077 SP Switch Router: Get Connected to the SP SwitchSP Switch Routers are delivered with the current level of machine code already installed

Hardware and Software Information 301ftp> cd releasesftp> cd A1_4_6ftp> cd patchesftp> cd A1_4_6_44. Set the file format and download the

14 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 8. Conventional RoutersThe SP Switch Router provides near wire-speed packet forwa

302 IBM 9077 SP Switch Router: Get Connected to the SP Switch- Ftp access to service2.boulder.ibm.com from testbox.site.com.- Approximately 30MB of d

Hardware and Software Information 303To temporarily disable the directed bcast setting later on, use:# sysctl -w net.inet.ip.fwdirbcast=0To verify th

304 IBM 9077 SP Switch Router: Get Connected to the SP Switch

© Copyright IBM Corp. 1998 305Appendix D. Special NoticesThis publication is intended to help IBM customers, Business Partners, IBM System Engineers

306 IBM 9077 SP Switch Router: Get Connected to the SP Switchinformation or the implementation of any of these techniques is a customer responsibilit

Special Notices 307Pentium, MMX, ProShare, LANDesk, and ActionMedia are trademarks orregistered trademarks of Intel Corporation in the U.S. and other

308 IBM 9077 SP Switch Router: Get Connected to the SP Switch

© Copyright IBM Corp. 1998 309Appendix E. Related PublicationsThe publications listed in this section are considered particularly suitable for a more

310 IBM 9077 SP Switch Router: Get Connected to the SP Switch •RS/6000 SP: Diagnosis and Messages Guide Version 2 Release 4, GC23-3899 •RS/6000 SP:

© Copyright IBM Corp. 1998 311How to Get ITSO RedbooksThis section explains how both customers and IBM employees can find out about ITSO redbooks, CD-

Router Node 15Figure 9. Switched RoutersOther advantages of using GRF are as follows: • Availability of a redundant power supply • Availability of

312 IBM 9077 SP Switch Router: Get Connected to the SP SwitchHow Customers Can Get ITSO RedbooksCustomers may request ITSO deliverables (redbooks, Bo

313IBM Redbook Order FormPlease send me the following:We accept American Express, Diners, Eurocard, Master Card, and Visa. Payment by credit card no

314 IBM 9077 SP Switch Router: Get Connected to the SP Switch

315List of AbbreviationsACLAccess Control ListAIXAdvanced Interactive ExecutiveAMGAdapter Membership GroupANSAbstract Notation SyntaxAPAAll Points A

316 IBM 9077 SP Switch Router: Get Connected to the SP SwitchLRULast Recently UsedLSCLink Switch ChipLVMLogical Volume ManagerMBMegabytesMIBManagemen

© Copyright IBM Corp. 1998317IndexSymbols/etc/bridged.conf 144, 145, 146, 148, 149, 181, 216, 218, 264/etc/fstab 77, 267/etc/grarp.conf 112, 115

318 IBM 9077 SP Switch Router: Get Connected to the SP Switchconfig_netstat 70csconfig 79dev1config 87, 95Eannotator 82Efence 51, 99Efence

319Ffault service daemon 4FDDI 6, 16, 18, 39, 66, 69, 121, 122, 125, 129, 142, 157, 163, 174, 209backbone 126, 155, 174, 177, 179, 181concentr

320 IBM 9077 SP Switch Router: Get Connected to the SP Switch33, 34, 36slot 66 31IP traffic 7, 8, 11, 12, 15, 194IPv4 142, 143IS-IS 15, 23Jja

321disk 75, 76, 79interface 79modem card 34slot 34performance limitation 7Permanent virtual circuits 112perspectives 52, 56physical in

16 IBM 9077 SP Switch Router: Get Connected to the SP SwitchMulticastIP Multicast and OSPF MulticastEGPExterior Gateway ProtocolBGPBorder Gateway Pro

322 IBM 9077 SP Switch Router: Get Connected to the SP Switch16-port 38-port 3adapter card 28cable 81network 12port 41, 63, 75, 81router

© Copyright IBM Corp. 1998 323ITSO Redbook EvaluationIBM 9077 SP Switch Router: Get Connected to the SP Switch SG24-5157-00Your feedback is very impo

Printed in the U.S.A.SG24-5157-00IBM 9077 SP Switch Router: Get Connected to the SP Switch SG24-5157-00

Router Node 17adapter. As a result, other network adapters are brought down as well. Bringing down the router will impact all the networks in the loc

18 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 10. Price ComparisonThese price comparisons are based on US prices as of March 19

Router Node 19Manager updates the system routing tables and performs other administrative functions, the intelligent processors on each media card pe

20 IBM 9077 SP Switch Router: Get Connected to the SP SwitchSubnet Masking/SupernettingVariable length subnet masking is a classless addressing schem

Router Node 21information for the autonomous system. Here is the list of interior protocols supported by the GRF: • RIPThe Routing Information Proto

© Copyright International Business Machines Corporation 1998. All rights reservedNote to U.S Government Users – Documentation related to restricted r

22 IBM 9077 SP Switch Router: Get Connected to the SP SwitchEvery area must connect to the backbone, because the backbone is responsible for the dist

Router Node 23Host extensions for IP multicasting as described in RFC 1112 are also provided. The Router Manager acts as a host and uses the Internet

24 IBM 9077 SP Switch Router: Get Connected to the SP Switch • Source address • Destination address • Protocol port number (single number, or rang

Router Node 25Figure 11. GRF ModelsThe SP Switch Router model 9077 04S (GRF 400) can accommodate up to four media adapters.The SP Switch Router mode

26 IBM 9077 SP Switch Router: Get Connected to the SP SwitchPower SupplyThe left side of the chassis is reserved for the two power supplies that are

Router Node 27If the temperature exceeds 57.5 °C (137 °F), the GRF does an automatic system shutdown. • Hot-swappable fanFor the GRF 16S model, the

28 IBM 9077 SP Switch Router: Get Connected to the SP Switch1. Normally, all media cards have a 4 MB send buffer and a 4 MB receive buffer, except th

Router Node 29Figure 13. Data Packet TransferThe routing can be divided into the following steps:1. A data packet is received by the media card.2. T

30 IBM 9077 SP Switch Router: Get Connected to the SP Switch10.The header is examined by the CPU, which uses the information to build a new header th

Router Node 316. The packet is then transferred to the Combus interface by the DMA engine.7. The packet is sent to the IP Switch Control Board’s Rout

© Copyright IBM Corp. 1998 iiiContentsFigures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .ix

32 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 15. Side View of GRF 400 Chassis with Slots NumberedThe GRF 1600 has 16 media slo

Router Node 332.3.3.1 Route ManagerAs already mentioned, the router management takes place on the IP Switch Control Board.Specific functions of the

34 IBM 9077 SP Switch Router: Get Connected to the SP SwitchItemDescriptionMemoryThe IP Switch Control Board comes standard with 128 MB of memory (th

Router Node 35Additionally, the RS232 port (which is not shown in the figure) allows you to connect the VT100 console by using an RS232 null modem ca

36 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 18. System RAM2.3.5 Characteristics of GRF Media CardsAll GRF media cards (media

Router Node 37Figure 19. SP Switch Router AdapterThe SP Switch Router Adapter is made up of two parts: the media board and a serial daughter card.Th

38 IBM 9077 SP Switch Router: Get Connected to the SP SwitchReceive Controllerand ProcessorThis component recognizes the SP Switch segments and assem

Router Node 39 • It is able to transfer up to 30,000 packets per second. At 20,000 packets per second, each packet needs to be at 5 KB in order to a

40 IBM 9077 SP Switch Router: Get Connected to the SP SwitchIP/SONETThe IP/SONET OC-3c is a single-ported card that allows the user to connect to a d

Router Node 41The attributes of the DependentNode class are described in detail as follows:AttributeDescriptionnode_numberThis user-supplied node num

iv IBM 9077 SP Switch Router: Get Connected to the SP Switch2.4.1 SDR Enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

42 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.4.1.2 DependentAdapter AttributesThe attributes of the DependentAdapter class are desc

Router Node 43AttributeDescriptionnode_typeThis attribute is set to dependent for GRF and to standard for all other RS/6000 SP nodes.switch_max_ltuTh

44 IBM 9077 SP Switch Router: Get Connected to the SP SwitchThe enadmin command is used to change the administrative state of a dependent node in the

Router Node 45Table 7. endefnode Command OptionsThis command adds attribute information for the extension node. The endefadapter command adds IP inf

46 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.4.2.2 The enrmnode CommandThe enrmnode command is used to remove an extension node fro

Router Node 472.4.2.3 The endefadapter CommandThe endefadapter command is used to add or change the extension node adapter IP information in the SDR

48 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.4.2.5 The enadmin CommandThe enadmin command is used to change the status of the SP Sw

Router Node 492.4.2.6 The splstnodes CommandThe splstnodes command is used to list the node attributes of all nodes in the SDR, and can also be exec

50 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.4.2.7 The splstadapters CommandThe splstadapers command is used to list the adapter at

Router Node 512.4.3 Enhanced CommandsThe following commands (see Table 13) have been modified due to the introduction of the dependent node:Table 13

v3.14.2 Check Media Card Status Using grcard . . . . . . . . . . . . . . . . . . 983.14.3 Reset Media Card Using grreset. . . . . . . . . . . . .

52 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.4.4 Hardware PerspectivesIn Perspectives IP Node is used as a convenient and short des

Router Node 533. Nodes pane (Frame or Icon View)4. Information areaThe most obvious change is the addition of the IP Node icon as seen in the Nodes p

54 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 21. Action Menu •ViewThis will bring up the IP Node’s hardware notebook, shown i

Router Node 55This will bring up a window to show the three-digit display of all RS/6000 SP standard nodes in the current partition. This action does

56 IBM 9077 SP Switch Router: Get Connected to the SP SwitchThese are the attributes listed in the Configuration tab: • Node number • Hostname • M

Router Node 57Figure 23. System Partition Aid PerspectivesThe IP Nodes can only be assigned to a partition here. This is done either by using the As

58 IBM 9077 SP Switch Router: Get Connected to the SP SwitchFigure 24. System Partition Aid NotebookThese attributes are listed in the Node Informat

Router Node 59 •stopsrc •lssrc •traceson •tracesoff2.4.6 Dependent Node MIBIBM has defined a dependent node SNMP Management Information Base (MI

60 IBM 9077 SP Switch Router: Get Connected to the SP SwitchibmSPDepSwTokenA combination of switch_number, switch_chip and switch_chip_port attribute

Router Node 61PSSP 2.4 to represent coexistence. Also, note that Node 16 is empty, because the SP Switch port for this node is used by the SP Switch

vi IBM 9077 SP Switch Router: Get Connected to the SP Switch4.5.3 Physical and Logical Interfaces . . . . . . . . . . . . . . . . . . . . . . . . 1

62 IBM 9077 SP Switch Router: Get Connected to the SP Switch • All RS/6000 SP nodes with a version less than PSSP 2.3 in the partition need to maint

Router Node 63Figure 26. PartitioningNormally, RS/6000 SP nodes in different partitions cannot communicate with each other through the SP Switch. Th

64 IBM 9077 SP Switch Router: Get Connected to the SP SwitchNext, ensure that the following parameters are defined:ParametersDescriptionsGRF IP addre

Router Node 652.6 Planning for the Dependent NodeNext, for each dependent node on the RS/6000 SP, define the following:ParametersDescriptionsNode #A

66 IBM 9077 SP Switch Router: Get Connected to the SP Switch2.7 ConclusionThe SP Switch Router 9077-04S has an aggregate bandwidth of 800 MB/s. An S

© Copyright IBM Corp. 1998 67Part 2. ScenariosThis part presents some sample configurations of an RS/6000 SP system with an SP Switch Router. It is b

68 IBM 9077 SP Switch Router: Get Connected to the SP Switch

© Copyright IBM Corp. 1998 69Chapter 3. Installation and Configuration The SP Switch Router functions as an IP router to provide high-speed data comm

Installation and Configuration 70The intent of this chapter is to provide, or refer you to, the necessary information to enable you to attach an SP S

Installation and Configuration 71UNIX systems. On most of the UNIX systems you are working on the shell layer after you logged onto the system.Many s

viiAppendix A. Laboratory Hardware and Software Configuration . . . . 233A.1 Node and Control Workstation Configuration . . . . . . . . . . . . .

Installation and Configuration 72system and enter these basic configuration parameters. Procedures for starting and setting up the SP Switch Router a

Installation and Configuration 73Figure 29. Connecting the GRF to the Frame • You are ready to configure media cards. Procedures to configure media

Installation and Configuration 74Figure 30. Connecting the GRF Console • The IBM SP system is up and operating. • The SP system administrator has

Installation and Configuration 754. Methods to determine node number and SP Switch port for an SP Switch Router Adapter card5. A step-by-step configu

Installation and Configuration 764. Route the Ethernet twisted-pair cable between the SP Switch Router unit and the Ethernet hub, then connect the ca

Installation and Configuration 773. Edit the file /etc/rc.boot and see if the line mount /dev/wd3a /var/log is present; if not, add this line at the

Installation and Configuration 785. Edit the file /etc/syslog.conf to specify the location where the logs will be kept. Uncomment the local log confi

Installation and Configuration 797. Save all changes and reboot:# grwrite -v# reboot8. After the SP Switch Router is up and running again, use csconf

Installation and Configuration 80Figure 31. SP System Administrative Ethernet Connections3.4.2 SP Switch CableThe SP Switch Router Adapter card pro

Installation and Configuration 812. Using appropriate frame entry and exit holes for cable management, route the SP Switch cable between the SP Switc