Scandal cluster

8 8-core AMD nodes, 32Gb/node. Fedora 10.

Presidential scandals: watergate lewinsky irancontra bayofpigs malaise katrina potatoe pardon

These machines come with Fedora's NetworkManager service running by default. This service appears to be designed primarily for laptops, to make it easier to switch network devices, find WiFi domains, etc. Pretty useless for our purposes. So I changed back to the network script instead. First you need to set the eth[0,1] devices to come on at boot and so that NetworkManager is not managing them:

/etc/sysconfig/network-scripts/ifcfg-eth0

# nVidia Corporation MCP55 Ethernet
DEVICE=eth0
BOOTPROTO=dhcp
HWADDR=00:30:48:c6:39:60
ONBOOT=yes
NM_CONTROLLED=no
TYPE=Ethernet
USERCTL=no
PEERDNS=yes
IPV6INIT=no

You can make this change by editing the file directly or using system-config-network inside X11. eth1 is similar if ever needed.

Then turn off NetworkManager, configure boot to start network instead.

# chkconfig --level 235 NetworkManager off
# chkconfig --level 235 network on
# service NetworkManager stop
# service network start

At this point network should have tried to start eth0 and DHCP its information from apu.

The onboard Ethernet controller (nVidia MCP55) uses the forcedeth module. When building a kernel choose (2.6.27):
Device Drivers –> Network device support –> Ethernet (10 or 100Mbit) –> EISA, VLB, PCI and on board controllers –> nForce Ethernet support

• SuperMicro H8DM8-2\E-2 serverboard

Note: The scandal machines use Finisar FTLX1471D3BCL 10GigE transceivers.

• NetEffect 10-GigE Adapter Product Leaflet
• H8DM8E-2 Serverboard User Manual
• Finisar Transceiver Product Specification
• Finisar Optics Cleaning Inspection Guide