Doug Stewart on 25 Feb 2011 12:03:57 -0800


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PLUG] Add an HDD to a diskless cluster node?


All of the nodes concerned are IBM Bladecenter blades with almost
identical hardware configuration (a couple differ in memory allocation
and not much else).  First up is a boot-from-SAN blade (head node)
that CAN see the new disks:

[root@cc ~]# lspci
00:01.0 PCI bridge: Broadcom BCM5785 [HT1000] PCI/PCI-X Bridge
00:02.0 Host bridge: Broadcom BCM5785 [HT1000] Legacy South Bridge
00:02.2 ISA bridge: Broadcom BCM5785 [HT1000] LPC
00:03.0 USB Controller: Broadcom BCM5785 [HT1000] USB (rev 01)
00:03.1 USB Controller: Broadcom BCM5785 [HT1000] USB (rev 01)
00:03.2 USB Controller: Broadcom BCM5785 [HT1000] USB (rev 01)
00:05.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02)
00:06.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-X bridge (rev b0)
00:07.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-X bridge (rev b0)
00:08.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0)
00:09.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0)
00:0a.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0)
00:0b.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0)
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] HyperTransport Technology Configuration
00:18.1 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Miscellaneous Control
00:19.0 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] HyperTransport Technology Configuration
00:19.1 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Address Map
00:19.2 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] DRAM Controller
00:19.3 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Miscellaneous Control
01:0d.0 PCI bridge: Broadcom BCM5785 [HT1000] PCI/PCI-X Bridge (rev c0)
02:04.0 Ethernet controller: Broadcom Corporation NetXtreme II
BCM5706S Gigabit Ethernet (rev 02)
02:05.0 Ethernet controller: Broadcom Corporation NetXtreme II
BCM5706S Gigabit Ethernet (rev 02)
03:04.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1064
PCI-X Fusion-MPT SAS (rev 02)
03:05.0 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to
PCI-X HBA (rev 02)
03:05.1 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to
PCI-X HBA (rev 02)
[root@cc ~]# lsmod
Module                  Size  Used by
ipv6                  410017  46
autofs4                56393  1
hidp                   83649  2
nfs                   286093  29
fscache                52385  1 nfs
nfs_acl                36673  1 nfs
rfcomm                104809  0
l2cap                  89281  10 hidp,rfcomm
bluetooth             118725  5 hidp,rfcomm,l2cap
lockd                  96209  2 nfs
sunrpc                195977  4 nfs,nfs_acl,lockd
bonding               114593  0
video                  51273  0
sbs                    49921  0
i2c_ec                 38593  1 sbs
i2c_core               56129  1 i2c_ec
button                 40545  0
battery                43849  0
asus_acpi              50917  0
acpi_memhotplug        40133  0
ac                     38729  0
parport_pc             62313  0
lp                     47121  0
parport                73165  2 parport_pc,lp
mptsas                 59857  1
mptscsih               57921  1 mptsas
mptbase                88033  2 mptsas,mptscsih
scsi_transport_sas     64961  1 mptsas
bnx2                  119057  0
pcspkr                 36289  0
serio_raw              40517  0
dm_round_robin         36673  0
dm_multipath           52305  1 dm_round_robin
dm_snapshot            50057  0
dm_zero                35265  0
dm_mirror              60865  0
dm_mod                 93585  11 dm_multipath,dm_snapshot,dm_zero,dm_mirror
mppVhba               162144  2
usb_storage           116257  0
shpchp                 70508  0
qla2xxx               791725  8
scsi_transport_fc      73161  1 qla2xxx
mppUpper              150252  1 mppVhba
sg                     69737  0
sd_mod                 54081  5
scsi_mod              184057  10
mptsas,mptscsih,scsi_transport_sas,mppVhba,usb_storage,qla2xxx,scsi_transport_fc,mppUpper,sg,sd_mod
ext3                  166609  3
jbd                    93873  1 ext3
uhci_hcd               57433  0
ohci_hcd               54493  0
ehci_hcd               65229  0
[root@cc ~]#

Next up is one of the diskless compute nodes.

[root@cl00152 ~]# lspci
00:01.0 PCI bridge: Broadcom HT1000 PCI/PCI-X bridge
00:02.0 Host bridge: Broadcom HT1000 Legacy South Bridge
00:02.2 ISA bridge: Broadcom HT1000 LPC Bridge
00:03.0 USB Controller: Broadcom HT1000 USB Controller (rev 01)
00:03.1 USB Controller: Broadcom HT1000 USB Controller (rev 01)
00:03.2 USB Controller: Broadcom HT1000 USB Controller (rev 01)
00:05.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02)
00:06.0 PCI bridge: Broadcom HT2000 PCI-X bridge (rev b0)
00:07.0 PCI bridge: Broadcom HT2000 PCI-X bridge (rev b0)
00:08.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0)
00:09.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0)
00:0a.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0)
00:0b.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0)
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] HyperTransport Technology Configuration
00:18.1 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Miscellaneous Control
00:19.0 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] HyperTransport Technology Configuration
00:19.1 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Address Map
00:19.2 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] DRAM Controller
00:19.3 Host bridge: Advanced Micro Devices [AMD] K8
[Athlon64/Opteron] Miscellaneous Control
01:0d.0 PCI bridge: Broadcom HT1000 PCI/PCI-X bridge (rev c0)
02:04.0 Ethernet controller: Broadcom Corporation NetXtreme II
BCM5706S Gigabit Ethernet (rev 02)
02:05.0 Ethernet controller: Broadcom Corporation NetXtreme II
BCM5706S Gigabit Ethernet (rev 02)
03:04.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1064
PCI-X Fusion-MPT SAS (rev 02)
03:05.0 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to
PCI-X HBA (rev 02)
03:05.1 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to
PCI-X HBA (rev 02)
[root@cl00152 ~]# lsmod
Module                  Size  Used by
ipv6                  410913  24
autofs4                56393  1
sd_mod                 54081  0
scsi_mod              184441  1 sd_mod
dm_mirror              60993  0
dm_multipath           52433  0
dm_mod                 93841  2 dm_mirror,dm_multipath
parport_pc             62313  0
lp                     47121  0
parport                73165  2 parport_pc,lp
nfs                   286093  32
lockd                  96209  2 nfs
fscache                52385  1 nfs
nfs_acl                36673  1 nfs
sunrpc                195977  4 nfs,lockd,nfs_acl
bnx2                  119057  0
[root@cl00152 ~]#



Ideas?
-- 
-Doug
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug