Doug Stewart on 25 Feb 2011 12:03:57 -0800 |
[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]
Re: [PLUG] Add an HDD to a diskless cluster node? |
All of the nodes concerned are IBM Bladecenter blades with almost identical hardware configuration (a couple differ in memory allocation and not much else). First up is a boot-from-SAN blade (head node) that CAN see the new disks: [root@cc ~]# lspci 00:01.0 PCI bridge: Broadcom BCM5785 [HT1000] PCI/PCI-X Bridge 00:02.0 Host bridge: Broadcom BCM5785 [HT1000] Legacy South Bridge 00:02.2 ISA bridge: Broadcom BCM5785 [HT1000] LPC 00:03.0 USB Controller: Broadcom BCM5785 [HT1000] USB (rev 01) 00:03.1 USB Controller: Broadcom BCM5785 [HT1000] USB (rev 01) 00:03.2 USB Controller: Broadcom BCM5785 [HT1000] USB (rev 01) 00:05.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02) 00:06.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-X bridge (rev b0) 00:07.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-X bridge (rev b0) 00:08.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0) 00:09.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0) 00:0a.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0) 00:0b.0 PCI bridge: Broadcom BCM5780 [HT2000] PCI-Express Bridge (rev b0) 00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration 00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map 00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller 00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control 00:19.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration 00:19.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map 00:19.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller 00:19.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control 01:0d.0 PCI bridge: Broadcom BCM5785 [HT1000] PCI/PCI-X Bridge (rev c0) 02:04.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706S Gigabit Ethernet (rev 02) 02:05.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706S Gigabit Ethernet (rev 02) 03:04.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1064 PCI-X Fusion-MPT SAS (rev 02) 03:05.0 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to PCI-X HBA (rev 02) 03:05.1 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to PCI-X HBA (rev 02) [root@cc ~]# lsmod Module Size Used by ipv6 410017 46 autofs4 56393 1 hidp 83649 2 nfs 286093 29 fscache 52385 1 nfs nfs_acl 36673 1 nfs rfcomm 104809 0 l2cap 89281 10 hidp,rfcomm bluetooth 118725 5 hidp,rfcomm,l2cap lockd 96209 2 nfs sunrpc 195977 4 nfs,nfs_acl,lockd bonding 114593 0 video 51273 0 sbs 49921 0 i2c_ec 38593 1 sbs i2c_core 56129 1 i2c_ec button 40545 0 battery 43849 0 asus_acpi 50917 0 acpi_memhotplug 40133 0 ac 38729 0 parport_pc 62313 0 lp 47121 0 parport 73165 2 parport_pc,lp mptsas 59857 1 mptscsih 57921 1 mptsas mptbase 88033 2 mptsas,mptscsih scsi_transport_sas 64961 1 mptsas bnx2 119057 0 pcspkr 36289 0 serio_raw 40517 0 dm_round_robin 36673 0 dm_multipath 52305 1 dm_round_robin dm_snapshot 50057 0 dm_zero 35265 0 dm_mirror 60865 0 dm_mod 93585 11 dm_multipath,dm_snapshot,dm_zero,dm_mirror mppVhba 162144 2 usb_storage 116257 0 shpchp 70508 0 qla2xxx 791725 8 scsi_transport_fc 73161 1 qla2xxx mppUpper 150252 1 mppVhba sg 69737 0 sd_mod 54081 5 scsi_mod 184057 10 mptsas,mptscsih,scsi_transport_sas,mppVhba,usb_storage,qla2xxx,scsi_transport_fc,mppUpper,sg,sd_mod ext3 166609 3 jbd 93873 1 ext3 uhci_hcd 57433 0 ohci_hcd 54493 0 ehci_hcd 65229 0 [root@cc ~]# Next up is one of the diskless compute nodes. [root@cl00152 ~]# lspci 00:01.0 PCI bridge: Broadcom HT1000 PCI/PCI-X bridge 00:02.0 Host bridge: Broadcom HT1000 Legacy South Bridge 00:02.2 ISA bridge: Broadcom HT1000 LPC Bridge 00:03.0 USB Controller: Broadcom HT1000 USB Controller (rev 01) 00:03.1 USB Controller: Broadcom HT1000 USB Controller (rev 01) 00:03.2 USB Controller: Broadcom HT1000 USB Controller (rev 01) 00:05.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02) 00:06.0 PCI bridge: Broadcom HT2000 PCI-X bridge (rev b0) 00:07.0 PCI bridge: Broadcom HT2000 PCI-X bridge (rev b0) 00:08.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0) 00:09.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0) 00:0a.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0) 00:0b.0 PCI bridge: Broadcom HT2000 PCI-Express bridge (rev b0) 00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration 00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map 00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller 00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control 00:19.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration 00:19.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map 00:19.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller 00:19.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control 01:0d.0 PCI bridge: Broadcom HT1000 PCI/PCI-X bridge (rev c0) 02:04.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706S Gigabit Ethernet (rev 02) 02:05.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5706S Gigabit Ethernet (rev 02) 03:04.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1064 PCI-X Fusion-MPT SAS (rev 02) 03:05.0 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to PCI-X HBA (rev 02) 03:05.1 Fibre Channel: QLogic Corp. ISP2422-based 4Gb Fibre Channel to PCI-X HBA (rev 02) [root@cl00152 ~]# lsmod Module Size Used by ipv6 410913 24 autofs4 56393 1 sd_mod 54081 0 scsi_mod 184441 1 sd_mod dm_mirror 60993 0 dm_multipath 52433 0 dm_mod 93841 2 dm_mirror,dm_multipath parport_pc 62313 0 lp 47121 0 parport 73165 2 parport_pc,lp nfs 286093 32 lockd 96209 2 nfs fscache 52385 1 nfs nfs_acl 36673 1 nfs sunrpc 195977 4 nfs,lockd,nfs_acl bnx2 119057 0 [root@cl00152 ~]# Ideas? -- -Doug ___________________________________________________________________________ Philadelphia Linux Users Group -- http://www.phillylinux.org Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug