Summary information ---------------------
Number of nodes defined in the cluster: 1 Number of local nodes active in the cluster: 1 Number of remote nodes joined in this cluster: 0 Number of quorum nodes defined in the cluster: 1 Number of quorum nodes active in the cluster: 1 Quorum = 1, Quorum achieved
4) 将node2节点加入集群
# mmaddnode –N node2
5) 将node2节点修改为从配置服务器
# mmchcluster -s node2 # mmlscluster
GPFS cluster information ========================
GPFS cluster name: node1
GPFS cluster id: 12398485736205447956 GPFS UID domain: node1
Remote shell command: /usr/bin/ssh Remote file copy command: /usr/bin/scp
GPFS cluster configuration servers: ----------------------------------- Primary server: node1 Secondary server: (none)
Node Daemon node name IP address Admin node name Designation ---------------------------------------------------------------------------------- 1 node1 172.16.69.22 node1 quorum-manager 2 node2 172.16.69.29 node2
6) 启动node2并查看状态
# mmstartup -N node2 # mmgetstate –Lsa
Node number Node name Quorum Nodes up Total nodes GPFS state Remarks ------------------------------------------------------------------------------------ 1 node1 1 1 2 active quorum node 2 node2 1 1 2 active
Summary information ---------------------
Number of nodes defined in the cluster: 2 Number of local nodes active in the cluster: 2 Number of remote nodes joined in this cluster: 0 Number of quorum nodes defined in the cluster: 1 Number of quorum nodes active in the cluster: 1 Quorum = 1, Quorum achieved
7) 查看GPFS集群信息
集群名字？_______________
node1,node2的IP地址? ___________________________ 此版本GPFS built的日期？___________________________
8) 使用4个hdisk创建NSD
在本阶段练习中，我们按照如下规则创建NSD
所有nsd容纳data和metadata 不指定STORAGE POOL 不指定FailureGroup 不指定主/备服务器节点
在node1上建立/home/gpfs 目录，创建并编辑/home/gpfs/nsds文件，内容如下:
#mkdir /home/gpfs #vi /home/gpfs/nsds #more /home/gpfs/nsds
#DiskName:ServerList::DiskUsage:FailureGroup:DesiredName:StoragePool hdiskw:::dataAndMetadata::nsd1: hdiskx:::dataAndMetadata::nsd2: hdisky:::dataAndMetadata::nsd3: hdiskz:::dataAndMetadata::nsd4:
备份nsds
#cp /home/gpfs/nsds /home/gpfs/nsds.bak
注：这里我们练习中使用4个hdisk，所以示例中列举4个，真实环境请视实际hdisk数量调整
创建NSD，这里-v 选项缺省值为yes，表示创建NSD是验证该hdisk是否已被NSD格式化了，
当然对一个全新系统，我们可以确定hdisk未被格式化，可以制定-v no跳过检查。
# mmcrnsd -F /home/gpfs/nsds -v yes #mmdel “nds1;nsd2;nsd3” #mmlsnsd 9) 创建文件系统
指定文件系统blocksize大小为：64K MOUNT路径为：gpfs # mmcrfs /gpfs gpfs1 “nsd1;nsd2” –B 64k (自我测试)
# mmcrfs /gpfs gpfs1 –F /home/gpfs/nsds –B 64k
GPFS: 6027-531 The following disks of gpfs1 will be formatted on node node1: nsd1: size 4194304 KB nsd2: size 4194304 KB nsd3: size 4194304 KB nsd4: size 4194304 KB
GPFS: 6027-540 Formatting file system ...
GPFS: 6027-535 Disks up to size 40 GB can be added to storage pool 'system'. Creating Inode File
Creating Allocation Maps
Clearing Inode Allocation Map Clearing Block Allocation Map
Formatting Allocation Map for storage pool 'system'
GPFS: 6027-572 Completed creation of file system /dev/gpfs1.
mmcrfs: 6027-1371 Propagating the cluster configuration data to all affected nodes. This is an asynchronous process.
#mmdelfs gpfs1 #mmlsfs all #mmdf gpfs1
10) 验证GPFS集群文件系统 # mmlsfs gpfs1
mmlsfs gpfs1
flag value description
---- ---------------- ----------------------------------------------------- -f 2048 Minimum fragment size in bytes -i 512 Inode size in bytes
-I 8192 Indirect block size in bytes
-m 1 Default number of metadata replicas -M 2 Maximum number of metadata replicas -r 1 Default number of data replicas -R 2 Maximum number of data replicas -j cluster Block allocation type
-D nfs4 File locking semantics in effect -k all ACL semantics in effect
-a 1048576 Estimated average file size
-n 32 Estimated number of nodes that will mount file system -B 65536 Block size
-Q none Quotas enforced
none Default quotas enabled
-F 33792 Maximum number of inodes -V 10.01 (3.2.1.5) File system version -u yes Support for large LUNs? -z no Is DMAPI enabled? -L 2097152 Logfile size
-E yes Exact mtime mount option -S no Suppress atime mount option
-K whenpossible Strict replica allocation option -P system Disk storage pools in file system -d nsd1;nsd2;nsd3;nsd4 Disks in file system -A yes Automatic mount option -o none Additional mount options -T /gpfs Default mount point
# mmmount all –a
# df -g
Filesystem GB blocks Free %Used Iused %Iused Mounted on /dev/hd4 1.00 0.95 5% 3914 2% / /dev/hd2 4.00 1.70 58% 53285 12% /usr /dev/hd9var 1.00 0.92 8% 4774 3% /var /dev/hd3 3.00 2.98 1% 179 1% /tmp
/dev/hd1 60.00 54.98 9% 985 1% /home /proc - - - - - /proc
/dev/hd10opt 10.00 5.88 42% 37933 3% /opt /dev/gpfs1 16.00 15.91 1% 4038 12% /gpfs
# mmdf gpfs1
disk disk size failure holds holds free KB free KB
name in KB group metadata data in full blocks in fragments --------------- ------------- -------- -------- ----- -------------------- ------------------- Disks in storage pool: system (Maximum disk size allowed is 40 GB)
nsd1 4194304 -1 yes yes 4170240 ( 99%) 104 ( 0%) nsd2 4194304 -1 yes yes 4170176 ( 99%) 124 ( 0%) nsd3 4194304 -1 yes yes 4170240 ( 99%) 124 ( 0%) nsd4 4194304 -1 yes yes 4170048 ( 99%) 118 ( 0%) ------------- -------------------- -------------------
(pool total) 16777216 16680704 ( 99%) 470 ( 0%)
============= ==================== =================== (total) 16777216 16680704 ( 99%) 470 ( 0%)
Inode Information -----------------
Number of used inodes: 4038 Number of free inodes: 29754 Number of allocated inodes: 33792 Maximum number of inodes: 33792
当前文件系统已使用了多少个inode？____________ 还有多少空闲的inodes？_____________
