[gpfsug-discuss] Seeking cNFS/GPFS advice. Add two IPs to cNFS pool

[Olaf Weiser]

Not sure, what you want to know... / missing Q ?!

anyway.. please be aware, cnfs IP handling is done over aliasing.. so in case you have configured the IP directly on the interface, that won't work


________________________________
Von: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> im Auftrag von Ward, Michael <mike-ward at utc.edu>
Gesendet: Montag, 28. März 2022 01:20
An: gpfsug-discuss at gpfsug.org <gpfsug-discuss at gpfsug.org>
Betreff: [EXTERNAL] [gpfsug-discuss] Seeking cNFS/GPFS advice. Add two IPs to cNFS pool

Hello, I am relatively new to GPFS/cNFS.  I have contacted reps and IBM and DDN (our vendor) w/no concrete answers.

We have two servers
 linux server gpfs0 infiniband IP addr 10.0.136.84
 linux server gpfs1 infiniband IP addr 10.0.136.85

 gpfs0 server already has cnfs node name gpfs0-adm
 gpfs1 server already has cnfs node name gpfs1-adm

We want to bind 10.0.136.86, 10.0.136.87 to these nodes to extend the cnfs pool.
Below are the commands I think will work

mmchnode --cnfs-interface= 10.0.136.86 -N  gpfs0-adm

mmchnode --cnfs-interface= 10.0.136.87 -N  gpfs1-adm



Below are some information about the current setup for Ethernet.

[root at gpfs1 ~]# mmlscluster --cnfs

GPFS cluster information
========================
  GPFS cluster name:         gpfs0-adm
  GPFS cluster id:           5815169472987570192

Cluster NFS global parameters
-----------------------------
  Shared root directory:                /gpfs/gsfs1/.cnfs
  rpc.mountd port number:               597
  nfsd threads:                         256
  Reboot on failure enabled:            no
  CNFS monitor enabled:                 yes

 Node  Daemon node name            IP address       CNFS state  group  CNFS IP address list
-------------------------------------------------------------------------------------------
   1   gpfs0-adm                   192.168.202.10   enabled        0   172.17.150.13
   2   gpfs1-adm                   192.168.202.11   enabled        0   172.17.150.14

[root at gpfs1 ~]# mmgetstate -N nsdnodes --cnfs

 Node number  Node name        GPFS state  CNFS state
-----------------------------------------------------
       1      gpfs0-adm        active      active
       2      gpfs1-adm        active      active


[root at gpfs1 ~]# ip addr show dev ib3
11: ib3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc mq state UP group default qlen 256
    link/infiniband 20:00:19:0e:fe:80:00:00:00:00:00:00:24:8a:07:03:00:b1:bb:c9 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
    inet 10.0.136.85/24 brd 10.0.136.255 scope global ib3
       valid_lft forever preferred_lft forever
    inet6 fe80::268a:703:b1:bbc9/64 scope link
       valid_lft forever preferred_lft forever
[root at gpfs1 ~]#





Michael Ward, Ed.D
HPC/HTC Administrator and Advanced Cyber
Infrastructure Facilitator
111B SimCenter
UT Chattanooga
4234254764

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
N
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220328/5504e1a8/attachment.htm>