[gpfsug-discuss] OPA HFI and Mellanox HCA on same NSD Server with only ib rdma enabled

[Walter Sklenka]

Hi!
Is it possible to mix OPAcards and Infininiband HCAs on the same server?
In the faq https://www.ibm.com/support/knowledgecenter/en/STXKQY/gpfsclustersfaq.html#rdma
They talk about RDMA :
"RDMA is NOT  supported on a node when both Mellanox HCAs and Intel Omni-Path HFIs are ENABLED for RDMA."

So do I understand right: When we do NOT enable  the opa interface we can still enable IB ?
The reason I ask  is, that we have a gpfs cluster of 6 NSD Servers  (wih access to storage)  with opa interfaces which provide access to remote cluster  also via OPA.
A new cluster with HDR interfaces will be implemented soon
They shell have access to the same filesystems

When we add HDR interfaces to  NSD servers  and enable rdma on this network  while disabling rdma on opa we would accept the worse performance via opa . We hope that this provides  still better perf and less technical overhead  than using routers

Or am I totally wrong?
Thank you very much and keep healthy!
Best regards
Walter

Mit freundlichen Grüßen
Walter Sklenka
Technical Consultant

EDV-Design Informationstechnologie GmbH
Giefinggasse 6/1/2, A-1210 Wien
Tel: +43 1 29 22 165-31
Fax: +43 1 29 22 165-90
E-Mail: sklenka at edv-design.at<mailto:sklenka at edv-design.at>
Internet: www.edv-design.at<http://www.edv-design.at/>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20210130/40e91f21/attachment.htm>