From leonardo.sala at psi.ch Wed May 3 14:17:56 2023 From: leonardo.sala at psi.ch (Leonardo Sala) Date: Wed, 3 May 2023 15:17:56 +0200 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Message-ID: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> Dear all, I do have a very naive question about the subnets parameter. I read the various docs [*], but it is not clear to me how do best define it in my use case. As an example, I have a CL1 storage cluster, and a CL2 client cluster that remotely mounts CL1 storage, and they are both connected to a private IB network 192.168.0.0. Where should I define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some directionality seems implied in the docs, but it was not totally clear to me... Thanks a lot! cheers leo [*] https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-remote-access-multiple-network-definitions https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-using-public-private-ip-addresses-gpfs-nodes -- Paul Scherrer Institut Dr. Leonardo Sala Group Leader Data Analysis and Research Infrastructure Deputy Department Head a.i Science IT Infrastructure and Services department Science IT Infrastructure and Services department (AWI) WHGA/036 Forschungstrasse 111 5232 Villigen PSI Switzerland Phone: +41 56 310 3369 leonardo.sala at psi.ch www.psi.ch -------------- next part -------------- An HTML attachment was scrubbed... URL: From pinto at scinet.utoronto.ca Wed May 3 14:35:35 2023 From: pinto at scinet.utoronto.ca (Jaime Pinto) Date: Wed, 3 May 2023 09:35:35 -0400 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> Message-ID: <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> /etc/sysconfig/network-scripts/ifcfg-ib0 Example: DEVICE=ib0 NM_CONTROLLED=no BOOTPROTO=none ONBOOT=yes IPADDR=192.168.0.1 NETMASK=255.255.0.0 There is no need to place storage and client clusters on different subnets. Cheers Jaime On 5/3/2023 09:17:56, Leonardo Sala wrote: > Dear all, > > I do have a very naive question about the subnets parameter. I read the various docs [*], but it is not clear to me how do best define it in my use case. As an example, I have a CL1 storage cluster, and a CL2 client cluster that remotely mounts CL1 storage, and they are both connected to a private IB network 192.168.0.0. Where should I define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some directionality seems implied in the docs, but it was not totally clear to me... > > Thanks a lot! > > cheers > > leo > > [*] > > https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-remote-access-multiple-network-definitions > > https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-using-public-private-ip-addresses-gpfs-nodes > > -- > Paul Scherrer Institut > Dr. Leonardo Sala > Group Leader Data Analysis and Research Infrastructure > Deputy Department Head a.i Science IT Infrastructure and Services department > Science IT Infrastructure and Services department (AWI) > WHGA/036 > Forschungstrasse 111 > 5232 Villigen PSI > Switzerland > > Phone: +41 56 310 3369 > leonardo.sala at psi.ch > www.psi.ch > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org --- Jaime Pinto - Storage Analyst SciNet HPC Consortium - www.scinet.utoronto.ca University of Toronto 661 University Ave. (MaRS), Suite 1140 Toronto, ON, M5G1M1 P: 416-978-2755 C: 416-505-1477 From laurence at qsplace.co.uk Wed May 3 15:00:10 2023 From: laurence at qsplace.co.uk (Laurence Horrocks-Barlow) Date: Wed, 03 May 2023 14:00:10 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> Message-ID: Hi Leonardo, I?ve found it easier to think and use the subnet parameter as a ?what is my preferred high speed network? parameter and can be used to allow common nodes to use a common high speed network. All nodes must have a common network for admin and data, however once and only once at mmstartup it will compare the subnet parameter to connect to the declared high speed networks (in addition to the common data network). It always treats RDMA as the first subnet regardless to what is defined in the subnets parameter. I commonly use this when 2 node groups, Group A and Group B Both groups have different slurm queues and they use different filesets of gpfs. Group A has 1G and 10G Group B have 1G and 100G 1G is a flat layer 2 network, let?s say 10.0.0.0/24 10G 10.0.10.0/24 100G 10.0.100.0/24 The 10G and 100G are separate networks, no routing between them. In this instance I would define both the admin and data networks as 10.0.0.0/24 But I would define the 10G and 100G networks under the subnets parameter. On mmstartup all nodes use the 1G for admin and data networks, but then they would compare subnet availability and escalate the data network to the subnet that is available to them. (Remembering RDMA is always the first subnet, regardless of definition and if available) Now in this instance the workload on the file system is separated by slurm and filesets, so there is minimal internode communication when accessing files, so you can get away with a ?slow? 1G common network when Group A and Group B have to communicate. But Group A will communicate with group A over 10G and Group B over 1G. Then Group B will communicate to Group B over 100G but to Group A over 1G. You can also use this to define preferred routed subnets etc, however it is important to note that this is not an ?LNET? feature/replacement, nor is it a HA/failover/tailback feature. All nodes must have a common network, whether routed or otherwise, the subnet parameter just allows you to define the preferred high speed network, and thus interface to use. It can help create flexibility in a gpfs cluster, but it can also be the source of an unexplained ?slow? file system when a node fails to escalate from 1G to a high speed network slowing the entire Group down to 1G during a job. I hope this helps. ? Lauz Get BlueMail for Mobile Leonardo Sala wrote: Dear all, I do have a very naive question about the subnets parameter. I read the various docs [*], but it is not clear to me how do best define it in my use case. As an example, I have a CL1 storage cluster, and a CL2 client cluster that remotely mounts CL1 storage, and they are both connected to a private IB network 192.168.0.0. Where should I define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some directionality seems implied in the docs, but it was not totally clear to me... Thanks a lot! cheers leo [*] https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-remote-access-multiple-network-definitions https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-using-public-private-ip-addresses-gpfs-nodes -- Paul Scherrer InstitutDr. Leonardo SalaGroup Leader Data Analysis and Research InfrastructureDeputy Department Head a.i Science IT Infrastructure and Services departmentScience IT Infrastructure and Services department (AWI)WHGA/036Forschungstrasse 1115232 Villigen PSISwitzerlandPhone: +41 56 310 3369leonardo.sala at psi.ch www.psi.ch Dear all, I do have a very naive question about the subnets parameter. I read the various docs [*], but it is not clear to me how do best define it in my use case. As an example, I have a CL1 storage cluster, and a CL2 client cluster that remotely mounts CL1 storage, and they are both connected to a private IB network 192.168.0.0. Where should I define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some directionality seems implied in the docs, but it was not totally clear to me... Thanks a lot! cheers leo [*] https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-remote-access-multiple-network-definitions https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-using-public-private-ip-addresses-gpfs-nodes -- Paul Scherrer InstitutDr. Leonardo SalaGroup Leader Data Analysis and Research InfrastructureDeputy Department Head a.i Science IT Infrastructure and Services departmentScience IT Infrastructure and Services department (AWI)WHGA/036Forschungstrasse 1115232 Villigen PSISwitzerlandPhone: +41 56 310 3369leonardo.sala at psi.ch www.psi.ch -------------- next part -------------- An HTML attachment was scrubbed... URL: From laurence at qsplace.co.uk Wed May 3 15:00:10 2023 From: laurence at qsplace.co.uk (Laurence Horrocks-Barlow) Date: Wed, 03 May 2023 14:00:10 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> Message-ID: Hi Leonardo, I?ve found it easier to think and use the subnet parameter as a ?what is my preferred high speed network? parameter and can be used to allow common nodes to use a common high speed network. All nodes must have a common network for admin and data, however once and only once at mmstartup it will compare the subnet parameter to connect to the declared high speed networks (in addition to the common data network). It always treats RDMA as the first subnet regardless to what is defined in the subnets parameter. I commonly use this when 2 node groups, Group A and Group B Both groups have different slurm queues and they use different filesets of gpfs. Group A has 1G and 10G Group B have 1G and 100G 1G is a flat layer 2 network, let?s say 10.0.0.0/24 10G 10.0.10.0/24 100G 10.0.100.0/24 The 10G and 100G are separate networks, no routing between them. In this instance I would define both the admin and data networks as 10.0.0.0/24 But I would define the 10G and 100G networks under the subnets parameter. On mmstartup all nodes use the 1G for admin and data networks, but then they would compare subnet availability and escalate the data network to the subnet that is available to them. (Remembering RDMA is always the first subnet, regardless of definition and if available) Now in this instance the workload on the file system is separated by slurm and filesets, so there is minimal internode communication when accessing files, so you can get away with a ?slow? 1G common network when Group A and Group B have to communicate. But Group A will communicate with group A over 10G and Group B over 1G. Then Group B will communicate to Group B over 100G but to Group A over 1G. You can also use this to define preferred routed subnets etc, however it is important to note that this is not an ?LNET? feature/replacement, nor is it a HA/failover/tailback feature. All nodes must have a common network, whether routed or otherwise, the subnet parameter just allows you to define the preferred high speed network, and thus interface to use. It can help create flexibility in a gpfs cluster, but it can also be the source of an unexplained ?slow? file system when a node fails to escalate from 1G to a high speed network slowing the entire Group down to 1G during a job. I hope this helps. ? Lauz Get BlueMail for Mobile Leonardo Sala wrote: Dear all, I do have a very naive question about the subnets parameter. I read the various docs [*], but it is not clear to me how do best define it in my use case. As an example, I have a CL1 storage cluster, and a CL2 client cluster that remotely mounts CL1 storage, and they are both connected to a private IB network 192.168.0.0. Where should I define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some directionality seems implied in the docs, but it was not totally clear to me... Thanks a lot! cheers leo [*] https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-remote-access-multiple-network-definitions https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-using-public-private-ip-addresses-gpfs-nodes -- Paul Scherrer InstitutDr. Leonardo SalaGroup Leader Data Analysis and Research InfrastructureDeputy Department Head a.i Science IT Infrastructure and Services departmentScience IT Infrastructure and Services department (AWI)WHGA/036Forschungstrasse 1115232 Villigen PSISwitzerlandPhone: +41 56 310 3369leonardo.sala at psi.ch www.psi.ch Dear all, I do have a very naive question about the subnets parameter. I read the various docs [*], but it is not clear to me how do best define it in my use case. As an example, I have a CL1 storage cluster, and a CL2 client cluster that remotely mounts CL1 storage, and they are both connected to a private IB network 192.168.0.0. Where should I define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some directionality seems implied in the docs, but it was not totally clear to me... Thanks a lot! cheers leo [*] https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-remote-access-multiple-network-definitions https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-using-public-private-ip-addresses-gpfs-nodes -- Paul Scherrer InstitutDr. Leonardo SalaGroup Leader Data Analysis and Research InfrastructureDeputy Department Head a.i Science IT Infrastructure and Services departmentScience IT Infrastructure and Services department (AWI)WHGA/036Forschungstrasse 1115232 Villigen PSISwitzerlandPhone: +41 56 310 3369leonardo.sala at psi.ch www.psi.ch -------------- next part -------------- An HTML attachment was scrubbed... URL: From Achim.Rehor at de.ibm.com Wed May 3 15:40:56 2023 From: Achim.Rehor at de.ibm.com (Achim Rehor) Date: Wed, 3 May 2023 14:40:56 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> Message-ID: correct, there is no need to put client and storage into different subnets,? and it is also not necessary to specify the subnet parameter at all, when they share the same network.? The subnets parameter is very helpful, though, if you are using multiple networks, and want to use specific ones for communication with one or the other remote cluster. -- Mit freundlichen Gr??en / Kind regards Achim Rehor Technical Support Specialist S?pectrum Scale and ESS (SME) Advisory Product Services Professional IBM Systems Storage Support - EMEA Achim.Rehor at de.ibm.com +49-170- 4521194 ? IBM Deutschland GmbH? Vorsitzender des Aufsichtsrats: Sebastian Krause Gesch?ftsf?hrung: Gregor Pillen (Vorsitzender), Nicole Reimer,? Gabriele Schwarenthorer,?Christine Rupp, Frank Theisen Sitz der Gesellschaft: Ehningen / Registergericht: AmtsgerichtStuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940 -----Original Message----- From: Jaime Pinto Reply-To: gpfsug main discussion list To: gpfsug-discuss at gpfsug.org Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Date: Wed, 03 May 2023 09:35:35 -0400 /etc/sysconfig/network-scripts/ifcfg-ib0 Example: DEVICE=ib0 NM_CONTROLLED=no BOOTPROTO=none ONBOOT=yes IPADDR=192.168.0.1 NETMASK=255.255.0.0 There is no need to place storage and client clusters on different subnets. Cheers Jaime On 5/3/2023 09:17:56, Leonardo Sala wrote: > Dear all, > > I do have a very naive question about the subnets parameter. I read > the various docs [*], but it is not clear to me how do best define it > in my use case. As an example, I have a CL1 storage cluster, and a > CL2 client cluster that remotely mounts CL1 storage, and they are > both connected to a private IB network 192.168.0.0. Where should I > define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some > directionality seems implied in the docs, but it was not totally > clear to me... > > Thanks a lot! > > cheers > > leo > > [*] > > https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using- > remote-access-multiple-network-definitions > > https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication- > using-public-private-ip-addresses-gpfs-nodes > > -- > Paul Scherrer Institut > Dr. Leonardo Sala > Group Leader Data Analysis and Research Infrastructure > Deputy Department Head a.i Science IT Infrastructure and Services > department > Science IT Infrastructure and Services department (AWI) > WHGA/036 > Forschungstrasse 111 > 5232 Villigen PSI > Switzerland > > Phone: +41 56 310 3369 > leonardo.sala at psi.ch > www.psi.ch > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > INVALID URI REMOVED > 3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss- > 5Fgpfsug.org&d=DwICAg&c=jf_iaSHvJObTbx- > siA1ZOg&r=RGTETs2tk0Kz_VOpznDVDkqChhnfLapOTkxLvgmR2- > M&m=a52vwqiBPgfri7y- > rne9oRxqBKDxxYqKimhVU6ZxaEvmSVBVmMqWrcYU773cCoYM&s=01OGdeEg83s2fYkuf8 > BQqhhMxUWiFPbvyedZrCqSDFc&e=? --- Jaime Pinto - Storage Analyst SciNet HPC Consortium - www.scinet.utoronto.ca University of Toronto 661 University Ave. (MaRS), Suite 1140 Toronto, ON, M5G1M1 P: 416-978-2755 C: 416-505-1477 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org INVALID URI REMOVED 3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss- 5Fgpfsug.org&d=DwICAg&c=jf_iaSHvJObTbx- siA1ZOg&r=RGTETs2tk0Kz_VOpznDVDkqChhnfLapOTkxLvgmR2- M&m=a52vwqiBPgfri7y- rne9oRxqBKDxxYqKimhVU6ZxaEvmSVBVmMqWrcYU773cCoYM&s=01OGdeEg83s2fYkuf8BQ qhhMxUWiFPbvyedZrCqSDFc&e=? From leonardo.sala at psi.ch Wed May 3 15:58:12 2023 From: leonardo.sala at psi.ch (Leonardo Sala) Date: Wed, 3 May 2023 16:58:12 +0200 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> Message-ID: Dear Achim, thanks! My point is: in case of a remote cluster mount, e.g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change this parameter on a production system, and as it needs a restart I would like to be sure I change it only where necessary Thanks again! cheers leo Paul Scherrer Institut Dr. Leonardo Sala Group Leader Data Analysis and Research Infrastructure Deputy Department Head a.i Science IT Infrastructure and Services department Science IT Infrastructure and Services department (AWI) WHGA/036 Forschungstrasse 111 5232 Villigen PSI Switzerland Phone: +41 56 310 3369 leonardo.sala at psi.ch www.psi.ch On 5/3/23 16:40, Achim Rehor wrote: > correct, there is no need to put client and storage into different > subnets, > and it is also not necessary to specify the subnet parameter at all, > when they share the same network. > > The subnets parameter is very helpful, though, if you are using > multiple networks, and want to use specific ones for communication with > one or the other remote cluster. > -------------- next part -------------- An HTML attachment was scrubbed... URL: From olaf.weiser at de.ibm.com Wed May 3 16:17:01 2023 From: olaf.weiser at de.ibm.com (Olaf Weiser) Date: Wed, 3 May 2023 15:17:01 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> Message-ID: and don't forget ... subnet is used for ... for MROT https://www.ibm.com/docs/en/spectrum-scale/5.1.6?topic=configuring-multi-rail-over-tcp-mrot Configuring Multi-Rail over TCP (MROT) IBM Spectrum Scale 5.1.5 introduces the Multi-Rail over TCP (MROT) feature. This feature enables the concurrent use of multiple subnets to communicate with a specified destination, and now allows the concurrent use of multiple physical network interfaces without requiring bonding to be configured. www.ibm.com ________________________________ Von: gpfsug-discuss im Auftrag von Achim Rehor Gesendet: Mittwoch, 3. Mai 2023 16:40 An: gpfsug-discuss at gpfsug.org Betreff: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts correct, there is no need to put client and storage into different subnets, and it is also not necessary to specify the subnet parameter at all, when they share the same network. The subnets parameter is very helpful, though, if you are using multiple networks, and want to use specific ones for communication with one or the other remote cluster. -- Mit freundlichen Gr??en / Kind regards Achim Rehor Technical Support Specialist S?pectrum Scale and ESS (SME) Advisory Product Services Professional IBM Systems Storage Support - EMEA Achim.Rehor at de.ibm.com +49-170- 4521194 IBM Deutschland GmbH Vorsitzender des Aufsichtsrats: Sebastian Krause Gesch?ftsf?hrung: Gregor Pillen (Vorsitzender), Nicole Reimer, Gabriele Schwarenthorer, Christine Rupp, Frank Theisen Sitz der Gesellschaft: Ehningen / Registergericht: AmtsgerichtStuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940 -----Original Message----- From: Jaime Pinto Reply-To: gpfsug main discussion list To: gpfsug-discuss at gpfsug.org Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Date: Wed, 03 May 2023 09:35:35 -0400 /etc/sysconfig/network-scripts/ifcfg-ib0 Example: DEVICE=ib0 NM_CONTROLLED=no BOOTPROTO=none ONBOOT=yes IPADDR=192.168.0.1 NETMASK=255.255.0.0 There is no need to place storage and client clusters on different subnets. Cheers Jaime On 5/3/2023 09:17:56, Leonardo Sala wrote: > Dear all, > > I do have a very naive question about the subnets parameter. I read > the various docs [*], but it is not clear to me how do best define it > in my use case. As an example, I have a CL1 storage cluster, and a > CL2 client cluster that remotely mounts CL1 storage, and they are > both connected to a private IB network 192.168.0.0. Where should I > define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some > directionality seems implied in the docs, but it was not totally > clear to me... > > Thanks a lot! > > cheers > > leo > > [*] > > https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using- > remote-access-multiple-network-definitions > > https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication- > using-public-private-ip-addresses-gpfs-nodes > > -- > Paul Scherrer Institut > Dr. Leonardo Sala > Group Leader Data Analysis and Research Infrastructure > Deputy Department Head a.i Science IT Infrastructure and Services > department > Science IT Infrastructure and Services department (AWI) > WHGA/036 > Forschungstrasse 111 > 5232 Villigen PSI > Switzerland > > Phone: +41 56 310 3369 > leonardo.sala at psi.ch > www.psi.ch > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > INVALID URI REMOVED > 3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss- > 5Fgpfsug.org&d=DwICAg&c=jf_iaSHvJObTbx- > siA1ZOg&r=RGTETs2tk0Kz_VOpznDVDkqChhnfLapOTkxLvgmR2- > M&m=a52vwqiBPgfri7y- > rne9oRxqBKDxxYqKimhVU6ZxaEvmSVBVmMqWrcYU773cCoYM&s=01OGdeEg83s2fYkuf8 > BQqhhMxUWiFPbvyedZrCqSDFc&e= --- Jaime Pinto - Storage Analyst SciNet HPC Consortium - www.scinet.utoronto.ca University of Toronto 661 University Ave. (MaRS), Suite 1140 Toronto, ON, M5G1M1 P: 416-978-2755 C: 416-505-1477 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org INVALID URI REMOVED 3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss- 5Fgpfsug.org&d=DwICAg&c=jf_iaSHvJObTbx- siA1ZOg&r=RGTETs2tk0Kz_VOpznDVDkqChhnfLapOTkxLvgmR2- M&m=a52vwqiBPgfri7y- rne9oRxqBKDxxYqKimhVU6ZxaEvmSVBVmMqWrcYU773cCoYM&s=01OGdeEg83s2fYkuf8BQ qhhMxUWiFPbvyedZrCqSDFc&e= _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From Achim.Rehor at de.ibm.com Wed May 3 23:00:27 2023 From: Achim.Rehor at de.ibm.com (Achim Rehor) Date: Wed, 3 May 2023 22:00:27 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> Message-ID: <3e6ddb452cec8fa6b62f95dd179dbdd106206dbb.camel@de.ibm.com> Dear Leonardo, you will find a description in the Concepts, Planning, and Installation Guide in the GPFS daemon communication section, explaining how the startup mechanism works. The Administration Guide contains an explanation on MROTs specifics for the subnets usage (Chapter 17 in the 5.1.7. version) Chapter 33 focuses on remote cluster mounts and contains examples. Basically, the node join triggers the compare and the matching, thus a client clusters node uses it's subnets configuration (including the remote clusters clustername) to initiate the connection. On the storage cluster you can also diffentiate your existing subnets for use with separate remote mounting clusters. I would recommend still to do it on both, just to be precise. Initially the idea (as can be seen in the examples in Chapter 33) was to force the daemon communication to the storage NSD servers to use the 'high speed' network, rather than the lower bandwidth common admin network. -- Mit freundlichen Gr??en / Kind regards Achim Rehor Technical Support Specialist S?pectrum Scale and ESS (SME) Advisory Product Services Professional IBM Systems Storage Support - EMEA Achim.Rehor at de.ibm.com +49-170- 4521194 ? IBM Deutschland GmbH? -----Original Message----- From: Leonardo Sala To: gpfsug main discussion list , Achim Rehor Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Date: Wed, 03 May 2023 16:58:12 +0200 Dear Achim, thanks! My point is: in case of a remote cluster mount, e.?g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ? ZjQcmQRYFpfptBannerEnd #pfptBannerzu381sx { all: revert !important; display: block !important; visibility: visible !important; opacity: 1 !important; background-color: #D0D8DC !important; max-width: none !important; max-height: none !important } .pfptPrimaryButtonzu381sx:hover, .pfptPrimaryButtonzu381sx:focus { background-color: #b4c1c7 !important; } .pfptPrimaryButtonzu381sx:active { background-color: #90a4ae !important; }Dear Achim, thanks! My point is: in case of a remote cluster mount, e.g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change this parameter on a production system, and as it needs a restart I would like to be sure I change it only where necessary Thanks again! cheers leo Paul Scherrer Institut Dr. Leonardo Sala Group Leader Data Analysis and Research Infrastructure Deputy Department Head a.i Science IT Infrastructure and Services department Science IT Infrastructure and Services department (AWI) WHGA/036 Forschungstrasse 111 5232 Villigen PSI Switzerland Phone: +41 56 310 3369 leonardo.sala at psi.ch www.psi.ch On 5/3/23 16:40, Achim Rehor wrote: > correct, there is no need to put client and storage into different > subnets,? > and it is also not necessary to specify the subnet parameter at all, > when they share the same network.? > > The subnets parameter is very helpful, though, if you are using > multiple networks, and want to use specific ones for communication with > one or the other remote cluster. > From olaf.weiser at de.ibm.com Thu May 4 06:14:01 2023 From: olaf.weiser at de.ibm.com (Olaf Weiser) Date: Thu, 4 May 2023 05:14:01 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: <3e6ddb452cec8fa6b62f95dd179dbdd106206dbb.camel@de.ibm.com> References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> <3e6ddb452cec8fa6b62f95dd179dbdd106206dbb.camel@de.ibm.com> Message-ID: Moin Achim, ouch .. Du has' aba Arbeitszeiten .. und ich dachte schon .. meine sind mies ? Danke Dir f?r deine Antwort.. wenn Du heute mal 5 min hast.. ping mich mal an ... ATOS France hat wohl n ticket bei uns offen ?!? aber kein Stress.. ich hab auch so genug Baustellen .. so denne (ich hoffe mal f?r Dich , Du tr?umst noch s?? , w?hrend ich das hier schreibe... ) cheers Mit freundlichen Gr??en / Kind regards Olaf Weiser IBM Systems, SpectrumScale Client Adoption ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland IBM Allee 1 71139 Ehningen Phone: +49-170-579-44-66 E-Mail: olaf.weiser at de.ibm.com ------------------------------------------------------------------------------------------------------------------------------------------- Vorsitzender des Aufsichtsrats: Gregor Pillen Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 ________________________________ Von: gpfsug-discuss im Auftrag von Achim Rehor Gesendet: Donnerstag, 4. Mai 2023 00:00 An: leonardo.sala at psi.ch Cc: gpfsug-discuss at gpfsug.org Betreff: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Dear Leonardo, you will find a description in the Concepts, Planning, and Installation Guide in the GPFS daemon communication section, explaining how the startup mechanism works. The Administration Guide contains an explanation on MROTs specifics for the subnets usage (Chapter 17 in the 5.1.7. version) Chapter 33 focuses on remote cluster mounts and contains examples. Basically, the node join triggers the compare and the matching, thus a client clusters node uses it's subnets configuration (including the remote clusters clustername) to initiate the connection. On the storage cluster you can also diffentiate your existing subnets for use with separate remote mounting clusters. I would recommend still to do it on both, just to be precise. Initially the idea (as can be seen in the examples in Chapter 33) was to force the daemon communication to the storage NSD servers to use the 'high speed' network, rather than the lower bandwidth common admin network. -- Mit freundlichen Gr??en / Kind regards Achim Rehor Technical Support Specialist S?pectrum Scale and ESS (SME) Advisory Product Services Professional IBM Systems Storage Support - EMEA Achim.Rehor at de.ibm.com +49-170- 4521194 IBM Deutschland GmbH -----Original Message----- From: Leonardo Sala To: gpfsug main discussion list , Achim Rehor Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Date: Wed, 03 May 2023 16:58:12 +0200 Dear Achim, thanks! My point is: in case of a remote cluster mount, e.?g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd #pfptBannerzu381sx { all: revert !important; display: block !important; visibility: visible !important; opacity: 1 !important; background-color: #D0D8DC !important; max-width: none !important; max-height: none !important } .pfptPrimaryButtonzu381sx:hover, .pfptPrimaryButtonzu381sx:focus { background-color: #b4c1c7 !important; } .pfptPrimaryButtonzu381sx:active { background-color: #90a4ae !important; }Dear Achim, thanks! My point is: in case of a remote cluster mount, e.g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change this parameter on a production system, and as it needs a restart I would like to be sure I change it only where necessary Thanks again! cheers leo Paul Scherrer Institut Dr. Leonardo Sala Group Leader Data Analysis and Research Infrastructure Deputy Department Head a.i Science IT Infrastructure and Services department Science IT Infrastructure and Services department (AWI) WHGA/036 Forschungstrasse 111 5232 Villigen PSI Switzerland Phone: +41 56 310 3369 leonardo.sala at psi.ch www.psi.ch On 5/3/23 16:40, Achim Rehor wrote: > correct, there is no need to put client and storage into different > subnets, > and it is also not necessary to specify the subnet parameter at all, > when they share the same network. > > The subnets parameter is very helpful, though, if you are using > multiple networks, and want to use specific ones for communication with > one or the other remote cluster. > _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From olaf.weiser at de.ibm.com Thu May 4 06:19:54 2023 From: olaf.weiser at de.ibm.com (Olaf Weiser) Date: Thu, 4 May 2023 05:19:54 +0000 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> <3e6ddb452cec8fa6b62f95dd179dbdd106206dbb.camel@de.ibm.com> Message-ID: sorry folks... that email was not intent to send to the list... please ignore... ________________________________ Von: gpfsug-discuss im Auftrag von Olaf Weiser Gesendet: Donnerstag, 4. Mai 2023 07:14 An: gpfsug main discussion list Betreff: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Moin Achim, ouch .. Du has' aba Arbeitszeiten .. und ich dachte schon .. meine sind mies ? Danke Dir f?r deine Antwort.?. wenn Du heute mal 5 min hast.?. ping mich mal an ..?. ATOS France hat wohl n ticket bei uns offen ?!? aber kein Stress.?.? ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Moin Achim, ouch .. Du has' aba Arbeitszeiten .. und ich dachte schon .. meine sind mies ? Danke Dir f?r deine Antwort.. wenn Du heute mal 5 min hast.. ping mich mal an ... ATOS France hat wohl n ticket bei uns offen ?!? aber kein Stress.. ich hab auch so genug Baustellen .. so denne (ich hoffe mal f?r Dich , Du tr?umst noch s?? , w?hrend ich das hier schreibe... ) cheers Mit freundlichen Gr??en / Kind regards Olaf Weiser IBM Systems, SpectrumScale Client Adoption ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland IBM Allee 1 71139 Ehningen Phone: +49-170-579-44-66 E-Mail: olaf.weiser at de.ibm.com ------------------------------------------------------------------------------------------------------------------------------------------- Vorsitzender des Aufsichtsrats: Gregor Pillen Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 ________________________________ Von: gpfsug-discuss im Auftrag von Achim Rehor Gesendet: Donnerstag, 4. Mai 2023 00:00 An: leonardo.sala at psi.ch Cc: gpfsug-discuss at gpfsug.org Betreff: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Dear Leonardo, you will find a description in the Concepts, Planning, and Installation Guide in the GPFS daemon communication section, explaining how the startup mechanism works. The Administration Guide contains an explanation on MROTs specifics for the subnets usage (Chapter 17 in the 5.1.7. version) Chapter 33 focuses on remote cluster mounts and contains examples. Basically, the node join triggers the compare and the matching, thus a client clusters node uses it's subnets configuration (including the remote clusters clustername) to initiate the connection. On the storage cluster you can also diffentiate your existing subnets for use with separate remote mounting clusters. I would recommend still to do it on both, just to be precise. Initially the idea (as can be seen in the examples in Chapter 33) was to force the daemon communication to the storage NSD servers to use the 'high speed' network, rather than the lower bandwidth common admin network. -- Mit freundlichen Gr??en / Kind regards Achim Rehor Technical Support Specialist S?pectrum Scale and ESS (SME) Advisory Product Services Professional IBM Systems Storage Support - EMEA Achim.Rehor at de.ibm.com +49-170- 4521194 IBM Deutschland GmbH -----Original Message----- From: Leonardo Sala To: gpfsug main discussion list , Achim Rehor Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts Date: Wed, 03 May 2023 16:58:12 +0200 Dear Achim, thanks! My point is: in case of a remote cluster mount, e.?g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd #pfptBannerzu381sx { all: revert !important; display: block !important; visibility: visible !important; opacity: 1 !important; background-color: #D0D8DC !important; max-width: none !important; max-height: none !important } .pfptPrimaryButtonzu381sx:hover, .pfptPrimaryButtonzu381sx:focus { background-color: #b4c1c7 !important; } .pfptPrimaryButtonzu381sx:active { background-color: #90a4ae !important; }Dear Achim, thanks! My point is: in case of a remote cluster mount, e.g. CL2 mounting CL1 storage, where should I specify the subnets parameter: 1) on CL2 (client cluster) 2) on CL1 (storage cluster) 3) on both CL1 and CL2 I might have to change this parameter on a production system, and as it needs a restart I would like to be sure I change it only where necessary Thanks again! cheers leo Paul Scherrer Institut Dr. Leonardo Sala Group Leader Data Analysis and Research Infrastructure Deputy Department Head a.i Science IT Infrastructure and Services department Science IT Infrastructure and Services department (AWI) WHGA/036 Forschungstrasse 111 5232 Villigen PSI Switzerland Phone: +41 56 310 3369 leonardo.sala at psi.ch www.psi.ch On 5/3/23 16:40, Achim Rehor wrote: > correct, there is no need to put client and storage into different > subnets, > and it is also not necessary to specify the subnet parameter at all, > when they share the same network. > > The subnets parameter is very helpful, though, if you are using > multiple networks, and want to use specific ones for communication with > one or the other remote cluster. > _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From chair at gpfsug.org Thu May 4 18:08:21 2023 From: chair at gpfsug.org (chair at gpfsug.org) Date: Thu, 04 May 2023 18:08:21 +0100 Subject: [gpfsug-discuss] UK Users Group Meeting June Message-ID: <64c9a1a273ee0b05fd531ebd62cd961d@gpfsug.org> Dear All, We have started to populate the events/presentations for the User Group meeting in June and have some user presentations, however more would be welcome. Regards Paul From leonardo.sala at psi.ch Fri May 5 14:45:06 2023 From: leonardo.sala at psi.ch (Leonardo Sala) Date: Fri, 5 May 2023 15:45:06 +0200 Subject: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts In-Reply-To: <3e6ddb452cec8fa6b62f95dd179dbdd106206dbb.camel@de.ibm.com> References: <47e7d3ec-75a1-e53f-9125-8d5bbe0acaff@psi.ch> <3b437b00-b422-d308-be65-343f5448a4c4@scinet.utoronto.ca> <3e6ddb452cec8fa6b62f95dd179dbdd106206dbb.camel@de.ibm.com> Message-ID: <56ef5d36-5ffd-230c-8044-9a92951895ac@psi.ch> Dear Achim thanks, it is clearer now! I read the docs, but it was not very clear to me - now I understand that it is enough to specify the parameter on the client cluster. Have a nice weekend! leo Paul Scherrer Institut Dr. Leonardo Sala Group Leader Data Analysis and Research Infrastructure Deputy Department Head a.i Science IT Infrastructure and Services department Science IT Infrastructure and Services department (AWI) WHGA/036 Forschungstrasse 111 5232 Villigen PSI Switzerland Phone: +41 56 310 3369 leonardo.sala at psi.ch www.psi.ch On 5/4/23 00:00, Achim Rehor wrote: > Dear Leonardo, > > you will find a description in the Concepts, Planning, and Installation > Guide in the GPFS daemon communication section, explaining how the > startup mechanism works. > The Administration Guide contains an explanation on MROTs specifics for > the subnets usage (Chapter 17 in the 5.1.7. version) > Chapter 33 focuses on remote cluster mounts and contains examples. > > Basically, the node join triggers the compare and the matching, thus a > client clusters node uses it's subnets configuration (including the > remote clusters clustername) to initiate the connection. > On the storage cluster you can also diffentiate your existing subnets > for use with separate remote mounting clusters. I would recommend still > to do it on both, just to be precise. > > Initially the idea (as can be seen in the examples in Chapter 33) was > to force the daemon communication to the storage NSD servers to use the > 'high speed' network, rather than the lower bandwidth common admin > network. > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bbanister at jumptrading.com Fri May 5 19:49:20 2023 From: bbanister at jumptrading.com (Bryan Banister) Date: Fri, 5 May 2023 18:49:20 +0000 Subject: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed In-Reply-To: References: <852d6fde37de92b95917092171e1a008@gpfsug.org> Message-ID: Hello, Any update on when this will be held? -Bryan From: gpfsug-discuss On Behalf Of Dorigo Alvise Sent: Thursday, April 13, 2023 4:16 AM To: Gpfsug Discuss ; gpfsug main discussion list Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed [https://s3.amazonaws.com/staticmediafiles/media/sights/iron-icon-color.png] IRONSCALES couldn't recognize this email as this is the first time you received an email from this sender alvise.dorigo @ psi.ch This message has originated from an EXTERNAL SENDER Good Morning, is there at least an idea about the month when the UK user group meeting will be held ? Thanks a lot, Alvise Dorigo, Paul Scherrer Institut Switzerland ________________________________ From: gpfsug-discuss > on behalf of chair at gpfsug.org > Sent: Friday, March 3, 2023 12:43 PM To: Gpfsug Discuss > Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed Dear All, Due to an issue with the IBM Centre, we have had to postpone the planned meeting in June and will update you with a new date in the near future Sorry for this Regards Paul _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org ________________________________ Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination, or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of transaction of a financial product. Personal data, as defined by applicable data protection and privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for legal, compliance, and/or business-related purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company's treatment of personal data, please email datarequests at jumptrading.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bbanister at jumptrading.com Fri May 5 19:49:20 2023 From: bbanister at jumptrading.com (Bryan Banister) Date: Fri, 5 May 2023 18:49:20 +0000 Subject: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed In-Reply-To: References: <852d6fde37de92b95917092171e1a008@gpfsug.org> Message-ID: Hello, Any update on when this will be held? -Bryan From: gpfsug-discuss On Behalf Of Dorigo Alvise Sent: Thursday, April 13, 2023 4:16 AM To: Gpfsug Discuss ; gpfsug main discussion list Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed [https://s3.amazonaws.com/staticmediafiles/media/sights/iron-icon-color.png] IRONSCALES couldn't recognize this email as this is the first time you received an email from this sender alvise.dorigo @ psi.ch This message has originated from an EXTERNAL SENDER Good Morning, is there at least an idea about the month when the UK user group meeting will be held ? Thanks a lot, Alvise Dorigo, Paul Scherrer Institut Switzerland ________________________________ From: gpfsug-discuss > on behalf of chair at gpfsug.org > Sent: Friday, March 3, 2023 12:43 PM To: Gpfsug Discuss > Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed Dear All, Due to an issue with the IBM Centre, we have had to postpone the planned meeting in June and will update you with a new date in the near future Sorry for this Regards Paul _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org ________________________________ Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination, or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of transaction of a financial product. Personal data, as defined by applicable data protection and privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for legal, compliance, and/or business-related purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company's treatment of personal data, please email datarequests at jumptrading.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: From TROPPENS at de.ibm.com Mon May 8 08:28:00 2023 From: TROPPENS at de.ibm.com (Ulf Troppens) Date: Mon, 8 May 2023 07:28:00 +0000 Subject: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed In-Reply-To: References: <852d6fde37de92b95917092171e1a008@gpfsug.org> Message-ID: Hi Bryan, hope to see you there: https://www.spectrumscaleug.org/event/spectrum-scale-user-group-london-tuesday-27th-june-wedensday-28th-june/ Best, Ulf Ulf Troppens Senior Technical Staff Member Spectrum Scale Development IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Gregor Pillen / Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: gpfsug-discuss On Behalf Of Bryan Banister Sent: Friday, May 5, 2023 20:49 To: gpfsug main discussion list ; Gpfsug Discuss Subject: [EXTERNAL] Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed Hello, Any update on when this will be held? -Bryan From: gpfsug-discuss On Behalf Of Dorigo Alvise Sent: Thursday, April 13, 2023 4:?16 AM To: Gpfsug Discuss ; ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hello, Any update on when this will be held? -Bryan From: gpfsug-discuss > On Behalf Of Dorigo Alvise Sent: Thursday, April 13, 2023 4:16 AM To: Gpfsug Discuss >; gpfsug main discussion list > Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed [https://s3.amazonaws.com/staticmediafiles/media/sights/iron-icon-color.png] IRONSCALES couldn't recognize this email as this is the first time you received an email from this sender alvise.dorigo @ psi.ch This message has originated from an EXTERNAL SENDER Good Morning, is there at least an idea about the month when the UK user group meeting will be held ? Thanks a lot, Alvise Dorigo, Paul Scherrer Institut Switzerland ________________________________ From: gpfsug-discuss > on behalf of chair at gpfsug.org > Sent: Friday, March 3, 2023 12:43 PM To: Gpfsug Discuss > Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed Dear All, Due to an issue with the IBM Centre, we have had to postpone the planned meeting in June and will update you with a new date in the near future Sorry for this Regards Paul _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org ________________________________ Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination, or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of transaction of a financial product. Personal data, as defined by applicable data protection and privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for legal, compliance, and/or business-related purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company?s treatment of personal data, please email datarequests at jumptrading.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: From TROPPENS at de.ibm.com Mon May 8 08:28:00 2023 From: TROPPENS at de.ibm.com (Ulf Troppens) Date: Mon, 8 May 2023 07:28:00 +0000 Subject: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed In-Reply-To: References: <852d6fde37de92b95917092171e1a008@gpfsug.org> Message-ID: Hi Bryan, hope to see you there: https://www.spectrumscaleug.org/event/spectrum-scale-user-group-london-tuesday-27th-june-wedensday-28th-june/ Best, Ulf Ulf Troppens Senior Technical Staff Member Spectrum Scale Development IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Gregor Pillen / Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: gpfsug-discuss On Behalf Of Bryan Banister Sent: Friday, May 5, 2023 20:49 To: gpfsug main discussion list ; Gpfsug Discuss Subject: [EXTERNAL] Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed Hello, Any update on when this will be held? -Bryan From: gpfsug-discuss On Behalf Of Dorigo Alvise Sent: Thursday, April 13, 2023 4:?16 AM To: Gpfsug Discuss ; ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hello, Any update on when this will be held? -Bryan From: gpfsug-discuss > On Behalf Of Dorigo Alvise Sent: Thursday, April 13, 2023 4:16 AM To: Gpfsug Discuss >; gpfsug main discussion list > Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed [https://s3.amazonaws.com/staticmediafiles/media/sights/iron-icon-color.png] IRONSCALES couldn't recognize this email as this is the first time you received an email from this sender alvise.dorigo @ psi.ch This message has originated from an EXTERNAL SENDER Good Morning, is there at least an idea about the month when the UK user group meeting will be held ? Thanks a lot, Alvise Dorigo, Paul Scherrer Institut Switzerland ________________________________ From: gpfsug-discuss > on behalf of chair at gpfsug.org > Sent: Friday, March 3, 2023 12:43 PM To: Gpfsug Discuss > Subject: Re: [gpfsug-discuss] GPFS UK Meeting Wednesday 21st June - Thursday 22nd June 2023 - Postponed Dear All, Due to an issue with the IBM Centre, we have had to postpone the planned meeting in June and will update you with a new date in the near future Sorry for this Regards Paul _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org ________________________________ Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination, or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of transaction of a financial product. Personal data, as defined by applicable data protection and privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for legal, compliance, and/or business-related purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company?s treatment of personal data, please email datarequests at jumptrading.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: From TROPPENS at de.ibm.com Tue May 16 15:57:43 2023 From: TROPPENS at de.ibm.com (Ulf Troppens) Date: Tue, 16 May 2023 14:57:43 +0000 Subject: [gpfsug-discuss] Storage Scale User Meeting at ISC 2023 In-Reply-To: References: Message-ID: Here is the agenda for the Storage Scale User Group Meeting along ISC next week. Date: Mon, 22. May 2023 - 13:00-17:00 CET Local time | Hotel Reichshof The User Meeting is face-to-face only. There is no ISC conference pass required. To register for the event, please send an email with your name and your company/organization name to IBMStorageScale at ibm.com. NDA's have to be signed when entering the meeting room as roadmap items are discussed. A non-confidential version of the charts will be made available after the event. Agenda 13:00 Registration an Networking 13:30 Welcome 13:40 What is new in Storage Scale and ESS? 14:05 Lightning talks with selected product updates and potential future enhancements 14:45 DESY - Site Update 15:05 - Break - 15:25 Sponsor Talk: High-performance SMB service with Tuxera Fusion File Share and IBM Storage Scale 15:45 University of Queensland - Site Update 16:30 Performance Update 16:55 Wrap-up 17:00 Get Together Looking forward to see many of you there. Ulf Troppens Senior Technical Staff Member Spectrum Scale Development IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Gregor Pillen / Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: gpfsug-discuss On Behalf Of Ulf Troppens Sent: Wednesday, April 19, 2023 14:42 To: gpfsug-discuss at spectrumscaleug.org Subject: [EXTERNAL] [gpfsug-discuss] Storage Scale User Meeting at ISC 2023 Greetings, IBM is organizing a Storage Scale User Meeting at ISC 2023. We have an exciting agenda covering user stories, roadmap update, insights into potential future product enhancements, plus access to IBM experts and your peers. We look ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Greetings, IBM is organizing a Storage Scale User Meeting at ISC 2023. We have an exciting agenda covering user stories, roadmap update, insights into potential future product enhancements, plus access to IBM experts and your peers. We look forward to welcoming you to this event. The user meeting is followed by a Get Together to continue the discussion. Date: Mon, 22. May 2023 - 13:00-17:00 CET Local time | Hotel Reichshof Please check the event page for agenda details and registration: https://www.spectrumscaleug.org/event/storage-scale-user-meeting-at-isc-2023/ Ulf Troppens Senior Technical Staff Member Spectrum Scale Development IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Gregor Pillen / Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 -------------- next part -------------- An HTML attachment was scrubbed... URL: From TROPPENS at de.ibm.com Tue May 16 15:57:43 2023 From: TROPPENS at de.ibm.com (Ulf Troppens) Date: Tue, 16 May 2023 14:57:43 +0000 Subject: [gpfsug-discuss] Storage Scale User Meeting at ISC 2023 In-Reply-To: References: Message-ID: Here is the agenda for the Storage Scale User Group Meeting along ISC next week. Date: Mon, 22. May 2023 - 13:00-17:00 CET Local time | Hotel Reichshof The User Meeting is face-to-face only. There is no ISC conference pass required. To register for the event, please send an email with your name and your company/organization name to IBMStorageScale at ibm.com. NDA's have to be signed when entering the meeting room as roadmap items are discussed. A non-confidential version of the charts will be made available after the event. Agenda 13:00 Registration an Networking 13:30 Welcome 13:40 What is new in Storage Scale and ESS? 14:05 Lightning talks with selected product updates and potential future enhancements 14:45 DESY - Site Update 15:05 - Break - 15:25 Sponsor Talk: High-performance SMB service with Tuxera Fusion File Share and IBM Storage Scale 15:45 University of Queensland - Site Update 16:30 Performance Update 16:55 Wrap-up 17:00 Get Together Looking forward to see many of you there. Ulf Troppens Senior Technical Staff Member Spectrum Scale Development IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Gregor Pillen / Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 From: gpfsug-discuss On Behalf Of Ulf Troppens Sent: Wednesday, April 19, 2023 14:42 To: gpfsug-discuss at spectrumscaleug.org Subject: [EXTERNAL] [gpfsug-discuss] Storage Scale User Meeting at ISC 2023 Greetings, IBM is organizing a Storage Scale User Meeting at ISC 2023. We have an exciting agenda covering user stories, roadmap update, insights into potential future product enhancements, plus access to IBM experts and your peers. We look ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Greetings, IBM is organizing a Storage Scale User Meeting at ISC 2023. We have an exciting agenda covering user stories, roadmap update, insights into potential future product enhancements, plus access to IBM experts and your peers. We look forward to welcoming you to this event. The user meeting is followed by a Get Together to continue the discussion. Date: Mon, 22. May 2023 - 13:00-17:00 CET Local time | Hotel Reichshof Please check the event page for agenda details and registration: https://www.spectrumscaleug.org/event/storage-scale-user-meeting-at-isc-2023/ Ulf Troppens Senior Technical Staff Member Spectrum Scale Development IBM Deutschland Research & Development GmbH Vorsitzender des Aufsichtsrats: Gregor Pillen / Gesch?ftsf?hrung: David Faller Sitz der Gesellschaft: B?blingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmagda+gpfs at ee.torontomu.ca Fri May 19 17:03:57 2023 From: dmagda+gpfs at ee.torontomu.ca (David Magda) Date: Fri, 19 May 2023 12:03:57 -0400 Subject: [gpfsug-discuss] SNMP monitoring Message-ID: Hello, Is anyone using SNMP monitoring as described in: https://www.ibm.com/docs/en/storage-scale/5.1.3?topic=monitoring-gpfs-snmp-support I believe I?ve followed the instructions correctly in setting up snmpd on my RHEL8 storage servers correctly: an ?snmptranslate -IR gpfsCluserName? gives back the MIB and ?-On? gives back the OID; an ?snmpget hrSystemUptime? gives back a proper uptime response. But a ?snmpget ? gpfsCluserName?? gives back an ?No such object at this OID?. Both snmpd and mmsnmpagentd are running, and in mmfs.log I see ?AgentX subagent connected?. In case it matters: there is a complaint about no libwrap.so, but that no longer comes with RHEL8. This is for 5.1.3 Erasure Code. (Poking around there are RPMs with ?pmcollections? and ?pmsensors? in the name, and we do not have those installed.) Thanks for any info. Regards, David From jonathan.buzzard at strath.ac.uk Sun May 21 21:52:35 2023 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Sun, 21 May 2023 21:52:35 +0100 Subject: [gpfsug-discuss] RHEL7 support Message-ID: <2c4ce476-4da4-6c8d-5314-41fe869a3d89@strath.ac.uk> I am looking at the tasks for the next year in removing our last RHEL7/CentOS7 installs and am wondering if it is planned for GPFS support to continue to the end of RHEL7 support? I have a recollection that GPFS support for RHEL6 stopped before the end of support for RHEL6, and if the same is going to happen with RHEL7 I would help to know for scheduling things over the next 12 months. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From anacreo at gmail.com Tue May 23 04:16:37 2023 From: anacreo at gmail.com (Alec) Date: Mon, 22 May 2023 23:16:37 -0400 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM Message-ID: Hello we are being asked to support TLS 1.3 in our configuration. Can I ask that folks upvote this RFE to help get it addressed? https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 Alec -------------- next part -------------- An HTML attachment was scrubbed... URL: From novosirj at rutgers.edu Tue May 23 20:22:39 2023 From: novosirj at rutgers.edu (Ryan Novosielski) Date: Tue, 23 May 2023 19:22:39 +0000 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: References: Message-ID: There?s very little detail there. Can you elaborate on what this is actually for/where it is used in GPFS? -- #BlackLivesMatter ____ || \\UTGERS, |---------------------------*O*--------------------------- ||_// the State | Ryan Novosielski - novosirj at rutgers.edu || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus || \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark `' On May 22, 2023, at 23:16, Alec wrote: Hello we are being asked to support TLS 1.3 in our configuration. Can I ask that folks upvote this RFE to help get it addressed? https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 Alec _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From anacreo at gmail.com Tue May 23 21:31:08 2023 From: anacreo at gmail.com (Alec) Date: Tue, 23 May 2023 16:31:08 -0400 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: References: Message-ID: For GPFS encryption we use an IBM SKLM (Key Server) and it uses SSL certificates for that communication. The SKLM server needs to provide / use TLS 1.3 SSL to pass our security standards but GPFS doesn't state it will support that. Alec On Tue, May 23, 2023, 3:25 PM Ryan Novosielski wrote: > There?s very little detail there. Can you elaborate on what this is > actually for/where it is used in GPFS? > > -- > #BlackLivesMatter > ____ > || \\UTGERS, |---------------------------*O*--------------------------- > ||_// the State | Ryan Novosielski - novosirj at rutgers.edu > || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus > || \\ of NJ | Office of Advanced Research Computing - MSB > A555B, Newark > `' > > On May 22, 2023, at 23:16, Alec wrote: > > Hello we are being asked to support TLS 1.3 in our configuration. > > Can I ask that folks upvote this RFE to help get it addressed? > > > https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 > > Alec > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > -------------- next part -------------- An HTML attachment was scrubbed... URL: From novosirj at rutgers.edu Tue May 23 21:49:29 2023 From: novosirj at rutgers.edu (Ryan Novosielski) Date: Tue, 23 May 2023 20:49:29 +0000 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: References: Message-ID: <335C1C87-141D-4624-857A-47ABA9A2ED05@rutgers.edu> Thanks! We don?t use encryption, which is I suppose why I was unfamiliar. Happy to vote for it though. On May 23, 2023, at 16:31, Alec wrote: For GPFS encryption we use an IBM SKLM (Key Server) and it uses SSL certificates for that communication. The SKLM server needs to provide / use TLS 1.3 SSL to pass our security standards but GPFS doesn't state it will support that. Alec On Tue, May 23, 2023, 3:25 PM Ryan Novosielski > wrote: There?s very little detail there. Can you elaborate on what this is actually for/where it is used in GPFS? -- #BlackLivesMatter ____ || \\UTGERS, |---------------------------*O*--------------------------- ||_// the State | Ryan Novosielski - novosirj at rutgers.edu || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus || \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark `' On May 22, 2023, at 23:16, Alec > wrote: Hello we are being asked to support TLS 1.3 in our configuration. Can I ask that folks upvote this RFE to help get it addressed? https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 Alec _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From anacreo at gmail.com Tue May 23 22:23:19 2023 From: anacreo at gmail.com (Alec) Date: Tue, 23 May 2023 17:23:19 -0400 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: <335C1C87-141D-4624-857A-47ABA9A2ED05@rutgers.edu> References: <335C1C87-141D-4624-857A-47ABA9A2ED05@rutgers.edu> Message-ID: For those who don't use GPFS encryption. I can say the GPFS version is fantastic. Our write performance was nominally faster due to the compression of encryption I suppose. But it works flawlessly and at speed. Alec On Tue, May 23, 2023, 4:51 PM Ryan Novosielski wrote: > Thanks! > > We don?t use encryption, which is I suppose why I was unfamiliar. Happy to > vote for it though. > > On May 23, 2023, at 16:31, Alec wrote: > > For GPFS encryption we use an IBM SKLM (Key Server) and it uses SSL > certificates for that communication. The SKLM server needs to provide / > use TLS 1.3 SSL to pass our security standards but GPFS doesn't state it > will support that. > > Alec > > On Tue, May 23, 2023, 3:25 PM Ryan Novosielski > wrote: > >> There?s very little detail there. Can you elaborate on what this is >> actually for/where it is used in GPFS? >> >> -- >> #BlackLivesMatter >> ____ >> || \\UTGERS, >> |---------------------------*O*--------------------------- >> ||_// the State | Ryan Novosielski - novosirj at rutgers.edu >> || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ >> RBHS Campus >> || \\ of NJ | Office of Advanced Research Computing - MSB >> A555B, Newark >> `' >> >> On May 22, 2023, at 23:16, Alec wrote: >> >> Hello we are being asked to support TLS 1.3 in our configuration. >> >> Can I ask that folks upvote this RFE to help get it addressed? >> >> >> https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 >> >> Alec >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at gpfsug.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org >> >> >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at gpfsug.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org >> > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > -------------- next part -------------- An HTML attachment was scrubbed... URL: From novosirj at rutgers.edu Tue May 23 22:27:23 2023 From: novosirj at rutgers.edu (Ryan Novosielski) Date: Tue, 23 May 2023 21:27:23 +0000 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: References: <335C1C87-141D-4624-857A-47ABA9A2ED05@rutgers.edu> Message-ID: We looked into it, but couldn?t afford the licenses. As it stands now, our ?standard? licenses (or the Lenovo equivalent ? data management, or data access? I forget) are apparently about to double in price. Glad to hear that if something changed in that area, it works well. On May 23, 2023, at 17:23, Alec wrote: For those who don't use GPFS encryption. I can say the GPFS version is fantastic. Our write performance was nominally faster due to the compression of encryption I suppose. But it works flawlessly and at speed. Alec On Tue, May 23, 2023, 4:51 PM Ryan Novosielski > wrote: Thanks! We don?t use encryption, which is I suppose why I was unfamiliar. Happy to vote for it though. On May 23, 2023, at 16:31, Alec > wrote: For GPFS encryption we use an IBM SKLM (Key Server) and it uses SSL certificates for that communication. The SKLM server needs to provide / use TLS 1.3 SSL to pass our security standards but GPFS doesn't state it will support that. Alec On Tue, May 23, 2023, 3:25 PM Ryan Novosielski > wrote: There?s very little detail there. Can you elaborate on what this is actually for/where it is used in GPFS? -- #BlackLivesMatter ____ || \\UTGERS, |---------------------------*O*--------------------------- ||_// the State | Ryan Novosielski - novosirj at rutgers.edu || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus || \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark `' On May 22, 2023, at 23:16, Alec > wrote: Hello we are being asked to support TLS 1.3 in our configuration. Can I ask that folks upvote this RFE to help get it addressed? https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 Alec _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From anacreo at gmail.com Tue May 23 23:53:48 2023 From: anacreo at gmail.com (Alec) Date: Tue, 23 May 2023 18:53:48 -0400 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: References: <335C1C87-141D-4624-857A-47ABA9A2ED05@rutgers.edu> Message-ID: I'm not sure what it costs.. but I can say for sure that if it's properly leveraged the money it saves on hardware can be exceptional. I don't know how to put a value on a technology that has remained the best solution for so long... We haven't had to reengineer anything to remain top dog on so many metrics (availability, throughput, enterprise standards, backups, failover, etc....) So don't think about the line item cost think of the cost per user, gb, Gbps, whatever makes you happy to pay it. ????????? Alec On Tue, May 23, 2023, 5:29 PM Ryan Novosielski wrote: > We looked into it, but couldn?t afford the licenses. As it stands now, our > ?standard? licenses (or the Lenovo equivalent ? data management, or data > access? I forget) are apparently about to double in price. Glad to hear > that if something changed in that area, it works well. > > On May 23, 2023, at 17:23, Alec wrote: > > For those who don't use GPFS encryption. I can say the GPFS version is > fantastic. Our write performance was nominally faster due to the > compression of encryption I suppose. But it works flawlessly and at speed. > > Alec > > On Tue, May 23, 2023, 4:51 PM Ryan Novosielski > wrote: > >> Thanks! >> >> We don?t use encryption, which is I suppose why I was unfamiliar. Happy >> to vote for it though. >> >> On May 23, 2023, at 16:31, Alec wrote: >> >> For GPFS encryption we use an IBM SKLM (Key Server) and it uses SSL >> certificates for that communication. The SKLM server needs to provide / >> use TLS 1.3 SSL to pass our security standards but GPFS doesn't state it >> will support that. >> >> Alec >> >> On Tue, May 23, 2023, 3:25 PM Ryan Novosielski >> wrote: >> >>> There?s very little detail there. Can you elaborate on what this is >>> actually for/where it is used in GPFS? >>> >>> -- >>> #BlackLivesMatter >>> ____ >>> || \\UTGERS, >>> |---------------------------*O*--------------------------- >>> ||_// the State | Ryan Novosielski - novosirj at rutgers.edu >>> || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ >>> RBHS Campus >>> || \\ of NJ | Office of Advanced Research Computing - MSB >>> A555B, Newark >>> `' >>> >>> On May 22, 2023, at 23:16, Alec wrote: >>> >>> Hello we are being asked to support TLS 1.3 in our configuration. >>> >>> Can I ask that folks upvote this RFE to help get it addressed? >>> >>> >>> https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 >>> >>> Alec >>> _______________________________________________ >>> gpfsug-discuss mailing list >>> gpfsug-discuss at gpfsug.org >>> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org >>> >>> >>> _______________________________________________ >>> gpfsug-discuss mailing list >>> gpfsug-discuss at gpfsug.org >>> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org >>> >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at gpfsug.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org >> >> >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at gpfsug.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org >> > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ewahl at osc.edu Wed May 24 17:31:06 2023 From: ewahl at osc.edu (Wahl, Edward) Date: Wed, 24 May 2023 16:31:06 +0000 Subject: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM In-Reply-To: References: <335C1C87-141D-4624-857A-47ABA9A2ED05@rutgers.edu> Message-ID: Do not forget, There ARE some limitations to using encryption with GPFS. Example: Using GPFS encryption means you lose the ability to put small files into the inode space (a HUGE speed increase normally) and HAWC (highly available write cache) and I thought LROC, but I could be wrong about that last one as it?s been a while since I read about that. Scale still uses a primary/backup method for encryption access which I dislike. I would LOVE if it had options such as round robin or other method (random,etc). And their ?hey, just change up the order in the config file on your nodes? isn?t simple at Scale if you use methods like NFS root or other stateless setups for moderate to large numbers of compute clients. And lastly I REALLY REALLY REALLY hate that SKLM has dumped their command line for REST only access, and is also switching from PVUs to a capacity based-style license. Just my .02 Ed Wahl Ohio Supercomputer Center From: gpfsug-discuss On Behalf Of Alec Sent: Tuesday, May 23, 2023 6:54 PM To: gpfsug main discussion list Subject: Re: [gpfsug-discuss] Support for TLS 1.3 to work with SKLM I'm not sure what it costs.?. but I can say for sure that if it's properly leveraged the money it saves on hardware can be exceptional. I don't know how to put a value on a technology that has remained the best solution for so long.?.?.? I'm not sure what it costs.. but I can say for sure that if it's properly leveraged the money it saves on hardware can be exceptional. I don't know how to put a value on a technology that has remained the best solution for so long... We haven't had to reengineer anything to remain top dog on so many metrics (availability, throughput, enterprise standards, backups, failover, etc....) So don't think about the line item cost think of the cost per user, gb, Gbps, whatever makes you happy to pay it. ????????? Alec On Tue, May 23, 2023, 5:29 PM Ryan Novosielski > wrote: We looked into it, but couldn?t afford the licenses. As it stands now, our ?standard? licenses (or the Lenovo equivalent ? data management, or data access? I forget) are apparently about to double in price. Glad to hear that if something changed in that area, it works well. On May 23, 2023, at 17:23, Alec > wrote: For those who don't use GPFS encryption. I can say the GPFS version is fantastic. Our write performance was nominally faster due to the compression of encryption I suppose. But it works flawlessly and at speed. Alec On Tue, May 23, 2023, 4:51 PM Ryan Novosielski > wrote: Thanks! We don?t use encryption, which is I suppose why I was unfamiliar. Happy to vote for it though. On May 23, 2023, at 16:31, Alec > wrote: For GPFS encryption we use an IBM SKLM (Key Server) and it uses SSL certificates for that communication. The SKLM server needs to provide / use TLS 1.3 SSL to pass our security standards but GPFS doesn't state it will support that. Alec On Tue, May 23, 2023, 3:25 PM Ryan Novosielski > wrote: There?s very little detail there. Can you elaborate on what this is actually for/where it is used in GPFS? -- #BlackLivesMatter ____ || \\UTGERS, |---------------------------*O*--------------------------- ||_// the State | Ryan Novosielski - novosirj at rutgers.edu || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus || \\ of NJ | Office of Advanced Research Computing - MSB A555B, Newark `' On May 22, 2023, at 23:16, Alec > wrote: Hello we are being asked to support TLS 1.3 in our configuration. Can I ask that folks upvote this RFE to help get it addressed? https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-964 Alec _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From cal.sawyer at outlook.com Fri May 26 07:10:13 2023 From: cal.sawyer at outlook.com (C Sawyer) Date: Fri, 26 May 2023 06:10:13 +0000 Subject: [gpfsug-discuss] GPFS UK Meeting 27,28th June, 2023 - online? In-Reply-To: References: Message-ID: Hello Is there any chance the SSUG presentations will be viewable online in realtime? Cal Sawyer Manager, HPC Platforms Queen Mary, University of London From ivano.talamo at psi.ch Tue May 30 14:55:25 2023 From: ivano.talamo at psi.ch (Talamo Ivano Giuseppe) Date: Tue, 30 May 2023 13:55:25 +0000 Subject: [gpfsug-discuss] List of deleted files via policies Message-ID: Hello everyone, I am currently looking for the most efficient way to get a list of all deleted files since time T. So far the best I could come to is to create a snapshot at time T, generate two lists via policies, one for the files inside the .snapshots dir, one for the current filesystem, and compare the two with standard diff command. But I was wondering if is there any smarter way with policies only. Thanks, Ivano __________________________________________ Paul Scherrer Institut Ivano Talamo WHGA/038 Forschungsstrasse 111 5232 Villigen PSI Schweiz Phone: +41 56 310 47 11 E-Mail: ivano.talamo at psi.ch -------------- next part -------------- An HTML attachment was scrubbed... URL: From luis.bolinches at fi.ibm.com Tue May 30 15:27:47 2023 From: luis.bolinches at fi.ibm.com (Luis Bolinches) Date: Tue, 30 May 2023 14:27:47 +0000 Subject: [gpfsug-discuss] List of deleted files via policies In-Reply-To: References: Message-ID: Hi What you are doing is not wrong, of course create and delete snaps is not free. If you are using mmbackup you could leverage the shadow DB but running the command before the next mmbackup with ?preview candidates and see the expires there. Never tried but in my head works ? as so many other things that end up not, but worth the try as you then get free of jail from snaps. If you are doing snaps anyway due some other reasons then maybe is not worth the try to go mmbackup. -- Yst?v?llisin terveisin/Regards/Saludos/Salutations/Salutacions Luis Bolinches Executive IT Specialist IBM Storage Scale development Phone: +358503112585 Ab IBM Finland Oy Toinen linja 7 00530 Helsinki Uusimaa - Finland Visitors entrance: Siltasaarenkatu 22 "If you always give you will always have" -- Anonymous https://www.credly.com/users/luis-bolinches/badges From: gpfsug-discuss On Behalf Of Talamo Ivano Giuseppe Sent: Tuesday, 30 May 2023 16.55 To: gpfsug-discuss at gpfsug.org Subject: [EXTERNAL] [gpfsug-discuss] List of deleted files via policies Hello everyone, I am currently looking for the most efficient way to get a list of all deleted files since time T. So far the best I could come to is to create a snapshot at time T, generate two lists via policies, one for the files inside ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hello everyone, I am currently looking for the most efficient way to get a list of all deleted files since time T. So far the best I could come to is to create a snapshot at time T, generate two lists via policies, one for the files inside the .snapshots dir, one for the current filesystem, and compare the two with standard diff command. But I was wondering if is there any smarter way with policies only. Thanks, Ivano __________________________________________ Paul Scherrer Institut Ivano Talamo WHGA/038 Forschungsstrasse 111 5232 Villigen PSI Schweiz Phone: +41 56 310 47 11 E-Mail: ivano.talamo at psi.ch Unless otherwise stated above: Oy IBM Finland Ab PL 265, 00101 Helsinki, Finland Business ID, Y-tunnus: 0195876-3 Registered in Finland -------------- next part -------------- An HTML attachment was scrubbed... URL: From stockf at us.ibm.com Tue May 30 16:25:03 2023 From: stockf at us.ibm.com (Frederick Stock) Date: Tue, 30 May 2023 15:25:03 +0000 Subject: [gpfsug-discuss] List of deleted files via policies In-Reply-To: References: Message-ID: I am not sure this will work, since I have never tried it, but perhaps you could enable file audit logging (FAL) and track only file deletions. Presumably you could then search through the FAL log for deletions after time T. This does of course require that you use the DME or Advanced version of Scale, and that you setup FAL. Fred Fred Stock, Spectrum Scale Development Advocacy stockf at us.ibm.com | 720-430-8821 From: gpfsug-discuss on behalf of Luis Bolinches Date: Tuesday, May 30, 2023 at 10:32 AM To: gpfsug main discussion list Subject: [EXTERNAL] Re: [gpfsug-discuss] List of deleted files via policies Hi What you are doing is not wrong, of course create and delete snaps is not free. If you are using mmbackup you could leverage the shadow DB but running the command before the next mmbackup with ?preview candidates and see the expires there.? ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi What you are doing is not wrong, of course create and delete snaps is not free. If you are using mmbackup you could leverage the shadow DB but running the command before the next mmbackup with ?preview candidates and see the expires there. Never tried but in my head works ? as so many other things that end up not, but worth the try as you then get free of jail from snaps. If you are doing snaps anyway due some other reasons then maybe is not worth the try to go mmbackup. -- Yst?v?llisin terveisin/Regards/Saludos/Salutations/Salutacions Luis Bolinches Executive IT Specialist IBM Storage Scale development Phone: +358503112585 Ab IBM Finland Oy Toinen linja 7 00530 Helsinki Uusimaa - Finland Visitors entrance: Siltasaarenkatu 22 "If you always give you will always have" -- Anonymous https://www.credly.com/users/luis-bolinches/badges From: gpfsug-discuss On Behalf Of Talamo Ivano Giuseppe Sent: Tuesday, 30 May 2023 16.55 To: gpfsug-discuss at gpfsug.org Subject: [EXTERNAL] [gpfsug-discuss] List of deleted files via policies Hello everyone, I am currently looking for the most efficient way to get a list of all deleted files since time T. So far the best I could come to is to create a snapshot at time T, generate two lists via policies, one for the files inside ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hello everyone, I am currently looking for the most efficient way to get a list of all deleted files since time T. So far the best I could come to is to create a snapshot at time T, generate two lists via policies, one for the files inside the .snapshots dir, one for the current filesystem, and compare the two with standard diff command. But I was wondering if is there any smarter way with policies only. Thanks, Ivano __________________________________________ Paul Scherrer Institut Ivano Talamo WHGA/038 Forschungsstrasse 111 5232 Villigen PSI Schweiz Phone: +41 56 310 47 11 E-Mail: ivano.talamo at psi.ch Unless otherwise stated above: Oy IBM Finland Ab PL 265, 00101 Helsinki, Finland Business ID, Y-tunnus: 0195876-3 Registered in Finland -------------- next part -------------- An HTML attachment was scrubbed... URL: From anacreo at gmail.com Tue May 30 17:33:25 2023 From: anacreo at gmail.com (Alec) Date: Tue, 30 May 2023 12:33:25 -0400 Subject: [gpfsug-discuss] List of deleted files via policies In-Reply-To: References: Message-ID: I do something where I make sure all my files are in my backup server... So I will pull the full index from the backup server... And I will use a generated list of files on the file system... Using a GPFS policy... And pulling indexes and comparing about 1.3 million files on both sides of the diff takes about 3 minutes. The sorts takes a bit of time but the whole thing runs in 6 minutes as I run both sorts and pulls in parallel. So I would recommend just generating the file listing using a mmfind or an apply policy at time of snapshot and doing it again at a different time and just running a diff command to find missing entries. Depending on the amount of data you could probably combine the date and inode into a single field and only sort those and compare then join the filename using the inode.. depends on how big your filesystem index would be. Good luck on this one. But it is very nice to know every morning which 16 files out of millions aren't in the backup because their filenames are too crazy.. lol Alec On Tue, May 30, 2023, 9:57 AM Talamo Ivano Giuseppe wrote: > Hello everyone, > > I am currently looking for the most efficient way to get a list of all > deleted files since time T. > So far the best I could come to is to create a snapshot at time T, > generate two lists via policies, one for the files inside the .snapshots > dir, one for the current filesystem, and compare the two with standard diff > command. > But I was wondering if is there any smarter way with policies only. > > Thanks, > Ivano > > __________________________________________ > Paul Scherrer Institut > Ivano Talamo > WHGA/038 > Forschungsstrasse 111 > 5232 Villigen PSI > Schweiz > > Phone: +41 56 310 47 11 > E-Mail: ivano.talamo at psi.ch > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > -------------- next part -------------- An HTML attachment was scrubbed... URL: