From jpr9c at virginia.edu Tue Oct 4 15:49:11 2022 From: jpr9c at virginia.edu (Ruffner, Scott (jpr9c)) Date: Tue, 4 Oct 2022 14:49:11 +0000 Subject: [gpfsug-discuss] SC 22 User Group meeting? Message-ID: I see the announcement that there will be a meeting in Dallas from 12:00-18:00 (GMT? really?) on 11/13 but no venue and no registration option (although the website indicates registration is required). Does anyone know if there are further details and if this is really happening? Best, Scott Ruffner -- Director of Infrastructure Services Research Computing University of Virginia From kraemerf at de.ibm.com Thu Oct 6 10:55:34 2022 From: kraemerf at de.ibm.com (Frank Kraemer) Date: Thu, 6 Oct 2022 09:55:34 +0000 Subject: [gpfsug-discuss] Tipp: IBM PREVAIL 2022: AVAILABILITY, PERFORMANCE, SECURITY AND TESTING Message-ID: IBM PREVAIL 2022: AVAILABILITY, PERFORMANCE, SECURITY AND TESTING Registration is now open. Register (free) by going to PREVAIL 2022 Conference Registration. https://www.ibm.com/blogs/academy-of-technology/events/ Oct 17th 2022 - 17:00-18:00 Session 10B LOCATION: Virtual Room B Greg Mewhinney and Paul Mazzurana Spectrum Scale on IBM Cloud PRESENTER: Greg Mewhinney ABSTRACT: The IBM Cloud Workload Engineering Services team partnered with the Spectrum Scale development team earlier this year to bring a high performance resilient distributed storage offering to IBM Cloud that leverages Spectrum Scale. From a tile in the IBM Cloud catalog, our customers can fill out a configuration page specifying the parameters of their desired storage and compute clusters. Click start, and set into motion a large, concerted effort that uses IBM Cloud Schematics, Terraform and Ansible to deploy and configure a multitude of IBM Cloud VPC resources, that will, in less than an hour, culminate in cloud based high performance parallel filesystem storage and compute clusters that are ready to run. In this talk we will lift the curtain and describe what is going on behind the scenes to prepare the cluster and how performance measurements and optimizations have shaped this offering. We will explain and give examples of how we process, organize and analyze Terraform logs to understand a provisioning process that can include up to 100 simultaneous tasks. We will use this data to show how we can separate the consequential processes that require synchronization delays from those whose runtime is masked by longer running processes. After explaining the analysis and optimizations applied to cluster creation, we will shift gears and cover the important details of the storage cluster?s runtime performance. We will tour the hardware showing how we build a performance picture piece by piece. Measuring IOPS and throughput on raw disks, checking that the network links meet their advertised throughput, and making sure the numbers add up at every step before concluding with a detailed discussion of the stunning performance numbers that can be achieved by employing IBM Cloud bare metal hosts with NVMe storage in our Spectrum Scale filesystem. Frank Kraemer IBM Senior Technical Specialist Wilhelm-Fay-Str. 34, 65936 Frankfurt, Germany mailto:kraemerf at de.ibm.com Mobile +49171-3043699 IBM Germany -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5355 bytes Desc: not available URL: From bbanister at jumptrading.com Fri Oct 7 16:49:12 2022 From: bbanister at jumptrading.com (Bryan Banister) Date: Fri, 7 Oct 2022 15:49:12 +0000 Subject: [gpfsug-discuss] GPFS User Group at SC22? Message-ID: Hey GPFS UG, The SC 22 conference is fast approaching, and schedules/planning is underway. Will there be a GPFS UG on Sunday the 13th per usual? Please send out a save the date/time for this meeting. Thanks, -Bryan ________________________________ Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination, or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of transaction of a financial product. Personal data, as defined by applicable data protection and privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for legal, compliance, and/or business-related purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company's treatment of personal data, please email datarequests at jumptrading.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: From l.r.sudbery at bham.ac.uk Thu Oct 13 11:18:47 2022 From: l.r.sudbery at bham.ac.uk (Luke Sudbery) Date: Thu, 13 Oct 2022 10:18:47 +0000 Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled Message-ID: IBM Spectrum Scale : Node crashes after upgrading to V5.1.2+ with msgqueue enabled https://www.ibm.com/support/pages/node/6824149?myns=s033&mynp=OCSTXKQY&mync=E&cm_sp=s033-_-OCSTXKQY-_-E says: A node crash can occur due to resource exhaustion after upgrading to V5.1.2.0 or higher with msgqueue enabled. This affects all upgraded nodes until the filesystem version is moved to V5.1.2.0+ (mmchfs -V) and the migration off msgqueue occurs (mmmsgqueue config --remove-msgqueue). My emphasis on and. But also says: This issue will affect all versions mentioned above until msgqueue is disabled across the cluster. So it's not entirely clear whether you have to just update client version, update the filesystem version or disable msgqueue or do all 3 to fix it... Can an IBMer clarify? Many thanks, Luke -- Luke Sudbery Principal Engineer (HPC and Storage). Architecture, Infrastructure and Systems Advanced Research Computing, IT Services Room 132, Computer Centre G5, Elms Road Please note I don't work on Monday. -------------- next part -------------- An HTML attachment was scrubbed... URL: From ewahl at osc.edu Thu Oct 13 17:28:26 2022 From: ewahl at osc.edu (Wahl, Edward) Date: Thu, 13 Oct 2022 16:28:26 +0000 Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled In-Reply-To: References: Message-ID: I?ll just toss in here that efixes for this issue are available. As we?re in the tail end of a large data transition and cannot go to LATEST yet, we?re running some efixes for this and they do work. However mmhealth will still report it broken until we can delete the msgqueue. On the positive side, the crashes went away. I don?t recall the 5.1.2.6 efix #s, but 5.1.3.1. is efix26 for ppcle and 5.1.3.1 efix 27 for x86_64 Ed Wahl Ohio Supercomputer Center From: gpfsug-discuss On Behalf Of Luke Sudbery Sent: Thursday, October 13, 2022 6:19 AM To: gpfsug-discuss at gpfsug.org Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled IBM Spectrum Scale : Node crashes after upgrading to V5.?1.?2+ with msgqueue enabled https:?//www.?ibm.?com/support/pages/node/6824149?myns=s033&mynp=OCSTXKQY&mync=E&cm_sp=s033-_-OCSTXKQY-_-E says: ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? IBM Spectrum Scale : Node crashes after upgrading to V5.1.2+ with msgqueue enabled https://www.ibm.com/support/pages/node/6824149?myns=s033&mynp=OCSTXKQY&mync=E&cm_sp=s033-_-OCSTXKQY-_-E says: A node crash can occur due to resource exhaustion after upgrading to V5.1.2.0 or higher with msgqueue enabled. This affects all upgraded nodes until the filesystem version is moved to V5.1.2.0+ (mmchfs -V) and the migration off msgqueue occurs (mmmsgqueue config --remove-msgqueue). My emphasis on and. But also says: This issue will affect all versions mentioned above until msgqueue is disabled across the cluster. So it's not entirely clear whether you have to just update client version, update the filesystem version or disable msgqueue or do all 3 to fix it... Can an IBMer clarify? Many thanks, Luke -- Luke Sudbery Principal Engineer (HPC and Storage). Architecture, Infrastructure and Systems Advanced Research Computing, IT Services Room 132, Computer Centre G5, Elms Road Please note I don?t work on Monday. -------------- next part -------------- An HTML attachment was scrubbed... URL: From ewahl at osc.edu Thu Oct 13 17:35:07 2022 From: ewahl at osc.edu (Wahl, Edward) Date: Thu, 13 Oct 2022 16:35:07 +0000 Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled In-Reply-To: References: Message-ID: Silly cut/paste error. APAR is IJ40726 Ed Wahl Ohio Supercomputer Center From: gpfsug-discuss On Behalf Of Wahl, Edward Sent: Thursday, October 13, 2022 12:28 PM To: gpfsug main discussion list Subject: Re: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled I?ll just toss in here that efixes for this issue are available. As we?re in the tail end of a large data transition and cannot go to LATEST yet, we?re running some efixes for this and they do work. However mmhealth will still report it broken I?ll just toss in here that efixes for this issue are available. As we?re in the tail end of a large data transition and cannot go to LATEST yet, we?re running some efixes for this and they do work. However mmhealth will still report it broken until we can delete the msgqueue. On the positive side, the crashes went away. I don?t recall the 5.1.2.6 efix #s, but 5.1.3.1. is efix26 for ppcle and 5.1.3.1 efix 27 for x86_64 Ed Wahl Ohio Supercomputer Center From: gpfsug-discuss > On Behalf Of Luke Sudbery Sent: Thursday, October 13, 2022 6:19 AM To: gpfsug-discuss at gpfsug.org Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled IBM Spectrum Scale : Node crashes after upgrading to V5.?1.?2+ with msgqueue enabled https:?//www.?ibm.?com/support/pages/node/6824149?myns=s033&mynp=OCSTXKQY&mync=E&cm_sp=s033-_-OCSTXKQY-_-E says: ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? IBM Spectrum Scale : Node crashes after upgrading to V5.1.2+ with msgqueue enabled https://www.ibm.com/support/pages/node/6824149?myns=s033&mynp=OCSTXKQY&mync=E&cm_sp=s033-_-OCSTXKQY-_-E says: A node crash can occur due to resource exhaustion after upgrading to V5.1.2.0 or higher with msgqueue enabled. This affects all upgraded nodes until the filesystem version is moved to V5.1.2.0+ (mmchfs -V) and the migration off msgqueue occurs (mmmsgqueue config --remove-msgqueue). My emphasis on and. But also says: This issue will affect all versions mentioned above until msgqueue is disabled across the cluster. So it's not entirely clear whether you have to just update client version, update the filesystem version or disable msgqueue or do all 3 to fix it... Can an IBMer clarify? Many thanks, Luke -- Luke Sudbery Principal Engineer (HPC and Storage). Architecture, Infrastructure and Systems Advanced Research Computing, IT Services Room 132, Computer Centre G5, Elms Road Please note I don?t work on Monday. -------------- next part -------------- An HTML attachment was scrubbed... URL: From drolson at us.ibm.com Thu Oct 13 17:50:25 2022 From: drolson at us.ibm.com (Drew R Olson) Date: Thu, 13 Oct 2022 16:50:25 +0000 Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled Message-ID: Hi Luke, All are required. The reason for the discrepancy in the second statement is because the filesystem version of 5.1.0.0 or higher is a checked pre-req to running the 'mmmsgqueue config --remove-msgqueue' command. Thanks, Drew Olson drolson at us.ibm.com IBM Spectrum Scale (DPE) -------------- next part -------------- An HTML attachment was scrubbed... URL: From l.r.sudbery at bham.ac.uk Thu Oct 13 18:04:36 2022 From: l.r.sudbery at bham.ac.uk (Luke Sudbery) Date: Thu, 13 Oct 2022 17:04:36 +0000 Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled In-Reply-To: References: Message-ID: OK, after confirming we don?t have msgqueue enabled I don?t think we?re affected at all. But for the sake of clarity, we have nodes at 5.1.2.3, but the filesystem release is at 5.0.5.0 ? and it appears the filesystem version is the important one here. Many thanks, Luke -- Luke Sudbery Principal Engineer (HPC and Storage). Architecture, Infrastructure and Systems Advanced Research Computing, IT Services Room 132, Computer Centre G5, Elms Road Please note I don?t work on Monday. From: gpfsug-discuss On Behalf Of drolson at us.ibm.com Sent: 13 October 2022 17:50 To: gpfsug-discuss at gpfsug.org Subject: [gpfsug-discuss] Node crashes after upgrading to V5.1.2+ with msgqueue enabled Hi Luke, All are required. The reason for the discrepancy in the second statement is because the filesystem version of 5.1.0.0 or higher is a checked pre-req to running the 'mmmsgqueue config --remove-msgqueue' command. Thanks, Drew Olson drolson at us.ibm.com IBM Spectrum Scale (DPE) -------------- next part -------------- An HTML attachment was scrubbed... URL: From chair at gpfsug.org Mon Oct 17 10:40:13 2022 From: chair at gpfsug.org (chair at gpfsug.org) Date: Mon, 17 Oct 2022 10:40:13 +0100 Subject: [gpfsug-discuss] Spectrum Scale User Group Meeting Sunday 13th November @ SC22 Message-ID: <0c11001d16a75d82413548eb9edea1c3@gpfsug.org> Dear All, The next Spectrum Scale User Group Meeting will be held on Sunday 13th November at the "The Adolphus Hotel, 1321 Commerce St, Dallas, TX", commencing about 1pm. IBM are handling the registration on this occasion and I will put the link on the website, once I receive it. If you would like to present at this meeting, please let me know and I will add you to the agenda, which is currently being assembled. I look forward to seeing you in Dallas Regards Paul From chair at gpfsug.org Wed Oct 19 09:11:11 2022 From: chair at gpfsug.org (chair at gpfsug.org) Date: Wed, 19 Oct 2022 09:11:11 +0100 Subject: [gpfsug-discuss] UK Spectrum Scale User Group Meeting, Friday 4th December @ CIUK Message-ID: <4a9e2ca98b10221a0ff96d1c34414975@gpfsug.org> Dear All, We will be holding a short User Group meeting on Friday 4th December @ CUIK, Manchester. If you wish to attend this event, you must be registered for CIUK and the early bird fees are available until 4 November. To register, go to www.stfc.ac.uk/CIUK. If you would to present, please let me know Regards Paul From christian.petersson at isstech.io Wed Oct 19 09:28:23 2022 From: christian.petersson at isstech.io (Christian Petersson) Date: Wed, 19 Oct 2022 10:28:23 +0200 Subject: [gpfsug-discuss] Swedish Spectrum User Group Message-ID: To just continue with all Spectrum Scale Users Groups invites, There is a large Swedish Spectrum User Group that also cover other products such Protect, Storage, ESS, COS and of course Spectrum Scale where I together with Karolinska Inistutet will present how they are using Spectrum Scale to help science people with their work. It is free and 99.999% of all presentations and discussions will be in English. https://ibm.co/3UYOSUI -- Med V?nliga H?lsningar Christian Petersson -------------- next part -------------- An HTML attachment was scrubbed... URL: From chair at gpfsug.org Wed Oct 19 09:32:56 2022 From: chair at gpfsug.org (chair at gpfsug.org) Date: Wed, 19 Oct 2022 09:32:56 +0100 Subject: [gpfsug-discuss] UK Spectrum Scale User Group Meeting, Friday 2nd December @ CIUK In-Reply-To: <4a9e2ca98b10221a0ff96d1c34414975@gpfsug.org> References: <4a9e2ca98b10221a0ff96d1c34414975@gpfsug.org> Message-ID: <367382c8718caca0ce05c845f22160ea@gpfsug.org> Lets try and get the date right :-) The meeting will be on Friday 2nd December On 2022-10-19 09:11, chair at gpfsug.org wrote: > Dear All, > > We will be holding a short User Group meeting on Friday 4th December @ > CUIK, Manchester. > > If you wish to attend this event, you must be registered for CIUK and > the early bird fees are available until 4 November. To register, go to > www.stfc.ac.uk/CIUK. > > If you would to present, please let me know > > Regards > > Paul From chair at gpfsug.org Mon Oct 24 09:33:40 2022 From: chair at gpfsug.org (chair at gpfsug.org) Date: Mon, 24 Oct 2022 09:33:40 +0100 Subject: [gpfsug-discuss] Fwd: Spectrum Scale User Group Meeting Sunday 13th November @ SC22 - With Registration link In-Reply-To: <0c11001d16a75d82413548eb9edea1c3@gpfsug.org> References: <0c11001d16a75d82413548eb9edea1c3@gpfsug.org> Message-ID: <1592f1d2fe489206fbe49af678484542@gpfsug.org> Dear All, The next Spectrum Scale User Group Meeting will be held on Sunday 13th November at the "The Adolphus Hotel, 1321 Commerce St, Dallas, TX", commencing about 1pm. IBM are handling the registration on this occasion and the link is https://ibm.biz/SC22_SSUG If you would like to present at this meeting, please let me know and I will add you to the agenda, which is currently being assembled. I look forward to seeing you in Dallas Regards Paul From p.ward at nhm.ac.uk Tue Oct 25 14:21:31 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Tue, 25 Oct 2022 13:21:31 +0000 Subject: [gpfsug-discuss] "un-dead" files -urgent Message-ID: We are in the middle of moving the last live service from v4.2 to v5.1 As part of the testing of smb shares we are creating and deleting files. When we delete a file, it appears to delete, but if you refresh the folder, the file re-appears. I have tried modifying the ACL, and the folder acl. The fileset has iam-mode off. I have intentionally not given much information, in case it's a simple fix. But will post more info as needed. Any ideas. I have until 3:30pm to solve this, otherwise we have to roll back! Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: From p.ward at nhm.ac.uk Tue Oct 25 15:24:52 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Tue, 25 Oct 2022 14:24:52 +0000 Subject: [gpfsug-discuss] "un-dead" files -urgent In-Reply-To: References: Message-ID: (sent to right address now I hope) We are in the middle of moving the last live service from v4.2 to v5.1 As part of the testing of smb shares we are creating and deleting files. When we delete a file, it appears to delete, but if you refresh the folder, the file re-appears. I have tried modifying the ACL, and the folder acl. The fileset has iam-mode off. I have intentionally not given much information, in case it's a simple fix. But will post more info as needed. Any ideas. I have until 3:30pm to solve this, otherwise we have to roll back! Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: