[gpfsug-discuss] Migrate/syncronize data from Isilon to Scale over NFS?

[Venkateswara R Puvvada]

Hi Yeep,

>If ACLs and other EAs migration from non scale is not supported by AFM, 
is there any 3rd party tool that could complement that when paired with 
AFM?

rsync can be used to just fix metadata like ACLs and EAs.  AFM does not 
revalidate the files with source system if rsync changes the ACLs on them. 
So ACLs can only be fixed after or during the cutover.  ACL inheritance 
may be used by setting on ACLs on required parent dirs upfront if this 
option is sufficient, there was an user who migrated to scale using this 
method.

~Venkat (vpuvvada at in.ibm.com)



From:   "T.A. Yeep" <yeep at robust.my>
To:     gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Cc:     gpfsug-discuss-bounces at spectrumscale.org
Date:   11/24/2020 07:40 PM
Subject:        [EXTERNAL] Re: [gpfsug-discuss] Migrate/syncronize data 
from Isilon to Scale over NFS?
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



Hi Venkat,

If ACLs and other EAs migration from non scale is not supported by AFM, is 
there any 3rd party tool that could complement that when paired with AFM?

On Tue, Nov 24, 2020 at 10:41 AM Venkateswara R Puvvada <
vpuvvada at in.ibm.com> wrote:
AFM provides near zero downtime for migration.  As of today,  AFM 
migration does not support ACLs or other EAs migration from non scale 
(GPFS) source.

https://www.ibm.com/support/knowledgecenter/STXKQY_5.1.0/com.ibm.spectrum.scale.v5r10.doc/bl1ins_uc_migrationusingafmmigrationenhancements.htm


~Venkat (vpuvvada at in.ibm.com)



From:        "Frederick Stock" <stockf at us.ibm.com>
To:        gpfsug-discuss at spectrumscale.org
Cc:        gpfsug-discuss at spectrumscale.org
Date:        11/17/2020 03:14 AM
Subject:        [EXTERNAL] Re: [gpfsug-discuss] Migrate/syncronize data 
from Isilon to Scale over        NFS?
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



Have you considered using the AFM feature of Spectrum Scale?  I doubt it 
will provide any speed improvement but it would allow for data to be 
accessed as it was being migrated.

Fred
__________________________________________________
Fred Stock | IBM Pittsburgh Lab | 720-430-8821
stockf at us.ibm.com
 
 
----- Original message -----
From: Andi Christiansen <andi at christiansen.xxx>
Sent by: gpfsug-discuss-bounces at spectrumscale.org
To: "gpfsug-discuss at spectrumscale.org" <gpfsug-discuss at spectrumscale.org>
Cc:
Subject: [EXTERNAL] [gpfsug-discuss] Migrate/syncronize data from Isilon 
to Scale over NFS?
Date: Mon, Nov 16, 2020 2:44 PM
 
Hi all,
 
i have got a case where a customer wants 700TB migrated from isilon to 
Scale and the only way for him is exporting the same directory on NFS from 
two different nodes...
 
as of now we are using multiple rsync processes on different parts of 
folders within the main directory. this is really slow and will take 
forever.. right now 14 rsync processes spread across 3 nodes fetching from 
2.. 
 
does anyone know of a way to speed it up? right now we see from 1Gbit to 
3Gbit if we are lucky(total bandwidth) and there is a total of 30Gbit from 
scale nodes and 20Gbits from isilon so we should be able to reach just 
under 20Gbit...
 
 
if anyone have any ideas they are welcome! 


Thanks in advance 
Andi Christiansen
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
 
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss



_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


-- 
Best regards 
T.A. Yeep
Mobile: +6-016-719 8506 | Tel: +6-03-7628 0526 | www.robusthpc.com


_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss 





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20201127/aaf80327/attachment.htm>