[lustre-discuss] Robinhood scan time
Degremont, Aurelien
degremoa at amazon.com
Mon Dec 7 04:49:42 PST 2020
Hi Amit,
Thanks for this data point, that's interesting.
Robinhood prints a scan summary in its logfile at the end of scan. It could be nice if you can copy/paste it, for further reference.
Aurélien
Le 04/12/2020 23:39, « lustre-discuss au nom de Kumar, Amit » <lustre-discuss-bounces at lists.lustre.org au nom de ahkumar at mail.smu.edu> a écrit :
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
Dual Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz;
256GB RAM
System x3650 M5
Storage for MDT is from NetApp EF560.
Best regards,
Amit
-----Original Message-----
From: Russell Dekema <dekemar at umich.edu>
Sent: Friday, December 4, 2020 4:27 PM
To: Kumar, Amit <ahkumar at mail.smu.edu>
Cc: lustre-discuss at lists.lustre.org
Subject: Re: [lustre-discuss] Robinhood scan time
Greetings,
What kind of hardware are you running on your metadata array?
Cheers,
Rusty Dekema
On Fri, Dec 4, 2020 at 5:12 PM Kumar, Amit <ahkumar at mail.smu.edu> wrote:
>
> HI All,
>
>
>
> During LAD’20 Andreas mentioned if I could share the Robinhood scan time for the 369millions files we have. So here it is. It took ~23 days for me to complete initial scan of all 369 million files, on a dedicated robinhood server that has 384GB RAM. I had it setup with all tweaks for database and client that was mentioned in Robinhood document. I only used 2 threads for this scan. Hope this reference helps.
>
>
>
> Thank you,
>
> Amit
>
>
>
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
----IF CLASSIFICATION START----
----IF CLASSIFICATION END----
_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
More information about the lustre-discuss
mailing list