[lustre-discuss] Robinhood scan time

Degremont, Aurelien degremoa at amazon.com
Mon Dec 7 04:49:42 PST 2020


Hi Amit,

Thanks for this data point, that's interesting.
Robinhood prints a scan summary in its logfile at the end of scan. It could be nice if you can copy/paste it, for further reference.

Aurélien

Le 04/12/2020 23:39, « lustre-discuss au nom de Kumar, Amit » <lustre-discuss-bounces at lists.lustre.org au nom de ahkumar at mail.smu.edu> a écrit :

    CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.



    Dual Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz;
    256GB RAM
    System x3650 M5
    Storage for MDT is from NetApp EF560.

    Best regards,
    Amit

    -----Original Message-----
    From: Russell Dekema <dekemar at umich.edu>
    Sent: Friday, December 4, 2020 4:27 PM
    To: Kumar, Amit <ahkumar at mail.smu.edu>
    Cc: lustre-discuss at lists.lustre.org
    Subject: Re: [lustre-discuss] Robinhood scan time

    Greetings,

    What kind of hardware are you running on your metadata array?

    Cheers,
    Rusty Dekema

    On Fri, Dec 4, 2020 at 5:12 PM Kumar, Amit <ahkumar at mail.smu.edu> wrote:
    >
    > HI All,
    >
    >
    >
    > During LAD’20 Andreas mentioned if I could share the Robinhood scan time for the 369millions files we have. So here it is. It took ~23 days for me to complete initial scan of all 369 million files, on a dedicated robinhood server that has 384GB RAM. I had it setup with all tweaks for database and client that was mentioned in Robinhood document. I only used 2 threads for this scan. Hope this reference helps.
    >
    >
    >
    > Thank you,
    >
    > Amit
    >
    >
    >
    > _______________________________________________
    > lustre-discuss mailing list
    > lustre-discuss at lists.lustre.org
    > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


    ----IF CLASSIFICATION START----

    ----IF CLASSIFICATION END----
    _______________________________________________
    lustre-discuss mailing list
    lustre-discuss at lists.lustre.org
    http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org



More information about the lustre-discuss mailing list