[Lustre-discuss] How do I recover files from partial lustre disk?

Ms. Megan Larko dobsonunit at gmail.com
Fri Jun 20 14:27:03 PDT 2008


This is a follow-up from Megan on 20 June 2008:
Success getting file information from remaining OST's.

Per the advice of Andreas, I mounted my good OST's on my OSS.
I went to the MDT and mounted the /srv/lustre/mds/crew4-MDT0000.

On a compute  node (not a lustre data OSS node), I mounted the disk
(/crew4) and then I used the lctl to identify the known bad nids in
/crew4 and then to "device {bad-nid}   then "deactivate"  that
bad-nid.   Finally I used Andreas suggestion of "lfs find --ost
crew4-OST0001_UUID --ost crew4-OST0003_UUID --ost crew4-OST0004_UUID
--print  /crew4 >& crew4.find.20Jun08"

I received a 759 Mb text output file of the names of files still
resident on the remaining OST's.   (...and there was great rejoicing!)
  So--- I want to cp those known/found file names from the read-only
mounted device named /crew4 onto some good space.   May I just use a
linux system "cp" command or is there a better lustre command that
should be used for this specific task?

Thanks bunches!
megan



On Thu, Jun 19, 2008 at 12:52 PM, Ms. Megan Larko <dobsonunit at gmail.com> wrote:
> Howdy,
>
> WRT consulting, our experience at CREW (my company) is similar.   Our
> company president contacted Sun about Lustre consulting and the Sun
> people to whom he spoke knew nothing about it.   We are still
> interested.    I have signed up for the Lustre class to be taught at
> Sun in San Jose California on July 15-17, 2008.   I am still learning
> how to set-up and manage my lustre files system.
>
> Our company has also purchased and received (yesterday) seven Xstore
> 16 bay JBODs and 110 Hitachi Ultrastar 1Tb sATA hard drives to add to
> our current lustre system.  We do use InfiniBand.   I don't know if
> the current system (I inherited) used quotas.  We have two new servers
> coming for the new disk space.   I am following the new lustre 1.6
> release thread with great interest as I believe that is what I will
> put onto the new servers to serve the new disk space (lustre format)
> we have just purchased.
>
> Can't get to that lustre class soon enough.
>
> megan
>
> On Thu, Jun 19, 2008 at 6:42 AM, Charles Taylor <taylor at hpc.ufl.edu> wrote:
>>>>
>>
>>
>>
>> Just some feedback on the item below...When we were getting started with
>> Lustre about seven or eight months ago we were having stability problems and
>> losing a lot of time to Lustre-related issues.   We were newbies and willing
>> to pay someone to help us clear some initial hurdles.   I contacted (phone
>> and email) ClusterFS (I guess this was just prior to the Sun purchase, I
>> don't know) to ask about some consulting help and never heard back from
>> anyone.   We all want you to be successful and this seems like a lost
>> revenue opportunity.
>>
>> FWIW, we are doing pretty well now and are mostly very happy with Lustre and
>> this list has been invaluable (to wit, "The Dilger Procedure").  However,
>> I'm sure there is plenty that we still don't know and we plan to attend some
>> training at the next opportunity.
>>
>> Regards,
>>
>> Charlie Taylor
>> UF HPC Center
>>
>>
>>>> Thank you again Andreas for this incredibly useful information.   Do
>>>> you/Sun do paid Lustre consulting by any chance?
>>>
>>> Yes, in fact we do...
>>>
>>>>
>>
>



More information about the lustre-discuss mailing list