<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
<span>Hi all,<br>
</span>
<div>1. I am trying to deploy Slurm HPC cluster based on Google Cloud Platform, with Lustre file system, as instructed below:</div>
<div> https://codelabs.developers.google.com/codelabs/hpc-slurm-on-gcp/#0</div>
<div> https://cloud.google.com/blog/products/storage-data-transfer/introducing-lustre-file-system-cloud-deployment-manager-scripts</div>
<div> https://github.com/GoogleCloudPlatform/deploymentmanager-samples/tree/master/community/lustre</div>
<div></div>
<div>2. I have created VPC Peering between the Slurm network and the Lustre cluster network</div>
<div></div>
<div>3. I have created Firewall rules for allowing all ports and protocols between the Slurm network and the Lustre cluster network</div>
<div></div>
<div>4. I have added DNS records for all the Lustre cluster machines inside the Slurm master node /etc/hosts</div>
<div></div>
<div>5. I have installed the following Lustre client pre-requirements on the Slurm master node:</div>
<div> sudo yum install kernel kernel-devel kernel-headers kernel-abi-whitelists kernel-tools kernel-tools-libs kernel-tools-libs-devel</div>
<div></div>
<div>6. I have created the /etc/yum.repos.d/lustre.repo with the following content:</div>
<div>[lustre-server]</div>
<div>name=CentOS-$releasever - Lustre</div>
<div>baseurl=https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7/server/</div>
<div>gpgcheck=0</div>
<div></div>
<div>[e2fsprogs]</div>
<div>name=CentOS-$releasever - Ldiskfs</div>
<div>baseurl=https://downloads.hpdd.intel.com/public/e2fsprogs/latest/el7/</div>
<div>gpgcheck=0</div>
<div></div>
<div>[lustre-client]</div>
<div>name=CentOS-$releasever - Lustre</div>
<div>baseurl=https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7/client/</div>
<div>gpgcheck=0</div>
<div></div>
<div>7. I have installed the Lustre client packages on the Slurm master node, using the following command:</div>
<div> sudo yum install e2fsprogs lustre-client</div>
<div></div>
<div>8. I used the following commands to create a mount point for the Lustre file system from within the Slurm master node:</div>
<div> sudo mkdir -p /lustre</div>
<div> sudo chmod 777 -R /lustre</div>
<div></div>
<div>9. Due to the fact that on the Slurm master node on Google Cloud Platform, my logged-in account is not Root account, but a Google G Suite account, the only way to perform mount and create a test file inside the mount point /lustre, is to use the following
Sudo commands:</div>
<div> sudo mount -t lustre lustre-mds1:/lustre /lustre</div>
<div> sudo touch /lustre/1.txt</div>
<div></div>
<div>I have couple of problems with the above process:</div>
<div>A. Even though the mount point (/lustre) has chmod of 777, the folder is still owned by Root user and group, and I am still unable to write files into the /Lustre mount point - How do I allow Google G Suite accounts the privilege to read/write/delete
files from the /Lustre mount point?</div>
<div><br>
</div>
<div>B. How do I add the following packages as part of the Slurm deployment package on both the Slurm master node and on all Slurm compute nodes (https://github.com/SchedMD/slurm-gcp)?</div>
<div> sudo yum install kernel kernel-devel kernel-headers kernel-abi-whitelists kernel-tools kernel-tools-libs kernel-tools-libs-devel</div>
<div> sudo yum install e2fsprogs lustre-client</div>
<div> Note: For the Lustre client installation, I need to add the /etc/yum.repos.d/lustre.repo with specific content (as instructed here: http://wiki.lustre.org/Installing_the_Lustre_Software)</div>
<span></span><br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
<br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
<br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
Thanks,</div>
<div id="Signature">
<div style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:12pt; background-color:rgb(255,255,255)">
<br>
</div>
<div style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:12pt; background-color:rgb(255,255,255)">
Eyal Estrin<br>
<div><br>
</div>
</div>
</div>
</body>
</html>