<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
<span>Hi all,<br>
</span>
<div>1. I am trying to deploy Slurm HPC cluster based on Google Cloud Platform, with Lustre file system, as instructed below:\u200b</div>
<div> https://codelabs.developers.google.com/codelabs/hpc-slurm-on-gcp/#0\u200b</div>
<div> https://cloud.google.com/blog/products/storage-data-transfer/introducing-lustre-file-system-cloud-deployment-manager-scripts\u200b</div>
<div> https://github.com/GoogleCloudPlatform/deploymentmanager-samples/tree/master/community/lustre\u200b</div>
<div>\u200b</div>
<div>2. I have created VPC Peering between the Slurm network and the Lustre cluster network\u200b</div>
<div>\u200b</div>
<div>3. I have created Firewall rules for allowing all ports and protocols between the Slurm network and the Lustre cluster network\u200b</div>
<div>\u200b</div>
<div>4. I have added DNS records for all the Lustre cluster machines inside the Slurm master node /etc/hosts\u200b</div>
<div>\u200b</div>
<div>5. I have installed the following Lustre client pre-requirements on the Slurm master node:\u200b</div>
<div> sudo yum install kernel kernel-devel kernel-headers kernel-abi-whitelists kernel-tools kernel-tools-libs kernel-tools-libs-devel\u200b</div>
<div>\u200b</div>
<div>6. I have created the /etc/yum.repos.d/lustre.repo with the following content:\u200b</div>
<div>[lustre-server]\u200b</div>
<div>name=CentOS-$releasever - Lustre\u200b</div>
<div>baseurl=https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7/server/\u200b</div>
<div>gpgcheck=0\u200b</div>
<div>\u200b</div>
<div>[e2fsprogs]\u200b</div>
<div>name=CentOS-$releasever - Ldiskfs\u200b</div>
<div>baseurl=https://downloads.hpdd.intel.com/public/e2fsprogs/latest/el7/\u200b</div>
<div>gpgcheck=0\u200b</div>
<div>\u200b</div>
<div>[lustre-client]\u200b</div>
<div>name=CentOS-$releasever - Lustre\u200b</div>
<div>baseurl=https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7/client/\u200b</div>
<div>gpgcheck=0\u200b</div>
<div>\u200b</div>
<div>7. I have installed the Lustre client packages on the Slurm master node, using the following command:\u200b</div>
<div> sudo yum install e2fsprogs lustre-client\u200b</div>
<div>\u200b</div>
<div>8. I used the following commands to create a mount point for the Lustre file system from within the Slurm master node:\u200b</div>
<div> sudo mkdir -p /lustre\u200b</div>
<div> sudo chmod 777 -R /lustre\u200b</div>
<div>\u200b</div>
<div>9. Due to the fact that on the Slurm master node on Google Cloud Platform, my logged-in account is not Root account, but a Google G Suite account, the only way to perform mount and create a test file inside the mount point /lustre, is to use the following
Sudo commands:\u200b</div>
<div> sudo mount -t lustre lustre-mds1:/lustre /lustre\u200b</div>
<div> sudo touch /lustre/1.txt\u200b</div>
<div>\u200b</div>
<div>I have couple of problems with the above process:\u200b</div>
<div>A. Even though the mount point (/lustre) has chmod of 777, the folder is still owned by Root user and group, and I am still unable to write files into the /Lustre mount point\u200b - How do I allow Google G Suite accounts the privilege to read/write/delete
files from the /Lustre mount point?</div>
<div><br>
</div>
<div>B. How do I add the following packages as part of the Slurm deployment package on both the Slurm master node and on all Slurm compute nodes (https://github.com/SchedMD/slurm-gcp)?\u200b</div>
<div> sudo yum install kernel kernel-devel kernel-headers kernel-abi-whitelists kernel-tools kernel-tools-libs kernel-tools-libs-devel\u200b</div>
<div> sudo yum install e2fsprogs lustre-client\u200b</div>
<div> Note: For the Lustre client installation, I need to add the /etc/yum.repos.d/lustre.repo with specific content (as instructed here: http://wiki.lustre.org/Installing_the_Lustre_Software)\u200b</div>
<span></span><br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
<br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
<br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri,Helvetica,sans-serif; font-size: 12pt;">
Thanks,</div>
<div id="Signature">
<div style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:12pt; background-color:rgb(255,255,255)">
<br>
</div>
<div style="color:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif; font-size:12pt; background-color:rgb(255,255,255)">
Eyal Estrin<br>
<div><br>
</div>
</div>
</div>
</body>
</html>