<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
Hi Thomas,</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
Thanks for the reply.<br>
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
Here is the output:</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
[root@mds ~]# lctl get_param osp.lustre-OST0003-osc-MDT0000.active</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.active=1</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
The problem is caused by the fact that I replaced a previously added OST using the --replace option in the mkfs.lustre command. </div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
OST0004 was added correctly in one go, and that one is visible to the client, so I don't think it is a client problem. The client can reach the OSS that has OST0003.</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
It seems that the according to the MDS everything is fine. It is only the 'lfs df' command that shows a problem. Regular 'df' shows all the space of the lustre fs, but 'lfs df' does not.</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
# df -h</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
Filesystem Size Used Avail Use% Mounted on</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
192.168.6.1@tcp:/lustre 487T 223T 264T 46% /lustre</div>
<div id="appendonsend"></div>
<div><br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
# lfs df -h</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
UUID bytes Used Available Use% Mounted on</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
lustre-MDT0000_UUID 11.4T 2.8T 8.6T 25% /lustre[MDT:0]</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
lustre-OST0000_UUID 97.2T 74.4T 22.8T 77% /lustre[OST:0]</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
lustre-OST0001_UUID 97.2T 74.0T 23.2T 77% /lustre[OST:1]</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
lustre-OST0002_UUID 97.2T 74.1T 23.1T 77% /lustre[OST:2]</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
OST0003 : Invalid argument</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
lustre-OST0004_UUID 97.2T 7.0M 97.2T 1% /lustre[OST:4]</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
filesystem_summary: 388.9T 222.5T 166.4T 58% /lustre</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);" class="elementToProof">
The fs is not in use at the moment, no data has been written to it since adding OST0003 an 4. If there is a way to fix this removing and adding OST0003 again then I can try that. As long as the data that is on the other OST's is not lost.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Regards,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Martin Balvers</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
In case this somehow helps:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
[root@mds ~]# lctl get_param osp.lustre-OST0003-osc-MDT0000.*</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.active=1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.blocksize=4096</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.create_count=32</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.destroys_in_flight=0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.filesfree=3262643968</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.filestotal=3262644326</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
error: read_param: '/sys/fs/lustre/osp/lustre-OST0003-osc-MDT0000/force_sync': Permission denied</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.kbytesavail=104404566016</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.kbytesfree=104404606976</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.kbytestotal=104404615168</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.lfsck_max_rpcs_in_flight=512</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.max_create_count=20000</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.max_rpcs_in_flight=8</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.max_rpcs_in_progress=4096</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.max_sync_changes=2000000000</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.maxage=5</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.old_sync_processed=1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.ost_conn_uuid=192.168.6.5@tcp</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.prealloc_last_id=33</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.prealloc_last_seq=0x100030000</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.prealloc_next_id=2</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.prealloc_next_seq=0x100030000</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.prealloc_reserved=0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.prealloc_status=0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.sync_changes=0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.sync_in_flight=0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.sync_in_progress=0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.uuid=lustre-MDT0000-mdtlov_UUID</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.connect_flags=</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
flags=0x2040401443000066</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
flags2=0x0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
lov_index</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
connect_from_mds</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
version</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
request_portal</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
adaptive_timeouts</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
lru_resize</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
fid_is_enabled</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
skip_orphan</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
full20</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
lvb_type</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
lfsck</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
bulk_mbits</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.import=</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
import:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
name: lustre-OST0003-osc-MDT0000</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
target: lustre-OST0003_UUID</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
state: FULL</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
connect_flags: [ lov_index, connect_from_mds, version, request_portal, adaptive_timeouts, lru_resize, fid_is_enabled, skip_orphan, full20, lvb_type, lfsck, bulk_mbits ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
connect_data:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
flags: 0x2040401443000066</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
instance: 1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
target_version: 2.15.1.0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
mdt_index: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
target_index: 3</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
import_flags: [ replayable, pingable, connect_tried ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
connection:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
failover_nids: [ 192.168.6.5@tcp ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
current_connection: 192.168.6.5@tcp</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
connection_attempts: 24</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
generation: 3</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
in-progress_invalidations: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
idle: 5 sec</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
rpcs:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
inflight: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
unregistering: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
timeouts: 17</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
avg_waittime: 464 usec</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
service_estimates:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
services: 1 sec</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
network: 1 sec</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
transactions:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
last_replay: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
peer_committed: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
last_checked: 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.ost_server_uuid=lustre-OST0003_UUID FULL</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.reserved_mb_high=38883</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.reserved_mb_low=19441</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.srpc_info=</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
rpc flavor: null</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
bulk flavor: null</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
flags: -,</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
id: -1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
refcount: 23</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
nctx: 1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
gc internal 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
gc next 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
error: read_param: '/sys/kernel/debug/lustre/osp/lustre-OST0003-osc-MDT0000/srpc_sepol': Invalid argument</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.state=</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
current_state: FULL</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
state_history:</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076684, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076739, DISCONN ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076739, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076794, DISCONN ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076794, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076849, DISCONN ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076849, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076904, DISCONN ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076904, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076959, DISCONN ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076959, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755076975, DISCONN ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755078008, CONNECTING ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755078008, EVICTED ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755078008, RECOVER ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
- [ 1755078008, FULL ]</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.stats=</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
snapshot_time 1112343.516378917 secs.nsecs</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
start_time 0.000000000 secs.nsecs</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
elapsed_time 1112343.516378917 secs.nsecs</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
req_waittime 14767 samples [usec] 221 1689 6858368 3261577492</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
req_active 14785 samples [reqs] 1 2 14809 14857</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
ost_create 4 samples [usec] 221 649 1775 950619</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
ost_get_info 2 samples [usec] 1403 1689 3092 4821130</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
ost_connect 6 samples [usec] 269 1095 4323 3583477</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
ost_statfs 14753 samples [usec] 247 718 6848319 3251852025</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
obd_ping 2 samples [usec] 404 455 859 370241</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
osp.lustre-OST0003-osc-MDT0000.timeouts=</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
last reply : 1755153467, 5s ago</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
network : cur 1 worst 1 (at 1755078008, 75464s ago) 1 1 1 1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
portal 28 : cur 1 worst 1 (at 1755076033, 77439s ago) 1 1 0 0</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
portal 7 : cur 1 worst 1 (at 1755076033, 77439s ago) 1 1 1 1</div>
<div style="line-height: 19px; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<hr style="display: inline-block; width: 98%;">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<b>From:</b> lustre-discuss <lustre-discuss-bounces@lists.lustre.org> on behalf of Thomas Roth via lustre-discuss <lustre-discuss@lists.lustre.org><br>
<b>Sent:</b> Wednesday, August 13, 2025 15:44<br>
<b>To:</b> lustre-discuss@lists.lustre.org <lustre-discuss@lists.lustre.org><br>
<b>Subject:</b> [lustre-discuss] Mistake while adding OST - OST0003 : Invalid argument
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<table style="border-width: 3px; border-style: solid; border-color: rgb(255, 0, 51); background-color: rgb(255, 251, 224); width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="line-height: 1; padding: 4px 8px; color: black;" align="center">
<div style="line-height: 1; font-size: 11px;"><b>WARNING - EXTERNAL SENDER - BE CYBERSAFE</b></div>
</td>
</tr>
</tbody>
</table>
<div><br>
</div>
<div>Hi,<br>
did you check the status of the new OST on the MDS? Some 'lctl get_param a.b.c.active' command?<br>
Because I'm not sure <span style="font-family: aptos, aptos_embeddedfont, aptos_msfontservice, calibri, helvetica, sans-serif; color: rgb(178, 178, 178);">
lctl --device 13 activate</span><br>
does the trick.<br>
And it isn't a client's problem either?<br>
<br>
Regards<br>
Thomas<br>
</div>
<DIV>
Ce message électronique et tous les fichiers attachés qu'il contient sont confidentiels et destinés exclusivement à l'usage de la personne à laquelle ils sont adressés. Si vous avez reçu ce message par erreur, merci de le retourner à son émetteur. Les idées et opinions présentées dans ce message sont celles de son auteur, et ne représentent pas nécessairement celles de DANONE ou d'une quelconque de ses filiales. La publication, l'usage, la distribution, l'impression ou la copie non autorisée de ce message et des attachements qu'il contient sont strictement interdits. <BR>
<BR>
This e-mail and any files transmitted with it are confidential and intended solely for the use of the individual to whom it is addressed. If you have received this email in error please send it back to the person that sent it to you. Any views or opinions presented are solely those of its author and do not necessarily represent those of DANONE or any of its subsidiary companies. Unauthorized publication, use, dissemination, forwarding, printing or copying of this email and its associated attachments is strictly prohibited.<BR>
</DIV></body>
</html>