From anna.fuchs at informatik.uni-hamburg.de Tue Nov 5 17:04:09 2019 From: anna.fuchs at informatik.uni-hamburg.de (Anna Fuchs) Date: Tue, 05 Nov 2019 18:04:09 +0100 Subject: [lustre-devel] trnasfer zfs record size to client Message-ID: <1572973449.3824.0@informatik.uni-hamburg.de> Dear all, for my work on the compression feature, I need the client to know the record size of the server/target (ZFS) where the request will be sent to. I assume there exist some communication channels between the client and the corresponding target for other options (like compatibility checking?). What would be the best way to tranfer this information? Thanks for any hints. Best regards Anna -- Uni Hamburg -------------- next part -------------- An HTML attachment was scrubbed... URL: From adilger at whamcloud.com Wed Nov 6 10:48:20 2019 From: adilger at whamcloud.com (Andreas Dilger) Date: Wed, 6 Nov 2019 10:48:20 +0000 Subject: [lustre-devel] trnasfer zfs record size to client In-Reply-To: <1572973449.3824.0@informatik.uni-hamburg.de> References: <1572973449.3824.0@informatik.uni-hamburg.de> Message-ID: On Nov 5, 2019, at 10:04, Anna Fuchs > wrote: Dear all, for my work on the compression feature, I need the client to know the record size of the server/target (ZFS) where the request will be sent to. I assume there exist some communication channels between the client and the corresponding target for other options (like compatibility checking?). What would be the best way to tranfer this information? Thanks for any hints.' Hi Anna, we pass the recordsize (or ldiskfs blcoksize) from each OST/MDT back to the client as part of struct obd_connect_data. You can see this information in the "grant_block_size" field of osc.*.import for each OST. Cheers, Andreas -- Andreas Dilger Principal Lustre Architect Whamcloud -------------- next part -------------- An HTML attachment was scrubbed... URL: From odrokin at ddn.com Fri Nov 8 17:51:31 2019 From: odrokin at ddn.com (Oleg Drokin) Date: Fri, 8 Nov 2019 17:51:31 +0000 Subject: [lustre-devel] New tag and branch split Message-ID: <58D576C1-7402-4D83-8FCA-8A6B5D669A24@whamcloud.com> Hello! I just split off b2_13 branch from master for final touches of 2.13 release and so we can continue landing other patches (of which there’s now quite a backlog) b2_13 in in codefreeze and will be tagged RC soon. Here’s the changelog: Alex Zhuravlev (5): LU-12751 tests: add missing error() LU-12612 osd: add lnb size down to osd LU-12769 recovery: use monotonic timer LU-12703 utils: reset rootpath in llapi_search_rootpath() LU-12799 ptlrpc: return proper error code Alexander Boyko (1): LU-12593 osd: zeroing a freshly allocated block buffer Alexey Lyashkov (1): LU-12707 obdecho: avoid panic with partially object init Alexey Zhuravlev (3): LU-12570 mdt: request env for DT threads LU-10496 ofd: serialize fmd check and set LU-12625 build: reliable detection of struct timespec64 Amir Shehata (3): LU-12385 lnet: update opa defaults LU-12621 o2iblnd: cache max_qp_wr LU-12893 lnet: fix peer_ni selection Andreas Dilger (22): LU-9897 utils: remove llverfs dependency on libext2fs LU-11607 tests: add a default definition for SINGLEMDS LU-1957 tests: remove sanity test 180 from ALWAYS_EXCEPT LU-12579 tests: allow some margin in runtests LU-11729 obdclass: align to T10 sector size when generating guard LU-12514 utils: add "lustre_tgt" filesystem type LU-12753 tests: wait for mds2 recovery in sanity 278 LU-11380 llapi: separate FID man pages LU-4315 doc: add separate lctl-list_param man page LU-12704 tests: component end must be multiple of stripesize LU-11467 utils: add lfs mirror delete command LU-12712 lod: fix warning message for non-SEL file LU-12760 tests: stack_trap defaults to sigspec=EXIT LU-12838 ptlrpc: fix watchdog ratelimit logic LU-12859 llite: clear flock when using localflock LU-12784 llite: limit max xattr size by kernel value LU-9629 utils: fix lfs_migrate for non-root users LU-12842 utils: llog_print with snapshot name LU-12025 osp: allow OS_STATE_* flags from OSTs LU-10070 utils: move new SEL find_param fields to end LU-12932 tests: remove obsolete qos.sh test script LU-12734 misc: allow older bash_completion versions Andrew Perepechko (1): LU-11426 llog: changelog records reordering Andriy Skulysh (2): LU-11444 ptlrpc: resend may corrupt the data LU-12800 mdd: do not cache atributes on mdd_parent_fid Arshad Hussain (21): LU-6142 ptlrpc: Fix style issues for llog_net.c LU-6142 tests: Fix style issues for multiop.c LU-6142 tests: Fix style issues for mcreate.c LU-6142 tests: Fix style issues for checkstat.c LU-6142 tests: Fix style issues for chownmany.c LU-6142 tests: Fix style issues for directio.c LU-6142 tests: Remove file flock.c LU-6142 tests: Remove file iam_ut.c LU-6142 tests: Fix style issues for ll_dirstripe_verify.c LU-6142 tests: Fix style issues for ll_sparseness_verify.c LU-6142 tests: Fix style issues for ll_sparseness_write.c LU-6142 tests: Fix style issues for mmap_sanity.c LU-6142 tests: Fix style issues for mkdirmany.c LU-6142 tests: Fix style issues for multifstat.c LU-6142 tests: Fix style issues for writemany.c LU-6142 tests: Fix style issues for openfilleddirunlink.c LU-6142 tests: Fix style issues for utime.c LU-6142 tests: Fix style issues for opendirunlink.c LU-6142 tests: Fix style issues for opendevunlink.c LU-6142 tests: Fix style issues for openfile.c LU-6142 tests: Fix style issues for munlink.c Artem Blagodarenko (3): LU-11915 tests: use trusted.* xattr for conf-sanity test_115 LU-12650 lib: fix strings comparison during mount searching LU-12103 ldiskfs: don't search large block range if disk full Bobi Jam (3): LU-12581 osc: prevent use after free LU-12690 llite: error handling of ll_och_fill() LU-12328 flr: avoid reading unhealthy mirror Chris Horn (6): LU-12739 lnet: Don't queue msg when discovery has completed LU-12763 lnet: Use alternate ping processing for non-mr peers LU-12824 o2ib: Fix whitespace in kiblnd_startup LU-12410 tests: Add auster option to skip setup LU-12824 o2ib: Record rc in debug log on startup failure LU-12824 o2ib: Reintroduce kiblnd_dev_search Dominique Martinet (1): LU-12734 misc: add bash completion for lctl set/get_param Emoly Liu (5): LU-12613 ptlrpc: check buffer length in lustre_msg_string() LU-12602 mdt: more EA size check in mdt_getxattr_pack_reply() LU-11743 utils: allow lctl pool_list on separate MGS LU-12229 tests: fix "bad substitution" error LU-12790 obdclass: print jobid error message properly Fan Yong (1): LU-12127 lfsck: skip orphan processing for namespace LFSCK Gu Zheng (2): LU-12705 build: fix building fail against Power9 little endian LU-12705 utils: cleanup unnecessary typecasting Hongchao Zhang (3): LU-11626 mdc: hold obd while processing changelog LU-12758 quota: clear default flag for new ID LU-11768 test: make at_max to take effect James Nunez (9): LU-12336 build: Revert Update ZFS version to 0.8.1 LU-10931 tests: resume testing of recovery-small 136 LU-11780 tests: add server version check to replay-single LU-11607 tests: replace version/fstype calls in recovery-small LU-11607 tests: replace lustre_version/fstype in posix/perf LU-12845 utils: fix typos in 'lctl pcc' help LU-11607 tests: replace lustre_version/fstype - large-lun LU-12903 doc: make PCC man pages LU-12895 tests: stop running tests for SSK and SELinux James Simmons (6): LU-12137 osd-ldiskfs: refactor osd_ios_ROOT_scan LU-12137 osd-ldiskfs: trace the obd device used for osd lookup LU-12137 osd-ldiskfs: create locked and unlocked versions of osd lookup code LU-12803 libcfs: bump module version LU-12932 lod: restore qos_thresholdrr sysfs file LU-12932 lod: rename qos_threshold_rr parameter Jian Yu (7): LU-12608 kernel: kernel update RHEL7.6 [3.10.0-957.27.2.el7] LU-12269 kernel: RHEL 8.0 server support LU-11485 lod: disallow setting the last non-stale mirror as stale LU-12755 ldiskfs: fix project quota unpon unpatched kernel LU-11670 tests: do not fail the first half in sanityn test 103 LU-12724 kernel: kernel update RHEL7.7 [3.10.0-1062.1.1.el7] LU-12844 lnet: fix strncpy bound error Joseph Gmitter (1): LU-12776 doc: update Changelog to reflect primary kernels Lai Siyao (9): LU-12719 obdclass: serialize lwp list access LU-11213 lmv: use lu_tgt_descs to manage tgts LU-11213 lod: share object alloc QoS code with LMV LU-11933 mdt: clear sp_cr_flags in migrate unpack LU-12495 obdclass: qos penalties miscalculated LU-11739 lod: subdir under ROOT should honor default layout LU-11967 mdt: reint layout_change in standard way LU-12624 obdclass: lu_tgt_descs cleanup LU-12624 lod: alloc dir stripes by QoS Li Dongyang (1): LU-11956 mdd: do not reset original lu_buf.lb_len Li Xi (1): LU-12802 tests: speedup cleanup of racer Mikhail Pershin (3): LU-12443 ptlrpc: fix reply buffers shrinking and growing LU-11421 dom: manual OST-to-DOM migration via mirroring LU-10496 tests: enable 39k for DoM Minh Diep (1): LU-12825 build: change lbuild to support MOFED 4.7 Mr NeilBrown (28): LU-6142 fld: remove fci_no_shrink field. LU-6142 lustre: remove ldt_obd_type field of lu_device_type LU-6142 lustre: remove imp_no_timeout field LU-6142 llog: remove olg_cat_processing field. LU-6142 ptlrpc: remove struct ptlrpc_bulk_page LU-6142 ptlrpc: remove bd_import_generation field. LU-6142 ptlrpc: remove srv_threads from struct ptlrpc_service LU-6142 ptlrpc: remove scp_nthrs_stopping field. LU-6142 ldlm: remove unused ldlm_server_conn LU-6142 llite: remove lli_readdir_mutex LU-6142 llite: remove ll_umounting field LU-6142 llite: remove lti_iter field LU-6142 llite: remove ft_mtime field LU-6142 llite: remove sub_reenter field. LU-6142 osc: remove oti_descr oti_handle oti_plist LU-6142 osc: remove oe_next_page LU-6142 o2iblnd: remove some unused fields. LU-6142 socklnd: Fix some white-space issues ... LU-6142 socklnd: remove ksnp_sharecount LU-6142 mtd: use tabs to indent struct mdt_thread_info LU-6142 mdt: remove unused field mti_wait_info. LU-12686 lnet: change ln_mt_waitq to a completion. LU-10467 fid: style cleanups in seq_client_alloc_meta() LU-10467 lustre: use TABs for indents in a few places. LU-10467 ptlrpc: fix indents in ptlrpc_recover_import() LU-11542 import: Fix missing spin_unlock() LU-10467 lustre: add wait_event macros suitable for upstream LU-10467 target: remove lwi arg from target_bulk_io Nathaniel Clark (1): LU-12745 build: Account for optional SPL for ZFS 0.8+ NeilBrown (3): LU-6142 lustre: introduce CONFIG_LUSTRE_FS_POSIX_ACL LU-9859 libcfs: move misc-device registration closer to related code. LU-8066 obd_type: discard obd_types linked list. Oleg Drokin (4): LU-11997 ptlrpc: Properly swab ll_fiemap_info_key LU-12773 tests: sanity test_805 Use do_facet LU-12672 tests: Correctly determine mdccli in recovery-small test 66 New tag 2.12.90 Patrick Farrell (8): LU-12533 llite: Improve readahead RPC issuance LU-12535 lov: Move page index to top level LU-12559 ptlrpc: Hold imp lock for idle reconnect LU-11670 osc: glimpse - search for active lock LU-9341 lod: Add special O_APPEND striping LU-12569 o2iblnd: Make credits hiw connection aware LU-9920 vvp: dirty pages with pagevec LU-4322 tests: re-enable 101a in dne config Qian Yingjin (3): LU-11367 som: integrate LSOM with lfs find LU-12026 mdt: MDS stores atime|mtime|ctime during close LU-12526 pcc: Auto attach for PCC during IO Sebastien Buisson (2): LU-12428 tests: fix sanity-sec wait_nm_sync LU-12275 sec: reserve flags for client side encryption Sergey Gorenko (1): LU-12789 o2ib: fix configure checks Shaun Tancheff (8): LU-12635 lnet: Fix deceptive indenting on for_each LU-12400 ptlrpc: Sun RPC changes for RCU locking LU-12634 osd-ldiskfs: bi_phys_segments removed from struct bio LU-12634 llite: lm_compare_owner removed LU-12634 lnet: for_ifa removed. Use in_dev_for_each_ifa_rtnl LU-12400 zfs: zfs mainline 0.8+ with mainline (5.2) kernel LU-12795 tests: Introduce FAILF and start using it LU-12795 tests: Prefer FAILF in mpi tests Tatsushi Takamura (1): LU-12691 ldlm: obd_max_recoverable_clients is not atomic Vitaly Fertman (2): LU-12681 osc: wrong cache of LVB attrs LU-12681 osc: wrong cache of LVB attrs, part2 Wang Shilong (4): LU-12043 llite: extend readahead locks for striped file LU-12518 readahead: convert stride page index to byte LU-12764 lnet: eliminate uninitialized warning LU-12777 test: fix to pass facet to facet_fstype From aik at fnal.gov Fri Nov 8 22:36:47 2019 From: aik at fnal.gov (Alexander I Kulyavtsev) Date: Fri, 8 Nov 2019 22:36:47 +0000 Subject: [lustre-devel] New tag and branch split In-Reply-To: <58D576C1-7402-4D83-8FCA-8A6B5D669A24@whamcloud.com> References: <58D576C1-7402-4D83-8FCA-8A6B5D669A24@whamcloud.com> Message-ID: What does 2.12.90 tag mean on branch 2.12 ? Last release on LTS branch 2.12 ? Or am I reading in it too much ? Alex. ________________________________ From: lustre-devel on behalf of Oleg Drokin Sent: Friday, November 8, 2019 11:51 AM To: Lustre Development List Subject: [lustre-devel] New tag and branch split Hello! I just split off b2_13 branch from master for final touches of 2.13 release and so we can continue landing other patches (of which there’s now quite a backlog) b2_13 in in codefreeze and will be tagged RC soon. Here’s the changelog: ... cut ... Oleg Drokin (4): ... cut ... New tag 2.12.90 _______________________________________________ lustre-devel mailing list lustre-devel at lists.lustre.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From pjones at whamcloud.com Fri Nov 8 23:21:59 2019 From: pjones at whamcloud.com (Peter Jones) Date: Fri, 8 Nov 2019 23:21:59 +0000 Subject: [lustre-devel] New tag and branch split Message-ID: Alex The release numbering convention is that for build numbers x.y.z that the numbers 50 to 99 are reserved for development builds for the release y+1. So, it is orthogonal to the 2.12.x LTS releases, which are based on the b2_12 branch, not the master branch Peter From: lustre-devel on behalf of Alexander I Kulyavtsev Date: Friday, November 8, 2019 at 2:36 PM To: Oleg Drokin , Lustre Development List Subject: Re: [lustre-devel] New tag and branch split What does 2.12.90 tag mean on branch 2.12 ? Last release on LTS branch 2.12 ? Or am I reading in it too much ? Alex. ________________________________ From: lustre-devel on behalf of Oleg Drokin Sent: Friday, November 8, 2019 11:51 AM To: Lustre Development List Subject: [lustre-devel] New tag and branch split Hello! I just split off b2_13 branch from master for final touches of 2.13 release and so we can continue landing other patches (of which there’s now quite a backlog) b2_13 in in codefreeze and will be tagged RC soon. Here’s the changelog: ... cut ... Oleg Drokin (4): ... cut ... New tag 2.12.90 _______________________________________________ lustre-devel mailing list lustre-devel at lists.lustre.org -------------- next part -------------- An HTML attachment was scrubbed... URL: