[Lustre-discuss] configure error using Lustre 2.3 and OFED 3.5

Shuichi Ihara sihara at ddn.com
Sat Apr 20 03:22:55 PDT 2013


Hi,

The lustre patches to build with OFED-3.5 are landed in master branch, but not included in lustre-2.3.
try this patch http://review.whamcloud.com/3011 (also need http://review.whamcloud.com/6048)

btw, did you apply any patches to OFED-3.5 to build with RHEL6.4's kernel?
As far as I tested, compat-driver didn't work on the latest RHEL6.4's kernel. I've filed on compat-driver's bugzilla and it was fixed in the latest branch. https://bugzilla.kernel.org/show_bug.cgi?id=55971

Also, compat-rdma failed on the latest RHEL6.3 kernel as well as RHEL6.4. It was filed at ofed bugzilla as well.
see http://bugs.openfabrics.org/show_bug.cgi?id=2421 and https://jira.hpdd.intel.com/browse/LU-2975

Anyway, we are waiting for these fixes for the Lustre.

Thanks
Ihara
 
On Apr 20, 2013, at 2:15 PM, "Hebenstreit, Michael" <michael.hebenstreit at intel.com> wrote:

> Could solve it - the problem was only in configure; to compile conftest.c some changes in the OFED header were necessary (note - I think the changes make sense there, as the header file uses functions otherwise undefined):
> 
> ofed/3.5/src/compat-rdma/include/rdma/ib_addr.h
> 
>    #include <rdma/ib_pack.h>
> +   #include <linux/rtnetlink.h>
> +
> +   #if (LINUX_VERSION_CODE < KERNEL_VERSION(3,2,0))
> +
> +   extern int __ethtool_get_settings(struct net_device *dev,
> +                                      struct ethtool_cmd *cmd);
> +   #endif
> 
>    struct rdma_addr_client {
>            atomic_t refcount;
>            struct completion comp;
>    };
> 
> There is also another error, but without any impact. Configure tries to source src/ofa_kernel/config.mk - in earlier versions this was a simple config file of the form "PARAM=VALUE"; now the file is in Makefile format; sourcing that from configure as bourne shell script is .. not advisable
> 
> Michael
> 
> -----Original Message-----
> From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Hebenstreit, Michael
> Sent: Friday, April 19, 2013 5:39 PM
> To: Diep, Minh; Lustre-discuss at lists.lustre.org
> Subject: Re: [Lustre-discuss] configure error using Lustre 2.3 and OFED 3.5
> 
> That's not my problem - OFED is working, Lustre is not willing to compile :P
> 
> Michael
> 
> -----Original Message-----
> From: Diep, Minh 
> Sent: Friday, April 19, 2013 5:33 PM
> To: Hebenstreit, Michael; Lustre-discuss at lists.lustre.org
> Subject: Re: [Lustre-discuss] configure error using Lustre 2.3 and OFED 3.5
> 
> Ofed 3.5 does not support Rhel6.4 kernel yet. I believe 3.5.1 will
> 
> Thanks
> -Minh
> 
> On 4/19/13 5:05 PM, "Hebenstreit, Michael" <michael.hebenstreit at intel.com>
> wrote:
> 
>> Configure fails at testing for openib - anyone an idea?
>> Thanks
>> Michaell
>> 
>> configure:10034: checking whether to enable OpenIB gen2 support
>> configure:10138: cp conftest.c build && make -d modules  CC=gcc -f 
>> /home/mhebenst/lustre-2.3.0/build/Makefile LUSTRE_LINUX_CONFIG=/adm 
>> in/extra/linux-2.6.32-358.2.1.el6.x86_64.crt1/.config LINUXINCLUDE= 
>> -I/usr/local/ofed/3.5/src/compat-rdma-3.5/include -I/admin/extra/l 
>> inux-2.6.32-358.2.1.el6.x86_64.crt1/arch/x86/include
>> -I/admin/extra/linux-2.6.32-358.2.1.el6.x86_64.crt1/arch/x86/include/ge
>> ner
>> ated -I
>> /admin/extra/linux-2.6.32-358.2.1.el6.x86_64.crt1/include
>> -I/admin/extra/linux-2.6.32-358.2.1.el6.x86_64.crt1/include
>> -I/admin/extra/l
>> inux-2.6.32-358.2.1.el6.x86_64.crt1/include2 -include 
>> include/linux/autoconf.h -o tmp_include_depends -o scripts -o 
>> include/config/MAR KER -C 
>> /admin/extra/linux-2.6.32-358.2.1.el6.x86_64.crt1
>> EXTRA_CFLAGS=-Werror-implicit-function-declaration -g 
>> -I/home/mhebenst/lustre -2.3.0/libcfs/include 
>> -I/home/mhebenst/lustre-2.3.0/lnet/include
>> -I/home/mhebenst/lustre-2.3.0/lustre/include -I/usr/local/ofed/3.5/sr 
>> c/compat-rdma-3.5/include  M=/home/mhebenst/lustre-2.3.0/build
>> make[1]: Warning: File `/home/mhebenst/lustre-2.3.0/build/conftest.c' 
>> has modification time 7.2e+03 s in the future In file included from 
>> /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/rdma_cm.h:39,
>>                from /home/mhebenst/lustre-2.3.0/build/conftest.c:58:
>> /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/ib_addr.h: In 
>> function âiboe_get_rateâ:
>> /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/ib_addr.h:223:
>> error: implicit declaration of function ârtnl_lockâ
>> /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/ib_addr.h:224:
>> error: implicit declaration of function â__ethtool_get_settingsâ
>> /usr/local/ofed/3.5/src/compat-rdma-3.5/include/rdma/ib_addr.h:225:
>> error: implicit declaration of function ârtnl_unlockâ
>> make[1]: *** [/home/mhebenst/lustre-2.3.0/build/conftest.o] Error 1
>> make: *** [_module_/home/mhebenst/lustre-2.3.0/build] Error 2
>> configure:10141: $? = 2
>> configure: failed program was:
>> | /* confdefs.h.  */
>> | #define PACKAGE_NAME "Lustre"
>> | #define PACKAGE_TARNAME "lustre"
>> | #define PACKAGE_VERSION "LUSTRE_VERSION"
>> | #define PACKAGE_STRING "Lustre LUSTRE_VERSION"
>> | #define PACKAGE_BUGREPORT "http://bugs.whamcloud.com/"
>> | #define PACKAGE "lustre"
>> | #define VERSION "2.3.0"
>> | #define STDC_HEADERS 1
>> | #define HAVE_SYS_TYPES_H 1
>> | #define HAVE_SYS_STAT_H 1
>> | #define HAVE_STDLIB_H 1
>> | #define HAVE_STRING_H 1
>> | #define HAVE_MEMORY_H 1
>> | #define HAVE_STRINGS_H 1
>> | #define HAVE_INTTYPES_H 1
>> | #define HAVE_STDINT_H 1
>> | #define HAVE_UNISTD_H 1
>> | #define SIZEOF_UNSIGNED_LONG_LONG 8
>> | #define CDEBUG_ENABLED 1
>> | #define CDEBUG_ENTRY_EXIT 1
>> | #define LIBCFS_DEBUG 1
>> | #define HAVE_SYS_QUOTA_H 1
>> | #define HAVE_MODULE_LOADING_SUPPORT 1 #define 
>> | HAVE_KERN__U64_LONG_LONG 1 #define HAVE_IS_COMPAT_TASK 1 #define 
>> | HAVE_REGISTER_SHRINKER 1 #define HAVE_SYSCTL_UNNUMBERED 1 #define 
>> | HAVE_SCATTERLIST_SETPAGE 1 #define HAVE_INIT_NET 1 #define 
>> | HAVE_DUMP_TRACE 1 #define HAVE_TRACE_ADDRESS_RELIABLE 1 #define 
>> | HAVE_STACKTRACE_WARNING 1 #define HAVE_CRED_WRAPPERS 1 #define 
>> | HAVE_CPUMASK_SIZE 1 #define HAVE_STRUCT_CRED 1 #define 
>> | HAVE_CPU_TOPOLOGY 1 #define HAVE_TOPOLOGY_CORE_CPUMASK 1 #define 
>> | HAVE_TOPOLOGY_THREAD_CPUMASK 1 #define HAVE_CPUMASK_OF_NODE 1 #define 
>> | HAVE_STRUCT_SHASH_ALG 1 #define HAVE_UNSHARE_FS_STRUCT 1 #define 
>> | HAVE_SOCK_MAP_FD_2ARG 1 #define HAVE_SET_MEMS_ALLOWED 1 #define 
>> | STACKTRACE_OPS_HAVE_WALK_STACK 1 #define 
>> | HAVE_SHRINKER_WANT_SHRINK_PTR 1 #define HAVE_LINUX_OOM_H 1 #define 
>> | HAVE_OOMADJ_IN_SIG 1 #define HAVE_SYSCTL_CTLNAME 1 #define 
>> | HAVE_DEV_GET_BY_NAME_2ARG 1
>> | /* end confdefs.h.  */
>> |
>> | #include <linux/kernel.h>
>> |
>> |                       #include <linux/version.h>
>> |                       #include <linux/pci.h>
>> |                       #include <linux/gfp.h>
>> |                       #include <rdma/rdma_cm.h>
>> |                       #include <rdma/ib_cm.h>
>> |                       #include <rdma/ib_verbs.h>
>> |                       #include <rdma/ib_fmr_pool.h>
>> |
>> | int
>> | main (void)
>> | {
>> |
>> |                       struct rdma_cm_id      *cm_idi __attribute__
>> ((unused));
>> |                       struct rdma_conn_param  conn_param 
>> | __attribute__
>> ((unused));
>> |                       struct ib_device_attr   device_attr __attribute__
>> ((unused));
>> |                       struct ib_qp_attr       qp_attr __attribute__
>> ((unused));
>> |                       struct ib_pool_fmr      pool_fmr __attribute__
>> ((unused));
>> |                       enum   ib_cm_rej_reason rej_reason __attribute__
>> ((unused));
>> |
>> |                       rdma_destroy_id(NULL);
>> |
>> |   ;
>> |   return 0;
>> | }
>> configure:10158: result: no
>> configure:10165: error: can't compile with OpenIB gen2 headers under
>> /usr/local/ofed/3.5/src/compat-rdma-3.5
>> 
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
> 
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss




More information about the lustre-discuss mailing list