]> git.proxmox.com Git - mirror_zfs.git/commit
Perform KABI checks in parallel
authorBrian Behlendorf <behlendorf1@llnl.gov>
Tue, 1 Oct 2019 19:50:34 +0000 (12:50 -0700)
committerGitHub <noreply@github.com>
Tue, 1 Oct 2019 19:50:34 +0000 (12:50 -0700)
commit608f8749a1055e6769899788e11bd51fd396f9e5
tree91f45b006e07d030881c058d29874438ed46a26f
parent99573cc05339ee04e80eb49c68f62d310da92ec7
Perform KABI checks in parallel

Reduce the time required for ./configure to perform the needed
KABI checks by allowing kbuild to compile multiple test cases in
parallel.  This was accomplished by splitting each test's source
code from the logic handling whether that code could be compiled
or not.

By introducing this split it's possible to minimize the number of
times kbuild needs to be invoked.  As importantly, it means all of
the tests can be built in parallel.  This does require a little extra
care since we expect some tests to fail, so the --keep-going (-k)
option must be provided otherwise some tests may not get compiled.
Furthermore, since a failure during the kbuild modpost phase will
result in an early exit; the final linking phase is limited to tests
which passed the initial compilation and produced an object file.

Once everything has been built the configure script proceeds as
previously.  The only significant difference is that it now merely
needs to test for the existence of a .ko file to determine the
result of a given test.  This vastly speeds up the entire process.

New test cases should use ZFS_LINUX_TEST_SRC to declare their test
source code and ZFS_LINUX_TEST_RESULT to check the result.  All of
the existing kernel-*.m4 files have been updated accordingly, see
config/kernel-current-time.m4 for a basic example.  The legacy
ZFS_LINUX_TRY_COMPILE macro has been kept to handle special cases
but it's use is not encouraged.

                  master (secs)   patched (secs)
                  -------------   ----------------
autogen.sh        61              68
configure         137             24  (~17% of current run time)
make -j $(nproc)  44              44
make rpms         287             150

Reviewed-by: Tony Hutter <hutter2@llnl.gov>
Signed-off-by: Brian Behlendorf <behlendorf1@llnl.gov>
Closes #8547
Closes #9132
Closes #9341
119 files changed:
.gitignore
Makefile.am
config/iconv.m4
config/kernel-access-ok-type.m4
config/kernel-acl.m4
config/kernel-aio-fsync.m4
config/kernel-automount.m4
config/kernel-bdev-logical-size.m4
config/kernel-bdev-physical-size.m4
config/kernel-bdi.m4
config/kernel-bio-bvec-iter.m4
config/kernel-bio-end-io-t-args.m4
config/kernel-bio-failfast.m4
config/kernel-bio-op.m4
config/kernel-bio-rw-barrier.m4
config/kernel-bio-rw-discard.m4
config/kernel-bio_set_dev.m4
config/kernel-blk-queue-bdi.m4
config/kernel-blk-queue-discard.m4
config/kernel-blk-queue-flags.m4
config/kernel-blk-queue-flush.m4
config/kernel-blk-queue-max-hw-sectors.m4
config/kernel-blk-queue-max-segments.m4
config/kernel-blk-queue-unplug.m4
config/kernel-blkdev-get-by-path.m4
config/kernel-blkdev-reread-part.m4
config/kernel-block-device-operations.m4
config/kernel-clear-inode.m4
config/kernel-commit-metadata.m4
config/kernel-config-defined.m4 [new file with mode: 0644]
config/kernel-create-nameidata.m4
config/kernel-ctl-table-name.m4
config/kernel-current-time.m4
config/kernel-current_bio_tail.m4
config/kernel-d-make-root.m4 [deleted file]
config/kernel-d-obtain-alias.m4 [deleted file]
config/kernel-d-prune-aliases.m4 [deleted file]
config/kernel-declare-event-class.m4
config/kernel-dentry-operations.m4
config/kernel-dirty-inode.m4
config/kernel-discard-granularity.m4
config/kernel-elevator-change.m4
config/kernel-encode-fh-inode.m4
config/kernel-evict-inode.m4
config/kernel-fallocate-pax.m4 [deleted file]
config/kernel-fallocate.m4
config/kernel-file-dentry.m4
config/kernel-file-inode.m4
config/kernel-fmode-t.m4
config/kernel-follow-down-one.m4
config/kernel-fpu.m4
config/kernel-fst-mount.m4
config/kernel-fsync.m4
config/kernel-generic_io_acct.m4
config/kernel-generic_readlink.m4
config/kernel-get-disk-and-module.m4
config/kernel-get-disk-ro.m4
config/kernel-get-link.m4
config/kernel-global_page_state.m4
config/kernel-group-info.m4
config/kernel-in-compat-syscall.m4
config/kernel-inode-getattr.m4
config/kernel-inode-lock.m4
config/kernel-inode-set-flags.m4
config/kernel-inode-set-iversion.m4
config/kernel-inode-times.m4
config/kernel-insert-inode-locked.m4
config/kernel-invalidate-bdev-args.m4
config/kernel-is_owner_or_cap.m4
config/kernel-kmap-atomic-args.m4
config/kernel-kmem-cache.m4
config/kernel-kstrtoul.m4
config/kernel-ktime_get_coarse_real_ts64.m4
config/kernel-kuid-helpers.m4
config/kernel-kuidgid.m4
config/kernel-lookup-bdev.m4
config/kernel-lookup-nameidata.m4
config/kernel-lseek-execute.m4
config/kernel-make-request-fn.m4 [new file with mode: 0644]
config/kernel-misc-minor.m4
config/kernel-mk-request-fn.m4 [deleted file]
config/kernel-mkdir-umode-t.m4
config/kernel-mod-param.m4
config/kernel-objtool.m4
config/kernel-open-bdev-exclusive.m4
config/kernel-pde-data.m4
config/kernel-put-link.m4
config/kernel-rename.m4
config/kernel-rw.m4
config/kernel-rwsem.m4
config/kernel-sched.m4
config/kernel-security-inode-init.m4
config/kernel-set-nlink.m4
config/kernel-setattr-prepare.m4
config/kernel-sget-args.m4
config/kernel-show-options.m4
config/kernel-shrink.m4
config/kernel-submit_bio.m4
config/kernel-super-userns.m4
config/kernel-timer.m4
config/kernel-tmpfile.m4
config/kernel-totalhigh_pages.m4
config/kernel-totalram-pages-func.m4
config/kernel-truncate-range.m4
config/kernel-truncate-setsize.m4
config/kernel-urange-sleep.m4 [deleted file]
config/kernel-userns-capabilities.m4
config/kernel-usleep_range.m4 [new file with mode: 0644]
config/kernel-vfs-direct_IO.m4
config/kernel-vfs-fsync.m4
config/kernel-vfs-getattr.m4
config/kernel-vfs-iterate.m4
config/kernel-vfs-rw-iterate.m4
config/kernel-wait.m4
config/kernel-xattr-handler.m4
config/kernel-zlib.m4
config/kernel.m4
config/zfs-build.m4
config/zfs-meta.m4