summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2021-02-16Add rust 1.46.0Steven Walter
2021-02-16rust: use PARALLEL_MAKE instead of BB_NUMBER_THREADSMartin Jansa
* BB_NUMBER_THREADS is number of bitbake tasks running in parallel, not parallelization inside individual tasks * use oe.utils.parallel_make_argument to make sure it works even when people add e.g. "-l 10" in PARALLEL_MAKE * with the recent improvements for rust-native build time, I wanted to rerun some build time tests from https://github.com/shr-project/test-oe-build-time here are the results on AMD Threadripper 3970x with 128GB ram: BB is BB_NUMBER_THREADS PM is PARALLEL_MAKE TIME BB PM Description 20:50 * * zeus based build with 1.37 rust (BB/PM has no impact) 14:50 8 32,48,64 dunfell, 1.43 as in https://github.com/meta-rust/meta-rust/commit/d2ff87ca5545b8081b16ac8f53ed4295593208c6 (PM has no impact, because bootstrap uses BB) 9:50 8 32,48,64 dunfell, 1.43 with this patch applied, it doesn't get faster after some threashold of PM 13:32 8 64 dunfell, 1.43 with this patch applied and "rust.inc: cut build time in half" (https://github.com/meta-rust/meta-rust/commit/afcb58e5b9cbda7efb1c8a12c980cb2f583728bd) reverted 13:30 8 64 dunfell, 1.43 with "rust.inc: cut build time in half" (https://github.com/meta-rust/meta-rust/commit/afcb58e5b9cbda7efb1c8a12c980cb2f583728bd) as well as "rust.inc: run bootstrap.py in parallel" (https://github.com/meta-rust/meta-rust/commit/40a6bd8a8d943eff495c7fdeb0bf8452891f6f99) reverted to see if 1.43 builds faster without any meta-rust improvements compared to 1.37 94:47 1 64 dunfell, 1.43 as in https://github.com/meta-rust/meta-rust/commit/d2ff87ca5545b8081b16ac8f53ed4295593208c6 (either something went wrong or explicit "-j 1" disables some parallelism done by default already 13:40 * * zeus based build with 1.39 rust (BB/PM has no impact) 10:50 8 64 zeus based build with 1.39 rust as proposed in jansa/new-zeus-branch 80:51 8 1 zeus based build with 1.39 rust as proposed in jansa/new-zeus-branch with "-j 1" PARALLEL_MAKE Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2021-02-16rust.inc: whitelist BB_NUMBER_THREADS in do_compileTyler Hall
d55cce6b8b6b510bf4905f19b949f7995af57a4d added a use of BB_NUMBER_THREADS which is not whitelisted in Poky. This caused machines with a different number of CPUs to have different sstate for rust-native.
2021-02-16Bump to Rust version 1.43Alistair Francis
Signed-off-by: Alistair Francis <alistair@alistair23.me>
2021-02-16Revert "cargo: fix progress output"Steven Walter
This reverts commit dd0fc89389d3f72fe025f71507e6cb1865b0829d.
2021-02-16cargo: fix progress outputSteven Walter
This patch got dropped from the new cargo version
2021-02-16rust.inc: cut build time in halfSteven Walter
Don't tar everything up just to untar it again. This literally takes longer than actually building the rust compiler
2021-02-16rust.inc: run bootstrap.py in parallelSteven Walter
Allow bootstrap.py to use as many cores as bitbake normally uses
2021-02-16rust.inc: make max-atomic-width an integerSteven Walter
As a string this was actually being ignored. It mostly didn't matter because max-atomic-width falls back to target-pointer-size, and they are usually the same. However, at least on i586, 64-bit atomics are supported with a 32-bit pointer size.
2021-02-16rust-native shouldn't depend on TARGET variablesSteven Walter
The whole point of rust-native is that it should be common for all targets. If we reference TARGET variables during the build of rust-native, then bitbake will build a different version for different TARGETS.
2021-02-16rustfmt: Upgrade to 1.4.2Khem Raj
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2021-02-16Avoid extra sh process from shell wrapperAngus Lees
`exec` from shell wrapper to avoid persistent sh process
2021-02-16Update 0001-Disable-http2.patch for cargo 1.41.0Colin Finck
2021-02-16Update to Rust 1.41.0Colin Finck
2021-02-16rust: add a language demo image to test reproducibilityRandy MacLeod
The image should contain a demo program from a variety of languages but let's start with rust. Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
2021-02-16cargo: Refresh http2 disable patchAlex Kiernan
Fixes: WARNING: Fuzz detected: checking file Cargo.toml Hunk #1 succeeded at 24 with fuzz 1. Signed-off-by: Alex Kiernan <alex.kiernan@gmail.com>
2021-02-16Update 0001-Disable-http2.patch for Cargo shipped with Rust 1.40.0Colin Finck
2021-02-16Update to Rust and Cargo 1.40.0.Colin Finck
2021-02-16rust: Use Python3 native for buildAlistair Francis
Use Python3 as the native Python instead of Python2. Signed-off-by: Alistair Francis <alistair@alistair23.me>
2021-02-16rust: Improve TUNE_FEATURE parsingZubair Lutfullah Kakakhel
Since https://github.com/openembedded/openembedded-core/commit/ac83d22eb5031f7fdd09d34a1a46d92fd3e39a3c The armvX arch definition is not present in TUNE_FEATURES but is now in MACHINEOVERRIDES. Improve parsing so that MACHINEOVERRIDES is also checked. Fixes #240 Tested on raspberrypi3 with balenaOS which uses rust. Signed-off-by: Zubair Lutfullah Kakakhel <zubair@balena.io>
2021-02-16Update to Rust and Cargo 1.39.0Reto Schneider
2021-02-16rust: mv README.md to recipes-devtools/rust/README-rust.mdRandy MacLeod
Import the meta-rust/README.md but relocate and rename it. Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
2021-02-16meta-rust: move code to oe-core from meta-rust layerRandy MacLeod
Rust is becoming more widely used so move the meta-rust layer. Taken from meta-rust at commit: 11aed43 cargo-1.37.0: fix patch fuzz Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
2021-02-16Add libgit2, libssh2 from meta-oe for rustRandy MacLeod
Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
2021-02-16local.conf.sample.extended: fix double 'of' typoVivien Didelot
Remove the redundant 'of' word in the INITRAMFS_IMAGE comment. (From meta-yocto rev: 200b05182c74f3f4f778907d5ee92831adb3d77e) Signed-off-by: Vivien Didelot <vdidelot@pbsc.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16bitbake: contrib: Add Dockerfile for building hash serverJoshua Watt
Adds a Dockerfile for build the reference hash equivalence server in a container (Bitbake rev: d9a0a88db5888039bfbb6ce5129b43350f79b1c1) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16selftest/reproducible: Update exclusionsRichard Purdie
Add ruby-ri-docs and meson back as not reproducible, remove watchdog, xorg-minimal-fonts and xmlto as issues fixed. (From OE-Core rev: 5e209a7455a231342cded99985b4a6caff424e4f) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16xmlto: Fix reproducibilityRichard Purdie
Don't hardcode the host's grep path into xmlto. (From OE-Core rev: a7d78971df193c321c309481749fc30cae77788c) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16xorg-fonts-minimal: Fix reproducibilityRichard Purdie
When installing the font files, preserve their timestamp rather than using the current time which fixes reproducibility issues. (From OE-Core rev: a0c4f4b0182a995f0eb2709cc9b3c852527ab936) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16watchdog: Avoid reproducibility failures after fixing buildRichard Purdie
Add some temporary bumps to versions to change the output hash so the fix applies correctly. Can be dropped next time we update the recipe and the output changes. (From OE-Core rev: 69205edcdff865048e55a6b7feaf82064ebc10c5) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16watchdog: Fix determinism issue from sendmail host pathRichard Purdie
The build was injecting the path of the host's sendmail binary. Set this deterministically to match OE's path for it. (From OE-Core rev: 476328b91ea4417160580d28df4fcc1147d85ae2) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16oeqa: reproducible: Add more loggingJoshua Watt
The reproducible build tests can take a long time, so having more logging messages at various points in the build can help debug where the build is taking a long time. (From OE-Core rev: 6b792afe8759d62af8e713b86dad8f6721961a05) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16oeqa: reproducible: Fix SSTATE_MIRRORS variableJoshua Watt
The SSTATE_MIRRORS variable was misspelled, which allowed the "clean" test build to pull from the mirror. (From OE-Core rev: e42497bd84d0bb370a9f7b0448bff29f01fd1b0c) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16buildtools-extended-tarball: Add glibc-gconvs needed for buildRichard Purdie
When building vim it tries to rebuild files using iconv. If this fails the build continues anyway but the output is not determnistic as builds using a hosttools tarball are different from builds where there isn't a hosttools tarball. Add the needed gconvs to the tarball when iconv is present to become determistic and generate vim locales consistently. (From OE-Core rev: b945652a088f430a2adec6b968cd00c5928d4272) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16quilt: Be determnistic about column presenceRichard Purdie
I've seen local differences in the quilt output depending on whether the column binary was available in the sysroot. Fix determinism issues by being specific about configuration. (From OE-Core rev: 0cd5fba8634bcc679518f98cc25be66a51081372) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16package_manager/deb: Fix image generation with package removalRichard Purdie
When building SDKs with the deb backend you could see errors like: Setting up nativesdk-python3-ndg-httpsclient (0.5.1-r0) ... mkdir: cannot create directory ‘/usr/lib/opkg’: Permission denied dpkg: error processing package nativesdk-python3-ndg-httpsclient (--configure): which is due to environment misconfiguration when removing packages. Fix this by setting the same environment variables as used for installation. (From OE-Core rev: f23c7e319a192ada14bb9a82822ef2967309aaea) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16vim: Fix a race over creation of the desktop filesRichard Purdie
The LINGUAS file can be written by two different Makefile targets and if they race, the desktop file contents isn't deterministic. Fix the makfile to avoid this. (From OE-Core rev: 416bc7b697764075fbf73683cd8bddf36d839244) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16vim: Improve determinismRichard Purdie
Add a couple of configure options to avoid determism issues in the vim build. This can happen due to the addition of glib-2.0 to the native sysroot through later task additions to the sysroot through indirect dependencies. (From OE-Core rev: 914f86054f5ea0a115767c1b3d9cdb4c4ef9545b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16weston-init: Fix weston-keyboard path in weston.iniMarek Vasut
The weston-keyboard executable is installed into /usr/libexec instead of /usr/lib/weston , correct the path in weston.ini . (From OE-Core rev: 56dee47a5ddb1da66d30f894a282d0658dcc930c) Signed-off-by: Marek Vasut <marex@denx.de> Cc: Khem Raj <raj.khem@gmail.com> Cc: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16cwautomacros: Ensure version is set deterministicallyRichard Purdie
The makefile injects the current date into the version file. Do this deterministically with SOURCE_DATE_EPOCH. (From OE-Core rev: 31f2ad739ea776a1e11b5cef5434df188007c7bf) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16classes: Drop now unneeded umask flagsRichard Purdie
Now that 022 is the default in BB_DEFAULT_UMASK in bitbake.conf, we don't need any of these task flags, clean up. (From OE-Core rev: 816fca781943a7dbf40391d9db34c7bf12711962) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16bitbake.conf: Set as default task umask of 022Richard Purdie
Rather than trying to set the umask of every task to the correct value for determinism, set one value globally. This uses a new bitbake variable so bump the minimum version to match. This fixes strange determinism issues in at least quilt-ptest, valgrind-ptest and kernel-devsrc. (From OE-Core rev: b07b7deeae3d519d9998d583592f3e4f8f2802b3) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16go: Update to 1.15.8Khem Raj
(From OE-Core rev: 2b724599e29808014f5d9c1fdc70d20abab9b3e5) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16musl: Update to latest masterKhem Raj
Brings in following changes * e5d28236 riscv64: define ELF_NFPREG * 964104f9 math: fix expm1f overflow threshold * c4c38e63 math: fix acoshf for negative inputs * 074932c8 fix possible fd leak via missing O_CLOEXEC in pthread_setname_np * 9b77aaca oldmalloc: preserve errno across free * 98b9df99 fix build regression in oldmalloc * 2010df0d preserve errno across free * 9afed99c fix inconsistent signature of __libc_start_main * dd5b6384 fail posix_spawn file_actions operations with negative fds (From OE-Core rev: 9e71e44db51c73cae2d493bee2f43c37025befbb) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16tar: update to 1.34Oleksandr Kravchuk
(From OE-Core rev: 6dd51b6d2f2c7110d8c2755dadcdb04f60db7d83) Signed-off-by: Oleksandr Kravchuk <open.source@oleksandr-kravchuk.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16mtd-utils: Remove duplicate assignments to alternative link namesThomas Viehweger
The two duplicate lines are not needed. The existence is confusing. (From OE-Core rev: 36bdb4faa90dc18bc020481eba82ee570b968c39) Signed-off-by: Thomas Viehweger <patchesThomas.Vie@web.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16gdb: Drop SIGRTMIN definition patchKhem Raj
This has been already fixed in gdb via https://sourceware.org/pipermail/gdb-patches/2015-October/128532.html and W_STOPCODE is fixed by including gdbsupport/gdb_wait.h in nat/linux-nat.h (From OE-Core rev: b5bafde095fedb2c6f6a526c647dd08f07444f6f) Signed-off-by: Khem Raj <raj.khem@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16systemd: Simplify mount error patchRichard Purdie
As mentioned during review, this patch can be less invasive and hence easier to maintain. Improve as such. (From OE-Core rev: 3a1bd768e62a493aa73e82f5c443ca28b108af51) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16bitbake: bitbake: Bump version to 1.49.2Richard Purdie
This allows metadata to rely upon BB_DEFAULT_UMASK. (Bitbake rev: 969ac64adab236ce2d5196bcc294005a497913ae) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-02-16bitbake: bitbake-worker/runqueue: Add support for BB_DEFAULT_UMASKRichard Purdie
Currently each task has to have a umask specified individually. This is leading to determinism issues since it is easy to miss specifying this for an extra task. Add support for specifing the default task umask globally which simplifies the problem. (Bitbake rev: 3e664599fd54a8a37ce587022fcbce5ca26f2ed3) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>