aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2016-11-16data_smart: Default to expansion for getVar/getVarFlagsrpurdie/wipqueue6Richard Purdie
We've been building to this for a while, default to return expanded values for getVar/getVarFlags. We can then go through and remove the "True" option to many of the calls to this function, all funcion calls should have a default by now though since the parameter has been required for a while. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-16data: Drop deprecated old style bitbake APIRichard Purdie
The old style bb.data.getVar/setVar API has long since been deprecated in favour of d.getVar/setVar and friends. Now we're about to change the default expansion parameter, drop the old APIs to simplify the transision and ensure everyone is using the new style functions. Conversion is trivial if there are remaining stragglers. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-16binconfig: Use d.getVarRichard Purdie
The bb.data API is deprecated, use d.getVar instead. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-16lib/bb: Don't use deprecated bb.data.getVar/setVar APIRichard Purdie
The old style bb.data.getVar/setVar API is obsolete. Most of bitbake doesn't use it but there were some pieces that escaped conversion. This patch fixes the remaining users. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-14runqueue: task world fixRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03siggen: Ensure taskhash mismatches don't override existing dataRichard Purdie
We recalculate the taskhash to ensure the version we have matches what we think it should be. When we write out a sigdata file, use the calculated value so that we don't overwrite any existing file. This leaves any original taskhash sigdata file intact to allow a debugging comparision. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03siggen: Pass basehash to worker processes and sanity check reparsing resultRichard Purdie
Bitbake can parse metadata in the cooker and in the worker during builds. If the metadata isn't deterministic, it can change between these two parses and this confuses things a lot. It turns out to be hard to debug these issues currently. This patch ensures the basehashes from the original parsing are passed into the workers and that these are checked when reparsing for consistency. The user is shown an error message if inconsistencies are found. There is debug code in siggen.py (see the "Slow but can be useful for debugging mismatched basehashes" commented code), we don't enable this by default due to performance issues. If you run into this message, enable this code and you will find "sigbasedata" files in tmp/stamps which should correspond to the hashes shown in this error message. bitbake-diffsigs on the files should show which variables are changing. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03build: Ensure we preserve sigbasedata files as well as sigdata onesRichard Purdie
We don't remove sigdata files, we also shouldn't remove sigbasedata files. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03rm_work: Ensure we don't remove sigbasedata filesRichard Purdie
We don't remove sigdata files, we also shouldn't remove sigbasedata files. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03sstate: Ensure we don't remove sigbasedata filesRichard Purdie
We don't remove sigdata files, we also shouldn't remove sigbasedata files. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03chrpath: Remove standard search paths from RPATHSRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03Revert "Add shared make jobserver support"Richard Purdie
This reverts commit 8ea1108cad6f75b92dece1cb3095529ce8c0a3e9.
2016-11-03Add shared make jobserver supportRichard Purdie
This is a WIP to add a make job server into bitbake. This means the pool of make tokens is central and shared by all tasks executed instead of the current one job pool per task. Currently we can end up with many more make subprocesses executing that is intended or optimal. Implementation wise, make usually uses a pipe for this functionality. Here we substitute a named pipe (fifo) and intercept the make commands, passing in file descriptors to the central fifo. This assumes knowledge of make's internal API, on the plus side it hasn't changed since 1999. Looking to the future we could dynamically control the pool but one step at a time. TODO: * Remove hardcoded /tmp/makefifo and use something in TMPDIR or similar (alongside the lock file?) * Remove hardcoded make threads number and set from PARALLEL_MAKE * If PARALLEL_MAKE = "", don't set MAKEARGS (currently parallelism is set everywhere) (need to check for -j in make commandline) I'm sending this out so at least the code is available to people. Its not ready for merging in its current form but might be the basis for someone else to finish this up, it also gives us something we can test the performance implications with. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03knotty: Show task elapsed timeRichard Purdie
Its often useful to know how long a task has been running for. This patch adds that information to the task display, updating every 5s if there were no other updates so the user can see how long tasks have been running for. [YOCTO #9737] Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03smart: pathalogical testcaseRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03Revert "qemurunner: Add cpulimit call"Richard Purdie
This reverts commit a9f86cbdb2a0e4b848020df0c14d532238ca99f9.
2016-11-03qemurunner: Add cpulimit callRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03testsdk: Improve loggingRichard Purdie
2016-11-03devshell: Error handling improvementRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03scripts: Add symlink to real utils (perf optimise experiment)Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03data_smart: Don't cache/process capitalised overridesRichard Purdie
Bitbake now only processes overrides which are lowercase since this allows variables like SRC_URI not to pollute the cache. There was a corner case where XXX_append_SomeThing was still being processed (yet XXX_append_SomeThing_SomeOtherThing would not be). This patch ensures we're consistent and only process lowercase _append/_prepend and _remove operators too. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03Revert "siggen: Experiment to always write data about the base siginfo"Richard Purdie
This reverts commit f5c3b56e5e2cc32380895ca476ca7dbbdf86e81c.
2016-11-03siggen: Experiment to always write data about the base siginfoRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03base: Simplify BASEDEPENDS constructionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03useradd: base-passwd debug/experimentRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03quieterr debugRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03tests/fetch: Improve failure messageRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03selftest: Add basic useradd testRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03useradd: Add debugging for multiple conflicting usersRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03Revert "debug junk"Richard Purdie
This reverts commit e6003ca8829a389e1e5ae9e8410c025735087e77.
2016-11-03debug junkRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03core-image-base: Extra debugRichard Purdie
2016-11-03gcc-configure/gcc-target: Move arm6/7 config to target onlyRichard Purdie
We only build one gcc-cross per architecture and having target specific flags means gcc-cross would rebuild. These flags are really for the on target case, so they should be set in gcc-target only. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03machine/qemu: Switch to use .xz instead of bz2Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03image_types: Use pixz for .xz compressionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03lib/oe/manifest: Reverse multilib application orderRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03runqueue: Debugging/docs fixesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03packagegroup-self-hosted: Drop things not needed to local experiments ↵Richard Purdie
(mainly webkit) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03bitbake-worker: Add configure optimisation test codeRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03buildstats: Hacks to profile tasks using perf or straceRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03process: Add optional timestamp functionalityRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03buildhistory.bbclass: Break up the find to catch failuresMark Hatle
If for some reason the 'find' operation were to fail, the buildhistory would not fail, but instead store invalid history! [YOCTO #9031] Note this fixes the symptom, but not the cause of 9031. That is a separate issue, see the defect for more details on the work being done to resolve the cause of the failure. (From OE-Core rev: 0c3efaabec2223185f2697a60ae72addffc2ec2d) Signed-off-by: Mark Hatle <mark.hatle@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03toolchain-script: use immediate expansion for TOOLCHAIN_CONFIGSITE_NOCACHEChen Qi
Use immediate expansion for the assignment to avoid other classes modifying variables like HOST_ARCH which changes the result. This happens in the meta-environment recipe. It inherits cross-canadian which changes HOST_ARCH from TARGET_ARCH to SDK_ARCH, resulting in wrong site config files in the generated SDK. (From OE-Core rev: 22d4ee68d108dfcbee0ed770453d61abd514c52f) Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03forktest: addRoss Burton
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03Revert "oeqa/selftest/sstatetests: remove obsolete exclusion"Richard Purdie
This reverts commit ac520c8860c374d9da1bccef1d3d5a6610e3a903. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03oeqa/selftest/sstatetests: remove obsolete exclusionRoss Burton
These changes have been fixed in oe-core now, so remove the workaround. (From OE-Core rev: fda272a0645fc55d30c8c7e1f3e11e0384838301) Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03bitbake: data/event/siggen: Fix various exceptions [FIXME]Richard Purdie
(Bitbake rev: c4cd03ed0ec581fac4d034a60f73dc530d20d443) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03build summary: add TCMODE to build summaryArmin Kuster
(From OE-Core rev: 5a2fc7fd2735efee00373ddfb6a15415df3bec0b) Signed-off-by: Armin Kuster <akuster808@gmail.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03build summary: add gcc version being used.Armin Kuster
(From OE-Core rev: cda8b6d9c69b190631c15728dacaa1620ea54d6c) Signed-off-by: Armin Kuster <akuster@mvista.com> Signed-off-by: Ross Burton <ross.burton@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2016-11-03Revert "bitbake.conf: Disable api-docs temporarily"Richard Purdie
This reverts commit 96ac471c358dee1844b22105269c2b4a791ccea0. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>