summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2021-10-12add ugly spewross/arghRoss Burton
2021-10-12cleanup netrcRoss Burton
2021-10-12sstate: name thread poolRoss Burton
2021-10-12knotty: show thread namesRoss Burton
2021-10-12oe/utils: allow naming threads in threadpoolRoss Burton
2021-10-12codegen: ast fixRoss Burton
2021-10-11Add loggingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10base: Use repr() for printing exceptionsRichard Purdie
Exceptions print more clearly using repr() instead of str(), fix in fetch and unpack tasks. (From OE-Core rev: d65854a2193c4e1ca3eae06b81d94cf15230f3a0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10base: Clean up unneeded len() callsRichard Purdie
(From OE-Core rev: be773970d2feb1aa0c35a09ad3f2eab51dd71bad) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10Revert "Add debug to track down corruption"Richard Purdie
This reverts commit 9f6ad0d4dd990cf51584bb25c1f27cde12febbd6. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10Add debug to track down corruptionRichard Purdie
(From OE-Core rev: 9aa25af68c6795ff9df24b9586e55e89c3cb5119) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: hashserv: Improve behaviour?Richard Purdie
(Bitbake rev: ef87f88d664ed19cd1cacc853f4714a8e89d07ac) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: Revert "siggen: Work around unihash issues"Richard Purdie
This reverts commit c32c2df2fded4c675e50e00e7ade25a6a3be5988. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: siggen: Work around unihash issuesRichard Purdie
Currently we have a bit of a determinism issue with hashequiv since there can be a unihash assigned by the server between our original query and this code reporting the outhash. This is fine if the outhashes are the same but if the outhashes are different (a determinism issue or a different arch situation). If the outhashes do differ, build can then proceed in a different path than a later build doing fresh unihash lookups would proceed in. There are changes on the server side we could make to try and address this but those are invasive this close to release. For now, requery the server and update the unihash. This should avoid the determinism issues and match the behaviour some future server changes will have in a way that is a reasonable workaround for this release. (Bitbake rev: 21ed048c1ea88831e07ced7d8118fe9e39dbc225) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: hashserv: Fix diverging report race conditionJoshua Watt
Fixes the hashequivalence server to resolve the diverging report race error. This error occurs when the same task(hash) is run simultaneous on two different builders, and then the results are reported back but the hashes diverge (e.g. have different outhashes), and one outhash is equivalent to a hash and another is not. If taskhash was not originally in the database, the client will fallback to using the taskhash as the suggested unihash and the server will see reports come in like: taskhash: A unihash: A outhash: B taskhash: C unihash: C outhash: B taskhash: C unihash: C outhash: D Note that the second and third reports are the same taskhash, with diverging outhashes. Taskhash C should be equivalent to taskhash (and unihash) A because they share an outhash B, but the server would not do this when tasks were reported in the order shown. It became clear while trying to fix this that single large table to store all reported hashes was going to make these updates difficult since updating the unihash of all entries would be complex and time consuming. Instead, it makes more sense to split apart the database into two tables: One that maps taskhashes to unihashes and one that maps outhashes to taskhashes. This should hopefully improve the parsing query times as well since they only care about the taskhashes to unihashes table, at the cost of more complex INNER JOIN queries on the lesser used API. Note this change does delete existing hash equivlance data and starts a new database table rather than converting existing data. (Bitbake rev: 268a55b4fdf6c2b77f7167837d141b7043e236b9) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: hashserv: Add tests for diverging reportsJoshua Watt
(Bitbake rev: f8ec98c0d67b4be522e326ac5ec697675ce01988) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: async: Close sync client event loopJoshua Watt
Prevents `ResourceWarning: unclosed event loop` warnings when using the synchronous client and python exits (Bitbake rev: 85d0fdb92846c52564b979d07545059fe400bac8) Signed-off-by: Joshua Watt <JPEWhacker@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: Revert "bitbake-worker: Set BB_CURRENTTASK earlier"Richard Purdie
This reverts commit a37e2b444de2a26073f13da795c09936f9a13129. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-10bitbake: bitbake-worker: Set BB_CURRENTTASK earlierRichard Purdie
(Bitbake rev: 0e11e36b41b1223e001be048b7aadd17e7fd528b) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-09ptest-runner: install -collect-system-data scriptTim Orling
When ptest-runner times out or otherwise fails, it tries to call ptest-runner-collect-system-data, so install the script. The script currently calls dmesg, df, free (which are provided by busybox, etc.) and pstree (which is a sub-package of psmisc). Add pstree as an RDEPENDS. (From OE-Core rev: 4e6be3fb521b23cfc175d0c09725bcc3ebbc73b2) Signed-off-by: Tim Orling <timothy.t.orling@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-09glibc: Drop libcidn packageFred Liu
libcidn has been dropped since glibc 2.28 (From OE-Core rev: cf83790728ad569af01300f793754c0108c78b4e) Signed-off-by: Fred Liu <yclw3d2y@live.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-09lttng-ust: fix do_compile failure for arm32 with DEBUG_BUILD enabledChangqing Li
After upgrade to 2.13.0, for arm32, with DEBUG_BUILD enabled, lttng-ust build failed with error: | /path/to/tmp/work/cortexa15t2hf-neon-poky-linux-gnueabi/lttng-ust/2_2.13.0-r0/recipe-sysroot-native/usr/bin/arm-poky-linux-gnueabi/../../libexec/arm-poky-linux-gnueabi/gcc/arm-poky-linux-gnueabi/11.2.0/ld: ../../../src/lib/lttng-ust/.libs/liblttng-ust.so: undefined reference to `_uatomic_link_error' | collect2: error: ld returned 1 exit status | Makefile:399: recipe for target 'test_ust_error' failed | make[3]: *** [test_ust_error] Error 1 The problem has reported to upstream, and upstream suggests to use -DUATOMIC_NO_LINK_ERROR for the failure case, refer [1]. [1]https://lists.lttng.org/pipermail/lttng-dev/2021-September/030056.html (From OE-Core rev: 722d58bccd5616b3b3364845bbf1121d3cc0c3cd) Signed-off-by: Changqing Li <changqing.li@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08poky.conf: Update tested distros list with recent changesRichard Purdie
(From meta-yocto rev: 4b923df6cb2858864c351fa1fd862547d5ad00c9) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08dev-manual: warn about license compliance issues when static libraries are usedMichael Opdenacker
This partly addresses [YOCTO #14407] (From yocto-docs rev: 444ca8900e8057562d2a71a77e6e6798aca3ce85) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08dev-manual: correct NO_GENERIC_LICENSE section titleMichael Opdenacker
(From yocto-docs rev: 522841b4715295c6f399fc5affe2ade128d139ae) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Reviewed-By: Quentin Schulz <foss@0leil.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08overview-manual: simplify expressionMichael Opdenacker
(From yocto-docs rev: ea1e5d4214f30927119f0124ee8a80a558601161) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08dev-manual: remove errant /Jon Mason
(From yocto-docs rev: 5a10c78c574eae48f50f5c912fd6534bdf99f71c) Signed-off-by: Jon Mason <jdmason@kudzu.us> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08documentation: use YOCTO_DL_URLJon Mason
(From yocto-docs rev: e3ad609d9fce8d6729bf6cb553993bddba1785ae) Signed-off-by: Jon Mason <jdmason@kudzu.us> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08documentation: replace http with https for URLsJon Mason
https has been the preferred way to access websites for many years now. Change all of the URLs with a _working_ https server/certificate to use that URL. (From yocto-docs rev: c77868c780df94356d5f21453f80ace073fade9b) Signed-off-by: Jon Mason <jdmason@kudzu.us> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08manuals: introduce 'yocto_sstate' extlinkMichael Opdenacker
(From yocto-docs rev: f428c8d3bb12bfdb2b2afb03e0e6b80e28fd0e62) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08docs: add "make all" to build old types of docs (html, epub, pdf) at onceMichael Opdenacker
(From yocto-docs rev: 8ce6aa0d4c0985e187464c7578662ff7581bc9ce) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Reviewed-by: Nicolas Dechesne <nicolas.dechesne@linaro.org> Signed-off-by: Quentin Schulz <foss@0leil.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08overview-manual: SVG diagram for the git workflowMichael Opdenacker
Set in full-width mode to make it ready in PDF and EPUB outputs. (From yocto-docs rev: 394c7c26c6591153670c67740d9a64f54725321b) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Reviewed-by: Nicolas Dechesne <nicolas.dechesne@linaro.org> Signed-off-by: Quentin Schulz <foss@0leil.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08conf.py: use PNG first in EPUB outputMichael Opdenacker
SVG directly included in EPUB output has multiple issues, in particular font size and alignment ones (tested on two EPUB readers). Instead, using PNG, generated from SVG when available as the primary format for images. GIF and JPEG are fine too. (From yocto-docs rev: ff3876ca4910cf61bc25bfeb07e65ad6f6a93b48) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Reviewed-by: Nicolas Dechesne <nicolas.dechesne@linaro.org> Signed-off-by: Quentin Schulz <foss@0leil.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08Makefile: allow epub and latexpdf outputs to use diagrams from SVG sourcesMichael Opdenacker
html output is great when directly using SVG epub output has to use exported PNG because of issues using SVG directly latexpdf output cannot use SVG, it needs exported PDF instead This adds rules to generate PNG and PDF formats from new SVG sources. Newly added diagrams have be stored in svg/ subdirectories so that PNG and PDF files generated from SVG can be "gitignored" without ignoring the original PNG diagrams that have no SVG source. Note: had to remove the dependency to "Makefile" in the final "catch-all" target, otherwise it was also catching the SVG to PNG and SVG to PDF targets. (From yocto-docs rev: cd9bbd41d323bc124057396f142010509c65bbaf) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Reviewed-by: Nicolas Dechesne <nicolas.dechesne@linaro.org> Signed-off-by: Quentin Schulz <foss@0leil.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08manuals: replace "apt-get" by "apt"Michael Opdenacker
Modern Debian based distros (such as Ubuntu) now use "apt" instead of "apt-get" Also make sure "apt" is invoked with root privileges (mandatory) (From yocto-docs rev: 380ef2474f3ecc2bce83f11cd838d054bef56d22) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Reviewed-by: Quentin Schulz <foss@0leil.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08documentation: update sources mirror URLJon Mason
The URL for the sources mirror no longer works. Update to the new location. (From yocto-docs rev: 616c326437c03d7f4530168c4c9d6ef50743952e) Signed-off-by: Jon Mason <jdmason@kudzu.us> Reviewed-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08ref-manual: document DEBUG_PREFIX_MAPMichael Opdenacker
Fixes [YOCTO #14433] (From yocto-docs rev: 23eb07c26044d06bc51c757bf1b0a53b1b357dc8) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08manuals: font fixesMichael Opdenacker
This fixes font inconsistencies, mixing a ``text`` string with another string with the regular font, where the whole string makes more sense with a single font. The result is also much simpler and will make future searches easier. (From yocto-docs rev: e6d1c166a97a1b6bb42ca49dfcbd3d39f8eadc16) Signed-off-by: Michael Opdenacker <michael.opdenacker@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: bitbake: replace http with https for URLsJon Mason
https has been the preferred way to access websites for many years now. Change all of the URLs with a _working_ https server/certificate to use that URL. (Bitbake rev: da543cdaf88a387675e25d3555765f1146e4105e) Signed-off-by: Jon Mason <jdmason@kudzu.us> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08yocto-bsp/poky: replace http with https for URLsJon Mason
https has been the preferred way to access websites for many years now. Change all of the URLs with a _working_ https server/certificate to use that URL. (From meta-yocto rev: 89de71da1c1e46d42a5c786bcac76462aa9c31e0) Signed-off-by: Jon Mason <jdmason@kudzu.us> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: bitbake:toaster:test: Update SSTATE URLJon Mason
(Bitbake rev: b3c0dbddd7eb3c87e3989977d7640f09b49a460b) Signed-off-by: Jon Mason <jdmason@kudzu.us> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: bitbake-worker: Handle pseudo shutdown in Ctrl+C caseRichard Purdie
If the build is interrupted, handle the shutdown of pseudo even in this case to avoid data corruption inside docker containers. [YOCTO #14555] (Bitbake rev: a2a04c6fe94bc56efcff299c669a151746e35916) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: knotty/uihelper: Show setscene task progress in summary outputRichard Purdie
With the changes to task accounting, bitbake doesn't show progress when executing setscene tasks on the summary console output. Change to show a progress within the setscene tasks and a progress within the main tasks. I can't see any way to display this more easily without confusing users. [YOCTO #14586] (Bitbake rev: 0244acb968eb593d2ad7bc6e52f222c2b1d39aa9) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: fetch2: npmsw: Add support for local tarball and link sourcesStefan Herbrechtsmeier
(Bitbake rev: 4f983dc419a1a6f635a5d333f253d49244cec374) Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: fetch2: npm: Create config npmrc in environment instantiationStefan Herbrechtsmeier
Create a configuration npmrc per npm environment to avoid repeated creation of the same configuration file. Create the file via python to avoid multiple npm config calls and add the ability to pass a file path instead of a temporary file. Deprecate the npm configs argument of the run function. The configs should be passed to npm environment or as command specific arguments. (Bitbake rev: 2c2df49b06a2bad7a5b8872a9998338a4660498f) Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: fetch2: npm: Support npm archives with missing search directory modeStefan Herbrechtsmeier
Delay directory restore and set execute/search directory mode bits in unpack to support npm archives with a missing search directory mode. (Bitbake rev: 60cbd34d3da8f0f523281aad7eec93eec9cd4db8) Signed-off-by: Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: fetch2/gitsm: remove the 'nugget' SRCREV cachingRoss Burton
The cached revisions which are used to decide if a repository doesn't need to be updated are misleading when used in conjunction with mirror tarballs and can cause partial fetches to happen, resulting in unpack errors as repositories were not fetched. A concrete example: edk2-firmware in meta-arm is at version 202102 (ef91b0). This is built on the autobuilder so the source mirror contains the repository as a mirror tarball. If I build edk2-firmware 202102 the gitsm fetcher will initially download the top-level repository and then iterate into the submodules to also fetch those repositories, including cmocka from cryptomilk.org. edk2-firmware will then unpack and build successfully. I then update edk2-firmware to 202105 (e1999b) and build it. Gitsm.needs_update() starts by calling Git.needs_update() which returns False, as the mirror tarball contains this revision. It then looks at the "nuggets" which are SRCREVs it has fetched before. The mirror tarball itself contains the nugget for e1999b as this has been built on the autobuilder, so needs_update return False, no more fetching is done, and the build proceeds to unpack. However, as part of the 202105 upgrade the URL of the cmocka submodule changed, and this new repository was never fetched. This means that unpack fails as one of the required git repositories isn't available. The nugget codepaths appear to be an attempt at optimising the fetch process, but have demonstratable failure cases. Just removing them entirely solves the edk2-firmware example, and all of the fetcher test cases still pass. (Bitbake rev: 51212507ce3f670ace9efb691c92887d66f7aaf8) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: fetch2: clarify the command-no-found error messageRoss Burton
If runfetchcmd() fails with bb.process.NotFoundError, the message output is simply "Fetch command" which doesn't really explain what the problem is. Add "not found" to clarify what happened. (Bitbake rev: 8de9dc02ed6a73b47f2ab10be30d1aed7954bc72) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: tests/fetch: prefix the FetcherTest temporary directoryRoss Burton
Set a prefix so the temporary directories are identifable. (Bitbake rev: c3440b82cbe9c317f9961d61e12ea37fc9541ce0) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2021-10-08bitbake: tests/utils: mark a regex as a raw stringRoss Burton
Avoids a warning from Python as \s isn't a valid escape. (Bitbake rev: be39c2e926beebe78030fbe26c6737f08f960fcb) Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
generated by cgit 1.2.3-korg (git 2.39.0) at 2024-05-20 09:28:18 +0000