aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2017-08-24oeqa/selftest/cases: systemd_boot enable threaded runsalimon/oe_selftest_threadedAníbal Limón
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/context: Enable support for threaded runsAníbal Limón
Add an option to specify how many threads will be used for execution, default to 1. Add OE_SELFTEST_THREAD_NUM environment variable for be able to set thread num into the Yocto Autobuilder and don't need to figure out the version of oe-selftest script. If the thread_num are greater than 1 the OESelftestContextThreaded will be used, this is due to compatibility reasons. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24seltest/cases/devtool: Build dbus on test_devtool_add_git_localAníbal Limón
The dbus-wait recipe has the dependency of dbus, due to now we have build folder per test class the dependency needs to be build before run devtool add because without it the DEPENDS field is unset. The devtool/recipetool uses previously build recipes to figure out the dependencies. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24selftest/cases/devtool{,end}: Move update/finish_{upgrade,modify} tests to ↵Aníbal Limón
its own module This devtool tests are set to run at end because made changes into the poky repository causing problems (non deteministic meta data) in other execution threads. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: Move devtool deploy test case to own moduleAníbal Limón
The devtool deploy test case uses runqemu that uses tinfoil so tinfoil requires to run on the main thread. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: recipetool enable for threaded runsAníbal Limón
- Change to use wrappers from OESelfTestCase. - Move templayer dir creation to RecipetoolBase class because now every class has its own build folder. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: devtool enable threaded runsAníbal Limón
- Add new class DevtoolCommon to split devtool suite into other modules. - Change to use wrappers from OESelfTest class (runCmd, bitbake). - When remove workspacedir using bitbake-layers use full path because now has it own builddir. - Add a build of xz-native because some tests needs it to decompress tarballs and is supposed to be provided, see bug [YOCTO #11474]. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: eSDK enable threaded runsAníbal Limón
- Change some staticmethods to classmethods to be able access wrappers from OESelfTestCase. - Remove unused method update_configuration. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: runtime enable threaded runsAníbal Limón
- Use wrappers from OESelfTestCase for runCmd, bitbake, etc. - Split into tree modules because runtime_test_export and runtime_test_postinsts uses runqemu/tinfoil and needs to be executed into the main thread. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: runqemu enable threaded runsAníbal Limón
- Update to use wrappers {bitbake,get_bb_var} from OESelftestTestCase class. - Run into the main thread because it needs tinfoil to run. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: imagefeatures enable threaded runsAníbal Limón
- Change to use wrapper methos from OESelfTestCase. - Move tests that use runqemu to its own module because it needs tinfoil and run in the main thread. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: Use wrapper methods from OESelfTestCase class and ↵Aníbal Limón
enable threaded runs In order to support threaded runs in oe-selftest cases, there is a need to use wrapper methods that takes into account the current builddir by Test class. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: Use builddir from class instead of get from environmentAníbal Limón
Now the build directory is setup by Test class, so the builddir attr points to the actual BUILDDIR instead of get from environment. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/cases: Use testlayer_path instead of call get_test_layer()Aníbal Limón
The testlayer_path is set at init of selftest so isn't need to call every time get_test_layer to get it. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/case: Support bitbake memres mode in per build directoryAníbal Limón
If BBSERVER is set on the environment the bitbake is set to be used as a memres, so starts an bitbake server per TestClass. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/case: tearDown extra commands print what actually failsAníbal Limón
Its better to have the output to see what actually fails in a command that is aim to execute at end of a test case. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/case: Creates meta-selftest layer per classAníbal Limón
The meta-selftest layer is used by test cases to modify meta data but in a threaded environment two test cases can modify the meta data causing errors because the signatures will change. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/case: Add wrappers to utils.commands modulesAníbal Limón
This wrappers are for be able to use a custom build directory per Test class, there is a function to modify the environment setting BUILDDIR, BBPATH and CWD. The oeqa.utils.commands module could be removed when other selftests (refkit, etc) are adapted to use this wrappers methods (get_bb_var{,s}, bitbake, runCmd). The remaining command (oeqa.utils) to provide a wrapper is runqemu, this has other issue because bitbake/tinfoil are expected to run into the main thread (signal handling, etc). Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/selftest/{case,context}: Add builddir by test class and contextAníbal Limón
The build directory by Test class will enable to use several instances of bitbake in parallel to enable oe-selftest threaded runs. [YOCTO #11429] Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/core/tests: Update test_loader threaded to cover main thread usageAníbal Limón
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/core/threaded: logSummary add skipped tests infoAníbal Limón
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/core/threaded: Add support to run into a thread at end of executionAníbal Limón
Some test cases aren't allowed to run into a multi-thread environment so add the posibility to run those tests at end of execution. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24oeqa/core/threaded: Enable support to use the main threadAníbal Limón
Some test cases needs to be executed by the main thread for several resons, this implmentation enables usage of the main thread to execute suites. The rules are if some test case request by test class attr _main_thread it will be executed, if no tests are scheduled to be executed into the main thread the algorithm with take the first suite in the pool, finallay this will avoid thread usage if only one suite needs to be executed. Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24bb/tinfoil: run_command handle busy status in bitbake serveralimon/simple_patchesAníbal Limón
When tinfoil request a command to bitbake is handled in async manner [1], sometimes is this ends on return a Busy status. This is a workaround a needs to be fixed in proper manner inside bitbake code. For example when running clientComplete and buildFile is on progress, ERROR: Function failed: base_do_unpack Traceback (most recent call last): File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 797, in modify initial_rev = _extract_source(srctree, args.keep_temp, args.branch, False, rd, tinfoil) File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 562, in _extract_source runtask(fn, 'unpack') File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 552, in runtask raise DevtoolError('Task do_%s failed' % task) devtool.DevtoolError: Task do_unpack failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/alimon/repos/poky/scripts/devtool", line 351, in <module> ret = main() File "/home/alimon/repos/poky/scripts/devtool", line 338, in main ret = args.func(args, config, basepath, workspace) File "/home/alimon/repos/poky/scripts/lib/devtool/standard.py", line 864, in modify tinfoil.shutdown() File "/home/alimon/repos/poky/bitbake/lib/bb/tinfoil.py", line 427, in shutdown self.run_command('clientComplete') File "/home/alimon/repos/poky/bitbake/lib/bb/tinfoil.py", line 320, in run_command raise TinfoilCommandFailed(result[1]) bb.tinfoil.TinfoilCommandFailed: Busy (buildFile in progress) Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2017-08-24maintainers.inc: assign newly added recipesAlexander Kanavin
Speak up if you disagree with these. (From meta-yocto rev: a09b543f9bd0ff9026b129f23d4ae8a5f5a980a6) Signed-off-by: Alexander Kanavin <alexander.kanavin@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24bitbake: main: Attempt to gain bitbake.lock rather than just waitingRichard Purdie
Rather than just waiting for 5s, try and get the lockfile. If we gain the lock, we know we're ready to retry and can skip any remaining timeout. (Bitbake rev: 8a60106c6f7d586c793b965c5e9460b6016fab15) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24bitbake: process: Clean up connection retry logicRichard Purdie
Its possible for a connection to connect to the server as its shutting down but before its removed the socket file. This patch: a) Removes the socket file earlier to avoid connections. b) Handles EOFError in initial connections gracefully. These occur if the socket is closed during the server shutdown. c) Ensure duplicate events aren't shown on the console. This makes debugging these issues very very confusing. With these changes the backtrace that was concerning users is hidden and the server works as expected with a reconnect when it catches it in a bad state. (Bitbake rev: f45196cf84669723382730944dddc7eaf50826f2) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24default-providers: Add entries for pkgconfig (due to pkg-conf being added)Richard Purdie
This silences warnings generated after pkg-conf was added as an alternative pkgconfig provider. (From OE-Core rev: a8b89b3cf58fd3bc6c8f0cd3fd93a552818bc040) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24populate_sdk_ext: Add BB_SERVER_TIMEOUT to SDK_LOCAL_CONF_BLACKLISTRichard Purdie
Whilst this should work we see failures in testsdkext at the moment when this is set. Add this to the blacklist for now until we can fix these issues meaning we can at least test BB_SERVER_TIMEOUT in other scenarios. Bug 119733 has been opened to track this. (From OE-Core rev: 88cb174680cd37b5afb2b79e8248979895c35312) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24boost: add python to default PACKAGECONFIG optionsJackie Huang
We want to provide python libs by default, and some other popular Linux distributions like redhat/fedora does the same. (From OE-Core rev: 41744c418009dccc5f79c1a4a28419807d67837c) Signed-off-by: Jackie Huang <jackie.huang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24kernel-yocto: relax BSP definition testBruce Ashfield
commit 44aea7b873 [kernel-yocto: ensure that only valid BSPs are built] introduced a new check to ensure that a valid BSP definition was found, rather than building something that 'closely' matched the current MACHINE. This check breaks valid configurations which do not have a bsp definition but are otherwise completely configured machines. To allow both elements to co-exist (and not add warnings or errors to otherwise valid builds), we first check to see if an empty bsp definition was found, but then check to see if a defconfig was provided. If a defconfig has been provided, that is a sign that the board configuration is complete and we should continue the build without otherwise bothering the user. Tested on meta-raspberrypi and linux-yocto* (From OE-Core rev: 156cf9e25f875a50f907e570d9b62cbc2c051133) Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24acl_2.25: improve reproducibilityJuro Bystricky
Remove all host build references from the acl-ptest package. (From OE-Core rev: 6b799e4b315ee5a1eaba9f445b2ba7d37d1e0176) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24attr: improve reproducibilityJuro Bystricky
Remove all host build references from the attr-ptest package. (From OE-Core rev: 0a181e26d09978bff850bc6b303de6053f7c53df) Signed-off-by: Juro Bystricky <juro.bystricky@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24initramfs-framework/setup-live: quote bootparam_root variableCalifornia Sullivan
When bootparam_root was empty the if statement would resolve into invalid syntax instead of short circuiting after the -z, causing a boot failure. (From OE-Core rev: dcd129504ea64986652e2e5907d9badf9373e367) Signed-off-by: California Sullivan <california.l.sullivan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24webkitgtk: disable gobject-introspection on armv7aJackie Huang
Disable gobject-introspection on armv7a and armv7ve to avoid do_compile failure: | qemu: uncaught target signal 11 (Segmentation fault) - core dumped | Segmentation fault (From OE-Core rev: bdddd81c8b4eab6bbf7a8697992b48cb5a30ae4a) Signed-off-by: Jackie Huang <jackie.huang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24core/target/ssh.py: use reader to handle partial dataRobert Yang
This can avoid UnicodeDecodeError error. (From OE-Core rev: baa78420d8d8e716935852c9c7b749af0161395a) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24libinput: remove obsolete touchpad patchJose Alarcon
This patch was a temporal workaround needed with 4.1 kernels. Remove it. (From OE-Core rev: 9f32d9405ed5430e9e55de2f1562baac963e807c) Signed-off-by: Jose Alarcon <jose.alarcon@ge.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24gpg_sign: depress the owership warnings on homedirJia Zhang
A gpg command, e.g, called by get_gpg_version(), may trigger such a warning: gpg: WARNING: unsafe ownership on homedir '/home/user/.gnupg' This sort of warning is harmless so it can be depressed through specifying --no-permission-warning. (From OE-Core rev: 0a740aa6f02deada56e0b7deb2bc1f7401e58726) Signed-off-by: Jia Zhang <lans.zhang2008@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24kernel-yocto: fix typo in error messageLuca Ceresoli
(From OE-Core rev: 92b4e043e9e2125105c697be2d0f75b3f01f91b1) Signed-off-by: Luca Ceresoli <luca@lucaceresoli.net> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24vulkan: Only build when 'vulkan' distro flag is setMark Hatle
Only build with the vulkan distro flag is set. (References to this flag were found in the mesa recipe.) In addition, only set the RRECOMEMND to mesa, if 'opengl' flag is set. Mesa required opengl distro flag to build. (From OE-Core rev: 152b59e07aed76de158d553178a2710330bc4cc1) Signed-off-by: Mark Hatle <mark.hatle@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-24maintainers.inc: fix pn- overridePaul Eggleton
Fix typo in override (_pn_go insteadof _pn-go). (From meta-yocto rev: e5860f12878966d9e8590e872c2f9d9264b24663) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23buildhistory.bbclass: add ptestRobert Yang
The ptest log will be saved to buildhistory/ptest, we can easily get the regression result between builds by: $ git show HEAD ptest/pass.fail.skip.* [YOCTO #11547] (From OE-Core rev: dcb6cd19fb8c639cb844d116fb83827267f37421) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23testimage.bbclass: update commentsRobert Yang
It's very important to add IMAGE_CLASSES += "testimage" in local.conf firstly, otherwise the var like TEST_LOG_DIR (defined in testimage.bbclass) will not be in testdata.json. [YOCTO #11547] (From OE-Core rev: 5663ed989f0af5b1c61c74288ec421cbca2261e7) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23buildhistory.bbclass: print message when no commitRobert Yang
This makes the user easier to know how to make commit in buildhistory. [YOCTO #11547] (From OE-Core rev: 164a0bd847f02ca65dcd53ddc789690060274191) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23core/target/ssh.py: replace decode errorsRobert Yang
There might be wild strings when read from target (especially when reading ptest results), replace the errors to avoid breaking the test. Fixed: (Not always happen) $ bitbake core-image-sato -ctestimage [snip] status, output = self.target.run('ptest-runner', 0) File "/buildarea/lyang1/poky/meta/lib/oeqa/core/target/ssh.py", line 84, in run status, output = self._run(sshCmd, processTimeout, True) File "/buildarea/lyang1/poky/meta/lib/oeqa/core/target/ssh.py", line 55, in _run status, output = SSHCall(command, self.logger, timeout) File "/buildarea/lyang1/poky/meta/lib/oeqa/core/target/ssh.py", line 258, in SSHCall run() File "/buildarea/lyang1/poky/meta/lib/oeqa/core/target/ssh.py", line 236, in run output = process.communicate()[0].decode("utf-8") UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc3 in position 4906: invalid continuation byte [YOCTO #11547] (From OE-Core rev: d0d2f892f0bed6adb5ec6fb59d64efcc97c83e19) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23utils/logparser.py: fix section checkRobert Yang
The section might be None or '', so use "if section" for it. Fixed: File "/buildarea/lyang1/poky/meta/lib/oeqa/utils/logparser.py", line 113, in log_as_files prefix += section TypeError: Can't convert 'NoneType' object to str implicitly [YOCTO #11547] (From OE-Core rev: 320ea01f9eb33df462534bf08488ff6ada9bbe7b) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23runtime/cases/_ptest.py: rename it to ptest.pyRobert Yang
It works now. [YOCTO #11547] (From OE-Core rev: 836393b467c3c0d53e4ace7611f991b0a5649182) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23runtime/cases/_ptest.py: add skip statusRobert Yang
The packages' test cases maybe skipped, check and save them. [YOCTO #11547] (From OE-Core rev: 5c89060e96919c9865034a0c64fde382763da71d) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23oeqa/utils/logparser.py: add skip statusRobert Yang
Some test cases maybe skipped, let's parse it. [YOCTO #11547] (From OE-Core rev: f23c0f6a5aa93d38a5ea9d450f0accff0a5cc869) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2017-08-23runtime/cases/_ptest.py: revive itRobert Yang
* Make it work with current oeqa * Skip the test if ptest is not in DISTRO_FEATURES * Skip the test if ptest-pkgs is not in IMAGE_FEATURES * The logs are saved to: testimage/ptest_log -> testimage/ptest_log.<datetime> * This provides data that could be used to detect regressions in ptest results [YOCTO #11547] (From OE-Core rev: f1dfb59495db9e79441c8aa623ede7ef20045a20) Signed-off-by: Robert Yang <liezhi.yang@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>