aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2018-11-08config.json: Remove sstate, add oe-selftest, and replace beaglebonehalstead/yocto-autobuilder-helperMichael Halstead
We want to build everything without sstate during bringup testing. Adding oe-selftest will catch errors other targets wouldn't. We just want to test on qemuarm64 and qemux86-64 architectures so remove beaglebone as an unneeded third. This takes advantage of the template as well. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2018-11-07config.json: Add steps to test new workers before adding to the main poolMichael Halstead
We add workers to the nightly-bringup pool to test them in a production like enviroment. Include one completely emulated target and one to test virtualization extentions. Signed-off-by: Michael Halstead <mhalstead@linuxfoundation.org>
2018-11-07config.json: Allow configuration of sstate publication pathsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-05scripts/send-qa-email: Handle systems with sendmail in sbinRichard Purdie
Many of the distros we use have sendmail in /sbin or /usr/sbin which may not be in the path for non-interactive users. Handle this in the script to avoid failures where tests work but the real QA email fails. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-11-05config.json: We don't need meta-qt3/meta-qt4 anymoreRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-10-10scripts/setup-config: Ensure PACKAGE_CLASSES is setRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-24config.json: Change QA contact addresses to public settings rather than test ↵Richard Purdie
ones Also add Armin to the list. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-19config.json: Add builds of aarch64 uninative to nightly-buildtoolsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-07config.json: Add mesa gallium/llvm testRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05run-config: Renumber the log files to match step numbersRichard Purdie
Also print a summary of the logfiles which contain failures. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-09-05config.json: Split nightly-qa-extras into twoRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30config-intelqa-x86_64-lava.json: Add extension to config.json to support BSPAaron Chan
config-intelqa on x86-64 is an extension to config.json where it contains the recipes and meta layers to build core-image-sato-sdk on various supported architectures in Yocto Project. This is an initial release model on specifying the recipes use to build the embeddded linux images starting with x86-64 MTURBOT64 (Intel IA). With this reference, community will inherit the structure and model benchmark from config-intelqa-<arch>-lava.json to support and build own hardware on other architectures (e.g arm64, mips64, pcc, x86) on the same common CI infrastructure (Yocto Autobuilder). The config-intelqa-<arch>-lava.json will contain the consolidate data in autobuilder and LAVA (Linaro) to execute independent jobs configuration respectively. Architecture owners are to work with the respective maintainers and review their automated hardware tests to ensure common structure is agree by the current and/or new community. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30publish-artefacts: Add deployment BSP support on x86_64Aaron Chan
Add in the support to publish images into the designated path. BSP packages of the previous build will be cleaned up before new BSP packages are copied over. This ensures the previous image will not be retained and causes conflicts before image is loaded into x86_64 (MTURBOT64) hardware. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30resume-lava-jobs: Add lava-job cleanup scriptAaron Chan
This script is needed to inform LAVA server to end the lava-job process and shutdowns the board/device gracefully while removing the lava-overlay tmpfs resides on LAVA dispatcher end. Once lava-job completely endsm it returns a signal to host machine to continue with the remaining steps in autobuilder before it completes and end the entire job workflow. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30trigger-lava-jobs: Add LAVA RPC trigger pipeline scriptAaron Chan
trigger-lava-jobs accepts the YAML pipeline lava-job config file generated by run-jinja-parser scripts. This triggers a new job at LAVA end thru RPC and parses the authentication token and user credentials to launch/start the hardware automation on LAVA Dispatcher.Script will exit on error when lava-job return a state either incomplete or canceling stage. trigger-lava-jobs uses lava_scheduler.py python module where the LAVA classes and library constructed from XML-RPC API which are define and supported by Linaro, LAVA. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30run-jinja-parser: Add converter Jinja2 template to YAML parserAaron Chan
run-jinja-parser converts the Jinja2 template from lava-templates folder into YAML pipeline job configuration used in LAVA. Jinja2 provides a standard template to be modify/update to meet other architecture supports. The lava-template/generate-jobconfig.jinja2 are to be couple with the JSON config-intelqa-x86_64-lava.json when defining your architecture and hardware configuration at LAVA end. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30lava-templates: Add Jinja2 LAVA job-template on BSP x86_64Aaron Chan
Include a reference LAVA job template on x86_64 in jinja2 format. This template will parsed and converted into YAML configuration before job is trigger on LAVA server end thru Yocto autobuilder. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30scripts: use argparse for command line parsingPaul Eggleton
[RP: Minor tweaks made to adpat to buildbot and option naming Fixed shared-repo-unpack for publishing when no cache-dir supplied] Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30run-config: Add a new option to control echoing of log outputRichard Purdie
The new buildbot code can directly monitor the logfiles itself so we need to be able to optionally stop echoing onto the console. Add missing flush() calls and print the command being used and logfile so its clear what is happening on stdout too. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-30scripts/checkvnc: Add checkvnc script from old autobuilder codebaseRichard Purdie
Update the scripts to correctly reference the new script. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-23ab-janitor: Ensure configuration variables are expandedRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-11config.json: Enable parallelism in oe-selftestRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-10config.json: Port BB_DISKMON_DIRS setting from older autobuilderRichard Purdie
This removes free inode monitoring which doesn't work on our NFS shares. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-08-08run-config: Reverse the oder of remove layersAaron Chan
This patch fixes the "Collection Error during parsing layer conf" when a parent layer is accidentally added before depend layers. When removing layers from bblayers, we should not be following the same sequence of adding the layers, it should be done in a reversed order. This is an assumption that the layers have their dependent layers added before the parent layers are added. In general, the parent layer require to be remove first before its child dependencies layers. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06TODO: Drop as all items have been resolved nowRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06run-config: Add a test mode using an enviornmental variableRichard Purdie
Testing this code is becoming increasingly problematic. This allows ABHELPERTEST to be set from the environment and means the script will still create directories and configuration files but it will not execute anything, just print what would be executed. This allows faster validation of changes to the configurations/code. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06utils: Fix previous commitRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06utils: Filter reponame to only use base repository name, not a full urlRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-06scripts: Various buildhistory code fixes/improvementsRichard Purdie
* Remove the code disabling it * Move to a non-shared directory by default (but still support absolute pathnames if wanted) * Use shallow clones by default for speed * Allow force pushing 'fork' mode branches Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-05clobberdir: Fix data expansion with utils APIAaron Chan
The changes to use variable expansion missed out the clobberdir script. This patch fixes regressions introduced by that change so data is expanded correctly. This fix is to move clobberdir from python2 to python3 to resolve unicode data in python2 and secondly, change the data extraction expansion from ourconfig["TRASH_DIR"] to utils.getconfig("TRASH_DIR", ourconfig) so that expansion occurs. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-04upload-error-reports: Shorted name since server has a 50 char limitRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-03utils: Ensure unspecified variables aren't expanded badlyRichard Purdie
We want ${BUILDDIR} to stay as ${BUILDDIR}, not become BUILDDIR for example. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-03Add Intel-QA x86_64 lava json config exampleAaron Chan
This patch is an extension to default config.json with ABHELPER_JSON env set. This extension is to support buildset config for target MACHINE intel-corei7-64 with meta-intel layer included for runtime testing using lava. Signed-off-by: Aaron Chan <aaron.chun.yew.chan@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-03config.json: Correct nightly-refkit SSTATEDIR settingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-07-03utils: Ensure we don't infinitely recurse for variable expansionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-21utils: Enhance loadconfig to better merge dictsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20utils: Allow customisation using ABHELPER_JSON from the environmentRichard Purdie
Usage is documented in README and an example, local-example.json is included. Also clean up the parameter to loadconfig() as its actually not needed. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20utils: Ensure list entries also are expandedRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20utils: Fix for python 3.5 and before, remove debugRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20config.json: Convert to use variable substituion instead of hardcoded pathsRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20scripts: Convert to use data expansion pretty much everywhereRichard Purdie
We want to be able to use data expansion/variable substitution in most variables so convert to use the utils API for this. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-20utils: Add data expansion handling/APIRichard Purdie
The code clearly won't scale without some kind of variable substitution/ variable expansion mechanism, so add one. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10scripts/send-qa-email: Handle form enable/disable of emailRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-06-10send-qa-email: Ensure we don't run when not publishingRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-16send-qa-email: Resolve revisions into full hashesRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-16config.json: Move QA variables to the correct sectionRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-15config.json: Use testing QA mail address for nowRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14send-qa-email: Allow execution (chmod)Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14config.json: Add QA/publish info and script to mail QARichard Purdie
Add a script which allows QA to be emailed upon build completion for QA test runs. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2018-05-14README: Add symlink command for ease of referenceRichard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>