aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning
Commit message (Collapse)AuthorAgeFilesLines
* Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-10-0176-45/+1136
|\ | | | | | | | | | | | | | | Conflicts: coin/platform_configs/default.yaml coin/platform_configs/qt5.yaml Change-Id: I48b1e814dd6328dfb2827d0898a277b81ec25e55
| * Reduce noise in the provision logsDimitrios Apostolou2019-10-013-4/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Reduce verbosity in order to shorten logs and make them more readable. In two cases we just remove the verbose flag. In one other case we undo inlining of a huge script in the command line. Because we run the provisioning scripts in trace mode, this caused the script to be logged, and it was rather long and meaningless since it comes from an external project. Change-Id: I078ee3b3ab2db9425204375deb5815b6526a4466 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Move telegraf install to start of provisioning macosDimitrios Apostolou2019-09-273-0/+0
| | | | | | | | | | Change-Id: Ied2b7a415abe5e101b6bfb60472b74070debe9e9 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Move telegraf install to start of provisioning linuxDimitrios Apostolou2019-09-278-0/+0
| | | | | | | | | | Change-Id: Ia42b0c21f6e341a941e98d3abbda512cfb0fda92 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Move telegraf install to start of provisioning windowsDimitrios Apostolou2019-09-276-0/+0
| | | | | | | | | | Change-Id: Icf4f213be5a33ec2ad89d514b9bba5d4a3587117 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * DownloadURL now works with either wget or curlDimitrios Apostolou2019-09-271-2/+11
| | | | | | | | | | | | | | | | | | The reason is that Ubuntu does not have curl at the very beginning of provisioning scripts, and also does not have the repositories configured in order to install it. Change-Id: Ia485c1672f894bc800f199b742d238b2945938e5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Install 7-zip at the beginning of provisioning WindowsDimitrios Apostolou2019-09-2712-0/+0
| | | | | | | | | | | | | | | | | | | | so that we can extract zip files early and install telegraf. Also moved disabling Windows defender, to keep it at the very beginning of provisioning. Change-Id: I6c2039ebd20e541bdd7d437dd56ccb06a1619a5f Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Adjust pre-existing script to use the new common.sourced.shDimitrios Apostolou2019-09-274-139/+14
| | | | | | | | | | Change-Id: Icf7829d3499110a76b90679ba2d067f80d189e69 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Install telegraf on all provisioned VMsDimitrios Apostolou2019-09-2730-1/+686
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Install binaries as early as possible in the provisioning process, and start them, in order to monitor provisioning too. To achieve this, some OS auto-detection logic is introduced in shell script common.sourced.sh. The script can be sourced and used in all kind of other generic scripts. ioping is also installed from custom-compiled binaries in order to monitor the disk latency of the VMs. Reason we don't use ioping from the repositories, is that the units differ between ioping versions (new ioping reports latencies in nanoseconds, old in microseconds). Fixes: QTQAINFRA-3092 Change-Id: I9d9afb791955725d4bd0b32dae97dfc0bd4a76a3 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Refactor DownloadURL.shDimitrios Apostolou2019-09-261-23/+61
| | | | | | | | | | | | | | | | | | | | | | | | Auto-detects and verifies all kinds of hashes, not only SHA1. Hash verification is now an autonomous function. If the file is found at the destination, skip redownloading it if the hash is OK. Runs on POSIX sh, not requiring bash. Retain compatibility with previous version. Change-Id: I9930336030aa776f49dc460fe766f3e831700255 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Do not silence standard errorDimitrios Apostolou2019-09-262-3/+3
| | | | | | | | | | | | | | | | | | | | Provisioning was failing and the logs did not provide any useful information because of the silenced squish install command. So I went through all the scripts and I re-enabled stderr logging where I found it silenced (with the exception of where it was purposeful or harmless). Change-Id: I5fa0b0ba4362970b214c150d399b6720b1780e1e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Increase open files and processes limit on macOSDimitrios Apostolou2019-09-266-0/+244
| | | | | | | | | | Change-Id: If93bbe067f76168a7c131c6ced187f00a8d908e1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Brew update only onceDimitrios Apostolou2019-09-264-3/+4
| | | | | | | | | | Change-Id: I6c2650574b6b62ceedfc95a9caab7ca26a6fa10b Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Speed up provisioning on LinuxDimitrios Apostolou2019-09-261-1/+1
| | | | | | | | | | Change-Id: I6e4e5621ed0b063215476ef51d61ef1f38198d0c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Fix message "RPMDB altered outside of yum"Dimitrios Apostolou2019-09-262-4/+2
| | | | | | | | | | | | | | yum install supports a local filename on RHEL 6 or newer. Change-Id: I873ab3dfab56003ded45bc6c4099aae150f423dd Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Fix delays caused by PackageKit locking RPMDBDimitrios Apostolou2019-09-261-0/+1
| | | | | | | | | | | | | | | | | | It seems that disabling it is not enough, it has to be fully removed. It is also removed later in the scripts but it wasn't enough apparently, so no harm done removing it twice. Change-Id: If1a4f032240e66100b68bca3196a700cb570701e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Remove the progress bar from the sdkmanager outputDimitrios Apostolou2019-09-261-4/+15
| | | | | | | | | | | | | | Cleans up many thousands of useless lines from the logs. Change-Id: I2673f65b713996637d2161da4db726823e17c0df Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Cherry-pick a QEMU fix for "core dumped" during testsAssam Boudjelthia2019-09-171-0/+1
| | | | | | | | | | | | Task-number: QTBUG-63152 Change-Id: Iac803ca67537eeb9085fb87625103fdde0bfd904 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provisioning: Upgrade Python pip version for Windows machinesHeikki Halmet2019-09-172-2/+9
| | | | | | | | | | | | Task-number: QTQAINFRA-2564 Change-Id: I10402bb3169b483c71e44db7ecba443eb4f46dc1 Reviewed-by: Liang Qi <liang.qi@qt.io>
| * Provisioning: Disable or delete unneeded tasks and servicesHeikki Halmet2019-09-1712-0/+214
| | | | | | | | | | | | | | | | | | | | Windows have lot's of tasks and services running which are slowing the performance of build machine. Also 'windows' and 'windows defender' updates need's to be "permanently" disabled. Task-number: QTQAINFRA-3182 Change-Id: I8f6b237fcdc6e38fa9a06836d349821d86c58afc Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-09-1337-39/+1106
|\| | | | | | | | | | | | | | | | | | | | | This change partially reverts 24f0367a60fdd3379014e507fa7f4553d433c601. Conflicts: coin/platform_configs/default.yaml SLES 12 got removed temporarily. Task-number: QTQAINFRA-2851 Change-Id: Ib12a6e5ced3c89a5c8c9c2b1548a1c9d23d159d9
| * Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-09-092-1/+24
| |\ | | | | | | | | | Change-Id: Iffcf9b199df17a50acf03e29b9deae033396dfcb
| | * Provisioning: Fix version of libiodbc on MacOsAssam Boudjelthia2019-09-062-1/+24
| | | | | | | | | | | | | | | | | | | | | | | | | | | libiodbc latest version (3.52.13) was automatically installed causing qt-config-gui to fail build, this installs version 3.52.12. Task-number: QTQAINFRA-3188 Change-Id: I5b87ff04c2301a5471cc9abfa0849b6073a1bdd4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * | Provisioning: Add emsdk to macOS 10.14Heikki Halmet2019-09-091-0/+6
| | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-3191 Change-Id: I46a72db63966804b33996d8bc3babe50cd2a41dd Reviewed-by: Liang Qi <liang.qi@qt.io>
| * | Provisioning: update QEMU toolchainsAssam Boudjelthia2019-09-071-19/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Update QEMU toolchains to Yocto thud(2.6) release(DC Qt 5.13.0) with GCC 8.2.0. * Suppress QEMU "Unsupported syscall" and "Unsupported ioctl" logs, set environment variable QEMU_SYSCALL_DEBUG to show them. Task-number: QTQAINFRA-2808 Change-Id: I987353b0f3aff87a02ea3bf96ace8de32d6f557b Reviewed-by: Liang Qi <liang.qi@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * | Provisioning: Add Android NDK ROOT to environment variableHeikki Halmet2019-09-041-0/+1
| | | | | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-3181 Task-number: QTBUG-74952 Change-Id: I4cc6936c3b3eef32a1013888ced3950cd1f39407 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
| * | Provisioning: Update Android NDK version to macOS 10.14Heikki Halmet2019-09-041-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | Currently we are provisioning older Android NDK version than the one used in macOS 10.13. Let's keep these sync even though we don't currently make Android builds with macOS 10.14 Change-Id: I6c284d50bac395eb474c0f7e34cd90eda3f180c3 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
| * | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-2832-18/+1055
| |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: coin/platform_configs/default.yaml coin/provisioning/common/linux/disable-ntp_linux.sh coin/provisioning/qtci-linux-SLES-12-x86_64/55-emsdk.sh coin/provisioning/qtci-linux-SLES-15-x86_64/55-emsdk.sh emsdk.sh was moved from linux to unix, see 38e416be664dc216b332e6b4ff8d38905dfdc1e9 Change-Id: I5b06dde2860a4e4869960ae2a5be1d6a1396e957
| | * Suppress QEMU syscall and ioctl debug messagesAssam Boudjelthia2019-08-211-0/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | Compile QEMU with "Unsupported syscall" and "Unsupported ioctl" messages suppressed, those can be shown by set/unset environment variable QEMU_SYSCALL_DEBUG. Task-number: QTQAINFRA-2808 Change-Id: If0b28c47f2599c4ebca9cae6a6d38f9a4fd00458 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| | * Provisioning: Update iOS signing toolsHeikki Halmet2019-08-192-16/+16
| | | | | | | | | | | | | | | | | | | | | | | | new apple id is required with notarization Task-number: QTBUG-77359 Change-Id: I2aafda37d40608296d598b1d9ade83a025bcac8d Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
| | * Add Suse Linux Enteprise Server 15 to the CITony Sarajärvi2019-08-1414-0/+498
| | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-3123 Change-Id: I725c58c7d319945f7470118dec99b5360385da7b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| | * Add Suse Linux Enteprise Server 12 to the CITony Sarajärvi2019-08-1315-2/+504
| | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-2851 Change-Id: Ia421a5e35f8a0515d7f761ca0c52a54a93dcee5c Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| | * Provisioning: Ubuntu 18.04: Add required packages for b2qtJoni Jäntti2019-08-111-0/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | These packages are required for building b2qt module. Needed also on 5.12 branch as meta-qt5 follows Qt branching and will take provisionings from here. Change-Id: Ia6c5ffd95d4f778b23f381a6f1f5473aa11971e3 Reviewed-by: Samuli Piippo <samuli.piippo@qt.io> (cherry picked from commit ee9dd0d8601bbe252a6a99e44a3376016911f1b0) Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | | Android: Update Android NDK to version r20BogDan Vatra2019-08-224-6/+6
| | | | | | | | | | | | | | | | | | Fixes: QTQAINFRA-3152 Change-Id: Ieee56346dd4e29754f259d71465edc8c2a0db2e5 Reviewed-by: Eskil Abrahamsen Blomfeldt <eskil.abrahamsen-blomfeldt@qt.io>
* | | Merge remote-tracking branch 'origin/5.13' into devLiang Qi2019-08-20131-2074/+4501
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This reverts commit d494d76c26df48c9cf3b45fc15ebad963fe34c52. Conflicts: coin/platform_configs/default.yaml Temporarily remove the -no-opengl build. coin/platform_configs/meta-boot2qt.yaml coin/platform_configs/qt5.yaml Temporarily remove the webassembly build on windows. coin/platform_configs/qtwebkit.yaml Task-number: QTQAINFRA-2577 Task-number: QTBUG-63917 Task-number: QTQAINFRA-2835 Done-With: Samuli Piippo <samuli.piippo@qt.io> Change-Id: Ia7972b481a5ce33febe26c6589db24578614b2fd
| * | Provisioning: Append the emscripten to path instead of prependSimo Fält2019-08-121-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | Having it first in path seems to cause some confusion when detecting libc++ in darwin. Change-Id: I841e7f169e4771d3818cf156d9d78fc242e9995c Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-0431-0/+913
| |\| | | | | | | | | | Change-Id: Ie49f7e5ff9ca02522c6611922b47870aba2c152e
| | * Add macOS 10.14 to the CITony Sarajärvi2019-08-0331-0/+913
| | | | | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-2938 Change-Id: Id25c6c3203a07985c9ef1cc914c4398ac7db615c Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Liang Qi <liang.qi@qt.io>
| * | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-0375-2003/+3184
| |\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: .gitmodules ignore QtWebEngine on QEMU temporarily. coin/platform_configs/default.yaml no-gui build was removed temporarily. coin/platform_configs/qt5.yaml coin/platform_configs/qtbase.yaml coin/platform_configs/qtconnectivity.yaml coin/platform_configs/qtsaferenderer.yaml Task-number: QTQAINFRA-2576 Task-number: QTBUG-77304 Task-number: QTBUG-77305 Done-With: Tony Sarajärvi <tony.sarajarvi@qt.io> Change-Id: If7cf75791677eace762374b92382a2ce15f17f55
| | * Provisioning: update conan_manifests for libxslt packagesKonstantin Tokarev2019-08-017-48/+40
| | | | | | | | | | | | | | | | | | | | | | | | Package recipe was improved, as a result packages were rebuilt and checksums need update. Change-Id: I33bd30b44cbe48b3550cb42eeb995ef8588fcce7 Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
| | * Provisioning: update Conan and Conan packagesKonstantin Tokarev2019-07-2661-1941/+2925
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [*] Update Conan to 1.17.0, adjust to change in command line arguments [*] Update Conan packages to up-to-date versions, add libjpeg-turbo and packages for 64-bit MinGW [*] Rename 03-conan.ps1 to 11-conan.ps1 so that it is installed after Python 3 and MinGW [*] Add license header to conan.ps1 Change-Id: Ibc451ddc54a7227eb6d3a007a20351e77a46875f Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Provisioning: Add CompilerException and CompilerThreads settings for ConanKonstantin Tokarev2019-07-261-3/+13
| | | | | | | | | | | | | | | Change-Id: I3a52101056bce4d3d4ac9124dbfd566adf47cf80 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Provisioning: rename 03-conan.ps1 to conan.ps1 to follow naming conventionKonstantin Tokarev2019-07-264-3/+3
| | | | | | | | | | | | | | | Change-Id: If24541709d4675498bc4af296e05ce3c62d5045a Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Conan: Suppress output of New-ItemKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | | | | Change-Id: I3d62fffa08d38a383187726e08743512236bb859 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Provisioning: install-msys2.ps1 must run its commands synchronouslyKonstantin Tokarev2019-07-261-6/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [*] Using bash instead of msys2_shell.cmd allows Start-Process to actually wait for the end of command execution. [*] cpan requires "yes" to be typed by user when it's run first time, otherwise it hangs indefinitely waiting for input. [*] Stop gpg-agent and dirmngr started in the background to prevent CI session from hanging. Change-Id: I4d4c1f36d215cb7578d1e7059217e34375de96c6 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Use msiexec to install Strawberry Perl from msi packageKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | Currently provisioning fails with following error: "This command cannot be run due to the error: %1 is not a valid Win32 application." Change-Id: I59290d394f231c37af10f27d07dbb9f5d2d2470a Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Provisioning: Run-Executable should print stdout and stderr to logKonstantin Tokarev2019-07-261-2/+34
| | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-3085 Change-Id: I5343753f75157a2a894bb3ac50d416ab044d86fb Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| | * Provisioning: don't re-run Conan 5 times if there is no errorKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | | | | | | | Change-Id: Ia348ebbc4fc3a2503cc426c011e68b7a410c4a08 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io> Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
| | * Provisioning: Upgrade PyYAML because of possible security vulnerabilityHeikki Halmet2019-04-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Known high severity security vulnerability in pyyaml v< 4.2b1 Task-number: QTQAINFRA-2888 Change-Id: I6522fc66ca7c4323cc6248ec2cb31c62201f8e84 Reviewed-by: Dominik Holland <dominik.holland@pelagicore.com> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| | * Provisioning: Fix cleanup when building GCC from sourcesTony Sarajärvi2019-05-161-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We need sudo rights to delete the temporary folder where sources for GCC are extracted. Change-Id: Ic0642e44eabfc3449f7ce5903a63bd38924f7dca Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>