aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning
Commit message (Collapse)AuthorAgeFilesLines
* Install telegraf on all provisioned VMsDimitrios Apostolou2019-09-2730-1/+686
| | | | | | | | | | | | | | | | | | Install binaries as early as possible in the provisioning process, and start them, in order to monitor provisioning too. To achieve this, some OS auto-detection logic is introduced in shell script common.sourced.sh. The script can be sourced and used in all kind of other generic scripts. ioping is also installed from custom-compiled binaries in order to monitor the disk latency of the VMs. Reason we don't use ioping from the repositories, is that the units differ between ioping versions (new ioping reports latencies in nanoseconds, old in microseconds). Fixes: QTQAINFRA-3092 Change-Id: I9d9afb791955725d4bd0b32dae97dfc0bd4a76a3 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Refactor DownloadURL.shDimitrios Apostolou2019-09-261-23/+61
| | | | | | | | | | | | Auto-detects and verifies all kinds of hashes, not only SHA1. Hash verification is now an autonomous function. If the file is found at the destination, skip redownloading it if the hash is OK. Runs on POSIX sh, not requiring bash. Retain compatibility with previous version. Change-Id: I9930336030aa776f49dc460fe766f3e831700255 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not silence standard errorDimitrios Apostolou2019-09-262-3/+3
| | | | | | | | | | Provisioning was failing and the logs did not provide any useful information because of the silenced squish install command. So I went through all the scripts and I re-enabled stderr logging where I found it silenced (with the exception of where it was purposeful or harmless). Change-Id: I5fa0b0ba4362970b214c150d399b6720b1780e1e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Increase open files and processes limit on macOSDimitrios Apostolou2019-09-266-0/+244
| | | | | Change-Id: If93bbe067f76168a7c131c6ced187f00a8d908e1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Brew update only onceDimitrios Apostolou2019-09-264-3/+4
| | | | | Change-Id: I6c2650574b6b62ceedfc95a9caab7ca26a6fa10b Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Speed up provisioning on LinuxDimitrios Apostolou2019-09-261-1/+1
| | | | | Change-Id: I6e4e5621ed0b063215476ef51d61ef1f38198d0c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Fix message "RPMDB altered outside of yum"Dimitrios Apostolou2019-09-262-4/+2
| | | | | | | yum install supports a local filename on RHEL 6 or newer. Change-Id: I873ab3dfab56003ded45bc6c4099aae150f423dd Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Fix delays caused by PackageKit locking RPMDBDimitrios Apostolou2019-09-261-0/+1
| | | | | | | | | It seems that disabling it is not enough, it has to be fully removed. It is also removed later in the scripts but it wasn't enough apparently, so no harm done removing it twice. Change-Id: If1a4f032240e66100b68bca3196a700cb570701e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Remove the progress bar from the sdkmanager outputDimitrios Apostolou2019-09-261-4/+15
| | | | | | | Cleans up many thousands of useless lines from the logs. Change-Id: I2673f65b713996637d2161da4db726823e17c0df Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Cherry-pick a QEMU fix for "core dumped" during testsAssam Boudjelthia2019-09-171-0/+1
| | | | | | Task-number: QTBUG-63152 Change-Id: Iac803ca67537eeb9085fb87625103fdde0bfd904 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Upgrade Python pip version for Windows machinesHeikki Halmet2019-09-172-2/+9
| | | | | | Task-number: QTQAINFRA-2564 Change-Id: I10402bb3169b483c71e44db7ecba443eb4f46dc1 Reviewed-by: Liang Qi <liang.qi@qt.io>
* Provisioning: Disable or delete unneeded tasks and servicesHeikki Halmet2019-09-1712-0/+214
| | | | | | | | | | Windows have lot's of tasks and services running which are slowing the performance of build machine. Also 'windows' and 'windows defender' updates need's to be "permanently" disabled. Task-number: QTQAINFRA-3182 Change-Id: I8f6b237fcdc6e38fa9a06836d349821d86c58afc Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-09-092-1/+24
|\ | | | | | | Change-Id: Iffcf9b199df17a50acf03e29b9deae033396dfcb
| * Provisioning: Fix version of libiodbc on MacOsAssam Boudjelthia2019-09-062-1/+24
| | | | | | | | | | | | | | | | | | libiodbc latest version (3.52.13) was automatically installed causing qt-config-gui to fail build, this installs version 3.52.12. Task-number: QTQAINFRA-3188 Change-Id: I5b87ff04c2301a5471cc9abfa0849b6073a1bdd4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Add emsdk to macOS 10.14Heikki Halmet2019-09-091-0/+6
| | | | | | | | | | | | Task-number: QTQAINFRA-3191 Change-Id: I46a72db63966804b33996d8bc3babe50cd2a41dd Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Provisioning: update QEMU toolchainsAssam Boudjelthia2019-09-071-19/+19
| | | | | | | | | | | | | | | | | | | | | | | | * Update QEMU toolchains to Yocto thud(2.6) release(DC Qt 5.13.0) with GCC 8.2.0. * Suppress QEMU "Unsupported syscall" and "Unsupported ioctl" logs, set environment variable QEMU_SYSCALL_DEBUG to show them. Task-number: QTQAINFRA-2808 Change-Id: I987353b0f3aff87a02ea3bf96ace8de32d6f557b Reviewed-by: Liang Qi <liang.qi@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Add Android NDK ROOT to environment variableHeikki Halmet2019-09-041-0/+1
| | | | | | | | | | | | | | Task-number: QTQAINFRA-3181 Task-number: QTBUG-74952 Change-Id: I4cc6936c3b3eef32a1013888ced3950cd1f39407 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
* | Provisioning: Update Android NDK version to macOS 10.14Heikki Halmet2019-09-041-1/+1
| | | | | | | | | | | | | | | | | | Currently we are provisioning older Android NDK version than the one used in macOS 10.13. Let's keep these sync even though we don't currently make Android builds with macOS 10.14 Change-Id: I6c284d50bac395eb474c0f7e34cd90eda3f180c3 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
* | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-2832-18/+1055
|\| | | | | | | | | | | | | | | | | | | | | | | Conflicts: coin/platform_configs/default.yaml coin/provisioning/common/linux/disable-ntp_linux.sh coin/provisioning/qtci-linux-SLES-12-x86_64/55-emsdk.sh coin/provisioning/qtci-linux-SLES-15-x86_64/55-emsdk.sh emsdk.sh was moved from linux to unix, see 38e416be664dc216b332e6b4ff8d38905dfdc1e9 Change-Id: I5b06dde2860a4e4869960ae2a5be1d6a1396e957
| * Suppress QEMU syscall and ioctl debug messagesAssam Boudjelthia2019-08-211-0/+37
| | | | | | | | | | | | | | | | | | Compile QEMU with "Unsupported syscall" and "Unsupported ioctl" messages suppressed, those can be shown by set/unset environment variable QEMU_SYSCALL_DEBUG. Task-number: QTQAINFRA-2808 Change-Id: If0b28c47f2599c4ebca9cae6a6d38f9a4fd00458 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provisioning: Update iOS signing toolsHeikki Halmet2019-08-192-16/+16
| | | | | | | | | | | | | | | | new apple id is required with notarization Task-number: QTBUG-77359 Change-Id: I2aafda37d40608296d598b1d9ade83a025bcac8d Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
| * Add Suse Linux Enteprise Server 15 to the CITony Sarajärvi2019-08-1414-0/+498
| | | | | | | | | | | | Task-number: QTQAINFRA-3123 Change-Id: I725c58c7d319945f7470118dec99b5360385da7b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Add Suse Linux Enteprise Server 12 to the CITony Sarajärvi2019-08-1315-2/+504
| | | | | | | | | | | | Task-number: QTQAINFRA-2851 Change-Id: Ia421a5e35f8a0515d7f761ca0c52a54a93dcee5c Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Provisioning: Ubuntu 18.04: Add required packages for b2qtJoni Jäntti2019-08-111-0/+5
| | | | | | | | | | | | | | | | | | | | | | | | These packages are required for building b2qt module. Needed also on 5.12 branch as meta-qt5 follows Qt branching and will take provisionings from here. Change-Id: Ia6c5ffd95d4f778b23f381a6f1f5473aa11971e3 Reviewed-by: Samuli Piippo <samuli.piippo@qt.io> (cherry picked from commit ee9dd0d8601bbe252a6a99e44a3376016911f1b0) Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Append the emscripten to path instead of prependSimo Fält2019-08-121-1/+1
| | | | | | | | | | | | | | | | | | Having it first in path seems to cause some confusion when detecting libc++ in darwin. Change-Id: I841e7f169e4771d3818cf156d9d78fc242e9995c Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-0431-0/+913
|\| | | | | | | Change-Id: Ie49f7e5ff9ca02522c6611922b47870aba2c152e
| * Add macOS 10.14 to the CITony Sarajärvi2019-08-0331-0/+913
| | | | | | | | | | | | | | Task-number: QTQAINFRA-2938 Change-Id: Id25c6c3203a07985c9ef1cc914c4398ac7db615c Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-0375-2003/+3184
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: .gitmodules ignore QtWebEngine on QEMU temporarily. coin/platform_configs/default.yaml no-gui build was removed temporarily. coin/platform_configs/qt5.yaml coin/platform_configs/qtbase.yaml coin/platform_configs/qtconnectivity.yaml coin/platform_configs/qtsaferenderer.yaml Task-number: QTQAINFRA-2576 Task-number: QTBUG-77304 Task-number: QTBUG-77305 Done-With: Tony Sarajärvi <tony.sarajarvi@qt.io> Change-Id: If7cf75791677eace762374b92382a2ce15f17f55
| * Provisioning: update conan_manifests for libxslt packagesKonstantin Tokarev2019-08-017-48/+40
| | | | | | | | | | | | | | | | Package recipe was improved, as a result packages were rebuilt and checksums need update. Change-Id: I33bd30b44cbe48b3550cb42eeb995ef8588fcce7 Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
| * Provisioning: update Conan and Conan packagesKonstantin Tokarev2019-07-2661-1941/+2925
| | | | | | | | | | | | | | | | | | | | | | | | [*] Update Conan to 1.17.0, adjust to change in command line arguments [*] Update Conan packages to up-to-date versions, add libjpeg-turbo and packages for 64-bit MinGW [*] Rename 03-conan.ps1 to 11-conan.ps1 so that it is installed after Python 3 and MinGW [*] Add license header to conan.ps1 Change-Id: Ibc451ddc54a7227eb6d3a007a20351e77a46875f Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: Add CompilerException and CompilerThreads settings for ConanKonstantin Tokarev2019-07-261-3/+13
| | | | | | | | | | Change-Id: I3a52101056bce4d3d4ac9124dbfd566adf47cf80 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: rename 03-conan.ps1 to conan.ps1 to follow naming conventionKonstantin Tokarev2019-07-264-3/+3
| | | | | | | | | | Change-Id: If24541709d4675498bc4af296e05ce3c62d5045a Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Conan: Suppress output of New-ItemKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | Change-Id: I3d62fffa08d38a383187726e08743512236bb859 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: install-msys2.ps1 must run its commands synchronouslyKonstantin Tokarev2019-07-261-6/+8
| | | | | | | | | | | | | | | | | | | | | | | | [*] Using bash instead of msys2_shell.cmd allows Start-Process to actually wait for the end of command execution. [*] cpan requires "yes" to be typed by user when it's run first time, otherwise it hangs indefinitely waiting for input. [*] Stop gpg-agent and dirmngr started in the background to prevent CI session from hanging. Change-Id: I4d4c1f36d215cb7578d1e7059217e34375de96c6 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Use msiexec to install Strawberry Perl from msi packageKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | | | | | Currently provisioning fails with following error: "This command cannot be run due to the error: %1 is not a valid Win32 application." Change-Id: I59290d394f231c37af10f27d07dbb9f5d2d2470a Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: Run-Executable should print stdout and stderr to logKonstantin Tokarev2019-07-261-2/+34
| | | | | | | | | | | | Task-number: QTQAINFRA-3085 Change-Id: I5343753f75157a2a894bb3ac50d416ab044d86fb Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: don't re-run Conan 5 times if there is no errorKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | Change-Id: Ia348ebbc4fc3a2503cc426c011e68b7a410c4a08 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io> Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
| * Provisioning: Upgrade PyYAML because of possible security vulnerabilityHeikki Halmet2019-04-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | Known high severity security vulnerability in pyyaml v< 4.2b1 Task-number: QTQAINFRA-2888 Change-Id: I6522fc66ca7c4323cc6248ec2cb31c62201f8e84 Reviewed-by: Dominik Holland <dominik.holland@pelagicore.com> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provisioning: Fix cleanup when building GCC from sourcesTony Sarajärvi2019-05-161-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | We need sudo rights to delete the temporary folder where sources for GCC are extracted. Change-Id: Ic0642e44eabfc3449f7ce5903a63bd38924f7dca Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Merge remote-tracking branch 'origin/5.12.4' into 5.12Liang Qi2019-06-2527-124/+475
| |\ | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: coin/platform_configs/default.txt coin/platform_configs/qt5.txt Done-With: Tony Sarajärvi <tony.sarajarvi@qt.io> Change-Id: I1381c4b80a64859cb42d6cb5205ef549de40dde6
| | * Fix openssl 1.1 library configurationsHeikki Halmet2019-06-131-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | Change-Id: Idcb919e5f388b509e4215cf5515c8716490d5872 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io>
| | * Install prebuilded OpenSSL 1.1.1b for Windows 7Heikki Halmet2019-06-101-49/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change-Id: Ie1ec2d6aaeea8432a654741ed7969cc66c3da7f5 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> (cherry picked from commit 247b429c3c435a62df3d6f94c96c7cd1b7c22299)
| | * Provision sed for windows 10Juha Karjalainen2019-06-103-0/+73
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Sed is needed by webassembly build. Cannot use sed from msys as having msys bin folder in path breaks webassembly build. Task-number: QTQAINFRA-2835 Change-Id: I6ad06f0a952a0d8bc5d21e62f8c2cef70f40c618 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 230a73409a2fe58e7de0674107a2d870be0bf03d) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| | * Provisioning: install msys2Juha Karjalainen2019-06-102-0/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Windows need msys2 perl for configuring openssl 1.1.1 for android. Task-number: QTQAINFRA-2327 Change-Id: I217542b6e9b3fd0f656b8186e2cde4283257dcf8 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 6465c421225574dc1c5d9f23293c37e784fd1b02) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| | * Provisioning: Change openssl version to 1.1.1bJuha Karjalainen2019-06-1019-116/+346
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Use newest LTS version of openssl as support for 1.0.2 series will end at end of 2019. For windows 7 x86 openssl 1.0.2 will be used until all need fixed are made to submodule tests Task-number: QTQAINFRA-2327 Change-Id: I930d239cd139b6202ebdfb5cdc8068ff2ad0b8a3 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> (cherry picked from commit 3e838f2a34d0c1538535bd184aa12681497c8a38)
| | * Provisioning: Use ANDROID_NDK_ROOT instead of ANDROID_NDK_HOMEHeikki Halmet2019-06-102-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Without this binaries will be hardcoded to look in e.g /opt/android/android-ndk-r19b which means that RTA tests will fail Task-number: QTBUG-74952 Change-Id: Ic2b1297e15d905f2250333b6bc884abe2f1472d4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit dbaa42baa77309a1aa407cd45078d885f7428aa2) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| | * Provisioning: Update Android NDK to version r19Heikki Halmet2019-06-103-8/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also let's start using 64-bit Android NDK for Windows Task-number: QTQAINFRA-2568 Change-Id: I2d757aa9e43abf5118abad7bf644e17e88a2ca94 Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit c09135cb56e03dd6a09b79f2c6e15932e9433df2) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| * | Update GCC version to 9.1.0 in Ubuntu 18.04Tony Sarajärvi2019-05-312-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-2958 Change-Id: I3ea8c8e467b9a1f56c2b114c40fb94dfdc1448d0 Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Liang Qi <liang.qi@qt.io>
| * | Provisioning: Install virtualenv to Ubuntu 18.04Simo Fält2019-05-161-1/+1
| |/ | | | | | | | | | | | | | | The python3-virtualenv package is missing the actual virtualenv executable. python3-virtualenv will get installed as dependency. Change-Id: If474831e8f46ac5dcd7e1028c97c7322c5e41b9d Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Log more version information on macOS provisioningJuha Karjalainen2019-05-124-0/+108
| | | | | | | | | | | | | | | | | | Logs more version information to make easier to reproduce build. Logs macOS build version, homebrew installed packages and apple's installer installed packages. Change-Id: Ia9f2842a3fd2e8e0acf1667c7435a19c7a878aed Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
generated by cgit v1.2.3 (git 2.25.1) at 2024-05-11 12:45:11 +0000