aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning/common
Commit message (Collapse)AuthorAgeFilesLines
* Remove more of update notifierswip/tqtc-qt-config-gui/masterwip/qdb/masterwip/flashing-wizard/master5.13.2Tony Sarajärvi2019-11-231-1/+1
| | | | | | | Change-Id: I507f584ef82b5f41f6b1cbc22fdd4ff6eff5e911 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 2eab420e807d5fa4e39d4437879b9a35a2cdc88e) Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* DownloadURL last argument (targetFile) is now optionalDimitrios Apostolou2019-11-231-1/+8
| | | | | | Change-Id: I0864bcb052cddcc9753c056758b6e65fd561d928 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit 6cc2215b8ce6da477cf23f01ff5b88c0d12c2b88)
* Docker installation: do not depend on external repositoriesDimitrios Apostolou2019-11-231-9/+28
| | | | | | | | | Also updated the docker-compose binary to the latest one. Task-number: QTQAINFRA-3279 Change-Id: Ie09a772ca8247aa5f5bd6d36774b68b6bb846386 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit a270bcdb6beb34d7590378899805391cfcfe7091)
* Add allowUntrusted parameter for command line tools and refresh XcodeHeikki Halmet2019-11-231-1/+1
| | | | | | | | | | | | | | Apple has signed their packages with certificate which has been expired 24.11.2019. Packages are unusable without allowUntrusted parameter Also Xcode package for macOS10.13 needs to be refetched from Apple's download to local cache Task-number: QTQAINFRA-3317 Change-Id: Iebbe81ee0c360e5f0b49d422b38fe1a148424891 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit eb0ef419ec91ed580b13d54bf480087b7d33c2e1)
* Fix for DownloadURL to try alternative URLDimitrios Apostolou2019-11-231-2/+2
| | | | | | | Change-Id: I7e9a77815ef8f4c258dda44bda6fdd4eb3736ef4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 518e114dc71fb58d175a15afb282ac7f6dff6adc) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Remove execute permissions from scripts not run on UnixEdward Welbourne2019-10-071-0/+0
| | | | | | | This amends 38e416be664dc216b332e6b4ff8d38905dfdc1e9. Change-Id: I8b0f4f72565b30b097cb36092f7cb90d61c1487e Reviewed-by: Liang Qi <liang.qi@qt.io>
* Reduce noise in the provision logsDimitrios Apostolou2019-10-013-4/+11
| | | | | | | | | | | | | | Reduce verbosity in order to shorten logs and make them more readable. In two cases we just remove the verbose flag. In one other case we undo inlining of a huge script in the command line. Because we run the provisioning scripts in trace mode, this caused the script to be logged, and it was rather long and meaningless since it comes from an external project. Change-Id: I078ee3b3ab2db9425204375deb5815b6526a4466 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* DownloadURL now works with either wget or curlDimitrios Apostolou2019-09-271-2/+11
| | | | | | | | | The reason is that Ubuntu does not have curl at the very beginning of provisioning scripts, and also does not have the repositories configured in order to install it. Change-Id: Ia485c1672f894bc800f199b742d238b2945938e5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Adjust pre-existing script to use the new common.sourced.shDimitrios Apostolou2019-09-271-10/+8
| | | | | Change-Id: Icf7829d3499110a76b90679ba2d067f80d189e69 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Install telegraf on all provisioned VMsDimitrios Apostolou2019-09-2713-1/+647
| | | | | | | | | | | | | | | | | | Install binaries as early as possible in the provisioning process, and start them, in order to monitor provisioning too. To achieve this, some OS auto-detection logic is introduced in shell script common.sourced.sh. The script can be sourced and used in all kind of other generic scripts. ioping is also installed from custom-compiled binaries in order to monitor the disk latency of the VMs. Reason we don't use ioping from the repositories, is that the units differ between ioping versions (new ioping reports latencies in nanoseconds, old in microseconds). Fixes: QTQAINFRA-3092 Change-Id: I9d9afb791955725d4bd0b32dae97dfc0bd4a76a3 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Refactor DownloadURL.shDimitrios Apostolou2019-09-261-23/+61
| | | | | | | | | | | | Auto-detects and verifies all kinds of hashes, not only SHA1. Hash verification is now an autonomous function. If the file is found at the destination, skip redownloading it if the hash is OK. Runs on POSIX sh, not requiring bash. Retain compatibility with previous version. Change-Id: I9930336030aa776f49dc460fe766f3e831700255 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not silence standard errorDimitrios Apostolou2019-09-262-3/+3
| | | | | | | | | | Provisioning was failing and the logs did not provide any useful information because of the silenced squish install command. So I went through all the scripts and I re-enabled stderr logging where I found it silenced (with the exception of where it was purposeful or harmless). Change-Id: I5fa0b0ba4362970b214c150d399b6720b1780e1e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Increase open files and processes limit on macOSDimitrios Apostolou2019-09-263-0/+112
| | | | | Change-Id: If93bbe067f76168a7c131c6ced187f00a8d908e1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Brew update only onceDimitrios Apostolou2019-09-262-1/+2
| | | | | Change-Id: I6c2650574b6b62ceedfc95a9caab7ca26a6fa10b Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Speed up provisioning on LinuxDimitrios Apostolou2019-09-261-1/+1
| | | | | Change-Id: I6e4e5621ed0b063215476ef51d61ef1f38198d0c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Remove the progress bar from the sdkmanager outputDimitrios Apostolou2019-09-261-4/+15
| | | | | | | Cleans up many thousands of useless lines from the logs. Change-Id: I2673f65b713996637d2161da4db726823e17c0df Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Upgrade Python pip version for Windows machinesHeikki Halmet2019-09-172-2/+9
| | | | | | Task-number: QTQAINFRA-2564 Change-Id: I10402bb3169b483c71e44db7ecba443eb4f46dc1 Reviewed-by: Liang Qi <liang.qi@qt.io>
* Provisioning: Disable or delete unneeded tasks and servicesHeikki Halmet2019-09-177-0/+208
| | | | | | | | | | Windows have lot's of tasks and services running which are slowing the performance of build machine. Also 'windows' and 'windows defender' updates need's to be "permanently" disabled. Task-number: QTQAINFRA-3182 Change-Id: I8f6b237fcdc6e38fa9a06836d349821d86c58afc Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-09-092-1/+24
|\ | | | | | | Change-Id: Iffcf9b199df17a50acf03e29b9deae033396dfcb
| * Provisioning: Fix version of libiodbc on MacOsAssam Boudjelthia2019-09-062-1/+24
| | | | | | | | | | | | | | | | | | libiodbc latest version (3.52.13) was automatically installed causing qt-config-gui to fail build, this installs version 3.52.12. Task-number: QTQAINFRA-3188 Change-Id: I5b87ff04c2301a5471cc9abfa0849b6073a1bdd4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-282-2/+4
|\| | | | | | | | | | | | | | | | | | | | | | | Conflicts: coin/platform_configs/default.yaml coin/provisioning/common/linux/disable-ntp_linux.sh coin/provisioning/qtci-linux-SLES-12-x86_64/55-emsdk.sh coin/provisioning/qtci-linux-SLES-15-x86_64/55-emsdk.sh emsdk.sh was moved from linux to unix, see 38e416be664dc216b332e6b4ff8d38905dfdc1e9 Change-Id: I5b06dde2860a4e4869960ae2a5be1d6a1396e957
| * Add Suse Linux Enteprise Server 15 to the CITony Sarajärvi2019-08-141-0/+2
| | | | | | | | | | | | Task-number: QTQAINFRA-3123 Change-Id: I725c58c7d319945f7470118dec99b5360385da7b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Add Suse Linux Enteprise Server 12 to the CITony Sarajärvi2019-08-131-2/+2
| | | | | | | | | | | | Task-number: QTQAINFRA-2851 Change-Id: Ia421a5e35f8a0515d7f761ca0c52a54a93dcee5c Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Provisioning: Append the emscripten to path instead of prependSimo Fält2019-08-121-1/+1
| | | | | | | | | | | | | | | | | | Having it first in path seems to cause some confusion when detecting libc++ in darwin. Change-Id: I841e7f169e4771d3818cf156d9d78fc242e9995c Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-041-0/+78
|\| | | | | | | Change-Id: Ie49f7e5ff9ca02522c6611922b47870aba2c152e
| * Add macOS 10.14 to the CITony Sarajärvi2019-08-031-0/+78
| | | | | | | | | | | | | | Task-number: QTQAINFRA-2938 Change-Id: Id25c6c3203a07985c9ef1cc914c4398ac7db615c Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Merge remote-tracking branch 'origin/5.12' into 5.13Liang Qi2019-08-0363-1970/+3082
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: .gitmodules ignore QtWebEngine on QEMU temporarily. coin/platform_configs/default.yaml no-gui build was removed temporarily. coin/platform_configs/qt5.yaml coin/platform_configs/qtbase.yaml coin/platform_configs/qtconnectivity.yaml coin/platform_configs/qtsaferenderer.yaml Task-number: QTQAINFRA-2576 Task-number: QTBUG-77304 Task-number: QTBUG-77305 Done-With: Tony Sarajärvi <tony.sarajarvi@qt.io> Change-Id: If7cf75791677eace762374b92382a2ce15f17f55
| * Provisioning: update conan_manifests for libxslt packagesKonstantin Tokarev2019-08-017-48/+40
| | | | | | | | | | | | | | | | Package recipe was improved, as a result packages were rebuilt and checksums need update. Change-Id: I33bd30b44cbe48b3550cb42eeb995ef8588fcce7 Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
| * Provisioning: update Conan and Conan packagesKonstantin Tokarev2019-07-2654-1913/+2845
| | | | | | | | | | | | | | | | | | | | | | | | [*] Update Conan to 1.17.0, adjust to change in command line arguments [*] Update Conan packages to up-to-date versions, add libjpeg-turbo and packages for 64-bit MinGW [*] Rename 03-conan.ps1 to 11-conan.ps1 so that it is installed after Python 3 and MinGW [*] Add license header to conan.ps1 Change-Id: Ibc451ddc54a7227eb6d3a007a20351e77a46875f Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: Add CompilerException and CompilerThreads settings for ConanKonstantin Tokarev2019-07-261-3/+13
| | | | | | | | | | Change-Id: I3a52101056bce4d3d4ac9124dbfd566adf47cf80 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: rename 03-conan.ps1 to conan.ps1 to follow naming conventionKonstantin Tokarev2019-07-261-0/+0
| | | | | | | | | | Change-Id: If24541709d4675498bc4af296e05ce3c62d5045a Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Conan: Suppress output of New-ItemKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | Change-Id: I3d62fffa08d38a383187726e08743512236bb859 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: install-msys2.ps1 must run its commands synchronouslyKonstantin Tokarev2019-07-261-6/+8
| | | | | | | | | | | | | | | | | | | | | | | | [*] Using bash instead of msys2_shell.cmd allows Start-Process to actually wait for the end of command execution. [*] cpan requires "yes" to be typed by user when it's run first time, otherwise it hangs indefinitely waiting for input. [*] Stop gpg-agent and dirmngr started in the background to prevent CI session from hanging. Change-Id: I4d4c1f36d215cb7578d1e7059217e34375de96c6 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Use msiexec to install Strawberry Perl from msi packageKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | | | | | Currently provisioning fails with following error: "This command cannot be run due to the error: %1 is not a valid Win32 application." Change-Id: I59290d394f231c37af10f27d07dbb9f5d2d2470a Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: Run-Executable should print stdout and stderr to logKonstantin Tokarev2019-07-261-2/+34
| | | | | | | | | | | | Task-number: QTQAINFRA-3085 Change-Id: I5343753f75157a2a894bb3ac50d416ab044d86fb Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Provisioning: don't re-run Conan 5 times if there is no errorKonstantin Tokarev2019-07-261-1/+1
| | | | | | | | | | | | Change-Id: Ia348ebbc4fc3a2503cc426c011e68b7a410c4a08 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io> Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
| * Provisioning: Upgrade PyYAML because of possible security vulnerabilityHeikki Halmet2019-04-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | Known high severity security vulnerability in pyyaml v< 4.2b1 Task-number: QTQAINFRA-2888 Change-Id: I6522fc66ca7c4323cc6248ec2cb31c62201f8e84 Reviewed-by: Dominik Holland <dominik.holland@pelagicore.com> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provisioning: Fix cleanup when building GCC from sourcesTony Sarajärvi2019-05-161-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | We need sudo rights to delete the temporary folder where sources for GCC are extracted. Change-Id: Ic0642e44eabfc3449f7ce5903a63bd38924f7dca Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Merge remote-tracking branch 'origin/5.12.4' into 5.12Liang Qi2019-06-2510-120/+292
| |\ | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: coin/platform_configs/default.txt coin/platform_configs/qt5.txt Done-With: Tony Sarajärvi <tony.sarajarvi@qt.io> Change-Id: I1381c4b80a64859cb42d6cb5205ef549de40dde6
| | * Fix openssl 1.1 library configurationsHeikki Halmet2019-06-131-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | Change-Id: Idcb919e5f388b509e4215cf5515c8716490d5872 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io>
| | * Provision sed for windows 10Juha Karjalainen2019-06-102-0/+72
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Sed is needed by webassembly build. Cannot use sed from msys as having msys bin folder in path breaks webassembly build. Task-number: QTQAINFRA-2835 Change-Id: I6ad06f0a952a0d8bc5d21e62f8c2cef70f40c618 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 230a73409a2fe58e7de0674107a2d870be0bf03d) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| | * Provisioning: install msys2Juha Karjalainen2019-06-101-0/+70
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Windows need msys2 perl for configuring openssl 1.1.1 for android. Task-number: QTQAINFRA-2327 Change-Id: I217542b6e9b3fd0f656b8186e2cde4283257dcf8 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 6465c421225574dc1c5d9f23293c37e784fd1b02) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| | * Provisioning: Change openssl version to 1.1.1bJuha Karjalainen2019-06-105-113/+136
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Use newest LTS version of openssl as support for 1.0.2 series will end at end of 2019. For windows 7 x86 openssl 1.0.2 will be used until all need fixed are made to submodule tests Task-number: QTQAINFRA-2327 Change-Id: I930d239cd139b6202ebdfb5cdc8068ff2ad0b8a3 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> (cherry picked from commit 3e838f2a34d0c1538535bd184aa12681497c8a38)
| | * Provisioning: Use ANDROID_NDK_ROOT instead of ANDROID_NDK_HOMEHeikki Halmet2019-06-101-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Without this binaries will be hardcoded to look in e.g /opt/android/android-ndk-r19b which means that RTA tests will fail Task-number: QTBUG-74952 Change-Id: Ic2b1297e15d905f2250333b6bc884abe2f1472d4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit dbaa42baa77309a1aa407cd45078d885f7428aa2) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| | * Provisioning: Update Android NDK to version r19Heikki Halmet2019-06-102-7/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also let's start using 64-bit Android NDK for Windows Task-number: QTQAINFRA-2568 Change-Id: I2d757aa9e43abf5118abad7bf644e17e88a2ca94 Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit c09135cb56e03dd6a09b79f2c6e15932e9433df2) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
| * | Update GCC version to 9.1.0 in Ubuntu 18.04Tony Sarajärvi2019-05-311-0/+5
| |/ | | | | | | | | | | | | | | | | | | Task-number: QTQAINFRA-2958 Change-Id: I3ea8c8e467b9a1f56c2b114c40fb94dfdc1448d0 Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org> Reviewed-by: Liang Qi <liang.qi@qt.io>
| * Log more version information on macOS provisioningJuha Karjalainen2019-05-122-0/+96
| | | | | | | | | | | | | | | | | | Logs more version information to make easier to reproduce build. Logs macOS build version, homebrew installed packages and apple's installer installed packages. Change-Id: Ia9f2842a3fd2e8e0acf1667c7435a19c7a878aed Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Add webAssembly build for windows and macosJuha Karjalainen2019-07-313-17/+154
| | | | | | | | | | | | | | | | | | | | Provision emsdk and its dependecies to windows and macos. Task-number: QTBUG-63917 Task-number: QTQAINFRA-2835 Done-with: Juha Karjalainen <juha.karjalainen@qt.io> Change-Id: I24ea9cbc4f7cc95e6952765099d5e46247470011 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* | Merge remote-tracking branch 'origin/5.13.0' into 5.13Liang Qi2019-07-051-0/+6
|\ \ | | | | | | | | | Change-Id: I97c42bef6632a4aeccefab008e0f615f7a9e9f78
| * | Fix openssl 1.1 library configurationsv5.13.0-rc3v5.13.0Heikki Halmet2019-06-131-0/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change-Id: Idcb919e5f388b509e4215cf5515c8716490d5872 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io> (cherry picked from commit de415914772b5ced911ec9f04738dab2ec355fc9) Change-Id: Ifbb5ecc4613319265a3378b60959fffc7301ae46 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>