aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning/common/unix
Commit message (Collapse)AuthorAgeFilesLines
* Use internal mirror repositories for Ubuntu docker containersDimitrios Apostolou2020-01-131-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | Depending on different external URLs makes our provisioning scripts flaky, because they can fail if any one of the external servers goes down. In this patch * the docker images qt_ubuntu_16.04 and qt_ubuntu_18.04 are being built first, they apt-get from the internal ubuntu mirror * all the existing docker images have been rebased to these two images, so they inherit this behavior * images that fetch files from the internet have been modified to not do the fetching themselves; insted URLs are fetched in advance using "DownloadURL" which accepts internal mirrored URLs, and the downloaded files are ADDed to the images with a local copy * previously existing git clone commands have been modified to fetch internally mirrored tarballs Task-number: QTQAINFRA-3343 Change-Id: Ic4640a4f7776e38623edba90f0eba7cb68631223 Reviewed-by: Sona Kurazyan <sona.kurazyan@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Remove sudo when installing pip packages for Qt userSimo Fält2019-11-251-2/+2
| | | | | | | | | There is no need to install as sudo for qt user. Using sudo will change the cache dir's permissions preventing us from installing anything with pip as normal user. Change-Id: Id45bf3805ce4d772a6c82e429d4e1948289f076e Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Provisioning: update SquishJohanna Äijälä2019-11-211-4/+4
| | | | | | | | Update with custom build of Squish to be able to launch Qt5.14 applications in RTA tests. Change-Id: Ic420656852ae885b057de937baabf01135526764 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Install python modules needed by packagingHeikki Halmet2019-11-201-0/+38
| | | | | | | | Needed by packaging scripts Task-number: COIN-214 Change-Id: I3ac719800c3afd183996379f6c23fbe3f8bcf7cb Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
* DownloadURL last argument (targetFile) is now optionalDimitrios Apostolou2019-11-141-1/+8
| | | | | Change-Id: I0864bcb052cddcc9753c056758b6e65fd561d928 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Upgrade OpenSSL version to 1.1.1dHeikki Halmet2019-11-021-2/+2
| | | | | | | | Plus removing unused file install_openssl_111a.sh Task-number: QTQAINFRA-3224 Change-Id: If5f9ee12e118e0329eb27f8d3ca9829011874382 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Fix for DownloadURL to try alternative URLDimitrios Apostolou2019-10-151-2/+2
| | | | | Change-Id: I7e9a77815ef8f4c258dda44bda6fdd4eb3736ef4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Fix shell function is_script_executedDimitrios Apostolou2019-10-081-1/+3
| | | | | | | | It used to return error when tested inside a login shell, because $0 is "-bash" and `basename` was trying to interpret -b as an option. Change-Id: I5faa2dc01e50c7d5bcfc0ab1fcfd910b2538afc2 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Fix provisioning script for RHEL 6Dimitrios Apostolou2019-10-081-2/+20
| | | | | | | It seems RHEL 6.6 does not provide /etc/os-release. Change-Id: I01ba2bb17b89c01f9991944a11eeaa9c2eba6f20 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* DownloadURL now works with either wget or curlDimitrios Apostolou2019-09-271-2/+11
| | | | | | | | | The reason is that Ubuntu does not have curl at the very beginning of provisioning scripts, and also does not have the repositories configured in order to install it. Change-Id: Ia485c1672f894bc800f199b742d238b2945938e5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Install telegraf on all provisioned VMsDimitrios Apostolou2019-09-273-0/+297
| | | | | | | | | | | | | | | | | | Install binaries as early as possible in the provisioning process, and start them, in order to monitor provisioning too. To achieve this, some OS auto-detection logic is introduced in shell script common.sourced.sh. The script can be sourced and used in all kind of other generic scripts. ioping is also installed from custom-compiled binaries in order to monitor the disk latency of the VMs. Reason we don't use ioping from the repositories, is that the units differ between ioping versions (new ioping reports latencies in nanoseconds, old in microseconds). Fixes: QTQAINFRA-3092 Change-Id: I9d9afb791955725d4bd0b32dae97dfc0bd4a76a3 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Refactor DownloadURL.shDimitrios Apostolou2019-09-261-23/+61
| | | | | | | | | | | | Auto-detects and verifies all kinds of hashes, not only SHA1. Hash verification is now an autonomous function. If the file is found at the destination, skip redownloading it if the hash is OK. Runs on POSIX sh, not requiring bash. Retain compatibility with previous version. Change-Id: I9930336030aa776f49dc460fe766f3e831700255 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not silence standard errorDimitrios Apostolou2019-09-261-2/+2
| | | | | | | | | | Provisioning was failing and the logs did not provide any useful information because of the silenced squish install command. So I went through all the scripts and I re-enabled stderr logging where I found it silenced (with the exception of where it was purposeful or harmless). Change-Id: I5fa0b0ba4362970b214c150d399b6720b1780e1e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Speed up provisioning on LinuxDimitrios Apostolou2019-09-261-1/+1
| | | | | Change-Id: I6e4e5621ed0b063215476ef51d61ef1f38198d0c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Append the emscripten to path instead of prependSimo Fält2019-08-121-1/+1
| | | | | | | | | Having it first in path seems to cause some confusion when detecting libc++ in darwin. Change-Id: I841e7f169e4771d3818cf156d9d78fc242e9995c Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Add webAssembly build for windows and macosJuha Karjalainen2019-07-311-0/+97
| | | | | | | | | | Provision emsdk and its dependecies to windows and macos. Task-number: QTBUG-63917 Task-number: QTQAINFRA-2835 Done-with: Juha Karjalainen <juha.karjalainen@qt.io> Change-Id: I24ea9cbc4f7cc95e6952765099d5e46247470011 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Fix openssl 1.1 library configurationsv5.13.0-rc3v5.13.0Heikki Halmet2019-06-131-0/+6
| | | | | | | | | | | Change-Id: Idcb919e5f388b509e4215cf5515c8716490d5872 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io> (cherry picked from commit de415914772b5ced911ec9f04738dab2ec355fc9) Change-Id: Ifbb5ecc4613319265a3378b60959fffc7301ae46 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Change openssl version to 1.1.1bJuha Karjalainen2019-05-221-0/+91
| | | | | | | | | | | | | | | | | | Use newest LTS version of openssl as support for 1.0.2 series will end at end of 2019. For windows 7 x86 openssl 1.0.2 will be used until all need fixed are made to submodule tests Task-number: QTQAINFRA-2327 Change-Id: I930d239cd139b6202ebdfb5cdc8068ff2ad0b8a3 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Merge remote-tracking branch 'origin/5.12.2' into 5.12Liang Qi2019-03-211-1/+1
|\ | | | | | | Change-Id: I8795e84dd750cbb2b55a03c861b911f57a1e2626
| * Fix: Set correct path to environmental variableJuha Karjalainen2019-02-181-1/+1
| | | | | | | | | | | | | | | | Env variable BREAKPAD_SOURCE_DIR had /src at end which was not needed. Change-Id: I4d126c3b7c3b2da03dc2a0ba075b0d4ddad92eeb Reviewed-by: Miikka Heikkinen <miikka.heikkinen@qt.io>
* | Update Squish to 6.4.3Johanna Aijala2019-03-071-2/+2
|/ | | | | | | | | | Froglogic has not yet released Squish for Qt5.13 but we can use Squish packages build with Qt5.12. Remove msvc12 Squish, not needed. Change-Id: I1de1bb67a5577fa7f7233c69c3a58bedd15fd16b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Install Google's Protocol BuffersHeikki Halmet2019-01-291-0/+75
| | | | | | | | Protobuf is needed for Automotive Suite Task-number: QTQAINFRA-2314 Change-Id: I12b4248f1de5aea88f573297a47b791b5b6296fb Reviewed-by: Samuli Piippo <samuli.piippo@qt.io>
* Provisioning: breakpad for qt3dstudioJuha Karjalainen2019-01-171-0/+81
| | | | | | | | | | Breakpad https://chromium.googlesource.com/breakpad/breakpad/ sources are needed for qt3studio. Also Breakpad need sources for https://chromium.googlesource.com/linux-syscall-support. Task-number: QT3DS-2650 Change-Id: I13c7534e1c6e97a1e345dad3c2c82eeb6428313d Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Fix broken provisioning script DownloadURL.shJuha Karjalainen2019-01-091-3/+5
| | | | | | | | DownloadURL returns 0 even when alt download fails. Task-number: QTQAINFRA-2501 Change-Id: Id2fb1e0b4ff12a48b6adb27291f55fc129296233 Reviewed-by: Paul Wicking <paul.wicking@qt.io>
* Provisioning: Hide squish installation output from provisioning logHeikki Halmet2018-12-171-1/+1
| | | | | | | This will prevent the output of unwanted information Change-Id: I547e91ef344ec51f799b26f254139b03d20a315c Reviewed-by: Simo Fält <simo.falt@qt.io>
* Don't set http_proxy in its own subshellTony Sarajärvi2018-11-291-1/+1
| | | | | | | | | The subshell actually meant, that the http_proxy environment variable was never seen outside that check. Thus proxy was never used where this was checked. Change-Id: I069f43f13dffca98d8b60a47c2e105209018c84d Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>
* Merge remote-tracking branch 'origin/5.11' into 5.12Liang Qi2018-11-201-1/+1
|\ | | | | | | | | | | | | Conflicts: coin/provisioning/common/unix/mqtt_broker.sh Change-Id: I990dbf66b7120f2f1bcf202f0a2547a5ad9881f2
| * Replace .ci.local addresses with .intra.qt.io in provisioning scriptsTony Sarajärvi2018-11-011-1/+1
| | | | | | | | | | Change-Id: I5e5bc084faabb28ffdf0437871445ecb8970bfb3 Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Provisioning: Support for WebassemblyHeikki Halmet2018-09-151-1/+4
| | | | | | | | | | | | | | | | | | This change will install specified packages of Emscripten and set up the build environment for making binary artifacts of WebAssembly Task-number: QTQAINFRA-1972 Change-Id: Ia5df6c208ea8f29ca8948f0273f321a59fc694a2 Reviewed-by: Eskil Abrahamsen Blomfeldt <eskil.abrahamsen-blomfeldt@qt.io>
* | Use Squish 6.3.2 Qt5.10 on Qt5.12 RTA testsJohanna Aijala2018-09-111-2/+2
| | | | | | | | | | | | | | | | Update to latest Squish versions that Froglogic is providing. May need to update to Squish 6.4 later, but now we use 6.3.2. Change-Id: I89e1f20b58cdd2e948c8021a5fdc357bfc201db1 Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Provisioning: Add chmod +x to Squish .run fileJoni Jäntti2018-09-111-0/+1
| | | | | | | | | | | | | | | | | | This file needs execution rights before it can be run in provisioning. Change-Id: Id49de89e0260b18a71cbcd4f4dc2b5a28e0a9890 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Cleanup of RHEL 6 codes from provisioning scriptsTony Sarajärvi2018-09-042-12/+4
| | | | | | | | | | | | | | | | RHEL 6 has been removed in 5.12+ verifications, so no need to maintain those changes. Change-Id: Ie65120bf8ec7a7d0aaa71b7c28e95283263e62eb Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
* | Change 'test suite' in license headers of prov scriptsTony Sarajärvi2018-09-046-6/+6
| | | | | | | | | | Change-Id: I9687bcb15b26287ea6eeb2098079137d6e3fc288 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Update MQTT brokerMaurice Kalinowski2018-08-171-2/+2
|/ | | | | | | | Required to get shared subscription testing working, namely to fix https://github.com/eclipse/paho.mqtt.testing/issues/56 Change-Id: Ib8657cde0d8e33135bbc2ebcb9558f8e6b13e40f Reviewed-by: Oliver Wolff <oliver.wolff@qt.io>
* Provisioning: Update MQTT test brokerMaurice Kalinowski2018-08-041-2/+2
| | | | | | | Updates required for latest MQTT5 features and fixes. Change-Id: I63e967efafbe1b22800e338b6c431febe3389a45 Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
* Provisioning: Add force option when unmounting squishHeikki Halmet2018-06-291-8/+13
| | | | | | | | | | | Sometimes unmount of squish fail because resource busy even if the installation is already succeeded. To avoid this let's add force option to make sure unmounting works every time. Task-number: QTQAINFRA-1964 Change-Id: Icacd01341d09577d9880e3ed208cb6ea18a7ac4f Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Refactor libclang installationHeikki Halmet2018-06-291-17/+24
| | | | | | | | | | Libclang must use cached url (ci-files01-hki) to reduce the download time Libclang release_60 versions were rebuild which requires sha1 changes Task-number: QTQAINFRA-1966 Task-number: QTQAINFRA-2100 Change-Id: Iddf47a2a3a5bc38dbed684320120164bb40c028c Reviewed-by: Simo Fält <simo.falt@qt.io>
* Provisioning: Update MQTT test brokerMaurice Kalinowski2018-06-251-2/+2
| | | | | | Change-Id: Ie4e9ff5c13eb5f882b70e4e948836ae78496dd40 Reviewed-by: Alex Blasche <alexander.blasche@qt.io> Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>
* Merge remote-tracking branch 'origin/5.11.0' into 5.11Liang Qi2018-05-181-0/+7
|\ | | | | | | Change-Id: Ifa6c63ef62e339b90e571b13c73addaa17d7af4e
| * Fix linking of qdoc against an external libclang (part 1)Simon Hausmann2018-05-141-0/+7
| | | | | | | | | | | | | | | | | | | | | | This is the qt5 part of the fix for the task. For the special version of libclang we hacked together that allows static linkage, set an environment variable that the mighty qdoc build system can utilize to activate the release packaging specific linkage. Change-Id: Ie340955214585329fe8fd3bc790e3cd6c6be42f9 Task-number: QTBUG-68178 Reviewed-by: Jędrzej Nowacki <jedrzej.nowacki@qt.io>
* | Merge remote-tracking branch 'origin/5.11.0' into 5.11Liang Qi2018-05-091-1/+1
|\| | | | | | | Change-Id: Ia252225aa1339ac448dd726b149e08739c02dfc5
| * Update clang version to 6.0Jędrzej Nowacki2018-04-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The version also contains statically compiled libraries so we can ship qdoc without shipping libclang. The change temporarly removes CI qdoc builds from RHEL6 and MinGW, these two configurations are not used for packaging, just for CI testing. We should restore MinGW later. Task-number: QTBUG-66015 Task-number: QTBUG-67764 Change-Id: Ie37b4be6a639e81d9ef0815682c6d60981cbeaae Reviewed-by: Jesus Fernandez <Jesus.Fernandez@qt.io> Reviewed-by: Fredrik de Vibe <fredrik.devibe@qt.io> Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
* | Fix shellcheck complaints in provisioning scriptsTony Sarajärvi2018-04-294-14/+17
|/ | | | | | Change-Id: I38306c6d2ff360dc12f8c33b289bbc4ae4935aca Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io>
* Provisioning: Add test for squish installationHeikki Halmet2018-04-151-0/+14
| | | | | | | | | | | | | | Squish is needed by RTA which is not run during normal qt5 build. Other words squish installation is not tested during integration. That's why we need separate test for it. This change will fetch test and run test suite which is made to check that squish installation works Task-number: QTQAINFRA-1733 Change-Id: I9284fd52d87767ae04022c3a6996e0bb972315dd Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io> Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Matti Paaso <matti.paaso@qt.io>
* Fix squish provisioning script typoTony Sarajärvi2018-04-151-2/+2
| | | | | Change-Id: If33847a552fe40128cef577b99adf3152de3a9e2 Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>
* Provisioning: Remove sha1 file after shasum checkHeikki Halmet2018-04-151-0/+1
| | | | | Change-Id: Iee8e66d98e5ebd2dee18baf8e1752a86065417d1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Remove try_catch.sh helper scriptTony Sarajärvi2018-03-191-64/+0
| | | | | | Change-Id: I3981920bb8085ffbad89c31e0fd628a6e11146b6 Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Remove try_catch codes from unix scriptsTony Sarajärvi2018-03-193-191/+77
| | | | | Change-Id: Iabadbf28c65132ae614048cb98e92f57e3786056 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Move http_proxy.txt under shared folderHeikki Halmet2018-03-151-1/+1
| | | | | | Change-Id: Id5b2f07a92eadfb21fbfdb3fb65621d6322dc8c4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> Reviewed-by: Frederik Gladhorn <frederik.gladhorn@qt.io>
* Simplify DownloadURLJędrzej Nowacki2018-03-141-38/+8
| | | | | | | | | | | | | The script was over-engineered. The new version provides the same functionality while removing uninteresting postmortem messages. In addition try_catch.sh has a bug that injects set +e to a sourcing script which was propagating through DownloadURL.sh to almost all provisioning scripts. So it is good to avoid using it. Change-Id: If191a0dcf52a29c4bec580a254e8e58a00130f6d Reviewed-by: Oliver Wolff <oliver.wolff@qt.io> Reviewed-by: Frederik Gladhorn <frederik.gladhorn@qt.io>
generated by cgit v1.2.3 (git 2.25.1) at 2024-05-03 17:10:07 +0000