aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning/common/unix
Commit message (Collapse)AuthorAgeFilesLines
* Fix shell function is_script_executedDimitrios Apostolou2019-10-081-1/+3
| | | | | | | | It used to return error when tested inside a login shell, because $0 is "-bash" and `basename` was trying to interpret -b as an option. Change-Id: I5faa2dc01e50c7d5bcfc0ab1fcfd910b2538afc2 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Fix provisioning script for RHEL 6Dimitrios Apostolou2019-10-081-2/+20
| | | | | | | It seems RHEL 6.6 does not provide /etc/os-release. Change-Id: I01ba2bb17b89c01f9991944a11eeaa9c2eba6f20 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* DownloadURL now works with either wget or curlDimitrios Apostolou2019-09-271-2/+11
| | | | | | | | | The reason is that Ubuntu does not have curl at the very beginning of provisioning scripts, and also does not have the repositories configured in order to install it. Change-Id: Ia485c1672f894bc800f199b742d238b2945938e5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Install telegraf on all provisioned VMsDimitrios Apostolou2019-09-273-0/+297
| | | | | | | | | | | | | | | | | | Install binaries as early as possible in the provisioning process, and start them, in order to monitor provisioning too. To achieve this, some OS auto-detection logic is introduced in shell script common.sourced.sh. The script can be sourced and used in all kind of other generic scripts. ioping is also installed from custom-compiled binaries in order to monitor the disk latency of the VMs. Reason we don't use ioping from the repositories, is that the units differ between ioping versions (new ioping reports latencies in nanoseconds, old in microseconds). Fixes: QTQAINFRA-3092 Change-Id: I9d9afb791955725d4bd0b32dae97dfc0bd4a76a3 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Refactor DownloadURL.shDimitrios Apostolou2019-09-261-23/+61
| | | | | | | | | | | | Auto-detects and verifies all kinds of hashes, not only SHA1. Hash verification is now an autonomous function. If the file is found at the destination, skip redownloading it if the hash is OK. Runs on POSIX sh, not requiring bash. Retain compatibility with previous version. Change-Id: I9930336030aa776f49dc460fe766f3e831700255 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not silence standard errorDimitrios Apostolou2019-09-261-2/+2
| | | | | | | | | | Provisioning was failing and the logs did not provide any useful information because of the silenced squish install command. So I went through all the scripts and I re-enabled stderr logging where I found it silenced (with the exception of where it was purposeful or harmless). Change-Id: I5fa0b0ba4362970b214c150d399b6720b1780e1e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Speed up provisioning on LinuxDimitrios Apostolou2019-09-261-1/+1
| | | | | Change-Id: I6e4e5621ed0b063215476ef51d61ef1f38198d0c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Append the emscripten to path instead of prependSimo Fält2019-08-121-1/+1
| | | | | | | | | Having it first in path seems to cause some confusion when detecting libc++ in darwin. Change-Id: I841e7f169e4771d3818cf156d9d78fc242e9995c Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Add webAssembly build for windows and macosJuha Karjalainen2019-07-311-0/+97
| | | | | | | | | | Provision emsdk and its dependecies to windows and macos. Task-number: QTBUG-63917 Task-number: QTQAINFRA-2835 Done-with: Juha Karjalainen <juha.karjalainen@qt.io> Change-Id: I24ea9cbc4f7cc95e6952765099d5e46247470011 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Fix openssl 1.1 library configurationsv5.13.0-rc3v5.13.0Heikki Halmet2019-06-131-0/+6
| | | | | | | | | | | Change-Id: Idcb919e5f388b509e4215cf5515c8716490d5872 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io> (cherry picked from commit de415914772b5ced911ec9f04738dab2ec355fc9) Change-Id: Ifbb5ecc4613319265a3378b60959fffc7301ae46 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Change openssl version to 1.1.1bJuha Karjalainen2019-05-221-0/+91
| | | | | | | | | | | | | | | | | | Use newest LTS version of openssl as support for 1.0.2 series will end at end of 2019. For windows 7 x86 openssl 1.0.2 will be used until all need fixed are made to submodule tests Task-number: QTQAINFRA-2327 Change-Id: I930d239cd139b6202ebdfb5cdc8068ff2ad0b8a3 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Merge remote-tracking branch 'origin/5.12.2' into 5.12Liang Qi2019-03-211-1/+1
|\ | | | | | | Change-Id: I8795e84dd750cbb2b55a03c861b911f57a1e2626
| * Fix: Set correct path to environmental variableJuha Karjalainen2019-02-181-1/+1
| | | | | | | | | | | | | | | | Env variable BREAKPAD_SOURCE_DIR had /src at end which was not needed. Change-Id: I4d126c3b7c3b2da03dc2a0ba075b0d4ddad92eeb Reviewed-by: Miikka Heikkinen <miikka.heikkinen@qt.io>
* | Update Squish to 6.4.3Johanna Aijala2019-03-071-2/+2
|/ | | | | | | | | | Froglogic has not yet released Squish for Qt5.13 but we can use Squish packages build with Qt5.12. Remove msvc12 Squish, not needed. Change-Id: I1de1bb67a5577fa7f7233c69c3a58bedd15fd16b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Install Google's Protocol BuffersHeikki Halmet2019-01-291-0/+75
| | | | | | | | Protobuf is needed for Automotive Suite Task-number: QTQAINFRA-2314 Change-Id: I12b4248f1de5aea88f573297a47b791b5b6296fb Reviewed-by: Samuli Piippo <samuli.piippo@qt.io>
* Provisioning: breakpad for qt3dstudioJuha Karjalainen2019-01-171-0/+81
| | | | | | | | | | Breakpad https://chromium.googlesource.com/breakpad/breakpad/ sources are needed for qt3studio. Also Breakpad need sources for https://chromium.googlesource.com/linux-syscall-support. Task-number: QT3DS-2650 Change-Id: I13c7534e1c6e97a1e345dad3c2c82eeb6428313d Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Fix broken provisioning script DownloadURL.shJuha Karjalainen2019-01-091-3/+5
| | | | | | | | DownloadURL returns 0 even when alt download fails. Task-number: QTQAINFRA-2501 Change-Id: Id2fb1e0b4ff12a48b6adb27291f55fc129296233 Reviewed-by: Paul Wicking <paul.wicking@qt.io>
* Provisioning: Hide squish installation output from provisioning logHeikki Halmet2018-12-171-1/+1
| | | | | | | This will prevent the output of unwanted information Change-Id: I547e91ef344ec51f799b26f254139b03d20a315c Reviewed-by: Simo Fält <simo.falt@qt.io>
* Don't set http_proxy in its own subshellTony Sarajärvi2018-11-291-1/+1
| | | | | | | | | The subshell actually meant, that the http_proxy environment variable was never seen outside that check. Thus proxy was never used where this was checked. Change-Id: I069f43f13dffca98d8b60a47c2e105209018c84d Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>
* Merge remote-tracking branch 'origin/5.11' into 5.12Liang Qi2018-11-201-1/+1
|\ | | | | | | | | | | | | Conflicts: coin/provisioning/common/unix/mqtt_broker.sh Change-Id: I990dbf66b7120f2f1bcf202f0a2547a5ad9881f2
| * Replace .ci.local addresses with .intra.qt.io in provisioning scriptsTony Sarajärvi2018-11-011-1/+1
| | | | | | | | | | Change-Id: I5e5bc084faabb28ffdf0437871445ecb8970bfb3 Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Provisioning: Support for WebassemblyHeikki Halmet2018-09-151-1/+4
| | | | | | | | | | | | | | | | | | This change will install specified packages of Emscripten and set up the build environment for making binary artifacts of WebAssembly Task-number: QTQAINFRA-1972 Change-Id: Ia5df6c208ea8f29ca8948f0273f321a59fc694a2 Reviewed-by: Eskil Abrahamsen Blomfeldt <eskil.abrahamsen-blomfeldt@qt.io>
* | Use Squish 6.3.2 Qt5.10 on Qt5.12 RTA testsJohanna Aijala2018-09-111-2/+2
| | | | | | | | | | | | | | | | Update to latest Squish versions that Froglogic is providing. May need to update to Squish 6.4 later, but now we use 6.3.2. Change-Id: I89e1f20b58cdd2e948c8021a5fdc357bfc201db1 Reviewed-by: Liang Qi <liang.qi@qt.io>
* | Provisioning: Add chmod +x to Squish .run fileJoni Jäntti2018-09-111-0/+1
| | | | | | | | | | | | | | | | | | This file needs execution rights before it can be run in provisioning. Change-Id: Id49de89e0260b18a71cbcd4f4dc2b5a28e0a9890 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Cleanup of RHEL 6 codes from provisioning scriptsTony Sarajärvi2018-09-042-12/+4
| | | | | | | | | | | | | | | | RHEL 6 has been removed in 5.12+ verifications, so no need to maintain those changes. Change-Id: Ie65120bf8ec7a7d0aaa71b7c28e95283263e62eb Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
* | Change 'test suite' in license headers of prov scriptsTony Sarajärvi2018-09-046-6/+6
| | | | | | | | | | Change-Id: I9687bcb15b26287ea6eeb2098079137d6e3fc288 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Update MQTT brokerMaurice Kalinowski2018-08-171-2/+2
|/ | | | | | | | Required to get shared subscription testing working, namely to fix https://github.com/eclipse/paho.mqtt.testing/issues/56 Change-Id: Ib8657cde0d8e33135bbc2ebcb9558f8e6b13e40f Reviewed-by: Oliver Wolff <oliver.wolff@qt.io>
* Provisioning: Update MQTT test brokerMaurice Kalinowski2018-08-041-2/+2
| | | | | | | Updates required for latest MQTT5 features and fixes. Change-Id: I63e967efafbe1b22800e338b6c431febe3389a45 Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
* Provisioning: Add force option when unmounting squishHeikki Halmet2018-06-291-8/+13
| | | | | | | | | | | Sometimes unmount of squish fail because resource busy even if the installation is already succeeded. To avoid this let's add force option to make sure unmounting works every time. Task-number: QTQAINFRA-1964 Change-Id: Icacd01341d09577d9880e3ed208cb6ea18a7ac4f Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Refactor libclang installationHeikki Halmet2018-06-291-17/+24
| | | | | | | | | | Libclang must use cached url (ci-files01-hki) to reduce the download time Libclang release_60 versions were rebuild which requires sha1 changes Task-number: QTQAINFRA-1966 Task-number: QTQAINFRA-2100 Change-Id: Iddf47a2a3a5bc38dbed684320120164bb40c028c Reviewed-by: Simo Fält <simo.falt@qt.io>
* Provisioning: Update MQTT test brokerMaurice Kalinowski2018-06-251-2/+2
| | | | | | Change-Id: Ie4e9ff5c13eb5f882b70e4e948836ae78496dd40 Reviewed-by: Alex Blasche <alexander.blasche@qt.io> Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>
* Merge remote-tracking branch 'origin/5.11.0' into 5.11Liang Qi2018-05-181-0/+7
|\ | | | | | | Change-Id: Ifa6c63ef62e339b90e571b13c73addaa17d7af4e
| * Fix linking of qdoc against an external libclang (part 1)Simon Hausmann2018-05-141-0/+7
| | | | | | | | | | | | | | | | | | | | | | This is the qt5 part of the fix for the task. For the special version of libclang we hacked together that allows static linkage, set an environment variable that the mighty qdoc build system can utilize to activate the release packaging specific linkage. Change-Id: Ie340955214585329fe8fd3bc790e3cd6c6be42f9 Task-number: QTBUG-68178 Reviewed-by: Jędrzej Nowacki <jedrzej.nowacki@qt.io>
* | Merge remote-tracking branch 'origin/5.11.0' into 5.11Liang Qi2018-05-091-1/+1
|\| | | | | | | Change-Id: Ia252225aa1339ac448dd726b149e08739c02dfc5
| * Update clang version to 6.0Jędrzej Nowacki2018-04-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The version also contains statically compiled libraries so we can ship qdoc without shipping libclang. The change temporarly removes CI qdoc builds from RHEL6 and MinGW, these two configurations are not used for packaging, just for CI testing. We should restore MinGW later. Task-number: QTBUG-66015 Task-number: QTBUG-67764 Change-Id: Ie37b4be6a639e81d9ef0815682c6d60981cbeaae Reviewed-by: Jesus Fernandez <Jesus.Fernandez@qt.io> Reviewed-by: Fredrik de Vibe <fredrik.devibe@qt.io> Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
* | Fix shellcheck complaints in provisioning scriptsTony Sarajärvi2018-04-294-14/+17
|/ | | | | | Change-Id: I38306c6d2ff360dc12f8c33b289bbc4ae4935aca Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io>
* Provisioning: Add test for squish installationHeikki Halmet2018-04-151-0/+14
| | | | | | | | | | | | | | Squish is needed by RTA which is not run during normal qt5 build. Other words squish installation is not tested during integration. That's why we need separate test for it. This change will fetch test and run test suite which is made to check that squish installation works Task-number: QTQAINFRA-1733 Change-Id: I9284fd52d87767ae04022c3a6996e0bb972315dd Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io> Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Matti Paaso <matti.paaso@qt.io>
* Fix squish provisioning script typoTony Sarajärvi2018-04-151-2/+2
| | | | | Change-Id: If33847a552fe40128cef577b99adf3152de3a9e2 Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>
* Provisioning: Remove sha1 file after shasum checkHeikki Halmet2018-04-151-0/+1
| | | | | Change-Id: Iee8e66d98e5ebd2dee18baf8e1752a86065417d1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Remove try_catch.sh helper scriptTony Sarajärvi2018-03-191-64/+0
| | | | | | Change-Id: I3981920bb8085ffbad89c31e0fd628a6e11146b6 Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Remove try_catch codes from unix scriptsTony Sarajärvi2018-03-193-191/+77
| | | | | Change-Id: Iabadbf28c65132ae614048cb98e92f57e3786056 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Move http_proxy.txt under shared folderHeikki Halmet2018-03-151-1/+1
| | | | | | Change-Id: Id5b2f07a92eadfb21fbfdb3fb65621d6322dc8c4 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> Reviewed-by: Frederik Gladhorn <frederik.gladhorn@qt.io>
* Simplify DownloadURLJędrzej Nowacki2018-03-141-38/+8
| | | | | | | | | | | | | The script was over-engineered. The new version provides the same functionality while removing uninteresting postmortem messages. In addition try_catch.sh has a bug that injects set +e to a sourcing script which was propagating through DownloadURL.sh to almost all provisioning scripts. So it is good to avoid using it. Change-Id: If191a0dcf52a29c4bec580a254e8e58a00130f6d Reviewed-by: Oliver Wolff <oliver.wolff@qt.io> Reviewed-by: Frederik Gladhorn <frederik.gladhorn@qt.io>
* Provisioning: Create symbolic for shasum tool on macOS for compatibilityRainer Keller2018-03-102-7/+2
| | | | | | | | | | | On macOS the sha1 tool is named 'shasum' while on all other unix systems it is called 'sha1sum'. In order to make all unix provisioning scripts run on macOS without special case handling a symbolic link is created. Change-Id: Ib1365cbb0dcb31e68a22959ce939fb450ec7e3f7 Reviewed-by: Joni Jäntti <joni.jantti@qt.io> Reviewed-by: Frederik Gladhorn <frederik.gladhorn@qt.io> Reviewed-by: Simo Fält <simo.falt@qt.io>
* Set proxy on Windows VMs while provisioningTony Sarajärvi2018-02-232-3/+1
| | | | | | Task-number: QTQAINFRA-1669 Change-Id: Ia6b5b668051642a3729d7c7c83c69d8797045847 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Merge remote-tracking branch 'origin/5.9' into 5.10Liang Qi2018-02-031-0/+40
|\ | | | | | | Change-Id: I3e4ae2508d632919db77af0f365eb25ace1a69e0
| * Provisioning: Disable Network Time ProtocolHeikki Halmet2018-02-021-0/+40
| | | | | | | | | | | | | | | | NTP need to be disabled from all tier2 templates Task-number: QTQAINFRA-1608 Change-Id: I89e019c23b7a194efffa011200a8c870e3a65d66 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Switch download sources for mqtt paho brokerMaurice Kalinowski2018-02-021-2/+2
| | | | | | | | | | | | | | Internal resources are preferred and should be used first. Change-Id: Ifd2a54858c9fb6b82c3dc268566c67238aad262e Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Update MQTT provisioningMaurice Kalinowski2018-02-021-1/+4
| | | | | | | | | | | | | | | | Setting an environment variable has been centralized to a separate script. Change-Id: I027f9a71d32ee7f7d68575c9433f56a40a369deb Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Merge remote-tracking branch 'origin/5.9' into 5.10.1Frederik Gladhorn2018-01-293-1/+263
|\| | | | | | | | | | | | | | | This was pushed directly, bypassing codereview.qt-project.org to get provisioning back into a working state. Change-Id: Ia5d2e6f7079162f571cd7c7994c0f2b3133b1163 Reviewed-by: Oswald Buddenhagen <oswald.buddenhagen@qt.io>