aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning/common
Commit message (Collapse)AuthorAgeFilesLines
* Provisioning: Change mounting folder for Squish installationHeikki Halmet2020-05-201-4/+3
| | | | | | | | | | | | Sometimes some process is locking the mounted folder (/tmp) so that it can't be unmounted untill the process has been ended. Let's create squish folder under tmp and use that for mounting instead Task-number: QTQAINFRA-3709 Change-Id: I49ab8fd90af37a670e45764a176b62d7a732cc6c Reviewed-by: Dimitrios Apostolou <jimis@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Fetch pre-installed squish from local cacheHeikki Halmet2020-05-192-208/+88
| | | | | | | | | | | | | Squish installation is flaky so the installation phase has been moved from provisioning to Jenkins. Jenkins job will install the squish to target VM and copy it to local cache. This change only fetch the installed squish packages from local cache and uncompress those to VMs. Task-number: QTQAINFRA-3510 Task-number: QTQAINFRA-3107 Change-Id: I862da3250120dc6a43d9c04d973a25a691ca66a1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Update expired QNX licenseHeikki Halmet2020-05-191-2/+2
| | | | | | | | Task-number: QTQAINFRA-3708 Change-Id: Id2d6d10d88fc50c9985014c44df0b1cf51cc3410 (cherry picked from commit 71043ca2438d49c1f9aa64b56cfd453dac384696) Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Merge remote-tracking branch 'origin/5.14.2' into 5.14Liang Qi2020-04-239-0/+781
|\ | | | | | | | | | | | | Conflicts: .gitmodules Change-Id: I950588f85d1b39ba6ce994821db9f340b72fa6d2
| * Provisioning: install dwz 0.13 to RHEL 7.6Konstantin Tokarev2020-03-051-0/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | It is used for compression of QtWebKit debug info, saving about 1Gb (~40%) for non-compressed debug file of libQt5WebKit.so, and ~50% of 7z-compressed debug package. Version 0.12 provided in RedHat devtoolset exposes a bug when applied to QtWebKit debug info: https://sourceware.org/bugzilla/show_bug.cgi?id=24251 Change-Id: I0395aadfb7babbbc150f367f8b5dd296dc6d2064 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Provisioning: Install Conan packages for VS2019Konstantin Tokarev2020-03-058-0/+710
| | | | | | | | | | Change-Id: Ibbee96ea7ad9e054e1521c897206c9863acc9c08 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Provisioning: Remove notifications and warnings from macOSHeikki Halmet2020-04-141-0/+7
|/ | | | | | | Notifications and warnings in UI might affect RTA and autotests results Change-Id: I447dab3ba839d2c577f633cbf96fc7f3e5fdfe25 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
* Provisioning: update Conan and Conan packages to latest versionsKonstantin Tokarev2020-02-2251-2546/+2134
| | | | | | Task-number: QTQAINFRA-3556 Change-Id: If9c600a6bb3aae893924f9372c8b248d3e58f887 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Try to catch all errors when sdkmanager installsDimitrios Apostolou2020-02-152-1/+9
| | | | | | Task-number: QTQAINFRA-3531 Change-Id: I008c31a824287c60e67a665d0c2a3aebec863929 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Exclude monitoring of some filesystems on macosDimitrios Apostolou2020-02-151-1/+7
| | | | | | | | | | | | | | | For a short time after boot, macos sometimes mounts a filesystem of type "msdos" at the unique path /Volumes/firmwaresyncd.XXXXXX. Telegraf [inputs.disk] plug-in stores records to InfluxDB, with the unique mount path under "path" tag. The uniqueness of the path blows up the cardinality of the database. So exclude "msdos" filesystems from being monitored by telegraf. Additionally exclude "cd9660" filesystems that appear always as 100% full. Change-Id: I4cdd3fca57b3db6157df168cc8a5314e64528b2d Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Update telegraf versionDimitrios Apostolou2020-02-153-10/+8
| | | | | Change-Id: I1a023e4f1de860a03a135f3b10f2c99d5309dd8b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Silence sdkmanager on WindowsDimitrios Apostolou2020-02-151-1/+1
| | | | | | | | sdkmanager is already silenced on the other OSes, as it prints thousands of lines of progress bars in the logfiles. Change-Id: I4a2aa422a83cfe5fc6a3a7ba7be69e1e9c01acc0 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Print filesystem information at the end of each provisioningDimitrios Apostolou2020-02-152-0/+12
| | | | | Change-Id: I549a917126954fae62dcdebb5c45a4f6aeb07551 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Windows now report versions.txt and df info at the end of provisioningDimitrios Apostolou2020-02-151-0/+6
| | | | | Change-Id: Ic2b299c04c91eb498822aca110cea774fdb7cf17 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Extract archive directly to destination filesystemDimitrios Apostolou2020-02-151-2/+2
| | | | | | | | | Save some seconds or even minutes during provisioning, by avoiding copying many files across filesystems, from /tmp to /usr/local. We now install directly to /usr/local. Change-Id: I3a8f545f1400995095193c4eb337f9dd8534ef72 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Create more meaningful temporary file namesDimitrios Apostolou2020-02-151-5/+9
| | | | | Change-Id: I4bbc94993e51502ea08109a4c99f3e212349ab24 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Do not complain about existing empty filesDimitrios Apostolou2020-02-151-12/+19
| | | | | | | | Sometimes we pre-create the target filename using mktemp. In that case of course the hash will not match, so avoid comparing. Change-Id: Id0feb0178d659e03f5ceb000f738167cdc28a3ec Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Alias expansion is not working reliably in non-interactive shellsDimitrios Apostolou2020-02-151-4/+6
| | | | | | | | | | | It happened that old bash version on macOS the alias was not being expanded for non-interactive shells running under "bash" but was being expanded fine when under "sh". Using functions is the recommended way. Here we define a function conditionally. Change-Id: I607b265cb9e88b2b529ed170121e5a0833003acd Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Execute a specific version of homebrew install scriptDimitrios Apostolou2020-02-151-4/+13
| | | | | | | | | | | | Also first try to download it from local mirror. This install script appears to be doing a lot of git-cloning and downloading itself though, so it is still far from the ideal solution: to only download from locally cached endpoints. Task-number: QTQAINFRA-3134 Change-Id: I32131045d6e62f302ec666b4ac055ca5ee9662d5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Update jinja2 to 2.10.3Dominik Holland2020-02-151-1/+1
| | | | | | | | | This makes sure we don't run into CVE-2019-10906 when using jinja2 in QtIvis Autogenerator. Change-Id: If51bf54bd26858c6b5faa3dd6a6627f2979b862d Reviewed-by: Robert Griebl <robert.griebl@qt.io> Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Remove unistd.h from postreSQL from 64 bit WindowsTuomas Heimonen2020-02-021-0/+1
| | | | | | | | | | PostreSQL 9.6 version creates emtpy unistd.h file which will cause failure in Qt Safe Renderer' MinGW build. By removing it the system should use the one from the MinGW environment. Task-number: COIN-488 Change-Id: I76d3f34dd9726dc4f0aac06c410f306dffc8f365 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Remove unistd.h from postreSQLHeikki Halmet2020-01-281-0/+1
| | | | | | | | | | PostreSQL 9.6 version creates emtpy unistd.h file which will cause failure in Qt Safe Renderer' MinGW build. By removing it the system should use the one from the MinGW environment. Task-number: COIN-488 Change-Id: Id7f2f5024998cc5fbeb61e144bcd87f6e09b2bb1 Reviewed-by: Jukka Jokiniva <jukka.jokiniva@qt.io>
* Provisioning: Update postgresqlHeikki Halmet2020-01-141-4/+8
| | | | | | | | | | Apparently libpq version 9.1.9 is no longer supported. Let's use version 9.6 to keep maximum compatibility and align the version with MacOS. Task-number: QTBUG-79555 Change-Id: Iea98a1eb821f103e3a610ed602746407bfe5ea97 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Use internal mirror repositories for Ubuntu docker containersDimitrios Apostolou2020-01-1323-72/+142
| | | | | | | | | | | | | | | | | | | | | | | | | Depending on different external URLs makes our provisioning scripts flaky, because they can fail if any one of the external servers goes down. In this patch * the docker images qt_ubuntu_16.04 and qt_ubuntu_18.04 are being built first, they apt-get from the internal ubuntu mirror * all the existing docker images have been rebased to these two images, so they inherit this behavior * images that fetch files from the internet have been modified to not do the fetching themselves; insted URLs are fetched in advance using "DownloadURL" which accepts internal mirrored URLs, and the downloaded files are ADDed to the images with a local copy * previously existing git clone commands have been modified to fetch internally mirrored tarballs Task-number: QTQAINFRA-3343 Change-Id: Ic4640a4f7776e38623edba90f0eba7cb68631223 Reviewed-by: Sona Kurazyan <sona.kurazyan@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not try to double-install docker-ce-cliDimitrios Apostolou2020-01-131-2/+2
| | | | | | | | That happened because docker-ce* was installing both docker-ce and docker-ce-cli, so apt was printing a warning. Change-Id: I0cad82243c8c3d5c0b9f26fc7b24673268259aa4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Remove unused scriptDimitrios Apostolou2020-01-101-3/+0
| | | | | Change-Id: Ic3c57966c78fd8158a2467956fd31eaa4374412d Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Tag the docker images as "latest"Dimitrios Apostolou2019-12-051-6/+8
| | | | | | | | | | We will use this tag in qtbase to refer to the image to run, because with the current sha1tree() tag, every minor change in the docker images requires synchronized changes between repositories. Task-number: QTBUG-79867 Change-Id: If94eb6dd8b97526b589e58064837bc6554fed79c Reviewed-by: Volker Hilsheimer <volker.hilsheimer@qt.io>
* Provisioning: Remove sudo when installing pip packages for Qt userSimo Fält2019-11-251-2/+2
| | | | | | | | | There is no need to install as sudo for qt user. Using sudo will change the cache dir's permissions preventing us from installing anything with pip as normal user. Change-Id: Id45bf3805ce4d772a6c82e429d4e1948289f076e Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Provisioning: update SquishJohanna Äijälä2019-11-212-11/+7
| | | | | | | | Update with custom build of Squish to be able to launch Qt5.14 applications in RTA tests. Change-Id: Ic420656852ae885b057de937baabf01135526764 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Change JDK script to use 'Remove' function from helpersHeikki Halmet2019-11-201-2/+1
| | | | | | Task-number: QTQAINFRA-3369 Change-Id: I2e873eb50d9129c48d92370af80fe121039d172e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Remove shell scripts under windowsHeikki Halmet2019-11-202-45/+0
| | | | | Change-Id: I3d7a949e95bab39adc349c25d267b7fc28e676cf Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Install python modules needed by packagingHeikki Halmet2019-11-201-0/+38
| | | | | | | | Needed by packaging scripts Task-number: COIN-214 Change-Id: I3ac719800c3afd183996379f6c23fbe3f8bcf7cb Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
* Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-11-183-13/+39
|\ | | | | | | | | | | | | Conflicts: coin/provisioning/common/linux/docker.sh Change-Id: Ic5c3fcaa856137de46c6f3830ca75cedb084927d
| * Keep debug trace off to avoid polluting the logsDimitrios Apostolou2019-11-141-1/+1
| | | | | | | | | | Change-Id: I8a2d878a52b5e0a818d7f80fff495feca84d0e9c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Docker installation: do not depend on external repositoriesDimitrios Apostolou2019-11-141-9/+28
| | | | | | | | | | | | | | | | Also updated the docker-compose binary to the latest one. Task-number: QTQAINFRA-3279 Change-Id: Ie09a772ca8247aa5f5bd6d36774b68b6bb846386 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Fix cache URL for telegraf windows packageDimitrios Apostolou2019-11-141-1/+1
| | | | | | | | | | | | Fixes: QTQAINFRA-3340 Change-Id: Ie7bad3666094e3f8f8e8971c2bfe05457ca6cd45 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * DownloadURL last argument (targetFile) is now optionalDimitrios Apostolou2019-11-141-1/+8
| | | | | | | | | | Change-Id: I0864bcb052cddcc9753c056758b6e65fd561d928 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Add MSVC 2019 and upgrade MSVC 2017 to the latest versionHeikki Halmet2019-11-074-133/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Under coin/pre-provisioning can be found information what have been provisioned to tier1 image Visual studios are updated to versions: MSVC 2019: version 16.3.1 MSVC 2017: version 15.9.16 Task-number: QTQAINFRA-2875 Change-Id: I3a9748296dcf088bb312dec8f78bdc59dfb281d1 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* | Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-11-0615-110/+87
|\| | | | | | | | | | | | | Conflicts: coin/provisioning/qtci-macos-10.12-x86_64/05-systemsetup.sh Change-Id: Ie9eae2144868cbe4a6c5ff9472c1a0e8fd53ed08
| * Provisioning: Upgrade OpenSSL version to 1.1.1dHeikki Halmet2019-11-025-87/+9
| | | | | | | | | | | | | | | | Plus removing unused file install_openssl_111a.sh Task-number: QTQAINFRA-3224 Change-Id: If5f9ee12e118e0329eb27f8d3ca9829011874382 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Remove more of update notifiersTony Sarajärvi2019-11-011-1/+1
| | | | | | | | | | Change-Id: I507f584ef82b5f41f6b1cbc22fdd4ff6eff5e911 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Add allowUntrusted parameter for command line tools and refresh XcodeHeikki Halmet2019-10-291-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | Apple has signed their packages with certificate which has been expired 24.11.2019. Packages are unusable without allowUntrusted parameter Also Xcode package for macOS10.13 needs to be refetched from Apple's download to local cache Task-number: QTQAINFRA-3317 Change-Id: Iebbe81ee0c360e5f0b49d422b38fe1a148424891 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provision gnuwin32's pathTony Sarajärvi2019-10-261-0/+1
| | | | | | | | | | | | | | | | | | | | By provisioning the path to gnuwin32, we can remove the hard coded paths from Coin. Task-number: QTBUG-73422 Change-Id: Ice96fcd992e22ed39b66496403b9eaa99a6865a0 Reviewed-by: Toni Saario <toni.saario@qt.io> Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Provisioning: Disable automatic cleanup from windowsHeikki Halmet2019-10-181-0/+8
| | | | | | | | | | | | | | | | Task-number: QTQAINFRA-3238 Change-Id: Ie64086b650016adb7129bd4c4592ca987cc1453b Reviewed-by: Daniel Smith <Daniel.Smith@qt.io> Reviewed-by: Dimitrios Apostolou <jimis@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Fix for DownloadURL to try alternative URLDimitrios Apostolou2019-10-151-2/+2
| | | | | | | | | | Change-Id: I7e9a77815ef8f4c258dda44bda6fdd4eb3736ef4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * Provisioning: Update Cmake to version 3.7.2Heikki Halmet2019-10-152-8/+8
| | | | | | | | | | | | | | | | | | QtCreator requires Cmake minimal version to be at least 3.7.0 Task-number: QTQAINFRA-3272 Change-Id: Id7f2d38ad0581c1aead4b5bac860ac193488ae1b Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> Reviewed-by: Nikolai Kosjar <nikolai.kosjar@qt.io>
| * Provisioning: Hide windows squish installation output from the logHeikki Halmet2019-10-091-2/+4
| | | | | | | | | | | | | | This will prevent the output of unwanted information Change-Id: I5f1824a6bbe98c673ef04dc2daa0db0536d27828 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provisioning: Make sure that Configure and Make will passHeikki Halmet2019-10-091-3/+20
| | | | | | | | | | | | | | | | | | | | During powershell process error is not caught and provisioning continues even if the exitcode is something else that '0' Task-number: QTQAINFRA-3214 Change-Id: I91116a78d0c4defe6ba4287913c2394e199be958 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Ensure provisioning works even without the secretsDimitrios Apostolou2019-10-081-3/+10
| | | | | | | | | | Change-Id: I3869e881341a719da8a351095c3bf314c2fa2f34 Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
| * Fix shell function is_script_executedDimitrios Apostolou2019-10-081-1/+3
| | | | | | | | | | | | | | | | It used to return error when tested inside a login shell, because $0 is "-bash" and `basename` was trying to interpret -b as an option. Change-Id: I5faa2dc01e50c7d5bcfc0ab1fcfd910b2538afc2 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>