aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning/common
Commit message (Collapse)AuthorAgeFilesLines
* Provisioning: Fix PYTHON3_WHEEL_CACHE pointing to wrong dirSimo Fält2020-07-301-1/+7
| | | | | | | | | | | | | Earlier we set the env variable point to latest Python install. It did work by accident, while the default python was installed as last. Now each python install has its own matching ENV variable that can be used buildtime. The PYTHON3_WHEEL_CACHE will now point to 64 bit default Python3, while the variable is already used in Qt codebase. Change-Id: I6a67936c06ed0209ef9e903120f2416aaa8eb3ff Reviewed-by: Assam Boudjelthia <assam.boudjelthia@qt.io> (cherry picked from commit 969acbce6e9b1ac1c270363aafc8b20a1f4ee8ff) Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
* Provisioning: Add delay after network setting changeToni Saario2020-07-221-0/+1
| | | | | | | | | | In many cases without waiting, next script would be missing network and fails. Change-Id: Iab50945716860618b495029ce179183d844dc98a Reviewed-by: Simo Fält <simo.falt@qt.io> (cherry picked from commit 3271bb2fe219d68fc83a7cf8de702b0468e530bb) Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
* Provisioning: Install Python 3.8 for testing Qt for PythonSimo Fält2020-07-171-9/+17
| | | | | | | | | | This installs Python 3.8.1 to be used with Qt for Python. It keeps the old 3.6 as a default python3. Change-Id: I8ea121514f6a4092f700688363c282cbea37a75b Reviewed-by: Toni Saario <toni.saario@qt.io> (cherry picked from commit 607b33aab2477f49eeb08b780ff9962d4e4f2a04) Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
* Provisioning: Update OpenSSL to version 1.1.1gHeikki Halmet2020-06-304-13/+13
| | | | | | | Task-number: QTQAINFRA-3819 Change-Id: Ie7d0f3a0c73d123c3f3536e6b2dd2eb8608eb9cd (cherry picked from commit 2ac3dd2d6ff8acf8348ac8607160ab972de66325) Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Disable LSO from the network adapters on WindowsTony Sarajärvi2020-06-291-0/+1
| | | | | | | | | | | Disabling LSO from the adapter gives us huge performance boosts on Windows. In our tests 2 VMs within the same hosts had transfer speeds of 30 Mbit/s with this enabled, and 2Gbit/s with this disabled. Change-Id: Id794e7559c9e9005043361289a3db246a8528dd4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io> (cherry picked from commit 97aa7a0031cc681915aa2f56545a175f8b4d112d) Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
* Provisioning: Change mounting folder for Squish installationHeikki Halmet2020-06-121-4/+3
| | | | | | | | | | | | | | Sometimes some process is locking the mounted folder (/tmp) so that it can't be unmounted untill the process has been ended. Let's create squish folder under tmp and use that for mounting instead Task-number: QTQAINFRA-3709 Change-Id: I49ab8fd90af37a670e45764a176b62d7a732cc6c Reviewed-by: Dimitrios Apostolou <jimis@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit c671c2352e1db453da17d346316acfa627617786) Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
* Provisioning: Install Node.jsHeikki Halmet2020-06-101-0/+61
| | | | | | | | | | Node.js is needed by QtWebengine Task-number: QTQAINFRA-3729 Change-Id: I23ece8567c569d8376eff52b7845589c60d069b8 Reviewed-by: Toni Saario <toni.saario@qt.io> Reviewed-by: Allan Sandfeld Jensen <allan.jensen@qt.io> (cherry picked from commit 122cf4cc0ea3433512d58937d483d42717892d51)
* Provisioning: Use signed opengl32 packageHeikki Halmet2020-06-091-7/+7
| | | | | | | Task-number: QTBUG-80252 Change-Id: Ife9942796ed64c4e2894fb3342259c674cf5d7ed Reviewed-by: Laszlo Agocs <laszlo.agocs@qt.io> (cherry picked from commit 9c33fe844a2b9b1b601466740dd6097d649c1e0c)
* Provisioning: Fetch pre-installed squish from local cacheHeikki Halmet2020-06-092-208/+88
| | | | | | | | | | | | | | | Squish installation is flaky so the installation phase has been moved from provisioning to Jenkins. Jenkins job will install the squish to target VM and copy it to local cache. This change only fetch the installed squish packages from local cache and uncompress those to VMs. Task-number: QTQAINFRA-3510 Task-number: QTQAINFRA-3107 Change-Id: I862da3250120dc6a43d9c04d973a25a691ca66a1 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io> (cherry picked from commit b0286d6cd6c86cfc3c5dbd5a3879354996632831) Reviewed-by: Toni Saario <toni.saario@qt.io>
* Provisioning: Add sleep before killing gpg-agent in msys installationHeikki Halmet2020-05-041-0/+3
| | | | | | | Task-number: QTQAINFRA-3691 Change-Id: If84fd2d0d1cd6dccadf21cbf688aca6182cdd920 (cherry picked from commit 5f03b84e6542f00cf9eccd1d8820f423cee5e2b9) Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Update expired QNX licenseHeikki Halmet2020-05-041-2/+2
| | | | | | Task-number: QTQAINFRA-3708 Change-Id: Id2d6d10d88fc50c9985014c44df0b1cf51cc3410 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Merge remote-tracking branch 'origin/5.14' into 5.15Liang Qi2020-04-2410-0/+788
|\ | | | | | | | | | | | | | | | | | | | | Conflicts: .gitmodules coin/platform_configs/qt5.yaml coin/platform_configs/qtsdk.yaml coin/platform_configs/tqtc-qt-rta.yaml coin/provisioning/qtci-linux-Ubuntu-18.04-x86_64/02-apt.sh Change-Id: I2221262edc024e0aa11b9dab4d08c2df3a0b53b0
| * Merge remote-tracking branch 'origin/5.14.2' into 5.14Liang Qi2020-04-239-0/+781
| |\ | | | | | | | | | | | | | | | | | | Conflicts: .gitmodules Change-Id: I950588f85d1b39ba6ce994821db9f340b72fa6d2
| | * Provisioning: install dwz 0.13 to RHEL 7.6Konstantin Tokarev2020-03-051-0/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | It is used for compression of QtWebKit debug info, saving about 1Gb (~40%) for non-compressed debug file of libQt5WebKit.so, and ~50% of 7z-compressed debug package. Version 0.12 provided in RedHat devtoolset exposes a bug when applied to QtWebKit debug info: https://sourceware.org/bugzilla/show_bug.cgi?id=24251 Change-Id: I0395aadfb7babbbc150f367f8b5dd296dc6d2064 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| | * Provisioning: Install Conan packages for VS2019Konstantin Tokarev2020-03-058-0/+710
| | | | | | | | | | | | | | | Change-Id: Ibbee96ea7ad9e054e1521c897206c9863acc9c08 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * | Provisioning: Remove notifications and warnings from macOSHeikki Halmet2020-04-141-0/+7
| |/ | | | | | | | | | | | | Notifications and warnings in UI might affect RTA and autotests results Change-Id: I447dab3ba839d2c577f633cbf96fc7f3e5fdfe25 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
* | Don't manually rerun conan Run-Conan-Installv5.15.0-beta4Mårten Nordheim2020-04-151-15/+8
| | | | | | | | | | | | | | | | Modern conan will retry downloads on its own. Change default number of attempts to 5 for more reliability. Change-Id: Iafd4845b31c3e5fb296ba0b897cbf2030c412b04 Reviewed-by: Oliver Wolff <oliver.wolff@qt.io>
* | qdb building for macRami Potinkara2020-04-152-0/+86
| | | | | | | | | | | | | | | | | | Modified qdb.yaml and created and pkgconfig and libusb relates .sh files so that QDB can be build for Mac OS due to USB Ethernet CDCECM enabling. Task-number: QTBUG-82531 Change-Id: Ia5f970e5940b7d9116831c8174db0ea1b9231234 Reviewed-by: Samuli Piippo <samuli.piippo@qt.io>
* | Provisioning: Update Windows 10 x86_64 to version 1909v5.15.0-beta3Heikki Halmet2020-04-041-3/+8
| | | | | | | | | | | | | | | | | | | | | | | | These are also updated to tier1 image: msvc 2017: Not installed msvc 2019: version 16.4.4 msvc 2019 build tools: version 16.4.4 Task-number: QTQAINFRA-3623 Task-number: QTQAINFRA-3417 Change-Id: I006204ca090c4e2cf0d2ffc2309ab6b94f9b7d47 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Bump emscripten version to 1.39.8 on WindowsLorn Potter2020-03-201-29/+32
| | | | | | | | | | | | Task-number: QTQAINFRA-3577 Change-Id: I63b06a8ac0b4a7233ed9031c7354f3b355c9f8ad Reviewed-by: Morten Johan Sørvig <morten.sorvig@qt.io>
* | Provisioning: Bump Emscripten version to 1.39.8Morten Johan Sørvig2020-03-122-32/+31
| | | | | | | | | | | | | | | | | | | | | | | | | | The upstream URLs have changed: - emscripten packages now at github.com/emscripten-core/emscripten/archive/ - binaries (llvm/binaryen/node) now at storage.googleapis.com/webassembly/emscripten-releases-builds/ Add support for unpacking tbz2 files. Keep caching as before, update .emscripten config file with new paths. Task-number: QTQAINFRA-3577 Change-Id: I53e72f19d3eefa0e2155493db4f93c8730c60334 Reviewed-by: Lorn Potter <lorn.potter@gmail.com>
* | Merge remote-tracking branch 'origin/5.14' into 5.15Liang Qi2020-02-2551-2546/+2134
|\| | | | | | | Change-Id: Ib51a6d362bf9cc5f6e6f56feadfe264216e24223
| * Provisioning: update Conan and Conan packages to latest versionsKonstantin Tokarev2020-02-2251-2546/+2134
| | | | | | | | | | | | Task-number: QTQAINFRA-3556 Change-Id: If9c600a6bb3aae893924f9372c8b248d3e58f887 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* | Provisioning: Update GCC to version 9.2 for Ubuntu 18.04Heikki Halmet2020-02-191-8/+8
|/ | | | | | | | | GCC bug which breaks Webengine build should be fixed in GCC 9.2 Task-number: QTQAINFRA-3534 Change-Id: Ie0df7c67e0e96cca5632bcd0e6a3db822fcbffbe Reviewed-by: Allan Sandfeld Jensen <allan.jensen@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Try to catch all errors when sdkmanager installsDimitrios Apostolou2020-02-152-1/+9
| | | | | | Task-number: QTQAINFRA-3531 Change-Id: I008c31a824287c60e67a665d0c2a3aebec863929 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Exclude monitoring of some filesystems on macosDimitrios Apostolou2020-02-151-1/+7
| | | | | | | | | | | | | | | For a short time after boot, macos sometimes mounts a filesystem of type "msdos" at the unique path /Volumes/firmwaresyncd.XXXXXX. Telegraf [inputs.disk] plug-in stores records to InfluxDB, with the unique mount path under "path" tag. The uniqueness of the path blows up the cardinality of the database. So exclude "msdos" filesystems from being monitored by telegraf. Additionally exclude "cd9660" filesystems that appear always as 100% full. Change-Id: I4cdd3fca57b3db6157df168cc8a5314e64528b2d Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Update telegraf versionDimitrios Apostolou2020-02-153-10/+8
| | | | | Change-Id: I1a023e4f1de860a03a135f3b10f2c99d5309dd8b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Silence sdkmanager on WindowsDimitrios Apostolou2020-02-151-1/+1
| | | | | | | | sdkmanager is already silenced on the other OSes, as it prints thousands of lines of progress bars in the logfiles. Change-Id: I4a2aa422a83cfe5fc6a3a7ba7be69e1e9c01acc0 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Print filesystem information at the end of each provisioningDimitrios Apostolou2020-02-152-0/+12
| | | | | Change-Id: I549a917126954fae62dcdebb5c45a4f6aeb07551 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Windows now report versions.txt and df info at the end of provisioningDimitrios Apostolou2020-02-151-0/+6
| | | | | Change-Id: Ic2b299c04c91eb498822aca110cea774fdb7cf17 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Extract archive directly to destination filesystemDimitrios Apostolou2020-02-151-2/+2
| | | | | | | | | Save some seconds or even minutes during provisioning, by avoiding copying many files across filesystems, from /tmp to /usr/local. We now install directly to /usr/local. Change-Id: I3a8f545f1400995095193c4eb337f9dd8534ef72 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Create more meaningful temporary file namesDimitrios Apostolou2020-02-151-5/+9
| | | | | Change-Id: I4bbc94993e51502ea08109a4c99f3e212349ab24 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Do not complain about existing empty filesDimitrios Apostolou2020-02-151-12/+19
| | | | | | | | Sometimes we pre-create the target filename using mktemp. In that case of course the hash will not match, so avoid comparing. Change-Id: Id0feb0178d659e03f5ceb000f738167cdc28a3ec Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Alias expansion is not working reliably in non-interactive shellsDimitrios Apostolou2020-02-151-4/+6
| | | | | | | | | | | It happened that old bash version on macOS the alias was not being expanded for non-interactive shells running under "bash" but was being expanded fine when under "sh". Using functions is the recommended way. Here we define a function conditionally. Change-Id: I607b265cb9e88b2b529ed170121e5a0833003acd Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Execute a specific version of homebrew install scriptDimitrios Apostolou2020-02-151-4/+13
| | | | | | | | | | | | Also first try to download it from local mirror. This install script appears to be doing a lot of git-cloning and downloading itself though, so it is still far from the ideal solution: to only download from locally cached endpoints. Task-number: QTQAINFRA-3134 Change-Id: I32131045d6e62f302ec666b4ac055ca5ee9662d5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Update jinja2 to 2.10.3Dominik Holland2020-02-151-1/+1
| | | | | | | | | This makes sure we don't run into CVE-2019-10906 when using jinja2 in QtIvis Autogenerator. Change-Id: If51bf54bd26858c6b5faa3dd6a6627f2979b862d Reviewed-by: Robert Griebl <robert.griebl@qt.io> Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Remove unistd.h from postreSQL from 64 bit WindowsTuomas Heimonen2020-02-021-0/+1
| | | | | | | | | | PostreSQL 9.6 version creates emtpy unistd.h file which will cause failure in Qt Safe Renderer' MinGW build. By removing it the system should use the one from the MinGW environment. Task-number: COIN-488 Change-Id: I76d3f34dd9726dc4f0aac06c410f306dffc8f365 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Remove unistd.h from postreSQLHeikki Halmet2020-01-281-0/+1
| | | | | | | | | | PostreSQL 9.6 version creates emtpy unistd.h file which will cause failure in Qt Safe Renderer' MinGW build. By removing it the system should use the one from the MinGW environment. Task-number: COIN-488 Change-Id: Id7f2f5024998cc5fbeb61e144bcd87f6e09b2bb1 Reviewed-by: Jukka Jokiniva <jukka.jokiniva@qt.io>
* Provisioning: Update postgresqlHeikki Halmet2020-01-141-4/+8
| | | | | | | | | | Apparently libpq version 9.1.9 is no longer supported. Let's use version 9.6 to keep maximum compatibility and align the version with MacOS. Task-number: QTBUG-79555 Change-Id: Iea98a1eb821f103e3a610ed602746407bfe5ea97 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Use internal mirror repositories for Ubuntu docker containersDimitrios Apostolou2020-01-1323-72/+142
| | | | | | | | | | | | | | | | | | | | | | | | | Depending on different external URLs makes our provisioning scripts flaky, because they can fail if any one of the external servers goes down. In this patch * the docker images qt_ubuntu_16.04 and qt_ubuntu_18.04 are being built first, they apt-get from the internal ubuntu mirror * all the existing docker images have been rebased to these two images, so they inherit this behavior * images that fetch files from the internet have been modified to not do the fetching themselves; insted URLs are fetched in advance using "DownloadURL" which accepts internal mirrored URLs, and the downloaded files are ADDed to the images with a local copy * previously existing git clone commands have been modified to fetch internally mirrored tarballs Task-number: QTQAINFRA-3343 Change-Id: Ic4640a4f7776e38623edba90f0eba7cb68631223 Reviewed-by: Sona Kurazyan <sona.kurazyan@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not try to double-install docker-ce-cliDimitrios Apostolou2020-01-131-2/+2
| | | | | | | | That happened because docker-ce* was installing both docker-ce and docker-ce-cli, so apt was printing a warning. Change-Id: I0cad82243c8c3d5c0b9f26fc7b24673268259aa4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Remove unused scriptDimitrios Apostolou2020-01-101-3/+0
| | | | | Change-Id: Ic3c57966c78fd8158a2467956fd31eaa4374412d Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Tag the docker images as "latest"Dimitrios Apostolou2019-12-051-6/+8
| | | | | | | | | | We will use this tag in qtbase to refer to the image to run, because with the current sha1tree() tag, every minor change in the docker images requires synchronized changes between repositories. Task-number: QTBUG-79867 Change-Id: If94eb6dd8b97526b589e58064837bc6554fed79c Reviewed-by: Volker Hilsheimer <volker.hilsheimer@qt.io>
* Provisioning: Remove sudo when installing pip packages for Qt userSimo Fält2019-11-251-2/+2
| | | | | | | | | There is no need to install as sudo for qt user. Using sudo will change the cache dir's permissions preventing us from installing anything with pip as normal user. Change-Id: Id45bf3805ce4d772a6c82e429d4e1948289f076e Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Provisioning: update SquishJohanna Äijälä2019-11-212-11/+7
| | | | | | | | Update with custom build of Squish to be able to launch Qt5.14 applications in RTA tests. Change-Id: Ic420656852ae885b057de937baabf01135526764 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Change JDK script to use 'Remove' function from helpersHeikki Halmet2019-11-201-2/+1
| | | | | | Task-number: QTQAINFRA-3369 Change-Id: I2e873eb50d9129c48d92370af80fe121039d172e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Remove shell scripts under windowsHeikki Halmet2019-11-202-45/+0
| | | | | Change-Id: I3d7a949e95bab39adc349c25d267b7fc28e676cf Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Install python modules needed by packagingHeikki Halmet2019-11-201-0/+38
| | | | | | | | Needed by packaging scripts Task-number: COIN-214 Change-Id: I3ac719800c3afd183996379f6c23fbe3f8bcf7cb Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
* Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-11-183-13/+39
|\ | | | | | | | | | | | | Conflicts: coin/provisioning/common/linux/docker.sh Change-Id: Ic5c3fcaa856137de46c6f3830ca75cedb084927d
| * Keep debug trace off to avoid polluting the logsDimitrios Apostolou2019-11-141-1/+1
| | | | | | | | | | Change-Id: I8a2d878a52b5e0a818d7f80fff495feca84d0e9c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>