aboutsummaryrefslogtreecommitdiffstats
path: root/coin/provisioning
Commit message (Collapse)AuthorAgeFilesLines
* Provisioning: Install Conan packages for VS2019Konstantin Tokarev2020-03-059-0/+726
| | | | | Change-Id: Ibbee96ea7ad9e054e1521c897206c9863acc9c08 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: update Conan and Conan packages to latest versionsKonstantin Tokarev2020-02-2254-2567/+2155
| | | | | | Task-number: QTQAINFRA-3556 Change-Id: If9c600a6bb3aae893924f9372c8b248d3e58f887 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Make sure that Perl's Data:Dumper is installedHeikki Halmet2020-02-151-0/+2
| | | | | | | | | | Data:dumper is critical for release script build.pl. Currently data:dumper is installed by devtoolset as a dependency for autoconf. But, it seems, that in earlier version of devtoolset the autoconf wasn't installed by devtoolset which caused the failure with build.pl. Change-Id: I487a17ca0eb37c5984eb2f195e1024ed019b80d2 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Try to catch all errors when sdkmanager installsDimitrios Apostolou2020-02-153-3/+14
| | | | | | Task-number: QTQAINFRA-3531 Change-Id: I008c31a824287c60e67a665d0c2a3aebec863929 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Update python3 version on SLES-15Dimitrios Apostolou2020-02-151-2/+2
| | | | | | | We update to the latest 3.7.x maintenance release for security/stability. Change-Id: Ic2c251ab8e0db2c5e622f685e54e5cdd715723fc Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Refactor python3 installation in SLES-15 provisioningDimitrios Apostolou2020-02-152-10/+19
| | | | | | | | | | | | | + Use DownloadURL to download from local cache + Verify download SHA + Silence the tarball extraction + Install some generic packages in 02-zypper.sh + Use some other generic facilities from common.sourced.sh + Other minor changes Task-number: QTQAINFRA-3528 Change-Id: Ic085d43381e220a0a4a52ef6d5bb0cf8a9bf7032 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Exclude monitoring of some filesystems on macosDimitrios Apostolou2020-02-151-1/+7
| | | | | | | | | | | | | | | For a short time after boot, macos sometimes mounts a filesystem of type "msdos" at the unique path /Volumes/firmwaresyncd.XXXXXX. Telegraf [inputs.disk] plug-in stores records to InfluxDB, with the unique mount path under "path" tag. The uniqueness of the path blows up the cardinality of the database. So exclude "msdos" filesystems from being monitored by telegraf. Additionally exclude "cd9660" filesystems that appear always as 100% full. Change-Id: I4cdd3fca57b3db6157df168cc8a5314e64528b2d Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Update telegraf versionDimitrios Apostolou2020-02-153-10/+8
| | | | | Change-Id: I1a023e4f1de860a03a135f3b10f2c99d5309dd8b Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Silence the sdkmanager progress bar on macosDimitrios Apostolou2020-02-152-2/+12
| | | | | | | | The exact same method is already in use on all Linux provisions, it was just copied to macos. Change-Id: I873f6efd99b147c5364e0dda6c26c7dad7dee480 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Silence sdkmanager on WindowsDimitrios Apostolou2020-02-151-1/+1
| | | | | | | | sdkmanager is already silenced on the other OSes, as it prints thousands of lines of progress bars in the logfiles. Change-Id: I4a2aa422a83cfe5fc6a3a7ba7be69e1e9c01acc0 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Print filesystem information at the end of each provisioningDimitrios Apostolou2020-02-152-0/+12
| | | | | Change-Id: I549a917126954fae62dcdebb5c45a4f6aeb07551 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Windows now report versions.txt and df info at the end of provisioningDimitrios Apostolou2020-02-157-0/+12
| | | | | Change-Id: Ic2b299c04c91eb498822aca110cea774fdb7cf17 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Mask PackageKit on SUSEDimitrios Apostolou2020-02-153-3/+7
| | | | | | | | | | | | | | | | | | | | | Fixes a flaky conflict between zypper and packagekitd. packagekit is a *static* unit, that means it is missing an [Install] section, so it can't be enabled or disabled. It is started as a dependency by other units, or by dbus activation. We *mask* the unit to make it impossible to start in any way. For that we had replace a few occurrences of "pkcon" with the native package manager. Finally the package "libpython3_4m1_0" is not being installed any longer because it never was: this package does not exist. It's just that pkcon does not fail on invalid package names. Fixes: QTQAINFRA-3523 Change-Id: I6ff580afb05aa508042c444b2ce777c3a9443dfe Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* 08-pythondev build should not execute external scriptDimitrios Apostolou2020-02-151-4/+38
| | | | | | | | | | | The important bits of the script were copied and modified. NOTE that we no longer build openssl from source, the distro (SLES15) provides a version that works well. Task-number: QTQAINFRA-3528 Change-Id: Iad63d75055a7efc3e104789e4a515b8511cf0880 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Extract archive directly to destination filesystemDimitrios Apostolou2020-02-151-2/+2
| | | | | | | | | Save some seconds or even minutes during provisioning, by avoiding copying many files across filesystems, from /tmp to /usr/local. We now install directly to /usr/local. Change-Id: I3a8f545f1400995095193c4eb337f9dd8534ef72 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Create more meaningful temporary file namesDimitrios Apostolou2020-02-151-5/+9
| | | | | Change-Id: I4bbc94993e51502ea08109a4c99f3e212349ab24 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Do not complain about existing empty filesDimitrios Apostolou2020-02-151-12/+19
| | | | | | | | Sometimes we pre-create the target filename using mktemp. In that case of course the hash will not match, so avoid comparing. Change-Id: Id0feb0178d659e03f5ceb000f738167cdc28a3ec Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Alias expansion is not working reliably in non-interactive shellsDimitrios Apostolou2020-02-151-4/+6
| | | | | | | | | | | It happened that old bash version on macOS the alias was not being expanded for non-interactive shells running under "bash" but was being expanded fine when under "sh". Using functions is the recommended way. Here we define a function conditionally. Change-Id: I607b265cb9e88b2b529ed170121e5a0833003acd Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Execute a specific version of homebrew install scriptDimitrios Apostolou2020-02-153-6/+15
| | | | | | | | | | | | Also first try to download it from local mirror. This install script appears to be doing a lot of git-cloning and downloading itself though, so it is still far from the ideal solution: to only download from locally cached endpoints. Task-number: QTQAINFRA-3134 Change-Id: I32131045d6e62f302ec666b4ac055ca5ee9662d5 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Update jinja2 to 2.10.3Dominik Holland2020-02-151-1/+1
| | | | | | | | | This makes sure we don't run into CVE-2019-10906 when using jinja2 in QtIvis Autogenerator. Change-Id: If51bf54bd26858c6b5faa3dd6a6627f2979b862d Reviewed-by: Robert Griebl <robert.griebl@qt.io> Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Update signing tools for macOSHeikki Halmet2020-02-142-4/+4
| | | | | | | | | Update expired certificates Task-number: QTQAINFRA-3540 Change-Id: I21e718901cb3f5c901273c0c122430f5caaea3d0 Reviewed-by: Eike Ziller <eike.ziller@qt.io> Reviewed-by: Tim Jenssen <tim.jenssen@qt.io>
* Fix openssl build in SLES-15Dimitrios Apostolou2020-02-051-0/+3
| | | | | | | | | | | | Upstream changes of binutils or elfutils broke the build. Error was: /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /usr/lib64/libc_nonshared.a(elf-init.oS): unable to initialize decompress status for section .debug_info /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /usr/lib64/libc_nonshared.a: error adding symbols: file format not recognized collect2: error: ld returned 1 exit status Task-number: QTQAINFRA-3527. Change-Id: I50b677598b4415a281abbf0ddb2db39613646b36 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Remove unistd.h from postreSQL from 64 bit WindowsTuomas Heimonen2020-02-021-0/+1
| | | | | | | | | | PostreSQL 9.6 version creates emtpy unistd.h file which will cause failure in Qt Safe Renderer' MinGW build. By removing it the system should use the one from the MinGW environment. Task-number: COIN-488 Change-Id: I76d3f34dd9726dc4f0aac06c410f306dffc8f365 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Provisioning: Remove unistd.h from postreSQLHeikki Halmet2020-01-281-0/+1
| | | | | | | | | | PostreSQL 9.6 version creates emtpy unistd.h file which will cause failure in Qt Safe Renderer' MinGW build. By removing it the system should use the one from the MinGW environment. Task-number: COIN-488 Change-Id: Id7f2f5024998cc5fbeb61e144bcd87f6e09b2bb1 Reviewed-by: Jukka Jokiniva <jukka.jokiniva@qt.io>
* Provisioning: Install needed packages for Python buildHeikki Halmet2020-01-231-1/+6
| | | | | | | | For Conan python needs to be built from sources. Task-number: QTBUG-81014 Change-Id: I8d14d65ce2f1c57a7fa370b93aa61bc156d617ca Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
* Remove default hostname from ubuntuSamuli Piippo2020-01-201-0/+3
| | | | | | | | | | Removing the default hostname makes system create unique hostname based on the IP address. This is needed to make NFS operations reliable. Task-number: QTQAINFRA-3257 Change-Id: I9e4dc4950f5d1a1b7f85372674f79d1701d1eab6 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Update postgresqlHeikki Halmet2020-01-141-4/+8
| | | | | | | | | | Apparently libpq version 9.1.9 is no longer supported. Let's use version 9.6 to keep maximum compatibility and align the version with MacOS. Task-number: QTBUG-79555 Change-Id: Iea98a1eb821f103e3a610ed602746407bfe5ea97 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Use internal mirror repositories for Ubuntu docker containersDimitrios Apostolou2020-01-1323-72/+142
| | | | | | | | | | | | | | | | | | | | | | | | | Depending on different external URLs makes our provisioning scripts flaky, because they can fail if any one of the external servers goes down. In this patch * the docker images qt_ubuntu_16.04 and qt_ubuntu_18.04 are being built first, they apt-get from the internal ubuntu mirror * all the existing docker images have been rebased to these two images, so they inherit this behavior * images that fetch files from the internet have been modified to not do the fetching themselves; insted URLs are fetched in advance using "DownloadURL" which accepts internal mirrored URLs, and the downloaded files are ADDed to the images with a local copy * previously existing git clone commands have been modified to fetch internally mirrored tarballs Task-number: QTQAINFRA-3343 Change-Id: Ic4640a4f7776e38623edba90f0eba7cb68631223 Reviewed-by: Sona Kurazyan <sona.kurazyan@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Do not try to double-install docker-ce-cliDimitrios Apostolou2020-01-131-2/+2
| | | | | | | | That happened because docker-ce* was installing both docker-ce and docker-ce-cli, so apt was printing a warning. Change-Id: I0cad82243c8c3d5c0b9f26fc7b24673268259aa4 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
* Remove unused scriptDimitrios Apostolou2020-01-101-3/+0
| | | | | Change-Id: Ic3c57966c78fd8158a2467956fd31eaa4374412d Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Update Xcode to 11.3 for macOS 10.14Heikki Halmet2020-01-042-4/+3
| | | | | | Task-number: QTQAINFRA-3189 Change-Id: If16062254b33579b14f141d1db4aca2ad1e23afb Reviewed-by: Liang Qi <liang.qi@qt.io>
* Install QEMU from .deb package from internal cacheAssam Boudjelthia2020-01-031-27/+59
| | | | | | | | | | | QEMU cloning and building with each provisioning takes time, thus installing it from a prebuilt installable package can save lots of time in provisioning. Task-number: QTQAINFRA-3396 Change-Id: I3e9b0fedeecb6ddbae3997742827552ce9419399 Reviewed-by: Dimitrios Apostolou <jimis@qt.io> Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Remove SLES 12 provisioning scripts, as the platforms is already removedTony Sarajärvi2019-12-1015-505/+0
| | | | | Change-Id: I52ded9be93b65b74ac4d42434f82a44831e3ec48 Reviewed-by: Liang Qi <liang.qi@qt.io>
* Tag the docker images as "latest"Dimitrios Apostolou2019-12-051-6/+8
| | | | | | | | | | We will use this tag in qtbase to refer to the image to run, because with the current sha1tree() tag, every minor change in the docker images requires synchronized changes between repositories. Task-number: QTBUG-79867 Change-Id: If94eb6dd8b97526b589e58064837bc6554fed79c Reviewed-by: Volker Hilsheimer <volker.hilsheimer@qt.io>
* Provisioning: Remove sudo when installing pip packages for Qt userSimo Fält2019-11-251-2/+2
| | | | | | | | | There is no need to install as sudo for qt user. Using sudo will change the cache dir's permissions preventing us from installing anything with pip as normal user. Change-Id: Id45bf3805ce4d772a6c82e429d4e1948289f076e Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Provisioning: update SquishJohanna Äijälä2019-11-212-11/+7
| | | | | | | | Update with custom build of Squish to be able to launch Qt5.14 applications in RTA tests. Change-Id: Ic420656852ae885b057de937baabf01135526764 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* Provisioning: Change JDK script to use 'Remove' function from helpersHeikki Halmet2019-11-201-2/+1
| | | | | | Task-number: QTQAINFRA-3369 Change-Id: I2e873eb50d9129c48d92370af80fe121039d172e Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Remove shell scripts under windowsHeikki Halmet2019-11-202-45/+0
| | | | | Change-Id: I3d7a949e95bab39adc349c25d267b7fc28e676cf Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* Provisioning: Install python modules needed by packagingHeikki Halmet2019-11-204-0/+87
| | | | | | | | Needed by packaging scripts Task-number: COIN-214 Change-Id: I3ac719800c3afd183996379f6c23fbe3f8bcf7cb Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
* Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-11-185-16/+48
|\ | | | | | | | | | | | | Conflicts: coin/provisioning/common/linux/docker.sh Change-Id: Ic5c3fcaa856137de46c6f3830ca75cedb084927d
| * Workaround broken local apt mirrorDimitrios Apostolou2019-11-141-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | Local mirror is mirroring a public mirror, and for some reason there is a mismatch of file sizes and file hashes for the dep-11 metadata files. More info: https://askubuntu.com/questions/823329/how-do-i-disable-fetching-of-dep-11-files Task-number: QTQAINFRA-3351 Change-Id: Ia48936e7d0b9efb2f86fbe001f22f2bd28a7ea3d Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Keep debug trace off to avoid polluting the logsDimitrios Apostolou2019-11-141-1/+1
| | | | | | | | | | Change-Id: I8a2d878a52b5e0a818d7f80fff495feca84d0e9c Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Docker installation: do not depend on external repositoriesDimitrios Apostolou2019-11-141-9/+28
| | | | | | | | | | | | | | | | Also updated the docker-compose binary to the latest one. Task-number: QTQAINFRA-3279 Change-Id: Ie09a772ca8247aa5f5bd6d36774b68b6bb846386 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Fix cache URL for telegraf windows packageDimitrios Apostolou2019-11-141-1/+1
| | | | | | | | | | | | Fixes: QTQAINFRA-3340 Change-Id: Ie7bad3666094e3f8f8e8971c2bfe05457ca6cd45 Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
| * DownloadURL last argument (targetFile) is now optionalDimitrios Apostolou2019-11-141-1/+8
| | | | | | | | | | Change-Id: I0864bcb052cddcc9753c056758b6e65fd561d928 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
| * Provisioning: Install pre-builded openssl for Windows 7Heikki Halmet2019-11-121-3/+5
| | | | | | | | | | | | Task-number: QTQAINFRA-3224 Change-Id: I972b497e1a98f2ebbb6633158714409313cf0506 Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Update Android NDK version to r20 for macOS 10.14Heikki Halmet2019-11-181-1/+1
| | | | | | | | | | | | Task-number: QTQAINFRA-3337 Change-Id: Ib14e3cc484198bb23bb611262b205144f8a8ac70 Reviewed-by: Johanna Äijälä <johanna.aijala@qt.io>
* | Use Xcode 11 on macOS 10.14Tor Arne Vestbø2019-11-142-4/+4
| | | | | | | | | | | | Fixes: QTQAINFRA-3261 Change-Id: Ibec6b156e030b2a1b91010321178612efc0bd06b Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
* | Provisioning: Add MSVC 2019 and upgrade MSVC 2017 to the latest versionHeikki Halmet2019-11-0712-142/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Under coin/pre-provisioning can be found information what have been provisioned to tier1 image Visual studios are updated to versions: MSVC 2019: version 16.3.1 MSVC 2017: version 15.9.16 Task-number: QTQAINFRA-2875 Change-Id: I3a9748296dcf088bb312dec8f78bdc59dfb281d1 Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
* | Merge remote-tracking branch 'origin/5.13' into 5.14Liang Qi2019-11-0645-570/+124
|\| | | | | | | | | | | | | Conflicts: coin/provisioning/qtci-macos-10.12-x86_64/05-systemsetup.sh Change-Id: Ie9eae2144868cbe4a6c5ff9472c1a0e8fd53ed08