kubespray/.gitlab-ci.yml

---
stages:
  - build
  - unit-tests
  - deploy-part1
  - moderator
  - deploy-part2
  - deploy-part3
  - deploy-special

variables:
  KUBESPRAY_VERSION: v2.22.1
  FAILFASTCI_NAMESPACE: 'kargo-ci'
  GITLAB_REPOSITORY: 'kargo-ci/kubernetes-sigs-kubespray'
  ANSIBLE_FORCE_COLOR: "true"
  MAGIC: "ci check this"
  TEST_ID: "$CI_PIPELINE_ID-$CI_JOB_ID"
  CI_TEST_VARS: "./tests/files/${CI_JOB_NAME}.yml"
  CI_TEST_REGISTRY_MIRROR: "./tests/common/_docker_hub_registry_mirror.yml"
  CI_TEST_SETTING: "./tests/common/_kubespray_test_settings.yml"
  GS_ACCESS_KEY_ID: $GS_KEY
  GS_SECRET_ACCESS_KEY: $GS_SECRET
  CONTAINER_ENGINE: docker
  SSH_USER: root
  GCE_PREEMPTIBLE: "false"
  ANSIBLE_KEEP_REMOTE_FILES: "1"
  ANSIBLE_CONFIG: ./tests/ansible.cfg
  ANSIBLE_INVENTORY: ./inventory/sample/${CI_JOB_NAME}-${BUILD_NUMBER}.ini
  IDEMPOT_CHECK: "false"
  RESET_CHECK: "false"
  REMOVE_NODE_CHECK: "false"
  UPGRADE_TEST: "false"
  MITOGEN_ENABLE: "false"
  ANSIBLE_LOG_LEVEL: "-vv"
  RECOVER_CONTROL_PLANE_TEST: "false"
  RECOVER_CONTROL_PLANE_TEST_GROUPS: "etcd[2:],kube_control_plane[1:]"
  TERRAFORM_VERSION: 1.3.7
  PIPELINE_IMAGE: "$CI_REGISTRY_IMAGE/pipeline:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}"

before_script:
  - ./tests/scripts/rebase.sh
  - update-alternatives --install /usr/bin/python python /usr/bin/python3 1
  - python -m pip uninstall -y ansible ansible-base ansible-core
  - python -m pip install -r tests/requirements.txt
  - ansible-galaxy install -r tests/requirements.yml
  - mkdir -p /.ssh

.job: &job
  tags:
    - packet
  image: $PIPELINE_IMAGE
  artifacts:
    when: always
    paths:
      - cluster-dump/

.testcases: &testcases
  <<: *job
  retry: 1
  interruptible: true
  before_script:
    - update-alternatives --install /usr/bin/python python /usr/bin/python3 1
    - ./tests/scripts/rebase.sh
    - ./tests/scripts/testcases_prepare.sh
  script:
    - ./tests/scripts/testcases_run.sh
  after_script:
    - chronic ./tests/scripts/testcases_cleanup.sh

# For failfast, at least 1 job must be defined in .gitlab-ci.yml
# Premoderated with manual actions
ci-authorized:
  extends: .job
  stage: moderator
  script:
    - /bin/sh scripts/premoderator.sh
  except: ['triggers', 'master']
  # Disable ci moderator
  only: []

include:
  - .gitlab-ci/build.yml
  - .gitlab-ci/lint.yml
  - .gitlab-ci/shellcheck.yml
  - .gitlab-ci/terraform.yml
  - .gitlab-ci/packet.yml
  - .gitlab-ci/vagrant.yml
  - .gitlab-ci/molecule.yml
Yamllint fixes (#4410) * Lint everything in the repository with yamllint * yamllint fixes: syntax fixes only * yamllint fixes: move comments to play names * yamllint fixes: indent comments in .gitlab-ci.yml file 2019-04-01 17:38:33 +08:00			`---`
add gitlabci 2016-12-10 10:23:37 +08:00			`stages:`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`- build`
add gitlabci 2016-12-10 10:23:37 +08:00			`- unit-tests`
fix inventory paths 2018-02-12 23:04:26 +08:00			`- deploy-part1`
Move moderator between part1 and part2 (#4844) 2019-06-06 16:00:17 +08:00			`- moderator`
fix inventory paths 2018-02-12 23:04:26 +08:00			`- deploy-part2`
Move long running jobs into separate CI stage (#5837) 2020-03-27 04:56:24 +08:00			`- deploy-part3`
fix inventory paths 2018-02-12 23:04:26 +08:00			`- deploy-special`
add gitlabci 2016-12-10 10:23:37 +08:00
			`variables:`
cleanup-for-2.22.1 (#10201) 2023-06-08 22:36:15 +08:00			`KUBESPRAY_VERSION: v2.22.1`
add gitlabci 2016-12-10 10:23:37 +08:00			`FAILFASTCI_NAMESPACE: 'kargo-ci'`
Update gitlab to new repository (#3784) 2018-11-28 22:13:28 +08:00			`GITLAB_REPOSITORY: 'kargo-ci/kubernetes-sigs-kubespray'`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00			`ANSIBLE_FORCE_COLOR: "true"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`MAGIC: "ci check this"`
Migrate CI_BUILD_ID to CI_JOB_ID and CI_BUILD_REF to CI_COMMIT_SHA (#10063) 2023-05-11 19:21:17 +08:00			`TEST_ID: "$CI_PIPELINE_ID-$CI_JOB_ID"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`CI_TEST_VARS: "./tests/files/${CI_JOB_NAME}.yml"`
containerd docker hub registry mirror support (#6962) * containerd docker hub registry mirror support * add docs * fix typo * fix yamllint * fix indent in sample and ansible-playbook param in testcases_run * fix md * mv common vars to tests/common/_docker_hub_registry_mirror.yml * checkout vars to upgrade tests 2020-11-30 16:22:49 +08:00			`CI_TEST_REGISTRY_MIRROR: "./tests/common/_docker_hub_registry_mirror.yml"`
Cleanup tests (#8234) * Add Fedora 35 image, support and CI * Cleanup tests and allow_failure for vagrant 2021-11-27 01:00:51 +08:00			`CI_TEST_SETTING: "./tests/common/_kubespray_test_settings.yml"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`GS_ACCESS_KEY_ID: $GS_KEY`
			`GS_SECRET_ACCESS_KEY: $GS_SECRET`
			`CONTAINER_ENGINE: docker`
Force to /usr/bin/python in CI 2018-02-12 22:32:40 +08:00			`SSH_USER: root`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`GCE_PREEMPTIBLE: "false"`
			`ANSIBLE_KEEP_REMOTE_FILES: "1"`
			`ANSIBLE_CONFIG: ./tests/ansible.cfg`
Fix CI upgrade scenario by using dynamic inventory file (#2635) Also updates the commit ID we use as a basis for upgrade tests. 2018-04-10 21:02:33 +08:00			`ANSIBLE_INVENTORY: ./inventory/sample/${CI_JOB_NAME}-${BUILD_NUMBER}.ini`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`IDEMPOT_CHECK: "false"`
			`RESET_CHECK: "false"`
[CI] add remove node job 2022-04-19 15:49:39 +08:00			`REMOVE_NODE_CHECK: "false"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`UPGRADE_TEST: "false"`
add strategy mitogen_linear when installed mitogen (#5985) * add strategy mitogen_linear when installed mitogen * add small docs Rename playbook file The raw action executes as a regular Mitogen connection, which requires Python on the target, so add strategy: linear to bootstrap-os role playbook. * add mitogen to CI test fix typo * enable mitogen test on deploy-part1 tests change version from master to release download tar.gz archive * run all CI tests with mitogen * disable mitogen with upgrade CI tests * enable mitogen on CI tests via env vars * disable mitogen on CI test by default, enable on some different OS * disable mitogen CI test on centos8 (get error /usr/bin/python: No such file or directory) 2020-04-24 20:20:07 +08:00			`MITOGEN_ENABLE: "false"`
Add cluster dump artifact in CI jobs (#5796) 2020-04-01 22:23:29 +08:00			`ANSIBLE_LOG_LEVEL: "-vv"`
Fix recover-control-plane to work with etcd 3.3.x and add CI (#5500) * Fix recover-control-plane to work with etcd 3.3.x and add CI * Set default values for testcase * Add actual test jobs * Attempt to satisty gitlab ci linter * Fix ansible targets * Set etcd_member_name as stated in the docs... * Recovering from 0 masters is not supported yet * Add other master to broken_kube-master group as well * Increase number of retries to see if etcd needs more time to heal * Make number of retries for ETCD loops configurable, increase it for recovery CI and document it 2020-02-11 17:38:01 +08:00			`RECOVER_CONTROL_PLANE_TEST: "false"`
Replace kube-master with kube_control_plane (#7256) This replaces kube-master with kube_control_plane because of [1]: The Kubernetes project is moving away from wording that is considered offensive. A new working group WG Naming was created to track this work, and the word "master" was declared as offensive. A proposal was formalized for replacing the word "master" with "control plane". This means it should be removed from source code, documentation, and user-facing configuration from Kubernetes and its sub-projects. NOTE: The reason why this changes it to kube_control_plane not kube-control-plane is for valid group names on ansible. [1]: https://github.com/kubernetes/enhancements/blob/master/keps/sig-cluster-lifecycle/kubeadm/2067-rename-master-label-taint/README.md#motivation 2021-03-24 08:26:05 +08:00			`RECOVER_CONTROL_PLANE_TEST_GROUPS: "etcd[2:],kube_control_plane[1:]"`
Update fedora35 vagrant box url (#9699) * Update fedora35 vagrant box url * Update Terraform to 1.3.7 * Update Vagrant to 2.3.4 2023-01-27 13:28:25 +08:00			`TERRAFORM_VERSION: 1.3.7`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`PIPELINE_IMAGE: "$CI_REGISTRY_IMAGE/pipeline:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}"`
add gitlabci 2016-12-10 10:23:37 +08:00
			`before_script:`
Always rebase on master before running a job (#4616) 2019-04-24 16:38:01 +08:00			`- ./tests/scripts/rebase.sh`
Use kubespray/kubespray:v2.11.0 for CI (#5363) 2019-12-11 16:10:05 +08:00			`- update-alternatives --install /usr/bin/python python /usr/bin/python3 1`
Exercise multiple ansible versions in CI (#8172) * Ansible: separate requirements files for supported ansible versions * Ansible: allow using ansible 2.11 * CI: Exercise Ansible 2.9 and Ansible 2.11 in a basic AIO CI job * CI: Allow running a reset test outside of idempotency tests and running it in stage1 * CI: move ubuntu18-calico-aio job to stage2 and relay only on ubuntu20 with the variously supported ansible versions for stage1 * CI: add capability to install collections or roles from ansible-galaxy to mitigate missing behavior in older ansible versions 2021-11-11 08:11:50 +08:00			`- python -m pip uninstall -y ansible ansible-base ansible-core`
project: upgrade test dependencies and drop ansible-core 2.11 (#10034) Molecule 5.0 require ansible-core 2.12.10. So this commit we update ansible-core from 2.12.5 to 2.12.10. We also drop supporting two ansible-core version. Also we now use the "oldest" still supported ansible-core version as both 2.11 is EOL and not supported by molecule. tests/molecule: remove linting in molecule to support molecule 5 tests/molecule: remove role name check for molecule 5 support Kubespray doesn't use ansible galaxy style naming so we have to disable that check. contrib/inventory_builder: fix tox.ini for tox4 tests/molecule: fix get_playbook in testinfra tests tests: upgrade most tests requirements Exclude ansible-lint for now, I will do that in a separate PR. tests/molecule: force kvm driver option If we don't do this it fallbacks to qemu emulated on our CI for some reasons. Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> 2023-06-03 11:40:40 +08:00			`- python -m pip install -r tests/requirements.txt`
Upgrade ansible (#10190) * project: update all dependencies including ansible Upgrade to ansible 7.x and ansible-core 2.14.x. There seems to be issue with ansible 8/ansible-core 2.15 so we remain on those versions for now. It's quite a big bump already anyway. Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * tests: install aws galaxy collection Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * ansible-lint: disable various rules after ansible upgrade Temporarily disable a bunch of linting action following ansible upgrade. Those should be taken care of separately. Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve deprecated-module ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve no-free-form ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve schema[meta] ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve schema[playbook] ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve schema[tasks] ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve risky-file-permissions ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve risky-shell-pipe ansible-lint error Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: remove deprecated warn args Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: use fqcn for non builtin tasks Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: resolve syntax-check[missing-file] for contrib playbook Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * project: use arithmetic inside jinja to fix ansible 6 upgrade Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> --------- Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> 2023-06-26 18:15:45 +08:00			`- ansible-galaxy install -r tests/requirements.yml`
Yamllint fixes (#4410) * Lint everything in the repository with yamllint * yamllint fixes: syntax fixes only * yamllint fixes: move comments to play names * yamllint fixes: indent comments in .gitlab-ci.yml file 2019-04-01 17:38:33 +08:00			`- mkdir -p /.ssh`
add gitlabci 2016-12-10 10:23:37 +08:00
			`.job: &job`
			`tags:`
PHASE 2 - Enable Packet-CI in gitlab and move unit-tests and deploy-part1 (#4538) * PHASE 2 - Enable Packet-CI in gitlab * Add gitlab files * Reset files back and only keep Packet * Include packet * Add missing Upgrade Tests * Update GCE jobs etc * Fix bug * Yaml lint all gitlab files * Remove GCE * Test * Test again * Enable GCE again * Install requirements * Cleanup the gitlab file * Cleanup runner tags * Install requirements * Test * Test variables for gce * Test again * Test again * Fix * Update 2019-04-17 23:32:03 +08:00			`- packet`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`image: $PIPELINE_IMAGE`
Add cluster dump artifact in CI jobs (#5796) 2020-04-01 22:23:29 +08:00			`artifacts:`
Always enable GitLab CI artifacts for cluster-dump (#6412) 2020-07-17 04:45:00 +08:00			`when: always`
Add cluster dump artifact in CI jobs (#5796) 2020-04-01 22:23:29 +08:00			`paths:`
			`- cluster-dump/`
add gitlabci 2016-12-10 10:23:37 +08:00
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`.testcases: &testcases`
add gitlabci 2016-12-10 10:23:37 +08:00			`<<: *job`
Retry vagrant and periodic packet jobs too 2021-09-03 23:00:41 +08:00			`retry: 1`
Enable interruptible jobs' pipelines (#10167) 2023-06-08 18:12:13 +08:00			`interruptible: true`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00			`before_script:`
Use kubespray/kubespray:v2.11.0 for CI (#5363) 2019-12-11 16:10:05 +08:00			`- update-alternatives --install /usr/bin/python python /usr/bin/python3 1`
Always rebase on master before running a job (#4616) 2019-04-24 16:38:01 +08:00			`- ./tests/scripts/rebase.sh`
Move inline shell into script files (#4604) 2019-04-24 04:36:03 +08:00			`- ./tests/scripts/testcases_prepare.sh`
add gitlabci 2016-12-10 10:23:37 +08:00			`script:`
Move inline shell into script files (#4604) 2019-04-24 04:36:03 +08:00			`- ./tests/scripts/testcases_run.sh`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00			`after_script:`
Hide after_script output if return code is zero (#5862) 2020-03-31 20:28:40 +08:00			`- chronic ./tests/scripts/testcases_cleanup.sh`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`# For failfast, at least 1 job must be defined in .gitlab-ci.yml`
fix inventory paths 2018-02-12 23:04:26 +08:00			`# Premoderated with manual actions`
			`ci-authorized:`
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`extends: .job`
fix inventory paths 2018-02-12 23:04:26 +08:00			`stage: moderator`
			`script:`
			`- /bin/sh scripts/premoderator.sh`
			`except: ['triggers', 'master']`
Disable moderator (#5069) * Test the CI * Disable CI moderator 2019-08-15 18:02:34 +08:00			`# Disable ci moderator`
			`only: []`
fix inventory paths 2018-02-12 23:04:26 +08:00
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`include:`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`- .gitlab-ci/build.yml`
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`- .gitlab-ci/lint.yml`
Add shellcheck CI (#4562) 2019-04-19 14:57:54 +08:00			`- .gitlab-ci/shellcheck.yml`
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`- .gitlab-ci/terraform.yml`
PHASE 2 - Enable Packet-CI in gitlab and move unit-tests and deploy-part1 (#4538) * PHASE 2 - Enable Packet-CI in gitlab * Add gitlab files * Reset files back and only keep Packet * Include packet * Add missing Upgrade Tests * Update GCE jobs etc * Fix bug * Yaml lint all gitlab files * Remove GCE * Test * Test again * Enable GCE again * Install requirements * Cleanup the gitlab file * Cleanup runner tags * Install requirements * Test * Test variables for gce * Test again * Test again * Fix * Update 2019-04-17 23:32:03 +08:00			`- .gitlab-ci/packet.yml`
Add molecule test for bootstrap-os (#5845) 2020-04-01 22:25:28 +08:00			`- .gitlab-ci/vagrant.yml`
[CI] split molecule testes to run in parallel (#8756) * add parametrization to molecule_run.sh * [CI] split molecule tests to allow parallelization of work 2022-04-29 15:09:12 +08:00			`- .gitlab-ci/molecule.yml`