kubespray/.gitlab-ci.yml

---
stages:
  - build
  - unit-tests
  - deploy-part1
  - moderator
  - deploy-part2
  - deploy-part3
  - deploy-special

variables:
  KUBESPRAY_VERSION: v2.21.0
  FAILFASTCI_NAMESPACE: 'kargo-ci'
  GITLAB_REPOSITORY: 'kargo-ci/kubernetes-sigs-kubespray'
  ANSIBLE_FORCE_COLOR: "true"
  MAGIC: "ci check this"
  TEST_ID: "$CI_PIPELINE_ID-$CI_JOB_ID"
  CI_TEST_VARS: "./tests/files/${CI_JOB_NAME}.yml"
  CI_TEST_REGISTRY_MIRROR: "./tests/common/_docker_hub_registry_mirror.yml"
  CI_TEST_SETTING: "./tests/common/_kubespray_test_settings.yml"
  GS_ACCESS_KEY_ID: $GS_KEY
  GS_SECRET_ACCESS_KEY: $GS_SECRET
  CONTAINER_ENGINE: docker
  SSH_USER: root
  GCE_PREEMPTIBLE: "false"
  ANSIBLE_KEEP_REMOTE_FILES: "1"
  ANSIBLE_CONFIG: ./tests/ansible.cfg
  ANSIBLE_INVENTORY: ./inventory/sample/${CI_JOB_NAME}-${BUILD_NUMBER}.ini
  IDEMPOT_CHECK: "false"
  RESET_CHECK: "false"
  REMOVE_NODE_CHECK: "false"
  UPGRADE_TEST: "false"
  MITOGEN_ENABLE: "false"
  ANSIBLE_LOG_LEVEL: "-vv"
  RECOVER_CONTROL_PLANE_TEST: "false"
  RECOVER_CONTROL_PLANE_TEST_GROUPS: "etcd[2:],kube_control_plane[1:]"
  TERRAFORM_VERSION: 1.3.7
  ANSIBLE_MAJOR_VERSION: "2.11"
  PIPELINE_IMAGE: "$CI_REGISTRY_IMAGE/pipeline:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}"

before_script:
  - ./tests/scripts/rebase.sh
  - update-alternatives --install /usr/bin/python python /usr/bin/python3 1
  - python -m pip uninstall -y ansible ansible-base ansible-core
  - PIP_CONSTRAINT=tests/constraints.txt python -m pip install -r tests/requirements-${ANSIBLE_MAJOR_VERSION}.txt
  - mkdir -p /.ssh

.job: &job
  tags:
    - packet
  image: $PIPELINE_IMAGE
  artifacts:
    when: always
    paths:
      - cluster-dump/

.testcases: &testcases
  <<: *job
  retry: 1
  before_script:
    - update-alternatives --install /usr/bin/python python /usr/bin/python3 1
    - ./tests/scripts/rebase.sh
    - ./tests/scripts/testcases_prepare.sh
  script:
    - ./tests/scripts/testcases_run.sh
  after_script:
    - chronic ./tests/scripts/testcases_cleanup.sh

# For failfast, at least 1 job must be defined in .gitlab-ci.yml
# Premoderated with manual actions
ci-authorized:
  extends: .job
  stage: moderator
  script:
    - /bin/sh scripts/premoderator.sh
  except: ['triggers', 'master']
  # Disable ci moderator
  only: []

include:
  - .gitlab-ci/build.yml
  - .gitlab-ci/lint.yml
  - .gitlab-ci/shellcheck.yml
  - .gitlab-ci/terraform.yml
  - .gitlab-ci/packet.yml
  - .gitlab-ci/vagrant.yml
  - .gitlab-ci/molecule.yml
Yamllint fixes (#4410) * Lint everything in the repository with yamllint * yamllint fixes: syntax fixes only * yamllint fixes: move comments to play names * yamllint fixes: indent comments in .gitlab-ci.yml file 2019-04-01 17:38:33 +08:00			`---`
add gitlabci 2016-12-10 10:23:37 +08:00			`stages:`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`- build`
add gitlabci 2016-12-10 10:23:37 +08:00			`- unit-tests`
fix inventory paths 2018-02-12 23:04:26 +08:00			`- deploy-part1`
Move moderator between part1 and part2 (#4844) 2019-06-06 16:00:17 +08:00			`- moderator`
fix inventory paths 2018-02-12 23:04:26 +08:00			`- deploy-part2`
Move long running jobs into separate CI stage (#5837) 2020-03-27 04:56:24 +08:00			`- deploy-part3`
fix inventory paths 2018-02-12 23:04:26 +08:00			`- deploy-special`
add gitlabci 2016-12-10 10:23:37 +08:00
			`variables:`
Update KUBESPRAY_VERSION and kube_version_min_required (with hashes cleanup) (#9691) 2023-01-21 06:11:54 +08:00			`KUBESPRAY_VERSION: v2.21.0`
add gitlabci 2016-12-10 10:23:37 +08:00			`FAILFASTCI_NAMESPACE: 'kargo-ci'`
Update gitlab to new repository (#3784) 2018-11-28 22:13:28 +08:00			`GITLAB_REPOSITORY: 'kargo-ci/kubernetes-sigs-kubespray'`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00			`ANSIBLE_FORCE_COLOR: "true"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`MAGIC: "ci check this"`
Migrate CI_BUILD_ID to CI_JOB_ID and CI_BUILD_REF to CI_COMMIT_SHA (#10063) 2023-05-11 19:21:17 +08:00			`TEST_ID: "$CI_PIPELINE_ID-$CI_JOB_ID"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`CI_TEST_VARS: "./tests/files/${CI_JOB_NAME}.yml"`
containerd docker hub registry mirror support (#6962) * containerd docker hub registry mirror support * add docs * fix typo * fix yamllint * fix indent in sample and ansible-playbook param in testcases_run * fix md * mv common vars to tests/common/_docker_hub_registry_mirror.yml * checkout vars to upgrade tests 2020-11-30 16:22:49 +08:00			`CI_TEST_REGISTRY_MIRROR: "./tests/common/_docker_hub_registry_mirror.yml"`
Cleanup tests (#8234) * Add Fedora 35 image, support and CI * Cleanup tests and allow_failure for vagrant 2021-11-27 01:00:51 +08:00			`CI_TEST_SETTING: "./tests/common/_kubespray_test_settings.yml"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`GS_ACCESS_KEY_ID: $GS_KEY`
			`GS_SECRET_ACCESS_KEY: $GS_SECRET`
			`CONTAINER_ENGINE: docker`
Force to /usr/bin/python in CI 2018-02-12 22:32:40 +08:00			`SSH_USER: root`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`GCE_PREEMPTIBLE: "false"`
			`ANSIBLE_KEEP_REMOTE_FILES: "1"`
			`ANSIBLE_CONFIG: ./tests/ansible.cfg`
Fix CI upgrade scenario by using dynamic inventory file (#2635) Also updates the commit ID we use as a basis for upgrade tests. 2018-04-10 21:02:33 +08:00			`ANSIBLE_INVENTORY: ./inventory/sample/${CI_JOB_NAME}-${BUILD_NUMBER}.ini`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`IDEMPOT_CHECK: "false"`
			`RESET_CHECK: "false"`
[CI] add remove node job 2022-04-19 15:49:39 +08:00			`REMOVE_NODE_CHECK: "false"`
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`UPGRADE_TEST: "false"`
add strategy mitogen_linear when installed mitogen (#5985) * add strategy mitogen_linear when installed mitogen * add small docs Rename playbook file The raw action executes as a regular Mitogen connection, which requires Python on the target, so add strategy: linear to bootstrap-os role playbook. * add mitogen to CI test fix typo * enable mitogen test on deploy-part1 tests change version from master to release download tar.gz archive * run all CI tests with mitogen * disable mitogen with upgrade CI tests * enable mitogen on CI tests via env vars * disable mitogen on CI test by default, enable on some different OS * disable mitogen CI test on centos8 (get error /usr/bin/python: No such file or directory) 2020-04-24 20:20:07 +08:00			`MITOGEN_ENABLE: "false"`
Add cluster dump artifact in CI jobs (#5796) 2020-04-01 22:23:29 +08:00			`ANSIBLE_LOG_LEVEL: "-vv"`
Fix recover-control-plane to work with etcd 3.3.x and add CI (#5500) * Fix recover-control-plane to work with etcd 3.3.x and add CI * Set default values for testcase * Add actual test jobs * Attempt to satisty gitlab ci linter * Fix ansible targets * Set etcd_member_name as stated in the docs... * Recovering from 0 masters is not supported yet * Add other master to broken_kube-master group as well * Increase number of retries to see if etcd needs more time to heal * Make number of retries for ETCD loops configurable, increase it for recovery CI and document it 2020-02-11 17:38:01 +08:00			`RECOVER_CONTROL_PLANE_TEST: "false"`
Replace kube-master with kube_control_plane (#7256) This replaces kube-master with kube_control_plane because of [1]: The Kubernetes project is moving away from wording that is considered offensive. A new working group WG Naming was created to track this work, and the word "master" was declared as offensive. A proposal was formalized for replacing the word "master" with "control plane". This means it should be removed from source code, documentation, and user-facing configuration from Kubernetes and its sub-projects. NOTE: The reason why this changes it to kube_control_plane not kube-control-plane is for valid group names on ansible. [1]: https://github.com/kubernetes/enhancements/blob/master/keps/sig-cluster-lifecycle/kubeadm/2067-rename-master-label-taint/README.md#motivation 2021-03-24 08:26:05 +08:00			`RECOVER_CONTROL_PLANE_TEST_GROUPS: "etcd[2:],kube_control_plane[1:]"`
Update fedora35 vagrant box url (#9699) * Update fedora35 vagrant box url * Update Terraform to 1.3.7 * Update Vagrant to 2.3.4 2023-01-27 13:28:25 +08:00			`TERRAFORM_VERSION: 1.3.7`
Drop Ansible support for v2.9 and v2.10 (#8925) Ansible v2.9 and v2.10 are EOL as [1]. This drops those version supports by following the upstream Ansible. This sets use_ssh_args true always because that is required to use ssh_args on ansible.cfg on Ansible v2.11 or later[2]. ansible_ssh_host is replaced with ansible_host because ansible_ssh_host has been deprecated already and cenots7 jobs were failed due to the deprecated ansible_ssh_host. [1]: https://docs.ansible.com/ansible/devel/reference_appendices/release_and_maintenance.html#ansible-core-changelogs [2]: https://docs.ansible.com/ansible/latest/collections/ansible/posix/synchronize_module.html#parameter-use_ssh_args 2022-06-09 22:07:42 +08:00			`ANSIBLE_MAJOR_VERSION: "2.11"`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`PIPELINE_IMAGE: "$CI_REGISTRY_IMAGE/pipeline:${CI_PIPELINE_ID}-${CI_COMMIT_SHORT_SHA}"`
add gitlabci 2016-12-10 10:23:37 +08:00
			`before_script:`
Always rebase on master before running a job (#4616) 2019-04-24 16:38:01 +08:00			`- ./tests/scripts/rebase.sh`
Use kubespray/kubespray:v2.11.0 for CI (#5363) 2019-12-11 16:10:05 +08:00			`- update-alternatives --install /usr/bin/python python /usr/bin/python3 1`
Exercise multiple ansible versions in CI (#8172) * Ansible: separate requirements files for supported ansible versions * Ansible: allow using ansible 2.11 * CI: Exercise Ansible 2.9 and Ansible 2.11 in a basic AIO CI job * CI: Allow running a reset test outside of idempotency tests and running it in stage1 * CI: move ubuntu18-calico-aio job to stage2 and relay only on ubuntu20 with the variously supported ansible versions for stage1 * CI: add capability to install collections or roles from ansible-galaxy to mitigate missing behavior in older ansible versions 2021-11-11 08:11:50 +08:00			`- python -m pip uninstall -y ansible ansible-base ansible-core`
[2.22] Add hashes for kubernetes 1.26.11, 1.26.10 (#10704) * [kubernetes] Add hashes for kubernetes 1.26.11, 1.26.10 Make kubernetes 1.26.11 default * Workaround for yaml/pyyaml#601 * Convert exoscale tf provider to new version (#10646) This is untested. It passes terraform validate to un-broke the CI. * Update 0040-verify-settings.yml (#10699) remove embedded template * Use supported version of fedora in CI (#10108) * tests: replace fedora35 with fedora37 Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * tests: replace fedora36 with fedora38 Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * docs: update fedora version in docs Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * molecule: upgrade fedora version Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * tests: upgrade fedora images for vagrant and kubevirt Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * vagrant: workaround to fix private network ip address in fedora Fedora stop supporting syconfig network script so we added a workaround here https://github.com/hashicorp/vagrant/issues/12762#issuecomment-1535957837 to fix it. * netowrkmanager: do not configure dns if using systemd-resolved We should not configure dns if we point to systemd-resolved. Systemd-resolved is using NetworkManager to infer the upstream DNS server so if we set NetworkManager to 127.0.0.53 it will prevent systemd-resolved to get the correct network DNS server. Thus if we are in this case we just don't set this setting. Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * image-builder: update centos7 image Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> * gitlab-ci: mark fedora packet jobs as allow failure Fedora networking is still broken on Packet, let's mark it as allow failure for now. Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> --------- Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> --------- Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> Co-authored-by: piwinkler <9642809+piwinkler@users.noreply.github.com> Co-authored-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@proton.ch> 2023-12-12 14:27:35 +08:00			`- PIP_CONSTRAINT=tests/constraints.txt python -m pip install -r tests/requirements-${ANSIBLE_MAJOR_VERSION}.txt`
Yamllint fixes (#4410) * Lint everything in the repository with yamllint * yamllint fixes: syntax fixes only * yamllint fixes: move comments to play names * yamllint fixes: indent comments in .gitlab-ci.yml file 2019-04-01 17:38:33 +08:00			`- mkdir -p /.ssh`
add gitlabci 2016-12-10 10:23:37 +08:00
			`.job: &job`
			`tags:`
PHASE 2 - Enable Packet-CI in gitlab and move unit-tests and deploy-part1 (#4538) * PHASE 2 - Enable Packet-CI in gitlab * Add gitlab files * Reset files back and only keep Packet * Include packet * Add missing Upgrade Tests * Update GCE jobs etc * Fix bug * Yaml lint all gitlab files * Remove GCE * Test * Test again * Enable GCE again * Install requirements * Cleanup the gitlab file * Cleanup runner tags * Install requirements * Test * Test variables for gce * Test again * Test again * Fix * Update 2019-04-17 23:32:03 +08:00			`- packet`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`image: $PIPELINE_IMAGE`
Add cluster dump artifact in CI jobs (#5796) 2020-04-01 22:23:29 +08:00			`artifacts:`
Always enable GitLab CI artifacts for cluster-dump (#6412) 2020-07-17 04:45:00 +08:00			`when: always`
Add cluster dump artifact in CI jobs (#5796) 2020-04-01 22:23:29 +08:00			`paths:`
			`- cluster-dump/`
add gitlabci 2016-12-10 10:23:37 +08:00
Enable multiple CI platform / Add DigitalOcean 2018-02-12 18:35:37 +08:00			`.testcases: &testcases`
add gitlabci 2016-12-10 10:23:37 +08:00			`<<: *job`
Retry vagrant and periodic packet jobs too 2021-09-03 23:00:41 +08:00			`retry: 1`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00			`before_script:`
Use kubespray/kubespray:v2.11.0 for CI (#5363) 2019-12-11 16:10:05 +08:00			`- update-alternatives --install /usr/bin/python python /usr/bin/python3 1`
Always rebase on master before running a job (#4616) 2019-04-24 16:38:01 +08:00			`- ./tests/scripts/rebase.sh`
Move inline shell into script files (#4604) 2019-04-24 04:36:03 +08:00			`- ./tests/scripts/testcases_prepare.sh`
add gitlabci 2016-12-10 10:23:37 +08:00			`script:`
Move inline shell into script files (#4604) 2019-04-24 04:36:03 +08:00			`- ./tests/scripts/testcases_run.sh`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00			`after_script:`
Hide after_script output if return code is zero (#5862) 2020-03-31 20:28:40 +08:00			`- chronic ./tests/scripts/testcases_cleanup.sh`
Add deployment from gitlab-ci 2016-12-14 06:01:37 +08:00
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`# For failfast, at least 1 job must be defined in .gitlab-ci.yml`
fix inventory paths 2018-02-12 23:04:26 +08:00			`# Premoderated with manual actions`
			`ci-authorized:`
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`extends: .job`
fix inventory paths 2018-02-12 23:04:26 +08:00			`stage: moderator`
			`script:`
			`- /bin/sh scripts/premoderator.sh`
			`except: ['triggers', 'master']`
Disable moderator (#5069) * Test the CI * Disable CI moderator 2019-08-15 18:02:34 +08:00			`# Disable ci moderator`
			`only: []`
fix inventory paths 2018-02-12 23:04:26 +08:00
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`include:`
Adds pipeline image (#9606) 2023-01-09 10:29:27 +08:00			`- .gitlab-ci/build.yml`
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`- .gitlab-ci/lint.yml`
Add shellcheck CI (#4562) 2019-04-19 14:57:54 +08:00			`- .gitlab-ci/shellcheck.yml`
Split .gitlab-ci.yml into several files (#4519) 2019-04-16 20:35:05 +08:00			`- .gitlab-ci/terraform.yml`
PHASE 2 - Enable Packet-CI in gitlab and move unit-tests and deploy-part1 (#4538) * PHASE 2 - Enable Packet-CI in gitlab * Add gitlab files * Reset files back and only keep Packet * Include packet * Add missing Upgrade Tests * Update GCE jobs etc * Fix bug * Yaml lint all gitlab files * Remove GCE * Test * Test again * Enable GCE again * Install requirements * Cleanup the gitlab file * Cleanup runner tags * Install requirements * Test * Test variables for gce * Test again * Test again * Fix * Update 2019-04-17 23:32:03 +08:00			`- .gitlab-ci/packet.yml`
Add molecule test for bootstrap-os (#5845) 2020-04-01 22:25:28 +08:00			`- .gitlab-ci/vagrant.yml`
[CI] split molecule testes to run in parallel (#8756) * add parametrization to molecule_run.sh * [CI] split molecule tests to allow parallelization of work 2022-04-29 15:09:12 +08:00			`- .gitlab-ci/molecule.yml`