02322c46de
Remove helm duplicate check ( #8196 )
2021-11-15 12:50:48 -08:00
4d79a55904
Remove extra parameter kube_proxy_remove ( #8158 )
...
Signed-off-by: EDGsheryl <edgsheryl@gmail.com>
2021-11-15 00:02:48 -08:00
027cbefb87
change krew uri to krew_download_url ( #8190 )
2021-11-14 12:08:47 -08:00
a08d82d94e
calico add support for container ip forwarding setting ( #8184 )
2021-11-12 19:06:46 -08:00
5f1456337b
Fix krew auto completion command not found at lower version ( #8185 )
2021-11-12 17:04:46 -08:00
b5a5478a8a
Added tolerations for cinder-csi-nodeplugin DaemonSet ( #8137 )
2021-11-11 11:48:07 -08:00
b7ae4a2cfd
Kata-Containers: Fix kata-containers runtime ( #8068 )
...
* Kata-containes: Fix for ubuntu and centos sometimes kata containers fail to start because of access errors to /dev/vhost-vsock and /dev/vhost-net
* Kata-containers: use similar testing strategy as gvisor
* Kata-Containers: adjust values for 2.2.0 defaults
Make CI tests actually pass
* Kata-Containers: bump to 2.2.2 to fix sandbox_cgroup_only issue
2021-11-09 10:01:48 -08:00
039205560a
nodelocaldns: allow a secondary pod for nodelocaldns for local-HA ( #8100 )
...
* nodelocaldns: allow a secondary pod for nodelocaldns for local-HA
* CI: add job to test nodelocaldns secondary
2021-11-09 09:57:47 -08:00
801268d5c1
containerd: upgrade versions 1.4.11 and 1.5.7 and make 1.4.11 the default ( #8129 )
2021-11-09 06:59:47 -08:00
46c536d261
Add krew auto completion ( #8171 )
2021-11-09 02:43:39 -08:00
4a8757161e
Docker: replace the use of containerd_version with docker_containerd_version to avoid causing conflicts when bumping containerd_version ( #8130 )
2021-11-08 15:56:49 -08:00
65540c5771
krew: update to v0.4.2 ( #8168 )
...
krew release urls changed since v0.4.2, clearly OS type and arch inside the filename.
from:
https://github.com/kubernetes-sigs/krew/releases/download/v0.4.1/krew.tar.gz
to:
https://github.com/kubernetes-sigs/krew/releases/download/v0.4.2/krew-linux_amd64.tar.gz
define `host_os` like `host_architecture` determine which OS is krew
installed at.
2021-11-08 02:54:59 -08:00
6c1ab24981
Limit kubectl delete node to k8s nodes ( #8101 )
...
* Limit kubectl delete node to k8s nodes
This avoids the use of `kubectl delete node` when removing etcd nodes
which are not part of the cluser (separate etcd)
* Take errors into account when deleting node
There should not be error now that we're limiting the deletion to nodes
actually in the cluster
* Retrying on error
2021-11-08 02:22:58 -08:00
61c2ae5549
Add vxlanEnabled spec in FelixConfiguration ( #8167 )
2021-11-08 00:06:52 -08:00
04711d3b00
Replace path_join to support Ansible 2.9 ( #8160 )
2021-11-08 00:00:52 -08:00
cb7c30a4f1
Fix cloud_provider check ( #8164 )
...
This fixes the preinstall check for cloud_provider option based on
inventory/sample/group_vars/all/all.yml
2021-11-07 23:48:52 -08:00
8922c45556
Added ArgoCD kubernetes-app ( #7895 )
...
* Added ArgoCD kubernetes-app
* Update argocd_version to latest
2021-11-07 02:22:51 -08:00
58390c79d0
Bump crun version 1.2 to 1.3 ( #8162 )
...
Signed-off-by: Emin Aktaş <eminaktas34@gmail.com>
Co-authored-by: Yasin Taha Erol <yasintahaerol@gmail.com>
Co-authored-by: Necatican Yıldırım <necaticanyildirim@gmail.com>
Co-authored-by: Yasin Taha Erol <yasintahaerol@gmail.com>
Co-authored-by: Necatican Yıldırım <necaticanyildirim@gmail.com>
2021-11-06 02:26:50 -07:00
b7eb1cf936
cert-manager: add trusted internal ca when configured ( #8135 )
...
* cert-manager: add trusted internal ca when configured
* wrong check for inventory variable
* Update documentation
2021-11-05 09:43:52 -07:00
6e5b9e0ebf
Fix Kubelet and Containerd when using cgroupfs as cgroup driver ( #8123 )
2021-11-05 07:59:54 -07:00
c94291558d
Fix containerd install for fcos ( #8107 )
...
* Fix containerd install for fcos
* rm orphaned runc and containerd binaries
2021-11-05 07:53:53 -07:00
1c3d082b8d
fix calico crds hashes for 3.20.2 ( #8157 )
2021-11-04 10:38:04 -07:00
9d4cdb7b02
Ensure addon-resizer 1.8.11 only effective at arch amd64. ( #8144 )
...
* Ensure addon-resizer 1.8.11 only effective at arch amd64.
k8s.gcr.io/addon-resizer:1.8.11 returns the amd64 image which is not executable at arm64.
Disable addon-resizer when the platform is not amd64.
When metrics-server upgrade and use addon-resizer:2.3, then revert this
commit and `image_arch` will determine the `addon_resizer_image_tag`.
* Add metrics_server_resizer architectures check
2021-11-01 08:21:19 -07:00
b353e062c7
Update default k8s version to 1.22.3
2021-10-29 10:43:44 -07:00
d8f9b9b61f
Update hashes for version v1.20.12/v1.21.6/v1.22.3
2021-10-29 10:43:44 -07:00
0b441ade2c
nginx ingress controller should watch kind:ingress without class ( #8128 )
2021-10-28 11:48:59 -07:00
6f6fad5a16
Calico: add missing verbs in ClusterRole ( #8136 )
2021-10-28 11:11:01 -07:00
465ffa3c9f
Weave: add extra_args for weave-npc ( #8140 )
...
* add weave_npc_extra_args in template
* add defaults weave_npc_extra_args
* add sample for weave_npc_extra_args
2021-10-28 08:58:27 -07:00
539c9e0d99
added hirsute in restart network ( #8134 )
...
restarting network in ubuntu 21.04 fails and checked the restart menu and found that hirsute was missing in the argument : )
2021-10-27 15:19:10 -07:00
649f962ac6
Metrics-server Deployment has incongruencies in resources requests/limits ( #8088 )
...
* fix(metrics-server): update defaults
* fix(metrics-server): typo error
2021-10-27 15:15:11 -07:00
16bdb3fe51
set check_mode to false ( #8133 )
2021-10-26 19:36:37 -07:00
7c3369e1b9
Fixed default DNS min replica for single node clusters ( #8112 )
2021-10-26 16:03:46 -07:00
9eacde212f
Fix quorum check when recovering broken etcd cluster ( #8126 )
2021-10-26 15:23:09 -07:00
331647f4ab
Remove deprecated Ambassador ingress code ( #8086 )
2021-10-26 15:19:09 -07:00
d8d01bf5aa
nginx-ingress: bump to 1.0.4 ( #8114 )
...
* Disable builtin ssl_session_cache solving the problem with OpenSSL consuming memory.
* Print warning only instead of error if no IngressClass permission is available.
2021-10-24 15:34:22 -07:00
d42b7228c2
Convert numbers to string for calico's inventory check. ( #8120 )
...
Fix https://github.com/kubernetes-sigs/kubespray/issues/8119
Signed-off-by: Julio Morimoto <julio@morimoto.net.br>
2021-10-24 11:42:21 -07:00
4db057e9c2
Allow changing metallb default pool name ( #8111 )
2021-10-22 09:38:39 -07:00
ea8e2fc651
containerd: download containerd from upstream instead of using distro specific packages ( #7970 )
...
* Containerd: download containerd from upstream instead of using distro specific packages
split runc download to separate role
make bootstrap-os role deploy container-selinux and seccomp libraries
clean up package manager provided containerd
move variables to docker role that are no longer common with containerd
* Containerd: make molecule testing more relevant
* replace ubuntu18 with ubuntu20
* add centos8 and debian11 to molecule tests
* run kubernetes/preinstall role to ensure relevancy
of test including dependency packages
* CI: adjust test scenarios for downloaded containerd
2021-10-20 08:47:58 -07:00
10c30ea5b1
Add fallback to node drain using --disable-eviction flag ( #8094 )
...
* Add fallback to node drain using --disable-eviction flag
Signed-off-by: Utku Ozdemir <uoz@protonmail.com>
* Move drain fallback tasks to separate file
Signed-off-by: Utku Ozdemir <uoz@protonmail.com>
* Add delegate_facts to fix the drain fallback
Signed-off-by: Utku Ozdemir <uoz@protonmail.com>
* Fix ansible-lint error
Signed-off-by: Utku Ozdemir <uoz@protonmail.com>
* Move drain fallback into block
Signed-off-by: Utku Ozdemir <uoz@protonmail.com>
2021-10-20 00:51:58 -07:00
19d07a4f2e
Fix ownership related to Calico ( #8072 )
...
kube-bench scan outputs warning related to Calico like:
* text: "Ensure that the Container Network Interface file
permissions are set to 644 or more restrictive (Manual)"
* text: "Ensure that the Container Network Interface file
ownership is set to root:root (Manual)"
This fixes these warnings.
2021-10-19 17:35:57 -07:00
6a5b87dda4
netchecker: update images to 1.2.2 from Mirantis ( #8074 )
...
* netchecker: update images to 1.2.2 from Mirantis which is slightly less ancinet than the l23networks images
* Netchecker: use local etcd instead of kubernetes v1beta1 crds which are no longer suported by kube 1.22+
2021-10-19 10:17:04 -07:00
6aac59394e
Rocky Linux support ( #8095 )
...
* Add Rocky as a known OS
* Make sure Rocky includes bootstrap-centos.yml
* Update docs with Rocky Linux
* Rocky Linux wireguard and EPEL
* Rocky Linux in the list of supported distributions
2021-10-19 08:29:04 -07:00
f147163b24
Up dashboard version to 2.4.0 - fix forgotten kubeovn version ( #8085 )
2021-10-15 05:40:54 -07:00
16bf3549c1
Update kube-ovn to 1.8.1
2021-10-14 19:42:54 -07:00
b912dafd7a
Update multus to 3.8.0
2021-10-14 19:42:54 -07:00
8b3481f511
Add molecule tests for roles ( #8080 )
...
* Add molecule tests for bastion-ssh-config
* Add molecule tests for adduser
* Update .gitignore
2021-10-14 18:46:54 -07:00
7019c2685d
Increase cpu limit to prevent throttling ( #8076 )
2021-10-14 11:03:36 -07:00
d18cc38586
Replcae deprecated --delete-local-data in pre-remove/pre-upgrade tasks ( #8081 )
2021-10-14 02:25:19 -07:00
cee481f63d
cert-manager: upgrade to 1.5.4 ( #8069 )
...
* cert-manager: update to 1.5.4
* cert-manager: remove outdated guidelines on creating an initial ClusterIssuer
2021-10-12 09:17:47 -07:00
e4c8c7188e
etcd: deploy container engine if needed ( #7532 )
...
If the etcd cluster is separate and the etcd_deployment_type is "host",
there is no need for a container engine on the etcd nodes
Do not rely on a 'default(true)' filter, but define a proper default in
kubespray-defaults depending on etcd deployment method and if internal
or external etcd is used
2021-10-12 00:31:47 -07:00
6c004efd5f
cert_manager: Remove deprecated ClusterIssuer and its Secret ( #8064 )
2021-10-11 09:40:40 -07:00
1a57780a75
Add kubeadm_join_phases_skip variable ( #8067 )
...
* Add kubeadm_join_phases_skip variable
* Update kubeadm_join_phases_skip comment
Co-authored-by: Cristian Calin <6627509+cristicalin@users.noreply.github.com>
* Add kubeadm_join_phases_skip_default variable to follow the same logic with kubeadm_init_phases_skip
Co-authored-by: Cristian Calin <6627509+cristicalin@users.noreply.github.com>
2021-10-11 09:36:41 -07:00
ce25e4aa21
MetalLB: update to v0.10.3 ( #8071 )
...
Signed-off-by: Maciej Wereski <m.wereski@partner.samsung.com>
2021-10-11 08:54:40 -07:00
ef4044b62f
csi_driver / cinder: implement rescan-on-resize variable via ( #8057 )
...
cinder_csi_rescan_on_resize
2021-10-11 02:14:40 -07:00
c8d9afce1a
Update a bunch of tools ( #8061 )
2021-10-08 09:00:59 -07:00
285983a555
Update docker version to 20.10.9 - CVE fixes ( #8060 )
2021-10-08 08:56:58 -07:00
ab4356aa69
Calico: bump default version to 3.20.2 ( #8058 )
2021-10-07 12:59:33 -07:00
5fcf047191
local-volume-provisioner quay.io -> k8s.gcr.io ( #8054 )
2021-10-06 17:08:41 -07:00
e707f78899
After upgrade, allow cilium to be back before uncordoning ( #7978 )
...
* After upgrade, allow cilium to be back before uncordoning
* add eol
* use kube_config_dir variable
resolves https://github.com/kubernetes-sigs/kubespray/pull/7978#discussion_r721685549
2021-10-05 12:56:58 -07:00
41e0ca3f85
Move kube_feature_gates to kubelet config ( #8048 )
...
to remove deprecation warning:
> Flag --feature-gates has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag.
2021-10-05 06:07:10 -07:00
43958614e3
Fix kubespray flatcar ansible_os_family and ansible_distribution ( #8029 )
...
Closes https://github.com/kubernetes-sigs/kubespray/issues/8028
Signed-off-by: Iago Santos <iago.santos.pardo@adfinis.com>
2021-10-01 09:11:23 -07:00
af04906b51
Ensure apparmor is installed ( #8036 )
...
Kubespray deployment failed when using containerd backend on nodes that apparmor was not installed or previously removed. This PR ensure apparmor is installed by adding it into required_pkgs var.
2021-09-29 23:52:08 -07:00
c7e17688b9
gVisor: bump release to 20210921 version ( #8015 )
...
* gVisor: bump release to 20210921 version
* gVisor: drop support for 20210518.0 version
2021-09-29 11:35:20 -07:00
f5885d05ea
In CentOS 8.x Docker install Step: remove podman when existing ( #8016 )
2021-09-29 06:32:48 -07:00
eee2eb11d8
Update weave template to match source for 2.8.1 ( #8013 )
2021-09-28 09:16:43 -07:00
8d3961edbe
Add metrics_server_resizer option ( #8018 )
...
The addon-resizer container can reduce resource limits of cpu and
memory of metrics-server container in the pod, and that caused
OOMKilled.
In addition, the original metrics-server manifest doesn't contain
the addon-resizer container as [1].
So this adds metrics_server_resizer option to control the addon-resizer
container deployment and the default value is false to make it stable
for most environments.
[1]: 527679e5e8/manifests/base/deployment.yaml
2021-09-28 00:02:42 -07:00
4c5328fd1f
Determine root filesistem device and partition before running growpart ( #8024 )
2021-09-27 23:58:42 -07:00
1472528f6d
check if 'plugins' key exists in calico_cni_config object ( #7717 )
...
* check if 'plugins' key exists in calico_cni_config object
* fix whitespace linting error
* fixed when list indentation
2021-09-27 11:04:20 -07:00
9416c9aa86
Enable stable and edge Docker CLI versions ( #8019 )
2021-09-27 10:44:19 -07:00
da92c7e215
Add proxy for subscription-manager ( #8012 )
...
If using proxy, it is necessary to configure it before running
"subscription-manager status" command.
This adds the step.
2021-09-27 08:47:35 -07:00
d27cf375af
Remove allowPrivilegeEscalation from metrics-server ( #8014 )
...
"allowPrivilegeEscalation: false" blocks deploying metrics-server
on CentOS7. In addition, the original metrics-server manifest doesn't
contain it as [1]. This removes it.
[1]: 527679e5e8/manifests/base/deployment.yaml
2021-09-27 08:43:36 -07:00
432a312a35
Enable stable and edge containerd versions ( #8020 )
2021-09-27 08:11:35 -07:00
3a6230af6b
Kata-Containers: update versions 2.2.0 (default) and 2.1.1 ( #8017 )
...
* Kata-Containers: add 2.2.0 hashes and make default
* Kata-Containers: replace 2.1.0 with bugfix version 2.1.1
* Kata-Containers: move to q35 a more modern VM architecture as 'pc' is removed in 2.2.0
2021-09-27 08:07:35 -07:00
ecd267854b
Move ovn4nvf crd from v1beta1 to v1 ( #8006 )
2021-09-27 01:18:22 -07:00
ac846667b7
Check if openstack application credentials are empty since they always exists ( #8021 )
2021-09-27 01:14:22 -07:00
4bace2491d
Ensure apparmor is installed ( #8011 )
...
Kubespray deployment failed when using containerd backend on nodes that apparmor was not installed or previously removed. This PR ensure apparmor is installed by adding it into required_pkgs var.
2021-09-24 07:55:23 -07:00
22017b7ff0
kube-router 1.3.0 -> 1.3.1 ( #8007 )
2021-09-23 13:42:55 -07:00
88c11b5946
Revert "etcd: enable v2 api only if needed ( #8001 )" ( #8008 )
...
This reverts commit c0e1211abe
2021-09-23 10:43:14 -07:00
843252c968
Use kube_config_dir for kubeconfig ( #7996 )
...
The path of kubeconfig should be configurable, and its default value
is /etc/kubernetes/admin.conf. Most paths of the file are configurable
but some were not. This make those configurable.
2021-09-23 10:19:13 -07:00
ddea79f0f0
Issue 8004: Fix typha prometheus ( #8005 )
...
The typha prometheus settings were in the `volumeMounts` section of the
spec and not in the `envs` section. This was cauing the deployment to
fail because it was looking for a volumeMount.
```
failed: [controller-001.a2.da.dev.logdna.net] (item=calico-typha.yml) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": true, "checksum": "598ac79530749e8e2110793b53fc49ac208e7130", "dest": "/etc/kubernetes/calico-typha.yml", "diff": [], "failed": false, "gid": 0, "group": "root", "invocation": {"module_args": {"_original_basename": "calico-typha.yml.j2", "attributes": null, "backup": false, "checksum": "598ac79530749e8e2110793b53fc49ac208e7130", "content": null, "delimiter": null, "dest": "/etc/kubernetes/calico-typha.yml", "directory_mode": null, "follow": false, "force": true, "group": null, "local_follow": null, "mode": null, "owner": null, "regexp": null, "remote_src": null, "selevel": null, "serole": null, "setype": null, "seuser": null, "src": "/home/core/.ansible/tmp/ansible-tmp-1632349768.56-75434-32452975679246/source", "unsafe_writes": null, "validate": null}}, "item": {"file": "calico-typha.yml", "name": "calico", "type": "typha"}, "md5sum": "53c00ac7f562cf9ecbbfd27899ea066d", "mode": "0644", "owner": "root", "size": 5378, "src": "/home/core/.ansible/tmp/ansible-tmp-1632349768.56-75434-32452975679246/source", "state": "file", "uid": 0}, "msg": "error running kubectl (/opt/bin/kubectl --namespace=kube-system apply --force --filename=/etc/kubernetes/calico-typha.yml) command (rc=1), out='service/calico-typha unchanged\n', err='error: error validating \"/etc/kubernetes/calico-typha.yml\": error validating data: [ValidationError(Deployment.spec.template.spec.containers[0].volumeMounts[2]): unknown field \"value\" in io.k8s.api.core.v1.VolumeMount, ValidationError(Deployment.spec.template.spec.containers[0].volumeMounts[2]): missing required field \"mountPath\" in io.k8s.api.core.v1.VolumeMount, ValidationError(Deployment.spec.template.spec.containers[0].volumeMounts[3]): unknown field \"value\" in io.k8s.api.core.v1.VolumeMount, ValidationError(Deployment.spec.template.spec.containers[0].volumeMounts[3]): missing required field \"mountPath\" in io.k8s.api.core.v1.VolumeMount]; if you choose to ignore these errors, turn validation off with --validate=false\n'"}
```
2021-09-23 08:37:22 -07:00
c0e1211abe
etcd: enable v2 api only if needed ( #8001 )
...
* etcd: enable v2 api only if needed
Only enable v2 API if we have a consumer (flannel)
This reduce the exposed surface for etcd.
* Fix bad group name
2021-09-22 12:36:32 -07:00
c8d7f000c9
Remove k8s hooks for versions prior to 1.20 ( #7998 )
2021-09-22 10:32:01 -07:00
598f178054
Fix cilium operator metrics activation ( #8000 )
2021-09-22 10:00:02 -07:00
5d1b34bdcd
Move min k8s version to 1.20
2021-09-22 09:50:01 -07:00
8efde799e1
Update kubernetes version to 1.22.2
2021-09-22 09:50:01 -07:00
a517a8db01
Drop chech for kubelet_shutdown_grace_period ( #7993 )
...
and kubelet_shutdown_grace_period_critical_pods as ansible cannot do
sane time interval calculations
2021-09-21 18:34:00 -07:00
2211504790
Fix k8s-certs-renew cp path ( #7992 )
...
Signed-off-by: Wang Zhen <lazybetrayer@gmail.com>
2021-09-21 00:36:22 -07:00
fb8662ec19
Calico: update versions 3.20.1, 3.19.3 ( #7984 )
...
* make Calico 3.20.1 the default version
* drop Calico 3.17.x support
2021-09-20 17:40:23 -07:00
6f7911264f
Calico: make calico_min_version check relevant ( #7939 )
...
* Calico: make calico_min_version check relevant
* Calico: only check currently installed version against the oldest supported version by the previous release
2021-09-20 07:58:09 -07:00
ae44aff330
Calico: increase calico node probe timeouts and allow tunning ( #7981 )
2021-09-17 16:08:07 -07:00
b83e8b020a
Fix default version ( #7977 )
2021-09-17 07:31:00 -07:00
30cd91dc6b
Add option to kubeadm upgrade command to control certificates renewal during control plane upgrade ( #7976 )
...
* Add option to kubeadm upgrade command to control certificates renewal during control plane upgrade
* Remove training whitespace
2021-09-17 04:31:00 -07:00
f2fa9c3b31
Update hashes with new versions
2021-09-17 00:39:02 -07:00
30a7dfa4f8
Fix ubuntu16/centos8 CI jobs ( #7972 )
2021-09-16 23:39:01 -07:00
62ab477838
remove kube_proxy_conntrack_max var ( #7971 )
2021-09-15 08:22:31 -07:00
f8a57f7598
Fix iptables missing on Debian 11 if APT::Install-Recommends=0 ( #7964 )
...
On Debian 11, `ipset` just recommend `iptables` so on the system that apt is configured with `APT::Install-Recommends "0";` iptables will not install automatically.
2021-09-14 08:19:09 -07:00
35c928798d
Fix missing file mode (risky-file-permissions) ( #7959 )
...
* Fix missing file mode (risky-file-permissions)
Found this using ansible-lint.
Signed-off-by: Bryan Hundven <bryanhundven@gmail.com>
* Fix another missing file mode (risky-file-permissions)
This one fixes `/etc/crio/config.json`
Signed-off-by: Bryan Hundven <bryanhundven@gmail.com>
2021-09-09 23:35:59 -07:00
83f64a7ff9
Bugfix/cinder csi cloud config template ( #7955 )
...
* Fix invalid condition for username and password inclusion
* Use length filter to test variable conditions
2021-09-09 10:04:11 -07:00
60853fa682
Update kube-ovn to 1.7.2
2021-09-09 08:14:10 -07:00
b66356be65
Update cilium to 1.9.10
2021-09-09 08:14:10 -07:00
zhengtianbao
EDGsheryl
Samuel Liu
Ajarmar
Cristian Calin
Max Gautier
Hyojun Jeon
Kenichi Omichi
Álvaro Torres Cogollo
Emin AKTAS
Antoine Gatineau
Pasquale Toscano
Marcus Fenner
Florian Ruynat
Sergey
Krystian Młynek
brainfair
vatech_seungjin
irizzant
Gheorghe Isak
Sébastien Masset
Mohamed Zaian
Julio H Morimoto
Damian Szeluga
Utku Özdemir
Omar Aloraini
efrikin
Olivier Levitt
rtsp
Necatican Yıldırım
Maciej Wereski
Rene Luria
Maxim Pogozhiy
Rene Luria
Ilya Margolin
Iago Santos
Peter Pan
Frank Filippone
Marcos Lorenzo
David Louks
Victor Morales
Hugo Blom
Eric Lake
Max Gautier
Léopold Jacquot
Wang Zhen
Hari Hud
Bryan Hundven
jhchong92