2020-06-19 14:52:56 +08:00
<!DOCTYPE HTML>
< html lang = "zh-hans" >
< head >
< meta charset = "UTF-8" >
< meta content = "text/html; charset=utf-8" http-equiv = "Content-Type" >
< title > 运行支持 Kubernetes 原生调度的 Spark 程序 · Kubernetes Handbook - Kubernetes中文指南/云原生应用架构实践手册 by Jimmy Song(宋净超)< / title >
< meta http-equiv = "X-UA-Compatible" content = "IE=edge" / >
< meta name = "description" content = "" >
< meta name = "generator" content = "GitBook 3.2.3" >
< meta name = "author" content = "Jimmy Song（ ） >
< link rel = "stylesheet" href = "../gitbook/style.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-splitter/splitter.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-page-toc-button/plugin.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-image-captions/image-captions.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-back-to-top-button/plugin.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-search-plus/search.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-tbfed-pagefooter/footer.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-prism/prism-ghcolors.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-lightbox/css/lightbox.min.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-alerts/style.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-fontsettings/website.css" >
< meta name = "HandheldFriendly" content = "true" / >
< meta name = "viewport" content = "width=device-width, initial-scale=1, user-scalable=no" >
< meta name = "apple-mobile-web-app-capable" content = "yes" >
< meta name = "apple-mobile-web-app-status-bar-style" content = "black" >
< link rel = "apple-touch-icon-precomposed" sizes = "152x152" href = "../gitbook/images/apple-touch-icon-precomposed-152.png" >
< link rel = "shortcut icon" href = "../gitbook/images/favicon.ico" type = "image/x-icon" >
< link rel = "next" href = "serverless.html" / >
< link rel = "prev" href = "spark-standalone-on-kubernetes.html" / >
< link rel = "shortcut icon" href = '../favicon.ico' type = "image/x-icon" >
< link rel = "bookmark" href = '../favicon.ico' type = "image/x-icon" >
< style >
@media only screen and (max-width: 640px) {
.book-header .hidden-mobile {
display: none;
}
}
< / style >
< script >
window["gitbook-plugin-github-buttons"] = {"repo":"rootsongjc/kubernetes-handbook","types":["star"],"size":"small"};
< / script >
< / head >
< body >
< div class = "book" >
< div class = "book-summary" >
< div id = "book-search-input" role = "search" >
< input type = "text" placeholder = "输入并搜索" / >
< / div >
< nav role = "navigation" >
< ul class = "summary" >
< li >
< a href = "https://jimmysong.io" target = "_blank" class = "custom-link" > 回到主页< / a >
< / li >
< li >
< a href = "https://jimmysong.io/awesome-cloud-native" target = "_blank" class = "custom-link" > Awesome Cloud Native< / a >
< / li >
< li >
< a href = "https://cloudnative.to" target = "_blank" class = "custom-link" > 云原生社区< / a >
< / li >
< li >
< a href = "https://cloudnativeindustryalliance.github.io/whitepaper2020/" target = "_blank" class = "custom-link" > 中国云原生发展白皮书2020< / a >
< / li >
< li >
< a href = "https://jimmysong.io/guide-to-cloud-native-app/" target = "_blank" class = "custom-link" > 云原生应用白皮书< / a >
< / li >
< li class = "divider" > < / li >
< li class = "header" > 前言< / li >
< li class = "chapter " data-level = "1.1" data-path = "../" >
< a href = "../" >
< b > 1.1.< / b >
序言
< / a >
< / li >
< li class = "header" > 云原生< / li >
< li class = "chapter " data-level = "2.1" data-path = "../cloud-native/cloud-native-definition.html" >
< a href = "../cloud-native/cloud-native-definition.html" >
< b > 2.1.< / b >
云原生（ ）
< / a >
< / li >
< li class = "chapter " data-level = "2.2" data-path = "../cloud-native/cloud-native-philosophy.html" >
< a href = "../cloud-native/cloud-native-philosophy.html" >
< b > 2.2.< / b >
云原生的设计哲学
< / a >
< / li >
< li class = "chapter " data-level = "2.3" data-path = "../cloud-native/play-with-kubernetes.html" >
< a href = "../cloud-native/play-with-kubernetes.html" >
< b > 2.3.< / b >
Play with Kubernetes
< / a >
< / li >
< li class = "chapter " data-level = "2.4" data-path = "../cloud-native/cloud-native-local-quick-start.html" >
< a href = "../cloud-native/cloud-native-local-quick-start.html" >
< b > 2.4.< / b >
快速部署一个云原生本地实验环境
< / a >
< / li >
< li class = "chapter " data-level = "2.5" data-path = "../cloud-native/setup-kubernetes-with-rancher-and-aliyun.html" >
< a href = "../cloud-native/setup-kubernetes-with-rancher-and-aliyun.html" >
< b > 2.5.< / b >
使用 Rancher 在阿里云上部署 Kubenretes 集群
< / a >
< / li >
< li class = "chapter " data-level = "2.6" data-path = "../cloud-native/kubernetes-and-cloud-native-app-overview.html" >
< a href = "../cloud-native/kubernetes-and-cloud-native-app-overview.html" >
< b > 2.6.< / b >
Kubernetes 与云原生应用概览
< / a >
< / li >
< li class = "chapter " data-level = "2.7" data-path = "../cloud-native/from-kubernetes-to-cloud-native.html" >
< a href = "../cloud-native/from-kubernetes-to-cloud-native.html" >
< b > 2.7.< / b >
云原生应用之路 —— 从 Kubernetes 到 Cloud Native
< / a >
< / li >
< li class = "chapter " data-level = "2.8" data-path = "../cloud-native/cloud-native-programming-languages.html" >
< a href = "../cloud-native/cloud-native-programming-languages.html" >
< b > 2.8.< / b >
云原生编程语言
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "2.8.1" data-path = "../cloud-native/cloud-native-programming-language-ballerina.html" >
< a href = "../cloud-native/cloud-native-programming-language-ballerina.html" >
< b > 2.8.1.< / b >
云原生编程语言 Ballerina
< / a >
< / li >
< li class = "chapter " data-level = "2.8.2" data-path = "../cloud-native/cloud-native-programming-language-pulumi.html" >
< a href = "../cloud-native/cloud-native-programming-language-pulumi.html" >
< b > 2.8.2.< / b >
云原生编程语言 Pulumi
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "2.9" data-path = "../cloud-native/the-future-of-cloud-native.html" >
< a href = "../cloud-native/the-future-of-cloud-native.html" >
< b > 2.9.< / b >
云原生的未来
< / a >
< / li >
< li class = "chapter " data-level = "2.10" data-path = "../cloud-native/define-cloud-native-app.html" >
< a href = "../cloud-native/define-cloud-native-app.html" >
< b > 2.10.< / b >
定义云原生应用
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "2.10.1" data-path = "../cloud-native/workload.html" >
< a href = "../cloud-native/workload.html" >
< b > 2.10.1.< / b >
Workload
< / a >
< / li >
< li class = "chapter " data-level = "2.10.2" data-path = "../cloud-native/component.html" >
< a href = "../cloud-native/component.html" >
< b > 2.10.2.< / b >
Component
< / a >
< / li >
< li class = "chapter " data-level = "2.10.3" data-path = "../cloud-native/trait.html" >
< a href = "../cloud-native/trait.html" >
< b > 2.10.3.< / b >
Trait
< / a >
< / li >
< li class = "chapter " data-level = "2.10.4" data-path = "../cloud-native/application-scope.html" >
< a href = "../cloud-native/application-scope.html" >
< b > 2.10.4.< / b >
Application Scope
< / a >
< / li >
< li class = "chapter " data-level = "2.10.5" data-path = "../cloud-native/application-configuration.html" >
< a href = "../cloud-native/application-configuration.html" >
< b > 2.10.5.< / b >
Application Configuration
< / a >
< / li >
< / ul >
< / li >
< li class = "header" > 概念与原理< / li >
< li class = "chapter " data-level = "3.1" data-path = "../concepts/" >
< a href = "../concepts/" >
< b > 3.1.< / b >
Kubernetes 架构
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.1.1" data-path = "../concepts/concepts.html" >
< a href = "../concepts/concepts.html" >
< b > 3.1.1.< / b >
设计理念
< / a >
< / li >
< li class = "chapter " data-level = "3.1.2" data-path = "../concepts/etcd.html" >
< a href = "../concepts/etcd.html" >
< b > 3.1.2.< / b >
Etcd 解析
< / a >
< / li >
< li class = "chapter " data-level = "3.1.3" data-path = "../concepts/open-interfaces.html" >
< a href = "../concepts/open-interfaces.html" >
< b > 3.1.3.< / b >
开放接口
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.1.3.1" data-path = "../concepts/cri.html" >
< a href = "../concepts/cri.html" >
< b > 3.1.3.1.< / b >
CRI - Container Runtime Interface（ ）
< / a >
< / li >
< li class = "chapter " data-level = "3.1.3.2" data-path = "../concepts/cni.html" >
< a href = "../concepts/cni.html" >
< b > 3.1.3.2.< / b >
CNI - Container Network Interface（ ）
< / a >
< / li >
< li class = "chapter " data-level = "3.1.3.3" data-path = "../concepts/csi.html" >
< a href = "../concepts/csi.html" >
< b > 3.1.3.3.< / b >
CSI - Container Storage Interface（ ）
< / a >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.2" data-path = "../concepts/networking.html" >
< a href = "../concepts/networking.html" >
< b > 3.2.< / b >
Kubernetes 中的网络
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.2.1" data-path = "../concepts/flannel.html" >
< a href = "../concepts/flannel.html" >
< b > 3.2.1.< / b >
Kubernetes 中的网络解析 —— 以 flannel 为例
< / a >
< / li >
< li class = "chapter " data-level = "3.2.2" data-path = "../concepts/calico.html" >
< a href = "../concepts/calico.html" >
< b > 3.2.2.< / b >
Kubernetes 中的网络解析 —— 以 calico 为例
< / a >
< / li >
< li class = "chapter " data-level = "3.2.3" data-path = "../concepts/cilium.html" >
< a href = "../concepts/cilium.html" >
< b > 3.2.3.< / b >
具备 API 感知的网络和安全性管理开源软件 Cilium
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.2.3.1" data-path = "../concepts/cilium-concepts.html" >
< a href = "../concepts/cilium-concepts.html" >
< b > 3.2.3.1.< / b >
Cilium 架构设计与概念解析
< / a >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.3" data-path = "../concepts/objects.html" >
< a href = "../concepts/objects.html" >
< b > 3.3.< / b >
资源对象与基本概念解析
< / a >
< / li >
< li class = "chapter " data-level = "3.4" data-path = "../concepts/pod-state-and-lifecycle.html" >
< a href = "../concepts/pod-state-and-lifecycle.html" >
< b > 3.4.< / b >
Pod 状态与生命周期管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.4.1" data-path = "../concepts/pod-overview.html" >
< a href = "../concepts/pod-overview.html" >
< b > 3.4.1.< / b >
Pod 概览
< / a >
< / li >
< li class = "chapter " data-level = "3.4.2" data-path = "../concepts/pod.html" >
< a href = "../concepts/pod.html" >
< b > 3.4.2.< / b >
Pod 解析
< / a >
< / li >
< li class = "chapter " data-level = "3.4.3" data-path = "../concepts/init-containers.html" >
< a href = "../concepts/init-containers.html" >
< b > 3.4.3.< / b >
Init 容器
< / a >
< / li >
< li class = "chapter " data-level = "3.4.4" data-path = "../concepts/pause-container.html" >
< a href = "../concepts/pause-container.html" >
< b > 3.4.4.< / b >
Pause 容器
< / a >
< / li >
< li class = "chapter " data-level = "3.4.5" data-path = "../concepts/pod-security-policy.html" >
< a href = "../concepts/pod-security-policy.html" >
< b > 3.4.5.< / b >
Pod 安全策略
< / a >
< / li >
< li class = "chapter " data-level = "3.4.6" data-path = "../concepts/pod-lifecycle.html" >
< a href = "../concepts/pod-lifecycle.html" >
< b > 3.4.6.< / b >
Pod 的生命周期
< / a >
< / li >
< li class = "chapter " data-level = "3.4.7" data-path = "../concepts/pod-hook.html" >
< a href = "../concepts/pod-hook.html" >
< b > 3.4.7.< / b >
Pod Hook
< / a >
< / li >
< li class = "chapter " data-level = "3.4.8" data-path = "../concepts/pod-preset.html" >
< a href = "../concepts/pod-preset.html" >
< b > 3.4.8.< / b >
Pod Preset
< / a >
< / li >
< li class = "chapter " data-level = "3.4.9" data-path = "../concepts/pod-disruption-budget.html" >
< a href = "../concepts/pod-disruption-budget.html" >
< b > 3.4.9.< / b >
Pod 中断与 PDB（
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.5" data-path = "../concepts/cluster.html" >
< a href = "../concepts/cluster.html" >
< b > 3.5.< / b >
集群资源管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.5.1" data-path = "../concepts/node.html" >
< a href = "../concepts/node.html" >
< b > 3.5.1.< / b >
Node
< / a >
< / li >
< li class = "chapter " data-level = "3.5.2" data-path = "../concepts/namespace.html" >
< a href = "../concepts/namespace.html" >
< b > 3.5.2.< / b >
Namespace
< / a >
< / li >
< li class = "chapter " data-level = "3.5.3" data-path = "../concepts/label.html" >
< a href = "../concepts/label.html" >
< b > 3.5.3.< / b >
Label
< / a >
< / li >
< li class = "chapter " data-level = "3.5.4" data-path = "../concepts/annotation.html" >
< a href = "../concepts/annotation.html" >
< b > 3.5.4.< / b >
Annotation
< / a >
< / li >
< li class = "chapter " data-level = "3.5.5" data-path = "../concepts/taint-and-toleration.html" >
< a href = "../concepts/taint-and-toleration.html" >
< b > 3.5.5.< / b >
Taint 和 Toleration（ ）
< / a >
< / li >
< li class = "chapter " data-level = "3.5.6" data-path = "../concepts/garbage-collection.html" >
< a href = "../concepts/garbage-collection.html" >
< b > 3.5.6.< / b >
垃圾收集
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.6" data-path = "../concepts/controllers.html" >
< a href = "../concepts/controllers.html" >
< b > 3.6.< / b >
控制器
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.6.1" data-path = "../concepts/deployment.html" >
< a href = "../concepts/deployment.html" >
< b > 3.6.1.< / b >
Deployment
< / a >
< / li >
< li class = "chapter " data-level = "3.6.2" data-path = "../concepts/statefulset.html" >
< a href = "../concepts/statefulset.html" >
< b > 3.6.2.< / b >
StatefulSet
< / a >
< / li >
< li class = "chapter " data-level = "3.6.3" data-path = "../concepts/daemonset.html" >
< a href = "../concepts/daemonset.html" >
< b > 3.6.3.< / b >
DaemonSet
< / a >
< / li >
< li class = "chapter " data-level = "3.6.4" data-path = "../concepts/replicaset.html" >
< a href = "../concepts/replicaset.html" >
< b > 3.6.4.< / b >
ReplicationController 和 ReplicaSet
< / a >
< / li >
< li class = "chapter " data-level = "3.6.5" data-path = "../concepts/job.html" >
< a href = "../concepts/job.html" >
< b > 3.6.5.< / b >
Job
< / a >
< / li >
< li class = "chapter " data-level = "3.6.6" data-path = "../concepts/cronjob.html" >
< a href = "../concepts/cronjob.html" >
< b > 3.6.6.< / b >
CronJob
< / a >
< / li >
< li class = "chapter " data-level = "3.6.7" data-path = "../concepts/horizontal-pod-autoscaling.html" >
< a href = "../concepts/horizontal-pod-autoscaling.html" >
< b > 3.6.7.< / b >
Horizontal Pod Autoscaling
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.6.7.1" data-path = "../concepts/custom-metrics-hpa.html" >
< a href = "../concepts/custom-metrics-hpa.html" >
< b > 3.6.7.1.< / b >
自定义指标 HPA
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.6.8" data-path = "../concepts/admission-controller.html" >
< a href = "../concepts/admission-controller.html" >
< b > 3.6.8.< / b >
准入控制器（ ）
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.7" data-path = "../concepts/service-discovery.html" >
< a href = "../concepts/service-discovery.html" >
< b > 3.7.< / b >
服务发现
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.7.1" data-path = "../concepts/service.html" >
< a href = "../concepts/service.html" >
< b > 3.7.1.< / b >
Service
< / a >
< / li >
< li class = "chapter " data-level = "3.7.2" data-path = "../concepts/ingress.html" >
< a href = "../concepts/ingress.html" >
< b > 3.7.2.< / b >
Ingress
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.7.2.1" data-path = "../concepts/traefik-ingress-controller.html" >
< a href = "../concepts/traefik-ingress-controller.html" >
< b > 3.7.2.1.< / b >
Traefik Ingress Controller
< / a >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.8" data-path = "../concepts/authentication-and-permission.html" >
< a href = "../concepts/authentication-and-permission.html" >
< b > 3.8.< / b >
身份与权限控制
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.8.1" data-path = "../concepts/serviceaccount.html" >
< a href = "../concepts/serviceaccount.html" >
< b > 3.8.1.< / b >
ServiceAccount
< / a >
< / li >
< li class = "chapter " data-level = "3.8.2" data-path = "../concepts/rbac.html" >
< a href = "../concepts/rbac.html" >
< b > 3.8.2.< / b >
RBAC—— 基于角色的访问控制
< / a >
< / li >
< li class = "chapter " data-level = "3.8.3" data-path = "../concepts/network-policy.html" >
< a href = "../concepts/network-policy.html" >
< b > 3.8.3.< / b >
NetworkPolicy
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.9" data-path = "../concepts/storage.html" >
< a href = "../concepts/storage.html" >
< b > 3.9.< / b >
存储
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.9.1" data-path = "../concepts/secret.html" >
< a href = "../concepts/secret.html" >
< b > 3.9.1.< / b >
Secret
< / a >
< / li >
< li class = "chapter " data-level = "3.9.2" data-path = "../concepts/configmap.html" >
< a href = "../concepts/configmap.html" >
< b > 3.9.2.< / b >
ConfigMap
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.9.2.1" data-path = "../concepts/configmap-hot-update.html" >
< a href = "../concepts/configmap-hot-update.html" >
< b > 3.9.2.1.< / b >
ConfigMap 的热更新
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.9.3" data-path = "../concepts/volume.html" >
< a href = "../concepts/volume.html" >
< b > 3.9.3.< / b >
Volume
< / a >
< / li >
< li class = "chapter " data-level = "3.9.4" data-path = "../concepts/persistent-volume.html" >
< a href = "../concepts/persistent-volume.html" >
< b > 3.9.4.< / b >
Persistent Volume（ ）
< / a >
< / li >
< li class = "chapter " data-level = "3.9.5" data-path = "../concepts/storageclass.html" >
< a href = "../concepts/storageclass.html" >
< b > 3.9.5.< / b >
Storage Class
< / a >
< / li >
< li class = "chapter " data-level = "3.9.6" data-path = "../concepts/local-persistent-storage.html" >
< a href = "../concepts/local-persistent-storage.html" >
< b > 3.9.6.< / b >
本地持久化存储
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.10" data-path = "../concepts/extension.html" >
< a href = "../concepts/extension.html" >
< b > 3.10.< / b >
集群扩展
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.10.1" data-path = "../concepts/custom-resource.html" >
< a href = "../concepts/custom-resource.html" >
< b > 3.10.1.< / b >
使用自定义资源扩展 API
< / a >
< / li >
< li class = "chapter " data-level = "3.10.2" data-path = "../concepts/crd.html" >
< a href = "../concepts/crd.html" >
< b > 3.10.2.< / b >
使用 CRD 扩展 Kubernetes API
< / a >
< / li >
< li class = "chapter " data-level = "3.10.3" data-path = "../concepts/aggregated-api-server.html" >
< a href = "../concepts/aggregated-api-server.html" >
< b > 3.10.3.< / b >
Aggregated API Server
< / a >
< / li >
< li class = "chapter " data-level = "3.10.4" data-path = "../concepts/apiservice.html" >
< a href = "../concepts/apiservice.html" >
< b > 3.10.4.< / b >
APIService
< / a >
< / li >
< li class = "chapter " data-level = "3.10.5" data-path = "../concepts/service-catalog.html" >
< a href = "../concepts/service-catalog.html" >
< b > 3.10.5.< / b >
Service Catalog
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "3.11" data-path = "../concepts/scheduling.html" >
< a href = "../concepts/scheduling.html" >
< b > 3.11.< / b >
资源调度
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "3.11.1" data-path = "../concepts/qos.html" >
< a href = "../concepts/qos.html" >
< b > 3.11.1.< / b >
QoS（ ）
< / a >
< / li >
< / ul >
< / li >
< li class = "header" > 用户指南< / li >
< li class = "chapter " data-level = "4.1" data-path = "../guide/" >
< a href = "../guide/" >
< b > 4.1.< / b >
用户指南
< / a >
< / li >
< li class = "chapter " data-level = "4.2" data-path = "../guide/resource-configuration.html" >
< a href = "../guide/resource-configuration.html" >
< b > 4.2.< / b >
资源对象配置
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "4.2.1" data-path = "../guide/configure-liveness-readiness-probes.html" >
< a href = "../guide/configure-liveness-readiness-probes.html" >
< b > 4.2.1.< / b >
配置 Pod 的 liveness 和 readiness 探针
< / a >
< / li >
< li class = "chapter " data-level = "4.2.2" data-path = "../guide/configure-pod-service-account.html" >
< a href = "../guide/configure-pod-service-account.html" >
< b > 4.2.2.< / b >
配置 Pod 的 Service Account
< / a >
< / li >
< li class = "chapter " data-level = "4.2.3" data-path = "../guide/secret-configuration.html" >
< a href = "../guide/secret-configuration.html" >
< b > 4.2.3.< / b >
Secret 配置
< / a >
< / li >
< li class = "chapter " data-level = "4.2.4" data-path = "../guide/resource-quota-management.html" >
< a href = "../guide/resource-quota-management.html" >
< b > 4.2.4.< / b >
管理 namespace 中的资源配额
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "4.3" data-path = "../guide/command-usage.html" >
< a href = "../guide/command-usage.html" >
< b > 4.3.< / b >
命令使用
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "4.3.1" data-path = "../guide/docker-cli-to-kubectl.html" >
< a href = "../guide/docker-cli-to-kubectl.html" >
< b > 4.3.1.< / b >
Docker 用户过渡到 kubectl 命令行指南
< / a >
< / li >
< li class = "chapter " data-level = "4.3.2" data-path = "../guide/using-kubectl.html" >
< a href = "../guide/using-kubectl.html" >
< b > 4.3.2.< / b >
kubectl 命令概览
< / a >
< / li >
< li class = "chapter " data-level = "4.3.3" data-path = "../guide/kubectl-cheatsheet.html" >
< a href = "../guide/kubectl-cheatsheet.html" >
< b > 4.3.3.< / b >
kubectl 命令技巧大全
< / a >
< / li >
< li class = "chapter " data-level = "4.3.4" data-path = "../guide/using-etcdctl-to-access-kubernetes-data.html" >
< a href = "../guide/using-etcdctl-to-access-kubernetes-data.html" >
< b > 4.3.4.< / b >
使用 etcdctl 访问 kubernetes 数据
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "4.4" data-path = "../guide/cluster-security-management.html" >
< a href = "../guide/cluster-security-management.html" >
< b > 4.4.< / b >
集群安全性管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "4.4.1" data-path = "../guide/managing-tls-in-a-cluster.html" >
< a href = "../guide/managing-tls-in-a-cluster.html" >
< b > 4.4.1.< / b >
管理集群中的 TLS
< / a >
< / li >
< li class = "chapter " data-level = "4.4.2" data-path = "../guide/kubelet-authentication-authorization.html" >
< a href = "../guide/kubelet-authentication-authorization.html" >
< b > 4.4.2.< / b >
kubelet 的认证授权
< / a >
< / li >
< li class = "chapter " data-level = "4.4.3" data-path = "../guide/tls-bootstrapping.html" >
< a href = "../guide/tls-bootstrapping.html" >
< b > 4.4.3.< / b >
TLS bootstrap
< / a >
< / li >
< li class = "chapter " data-level = "4.4.4" data-path = "../guide/kubectl-user-authentication-authorization.html" >
< a href = "../guide/kubectl-user-authentication-authorization.html" >
< b > 4.4.4.< / b >
创建用户认证授权的 kubeconfig 文件
< / a >
< / li >
< li class = "chapter " data-level = "4.4.5" data-path = "../guide/ip-masq-agent.html" >
< a href = "../guide/ip-masq-agent.html" >
< b > 4.4.5.< / b >
IP 伪装代理
< / a >
< / li >
< li class = "chapter " data-level = "4.4.6" data-path = "../guide/auth-with-kubeconfig-or-token.html" >
< a href = "../guide/auth-with-kubeconfig-or-token.html" >
< b > 4.4.6.< / b >
使用 kubeconfig 或 token 进行用户身份认证
< / a >
< / li >
< li class = "chapter " data-level = "4.4.7" data-path = "../guide/authentication.html" >
< a href = "../guide/authentication.html" >
< b > 4.4.7.< / b >
Kubernetes 中的用户与身份认证授权
< / a >
< / li >
< li class = "chapter " data-level = "4.4.8" data-path = "../guide/kubernetes-security-best-practice.html" >
< a href = "../guide/kubernetes-security-best-practice.html" >
< b > 4.4.8.< / b >
Kubernetes 集群安全性配置最佳实践
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "4.5" data-path = "../guide/access-kubernetes-cluster.html" >
< a href = "../guide/access-kubernetes-cluster.html" >
< b > 4.5.< / b >
访问 Kubernetes 集群
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "4.5.1" data-path = "../guide/access-cluster.html" >
< a href = "../guide/access-cluster.html" >
< b > 4.5.1.< / b >
访问集群
< / a >
< / li >
< li class = "chapter " data-level = "4.5.2" data-path = "../guide/authenticate-across-clusters-kubeconfig.html" >
< a href = "../guide/authenticate-across-clusters-kubeconfig.html" >
< b > 4.5.2.< / b >
使用 kubeconfig 文件配置跨集群认证
< / a >
< / li >
< li class = "chapter " data-level = "4.5.3" data-path = "../guide/connecting-to-applications-port-forward.html" >
< a href = "../guide/connecting-to-applications-port-forward.html" >
< b > 4.5.3.< / b >
通过端口转发访问集群中的应用程序
< / a >
< / li >
< li class = "chapter " data-level = "4.5.4" data-path = "../guide/service-access-application-cluster.html" >
< a href = "../guide/service-access-application-cluster.html" >
< b > 4.5.4.< / b >
使用 service 访问群集中的应用程序
< / a >
< / li >
< li class = "chapter " data-level = "4.5.5" data-path = "../guide/accessing-kubernetes-pods-from-outside-of-the-cluster.html" >
< a href = "../guide/accessing-kubernetes-pods-from-outside-of-the-cluster.html" >
< b > 4.5.5.< / b >
从外部访问 Kubernetes 中的 Pod
< / a >
< / li >
< li class = "chapter " data-level = "4.5.6" data-path = "../guide/cabin-mobile-dashboard-for-kubernetes.html" >
< a href = "../guide/cabin-mobile-dashboard-for-kubernetes.html" >
< b > 4.5.6.< / b >
Cabin - Kubernetes 手机客户端
< / a >
< / li >
< li class = "chapter " data-level = "4.5.7" data-path = "../guide/kubernetes-desktop-client.html" >
< a href = "../guide/kubernetes-desktop-client.html" >
< b > 4.5.7.< / b >
Kubernetic - Kubernetes 桌面客户端
< / a >
< / li >
< li class = "chapter " data-level = "4.5.8" data-path = "../guide/kubernator-kubernetes-ui.html" >
< a href = "../guide/kubernator-kubernetes-ui.html" >
< b > 4.5.8.< / b >
Kubernator - 更底层的 Kubernetes UI
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "4.6" data-path = "../guide/application-development-deployment-flow.html" >
< a href = "../guide/application-development-deployment-flow.html" >
< b > 4.6.< / b >
在 Kubernetes 中开发部署应用
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "4.6.1" data-path = "../guide/deploy-applications-in-kubernetes.html" >
< a href = "../guide/deploy-applications-in-kubernetes.html" >
< b > 4.6.1.< / b >
适用于 kubernetes 的应用开发部署流程
< / a >
< / li >
< li class = "chapter " data-level = "4.6.2" data-path = "../guide/migrating-hadoop-yarn-to-kubernetes.html" >
< a href = "../guide/migrating-hadoop-yarn-to-kubernetes.html" >
< b > 4.6.2.< / b >
迁移传统应用到 Kubernetes 中 —— 以 Hadoop YARN 为例
< / a >
< / li >
< li class = "chapter " data-level = "4.6.3" data-path = "../guide/using-statefulset.html" >
< a href = "../guide/using-statefulset.html" >
< b > 4.6.3.< / b >
使用 StatefulSet 部署用状态应用
< / a >
< / li >
< / ul >
< / li >
< li class = "header" > 最佳实践< / li >
< li class = "chapter " data-level = "5.1" data-path = "../practice/" >
< a href = "../practice/" >
< b > 5.1.< / b >
最佳实践概览
< / a >
< / li >
< li class = "chapter " data-level = "5.2" data-path = "../practice/install-kubernetes-on-centos.html" >
< a href = "../practice/install-kubernetes-on-centos.html" >
< b > 5.2.< / b >
在 CentOS 上部署 Kubernetes 集群
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.2.1" data-path = "../practice/create-tls-and-secret-key.html" >
< a href = "../practice/create-tls-and-secret-key.html" >
< b > 5.2.1.< / b >
创建 TLS 证书和秘钥
< / a >
< / li >
< li class = "chapter " data-level = "5.2.2" data-path = "../practice/create-kubeconfig.html" >
< a href = "../practice/create-kubeconfig.html" >
< b > 5.2.2.< / b >
创建 kubeconfig 文件
< / a >
< / li >
< li class = "chapter " data-level = "5.2.3" data-path = "../practice/etcd-cluster-installation.html" >
< a href = "../practice/etcd-cluster-installation.html" >
< b > 5.2.3.< / b >
创建高可用 etcd 集群
< / a >
< / li >
< li class = "chapter " data-level = "5.2.4" data-path = "../practice/kubectl-installation.html" >
< a href = "../practice/kubectl-installation.html" >
< b > 5.2.4.< / b >
安装 kubectl 命令行工具
< / a >
< / li >
< li class = "chapter " data-level = "5.2.5" data-path = "../practice/master-installation.html" >
< a href = "../practice/master-installation.html" >
< b > 5.2.5.< / b >
部署 master 节点
< / a >
< / li >
< li class = "chapter " data-level = "5.2.6" data-path = "../practice/flannel-installation.html" >
< a href = "../practice/flannel-installation.html" >
< b > 5.2.6.< / b >
安装 flannel 网络插件
< / a >
< / li >
< li class = "chapter " data-level = "5.2.7" data-path = "../practice/node-installation.html" >
< a href = "../practice/node-installation.html" >
< b > 5.2.7.< / b >
部署 node 节点
< / a >
< / li >
< li class = "chapter " data-level = "5.2.8" data-path = "../practice/kubedns-addon-installation.html" >
< a href = "../practice/kubedns-addon-installation.html" >
< b > 5.2.8.< / b >
安装 kubedns 插件
< / a >
< / li >
< li class = "chapter " data-level = "5.2.9" data-path = "../practice/dashboard-addon-installation.html" >
< a href = "../practice/dashboard-addon-installation.html" >
< b > 5.2.9.< / b >
安装 dashboard 插件
< / a >
< / li >
< li class = "chapter " data-level = "5.2.10" data-path = "../practice/heapster-addon-installation.html" >
< a href = "../practice/heapster-addon-installation.html" >
< b > 5.2.10.< / b >
安装 heapster 插件
< / a >
< / li >
< li class = "chapter " data-level = "5.2.11" data-path = "../practice/efk-addon-installation.html" >
< a href = "../practice/efk-addon-installation.html" >
< b > 5.2.11.< / b >
安装 EFK 插件
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.3" data-path = "../practice/install-kubernetes-with-kubeadm.html" >
< a href = "../practice/install-kubernetes-with-kubeadm.html" >
< b > 5.3.< / b >
生产级的 Kubernetes 简化管理工具 kubeadm
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.3.1" data-path = "../practice/install-kubernetes-on-ubuntu-server-16.04-with-kubeadm.html" >
< a href = "../practice/install-kubernetes-on-ubuntu-server-16.04-with-kubeadm.html" >
< b > 5.3.1.< / b >
使用 kubeadm 在 Ubuntu Server 16.04 上快速构建测试集群
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.4" data-path = "../practice/service-discovery-and-loadbalancing.html" >
< a href = "../practice/service-discovery-and-loadbalancing.html" >
< b > 5.4.< / b >
服务发现与负载均衡
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.4.1" data-path = "../practice/traefik-ingress-installation.html" >
< a href = "../practice/traefik-ingress-installation.html" >
< b > 5.4.1.< / b >
安装 Traefik ingress
< / a >
< / li >
< li class = "chapter " data-level = "5.4.2" data-path = "../practice/distributed-load-test.html" >
< a href = "../practice/distributed-load-test.html" >
< b > 5.4.2.< / b >
分布式负载测试
< / a >
< / li >
< li class = "chapter " data-level = "5.4.3" data-path = "../practice/network-and-cluster-perfermance-test.html" >
< a href = "../practice/network-and-cluster-perfermance-test.html" >
< b > 5.4.3.< / b >
网络和集群性能测试
< / a >
< / li >
< li class = "chapter " data-level = "5.4.4" data-path = "../practice/edge-node-configuration.html" >
< a href = "../practice/edge-node-configuration.html" >
< b > 5.4.4.< / b >
边缘节点配置
< / a >
< / li >
< li class = "chapter " data-level = "5.4.5" data-path = "../practice/nginx-ingress-installation.html" >
< a href = "../practice/nginx-ingress-installation.html" >
< b > 5.4.5.< / b >
安装 Nginx ingress
< / a >
< / li >
< li class = "chapter " data-level = "5.4.6" data-path = "../practice/dns-installation.html" >
< a href = "../practice/dns-installation.html" >
< b > 5.4.6.< / b >
安装配置 DNS
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.4.6.1" data-path = "../practice/configuring-dns.html" >
< a href = "../practice/configuring-dns.html" >
< b > 5.4.6.1.< / b >
安装配置 Kube-dns
< / a >
< / li >
< li class = "chapter " data-level = "5.4.6.2" data-path = "../practice/coredns.html" >
< a href = "../practice/coredns.html" >
< b > 5.4.6.2.< / b >
安装配置 CoreDNS
< / a >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.5" data-path = "../practice/operation.html" >
< a href = "../practice/operation.html" >
< b > 5.5.< / b >
运维管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.5.1" data-path = "../practice/master-ha.html" >
< a href = "../practice/master-ha.html" >
< b > 5.5.1.< / b >
Master 节点高可用
< / a >
< / li >
< li class = "chapter " data-level = "5.5.2" data-path = "../practice/service-rolling-update.html" >
< a href = "../practice/service-rolling-update.html" >
< b > 5.5.2.< / b >
服务滚动升级
< / a >
< / li >
< li class = "chapter " data-level = "5.5.3" data-path = "../practice/app-log-collection.html" >
< a href = "../practice/app-log-collection.html" >
< b > 5.5.3.< / b >
应用日志收集
< / a >
< / li >
< li class = "chapter " data-level = "5.5.4" data-path = "../practice/configuration-best-practice.html" >
< a href = "../practice/configuration-best-practice.html" >
< b > 5.5.4.< / b >
配置最佳实践
< / a >
< / li >
< li class = "chapter " data-level = "5.5.5" data-path = "../practice/monitor.html" >
< a href = "../practice/monitor.html" >
< b > 5.5.5.< / b >
集群及应用监控
< / a >
< / li >
< li class = "chapter " data-level = "5.5.6" data-path = "../practice/data-persistence-problem.html" >
< a href = "../practice/data-persistence-problem.html" >
< b > 5.5.6.< / b >
数据持久化问题
< / a >
< / li >
< li class = "chapter " data-level = "5.5.7" data-path = "../practice/manage-compute-resources-container.html" >
< a href = "../practice/manage-compute-resources-container.html" >
< b > 5.5.7.< / b >
管理容器的计算资源
< / a >
< / li >
< li class = "chapter " data-level = "5.5.8" data-path = "../practice/federation.html" >
< a href = "../practice/federation.html" >
< b > 5.5.8.< / b >
集群联邦
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.6" data-path = "../practice/storage.html" >
< a href = "../practice/storage.html" >
< b > 5.6.< / b >
存储管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.6.1" data-path = "../practice/glusterfs.html" >
< a href = "../practice/glusterfs.html" >
< b > 5.6.1.< / b >
GlusterFS
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.6.1.1" data-path = "../practice/using-glusterfs-for-persistent-storage.html" >
< a href = "../practice/using-glusterfs-for-persistent-storage.html" >
< b > 5.6.1.1.< / b >
使用 GlusterFS 做持久化存储
< / a >
< / li >
< li class = "chapter " data-level = "5.6.1.2" data-path = "../practice/using-heketi-gluster-for-persistent-storage.html" >
< a href = "../practice/using-heketi-gluster-for-persistent-storage.html" >
< b > 5.6.1.2.< / b >
使用 Heketi 作为 Kubernetes 的持久存储 GlusterFS 的 external provisioner
< / a >
< / li >
< li class = "chapter " data-level = "5.6.1.3" data-path = "../practice/storage-for-containers-using-glusterfs-with-openshift.html" >
< a href = "../practice/storage-for-containers-using-glusterfs-with-openshift.html" >
< b > 5.6.1.3.< / b >
在 OpenShift 中使用 GlusterFS 做持久化存储
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.6.2" data-path = "../practice/glusterd-2.0.html" >
< a href = "../practice/glusterd-2.0.html" >
< b > 5.6.2.< / b >
GlusterD-2.0
< / a >
< / li >
< li class = "chapter " data-level = "5.6.3" data-path = "../practice/ceph.html" >
< a href = "../practice/ceph.html" >
< b > 5.6.3.< / b >
Ceph
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.6.3.1" data-path = "../practice/ceph-helm-install-guide-zh.html" >
< a href = "../practice/ceph-helm-install-guide-zh.html" >
< b > 5.6.3.1.< / b >
用 Helm 托管安装 Ceph 集群并提供后端存储
< / a >
< / li >
< li class = "chapter " data-level = "5.6.3.2" data-path = "../practice/using-ceph-for-persistent-storage.html" >
< a href = "../practice/using-ceph-for-persistent-storage.html" >
< b > 5.6.3.2.< / b >
使用 Ceph 做持久化存储
< / a >
< / li >
< li class = "chapter " data-level = "5.6.3.3" data-path = "../practice/rbd-provisioner.html" >
< a href = "../practice/rbd-provisioner.html" >
< b > 5.6.3.3.< / b >
使用 rbd-provisioner 提供 rbd 持久化存储
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.6.4" data-path = "../practice/openebs.html" >
< a href = "../practice/openebs.html" >
< b > 5.6.4.< / b >
OpenEBS
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.6.4.1" data-path = "../practice/using-openebs-for-persistent-storage.html" >
< a href = "../practice/using-openebs-for-persistent-storage.html" >
< b > 5.6.4.1.< / b >
使用 OpenEBS 做持久化存储
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.6.5" data-path = "../practice/rook.html" >
< a href = "../practice/rook.html" >
< b > 5.6.5.< / b >
Rook
< / a >
< / li >
< li class = "chapter " data-level = "5.6.6" data-path = "../practice/nfs.html" >
< a href = "../practice/nfs.html" >
< b > 5.6.6.< / b >
NFS
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.6.6.1" data-path = "../practice/using-nfs-for-persistent-storage.html" >
< a href = "../practice/using-nfs-for-persistent-storage.html" >
< b > 5.6.6.1.< / b >
利用 NFS 动态提供 Kubernetes 后端存储卷
< / a >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.7" data-path = "../practice/monitoring.html" >
< a href = "../practice/monitoring.html" >
< b > 5.7.< / b >
集群与应用监控
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.7.1" data-path = "../practice/heapster.html" >
< a href = "../practice/heapster.html" >
< b > 5.7.1.< / b >
Heapster
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.7.1.1" data-path = "../practice/using-heapster-to-get-object-metrics.html" >
< a href = "../practice/using-heapster-to-get-object-metrics.html" >
< b > 5.7.1.1.< / b >
使用 Heapster 获取集群和对象的 metric 数据
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.7.2" data-path = "../practice/prometheus.html" >
< a href = "../practice/prometheus.html" >
< b > 5.7.2.< / b >
Prometheus
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.7.2.1" data-path = "../practice/using-prometheus-to-monitor-kuberentes-cluster.html" >
< a href = "../practice/using-prometheus-to-monitor-kuberentes-cluster.html" >
< b > 5.7.2.1.< / b >
使用 Prometheus 监控 kubernetes 集群
< / a >
< / li >
< li class = "chapter " data-level = "5.7.2.2" data-path = "../practice/promql.html" >
< a href = "../practice/promql.html" >
< b > 5.7.2.2.< / b >
Prometheus 查询语言 PromQL 使用说明
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.7.3" data-path = "../practice/vistio-visualize-your-istio-mesh.html" >
< a href = "../practice/vistio-visualize-your-istio-mesh.html" >
< b > 5.7.3.< / b >
使用 Vistio 监控 Istio 服务网格中的流量
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.8" data-path = "../practice/distributed-tracing.html" >
< a href = "../practice/distributed-tracing.html" >
< b > 5.8.< / b >
分布式跟踪
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.8.1" data-path = "../practice/opentracing.html" >
< a href = "../practice/opentracing.html" >
< b > 5.8.1.< / b >
OpenTracing
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.9" data-path = "../practice/services-management-tool.html" >
< a href = "../practice/services-management-tool.html" >
< b > 5.9.< / b >
服务编排管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.9.1" data-path = "../practice/helm.html" >
< a href = "../practice/helm.html" >
< b > 5.9.1.< / b >
使用 Helm 管理 Kubernetes 应用
< / a >
< / li >
< li class = "chapter " data-level = "5.9.2" data-path = "../practice/create-private-charts-repo.html" >
< a href = "../practice/create-private-charts-repo.html" >
< b > 5.9.2.< / b >
构建私有 Chart 仓库
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.10" data-path = "../practice/ci-cd.html" >
< a href = "../practice/ci-cd.html" >
< b > 5.10.< / b >
持续集成与发布
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.10.1" data-path = "../practice/jenkins-ci-cd.html" >
< a href = "../practice/jenkins-ci-cd.html" >
< b > 5.10.1.< / b >
使用 Jenkins 进行持续集成与发布
< / a >
< / li >
< li class = "chapter " data-level = "5.10.2" data-path = "../practice/drone-ci-cd.html" >
< a href = "../practice/drone-ci-cd.html" >
< b > 5.10.2.< / b >
使用 Drone 进行持续集成与发布
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.11" data-path = "../practice/update-and-upgrade.html" >
< a href = "../practice/update-and-upgrade.html" >
< b > 5.11.< / b >
更新与升级
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.11.1" data-path = "../practice/manually-upgrade.html" >
< a href = "../practice/manually-upgrade.html" >
< b > 5.11.1.< / b >
手动升级 Kubernetes 集群
< / a >
< / li >
< li class = "chapter " data-level = "5.11.2" data-path = "../practice/dashboard-upgrade.html" >
< a href = "../practice/dashboard-upgrade.html" >
< b > 5.11.2.< / b >
升级 dashboard
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "5.12" data-path = "../practice/controller-extended.html" >
< a href = "../practice/controller-extended.html" >
< b > 5.12.< / b >
扩展控制器
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "5.12.1" data-path = "../practice/openkruise.html" >
< a href = "../practice/openkruise.html" >
< b > 5.12.1.< / b >
OpenKruise
< / a >
< / li >
< / ul >
< / li >
< li class = "header" > 领域应用< / li >
< li class = "chapter " data-level = "6.1" data-path = "./" >
< a href = "./" >
< b > 6.1.< / b >
领域应用概览
< / a >
< / li >
< li class = "chapter " data-level = "6.2" data-path = "microservices.html" >
< a href = "microservices.html" >
< b > 6.2.< / b >
微服务架构
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.2.1" data-path = "service-discovery-in-microservices.html" >
< a href = "service-discovery-in-microservices.html" >
< b > 6.2.1.< / b >
微服务中的服务发现
< / a >
< / li >
< li class = "chapter " data-level = "6.2.2" data-path = "microservices-for-java-developers.html" >
< a href = "microservices-for-java-developers.html" >
< b > 6.2.2.< / b >
使用 Java 构建微服务并发布到 Kubernetes 平台
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.2.2.1" data-path = "spring-boot-quick-start-guide.html" >
< a href = "spring-boot-quick-start-guide.html" >
< b > 6.2.2.1.< / b >
Spring Boot 快速开始指南
< / a >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.3" data-path = "service-mesh.html" >
< a href = "service-mesh.html" >
< b > 6.3.< / b >
Service Mesh 服务网格
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.3.1" data-path = "the-enterprise-path-to-service-mesh-architectures.html" >
< a href = "the-enterprise-path-to-service-mesh-architectures.html" >
< b > 6.3.1.< / b >
企业级服务网格架构
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.3.1.1" data-path = "service-mesh-fundamental.html" >
< a href = "service-mesh-fundamental.html" >
< b > 6.3.1.1.< / b >
Service Mesh 基础
< / a >
< / li >
< li class = "chapter " data-level = "6.3.1.2" data-path = "comparing-service-mesh-technologies.html" >
< a href = "comparing-service-mesh-technologies.html" >
< b > 6.3.1.2.< / b >
Service Mesh 技术对比
< / a >
< / li >
< li class = "chapter " data-level = "6.3.1.3" data-path = "service-mesh-adoption-and-evolution.html" >
< a href = "service-mesh-adoption-and-evolution.html" >
< b > 6.3.1.3.< / b >
采纳和演进
< / a >
< / li >
< li class = "chapter " data-level = "6.3.1.4" data-path = "service-mesh-customization-and-integration.html" >
< a href = "service-mesh-customization-and-integration.html" >
< b > 6.3.1.4.< / b >
定制和集成
< / a >
< / li >
< li class = "chapter " data-level = "6.3.1.5" data-path = "service-mesh-conclusion.html" >
< a href = "service-mesh-conclusion.html" >
< b > 6.3.1.5.< / b >
总结
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.3.2" data-path = "istio.html" >
< a href = "istio.html" >
< b > 6.3.2.< / b >
Istio
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.3.2.1" data-path = "istio-installation.html" >
< a href = "istio-installation.html" >
< b > 6.3.2.1.< / b >
安装并试用 Istio service mesh
< / a >
< / li >
< li class = "chapter " data-level = "6.3.2.2" data-path = "sidecar-spec-in-istio.html" >
< a href = "sidecar-spec-in-istio.html" >
< b > 6.3.2.2.< / b >
Istio 中 sidecar 的注入规范及示例
< / a >
< / li >
< li class = "chapter " data-level = "6.3.2.3" data-path = "istio-community-tips.html" >
< a href = "istio-community-tips.html" >
< b > 6.3.2.3.< / b >
如何参与 Istio 社区及注意事项
< / a >
< / li >
< li class = "chapter " data-level = "6.3.2.4" data-path = "istio-tutorials-collection.html" >
< a href = "istio-tutorials-collection.html" >
< b > 6.3.2.4.< / b >
Istio 免费学习资源汇总
< / a >
< / li >
< li class = "chapter " data-level = "6.3.2.5" data-path = "understand-sidecar-injection-and-traffic-hijack-in-istio-service-mesh.html" >
< a href = "understand-sidecar-injection-and-traffic-hijack-in-istio-service-mesh.html" >
< b > 6.3.2.5.< / b >
Sidecar 的注入与流量劫持
< / a >
< / li >
< li class = "chapter " data-level = "6.3.2.6" data-path = "envoy-sidecar-routing-of-istio-service-mesh-deep-dive.html" >
< a href = "envoy-sidecar-routing-of-istio-service-mesh-deep-dive.html" >
< b > 6.3.2.6.< / b >
Envoy Sidecar 代理的路由转发
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.3.3" data-path = "linkerd.html" >
< a href = "linkerd.html" >
< b > 6.3.3.< / b >
Linkerd
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.3.3.1" data-path = "linkerd-user-guide.html" >
< a href = "linkerd-user-guide.html" >
< b > 6.3.3.1.< / b >
Linkerd 使用指南
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.3.4" data-path = "conduit.html" >
< a href = "conduit.html" >
< b > 6.3.4.< / b >
Conduit
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.3.4.1" data-path = "conduit-overview.html" >
< a href = "conduit-overview.html" >
< b > 6.3.4.1.< / b >
Condiut 概览
< / a >
< / li >
< li class = "chapter " data-level = "6.3.4.2" data-path = "conduit-installation.html" >
< a href = "conduit-installation.html" >
< b > 6.3.4.2.< / b >
安装 Conduit
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.3.5" data-path = "envoy.html" >
< a href = "envoy.html" >
< b > 6.3.5.< / b >
Envoy
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.3.5.1" data-path = "envoy-terminology.html" >
< a href = "envoy-terminology.html" >
< b > 6.3.5.1.< / b >
Envoy 的架构与基本术语
< / a >
< / li >
< li class = "chapter " data-level = "6.3.5.2" data-path = "envoy-front-proxy.html" >
< a href = "envoy-front-proxy.html" >
< b > 6.3.5.2.< / b >
Envoy 作为前端代理
< / a >
< / li >
< li class = "chapter " data-level = "6.3.5.3" data-path = "envoy-mesh-in-kubernetes-tutorial.html" >
< a href = "envoy-mesh-in-kubernetes-tutorial.html" >
< b > 6.3.5.3.< / b >
Envoy mesh 教程
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.3.6" data-path = "mosn.html" >
< a href = "mosn.html" >
< b > 6.3.6.< / b >
MOSN
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.4" data-path = "big-data.html" >
< a href = "big-data.html" >
< b > 6.4.< / b >
大数据
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.4.1" data-path = "spark-standalone-on-kubernetes.html" >
< a href = "spark-standalone-on-kubernetes.html" >
< b > 6.4.1.< / b >
Spark standalone on Kubernetes
< / a >
< / li >
< li class = "chapter active" data-level = "6.4.2" data-path = "running-spark-with-kubernetes-native-scheduler.html" >
< a href = "running-spark-with-kubernetes-native-scheduler.html" >
< b > 6.4.2.< / b >
运行支持 Kubernetes 原生调度的 Spark 程序
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.5" data-path = "serverless.html" >
< a href = "serverless.html" >
< b > 6.5.< / b >
Serverless 架构
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.5.1" data-path = "understanding-serverless.html" >
< a href = "understanding-serverless.html" >
< b > 6.5.1.< / b >
理解 Serverless
< / a >
< / li >
< li class = "chapter " data-level = "6.5.2" data-path = "faas.html" >
< a href = "faas.html" >
< b > 6.5.2.< / b >
FaaS（ ）
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.5.2.1" data-path = "openfaas-quick-start.html" >
< a href = "openfaas-quick-start.html" >
< b > 6.5.2.1.< / b >
OpenFaaS 快速入门指南
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.5.3" data-path = "knative.html" >
< a href = "knative.html" >
< b > 6.5.3.< / b >
Knative
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.6" data-path = "cloud-native-app-standard.html" >
< a href = "cloud-native-app-standard.html" >
< b > 6.6.< / b >
云原生应用标准
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "6.6.1" data-path = "oam.html" >
< a href = "oam.html" >
< b > 6.6.1.< / b >
OAM（ ）
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "6.7" data-path = "edge-computing.html" >
< a href = "edge-computing.html" >
< b > 6.7.< / b >
边缘计算
< / a >
< / li >
< li class = "chapter " data-level = "6.8" data-path = "ai.html" >
< a href = "ai.html" >
< b > 6.8.< / b >
人工智能
< / a >
< / li >
< li class = "header" > 开发指南< / li >
< li class = "chapter " data-level = "7.1" data-path = "../develop/" >
< a href = "../develop/" >
< b > 7.1.< / b >
开发指南概览
< / a >
< / li >
< li class = "chapter " data-level = "7.2" data-path = "../develop/sigs-and-working-group.html" >
< a href = "../develop/sigs-and-working-group.html" >
< b > 7.2.< / b >
SIG 和工作组
< / a >
< / li >
< li class = "chapter " data-level = "7.3" data-path = "../develop/developing-environment.html" >
< a href = "../develop/developing-environment.html" >
< b > 7.3.< / b >
开发环境搭建
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "7.3.1" data-path = "../develop/using-vagrant-and-virtualbox-for-development.html" >
< a href = "../develop/using-vagrant-and-virtualbox-for-development.html" >
< b > 7.3.1.< / b >
本地分布式开发环境搭建（使用 Vagrant 和 Virtualbox）
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "7.4" data-path = "../develop/testing.html" >
< a href = "../develop/testing.html" >
< b > 7.4.< / b >
单元测试和集成测试
< / a >
< / li >
< li class = "chapter " data-level = "7.5" data-path = "../develop/client-go-sample.html" >
< a href = "../develop/client-go-sample.html" >
< b > 7.5.< / b >
client-go 示例
< / a >
< / li >
< li class = "chapter " data-level = "7.6" data-path = "../develop/operator.html" >
< a href = "../develop/operator.html" >
< b > 7.6.< / b >
Operator
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "7.6.1" data-path = "../develop/operator-sdk.html" >
< a href = "../develop/operator-sdk.html" >
< b > 7.6.1.< / b >
operator-sdk
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "7.7" data-path = "../develop/kubebuilder.html" >
< a href = "../develop/kubebuilder.html" >
< b > 7.7.< / b >
kubebuilder
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "7.7.1" data-path = "../develop/kubebuilder-example.html" >
< a href = "../develop/kubebuilder-example.html" >
< b > 7.7.1.< / b >
使用 kubebuilder 创建 operator 示例
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "7.8" data-path = "../develop/advance-developer.html" >
< a href = "../develop/advance-developer.html" >
< b > 7.8.< / b >
高级开发指南
< / a >
< / li >
< li class = "chapter " data-level = "7.9" data-path = "../develop/contribute.html" >
< a href = "../develop/contribute.html" >
< b > 7.9.< / b >
社区贡献
< / a >
< / li >
< li class = "chapter " data-level = "7.10" data-path = "../develop/minikube.html" >
< a href = "../develop/minikube.html" >
< b > 7.10.< / b >
Minikube
< / a >
< / li >
< li class = "header" > CNCF（ ） < / li >
< li class = "chapter " data-level = "8.1" data-path = "../cloud-native/cncf.html" >
< a href = "../cloud-native/cncf.html" >
< b > 8.1.< / b >
CNCF - 云原生计算基金会简介
< / a >
< / li >
< li class = "chapter " data-level = "8.2" data-path = "../cloud-native/cncf-charter.html" >
< a href = "../cloud-native/cncf-charter.html" >
< b > 8.2.< / b >
CNCF 章程
< / a >
< / li >
< li class = "chapter " data-level = "8.3" data-path = "../cloud-native/cncf-sig.html" >
< a href = "../cloud-native/cncf-sig.html" >
< b > 8.3.< / b >
CNCF 特别兴趣小组（ ）
< / a >
< / li >
< li class = "chapter " data-level = "8.4" data-path = "../cloud-native/cncf-sandbox-criteria.html" >
< a href = "../cloud-native/cncf-sandbox-criteria.html" >
< b > 8.4.< / b >
开源项目加入 CNCF Sandbox 的要求
< / a >
< / li >
< li class = "chapter " data-level = "8.5" data-path = "../cloud-native/cncf-project-governing.html" >
< a href = "../cloud-native/cncf-project-governing.html" >
< b > 8.5.< / b >
CNCF 中的项目治理
< / a >
< / li >
< li class = "chapter " data-level = "8.6" data-path = "../cloud-native/cncf-ambassador.html" >
< a href = "../cloud-native/cncf-ambassador.html" >
< b > 8.6.< / b >
CNCF Ambassador
< / a >
< / li >
< li class = "header" > 附录< / li >
< li class = "chapter " data-level = "9.1" data-path = "../appendix/" >
< a href = "../appendix/" >
< b > 9.1.< / b >
附录说明
< / a >
< / li >
< li class = "chapter " data-level = "9.2" data-path = "../appendix/debug-kubernetes-services.html" >
< a href = "../appendix/debug-kubernetes-services.html" >
< b > 9.2.< / b >
Kubernetes 中的应用故障排查
< / a >
< / li >
< li class = "chapter " data-level = "9.3" data-path = "../appendix/material-share.html" >
< a href = "../appendix/material-share.html" >
< b > 9.3.< / b >
Kubernetes 相关资讯和情报链接
< / a >
< / li >
< li class = "chapter " data-level = "9.4" data-path = "../appendix/docker-best-practice.html" >
< a href = "../appendix/docker-best-practice.html" >
< b > 9.4.< / b >
Docker 最佳实践
< / a >
< / li >
< li class = "chapter " data-level = "9.5" data-path = "../appendix/tricks.html" >
< a href = "../appendix/tricks.html" >
< b > 9.5.< / b >
使用技巧
< / a >
< / li >
< li class = "chapter " data-level = "9.6" data-path = "../appendix/issues.html" >
< a href = "../appendix/issues.html" >
< b > 9.6.< / b >
问题记录
< / a >
< / li >
< li class = "chapter " data-level = "9.7" data-path = "../appendix/kubernetes-changelog.html" >
< a href = "../appendix/kubernetes-changelog.html" >
< b > 9.7.< / b >
Kubernetes 版本更新日志
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "9.7.1" data-path = "../appendix/kubernetes-1.7-changelog.html" >
< a href = "../appendix/kubernetes-1.7-changelog.html" >
< b > 9.7.1.< / b >
Kubernetes1.7 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.2" data-path = "../appendix/kubernetes-1.8-changelog.html" >
< a href = "../appendix/kubernetes-1.8-changelog.html" >
< b > 9.7.2.< / b >
Kubernetes1.8 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.3" data-path = "../appendix/kubernetes-1.9-changelog.html" >
< a href = "../appendix/kubernetes-1.9-changelog.html" >
< b > 9.7.3.< / b >
Kubernetes1.9 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.4" data-path = "../appendix/kubernetes-1.10-changelog.html" >
< a href = "../appendix/kubernetes-1.10-changelog.html" >
< b > 9.7.4.< / b >
Kubernetes1.10 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.5" data-path = "../appendix/kubernetes-1.11-changelog.html" >
< a href = "../appendix/kubernetes-1.11-changelog.html" >
< b > 9.7.5.< / b >
Kubernetes1.11 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.6" data-path = "../appendix/kubernetes-1.12-changelog.html" >
< a href = "../appendix/kubernetes-1.12-changelog.html" >
< b > 9.7.6.< / b >
Kubernetes1.12 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.7" data-path = "../appendix/kubernetes-1.13-changelog.html" >
< a href = "../appendix/kubernetes-1.13-changelog.html" >
< b > 9.7.7.< / b >
Kubernetes1.13 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.8" data-path = "../appendix/kubernetes-1.14-changelog.html" >
< a href = "../appendix/kubernetes-1.14-changelog.html" >
< b > 9.7.8.< / b >
Kubernetes1.14 更新日志
< / a >
< / li >
< li class = "chapter " data-level = "9.7.9" data-path = "../appendix/kubernetes-1.15-changelog.html" >
< a href = "../appendix/kubernetes-1.15-changelog.html" >
< b > 9.7.9.< / b >
Kubernetes1.15 更新日志
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "9.8" data-path = "../appendix/summary-and-outlook.html" >
< a href = "../appendix/summary-and-outlook.html" >
< b > 9.8.< / b >
Kubernetes 及云原生年度总结及展望
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "9.8.1" data-path = "../appendix/kubernetes-and-cloud-native-summary-in-2017-and-outlook-for-2018.html" >
< a href = "../appendix/kubernetes-and-cloud-native-summary-in-2017-and-outlook-for-2018.html" >
< b > 9.8.1.< / b >
Kubernetes 与云原生 2017 年年终总结及 2018 年展望
< / a >
< / li >
< li class = "chapter " data-level = "9.8.2" data-path = "../appendix/kubernetes-and-cloud-native-summary-in-2018-and-outlook-for-2019.html" >
< a href = "../appendix/kubernetes-and-cloud-native-summary-in-2018-and-outlook-for-2019.html" >
< b > 9.8.2.< / b >
Kubernetes 与云原生 2018 年年终总结及 2019 年展望
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "9.9" data-path = "../appendix/cncf-annual-report.html" >
< a href = "../appendix/cncf-annual-report.html" >
< b > 9.9.< / b >
CNCF 年度报告解读
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "9.9.1" data-path = "../appendix/cncf-annual-report-2018.html" >
< a href = "../appendix/cncf-annual-report-2018.html" >
< b > 9.9.1.< / b >
CNCF 2018 年年度报告解读
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "9.10" data-path = "../appendix/about-kcsp.html" >
< a href = "../appendix/about-kcsp.html" >
< b > 9.10.< / b >
Kubernetes 认证服务提供商（ ）
< / a >
< / li >
< li class = "chapter " data-level = "9.11" data-path = "../appendix/about-cka-candidate.html" >
< a href = "../appendix/about-cka-candidate.html" >
< b > 9.11.< / b >
认证 Kubernetes 管理员（ ）
< / a >
< / li >
< li class = "divider" > < / li >
< li >
< a href = "https://www.gitbook.com" target = "blank" class = "gitbook-link" >
本书使用 GitBook 发布
< / a >
< / li >
< / ul >
< / nav >
< / div >
< div class = "book-body" >
< div class = "body-inner" >
< div class = "book-header" role = "navigation" >
<!-- Title -->
< h1 >
< i class = "fa fa-circle-o-notch fa-spin" > < / i >
< a href = ".." > 运行支持 Kubernetes 原生调度的 Spark 程序< / a >
< / h1 >
< / div >
< div class = "page-wrapper" tabindex = "-1" role = "main" >
< div class = "page-inner" >
< div class = "search-plus" id = "book-search-results" >
< div class = "search-noresults" >
< section class = "normal markdown-section" >
< h1 id = "运行支持kubernetes原生调度的spark程序" > 运 行 支 持 kubernetes原 生 调 度 的 Spark程 序 < / h1 >
< p > TL;DR 这 个 主 题 比 较 大 ， 该 开 源 项 目 也 还 在 不 断 进 行 中 ， 我 单 独 做 了 一 个 web 用 来 记 录 spark on kubernetes 的 研 究 和 最 新 进 展 见 : < a href = "https://jimmysong.io/spark-on-k8s" target = "_blank" > https://jimmysong.io/spark-on-k8s< / a > < / p >
< p > < strong > 注 意 < / strong > ： 本 文 中 的 镜 像 仓 库 地 址 < code > harbor-001.jimmysong.io< / code > 为 的 镜 像 仓 库 地 址 为 伪 装 地 址 ， 非 本 文 中 真 正 使 用 的 镜 像 仓 库 ， 且 该 地 址 也 不 存 在 ， 请 替 换 为 您 自 己 的 镜 像 仓 库 。 < / p >
< p > 我 们 之 前 就 在 kubernetes 中 运 行 过 standalone 方 式 的 spark 集 群 ， 见 < a href = "spark-standalone-on-kubernetes.html" > Spark standalone on kubernetes< / a > 。 < / p >
< p > 目 前 运 行 支 持 kubernetes 原 生 调 度 的 spark 程 序 由 Google 主 导 ， fork 自 spark 的 官 方 代 码 库 ， 见 < a href = "https://github.com/apache-spark-on-k8s/spark/" target = "_blank" > https://github.com/apache-spark-on-k8s/spark/< / a > ， 属 于 Big Data SIG。 < / p >
< p > 参 与 到 该 项 目 的 公 司 有 ： < / p >
< ul >
< li > Bloomberg< / li >
< li > Google< / li >
< li > Haiwen< / li >
< li > Hyperpilot< / li >
< li > Intel< / li >
< li > Palantir< / li >
< li > Pepperdata< / li >
< li > Red Hat< / li >
< / ul >
< h2 id = "为何使用-spark-on-kubernetes" > 为 何 使 用 spark on kubernetes< / h2 >
< p > 使 用 kubernetes原 生 调 度 的 spark on kubernetes是 对 现 有 的 spark on yarn/mesos的 资 源 使 用 方 式 的 革 命 性 的 改 进 ， 主 要 表 现 在 以 下 几 点 ： < / p >
< ol >
< li > Kubernetes原 生 调 度 ： 不 再 需 要 二 层 调 度 ， 直 接 使 用 kubernetes的 资 源 调 度 功 能 ， 跟 其 他 应 用 共 用 整 个 kubernetes管 理 的 资 源 池 ； < / li >
< li > 资 源 隔 离 ， 粒 度 更 细 ： 原 先 yarn中 的 queue在 spark on kubernetes中 已 不 存 在 ， 取 而 代 之 的 是 kubernetes中 原 生 的 namespace， 可 以 为 每 个 用 户 分 别 指 定 一 个 namespace， 限 制 用 户 的 资 源 quota； < / li >
< li > 细 粒 度 的 资 源 分 配 ： 可 以 给 每 个 spark任 务 指 定 资 源 限 制 ， 实 际 指 定 多 少 资 源 就 使 用 多 少 资 源 ， 因 为 没 有 了 像 yarn那 样 的 二 层 调 度 （ 圈 地 式 的 ） ， 所 以 可 以 更 高 效 和 细 粒 度 的 使 用 资 源 ； < / li >
< li > 监 控 的 变 革 ： 因 为 做 到 了 细 粒 度 的 资 源 分 配 ， 所 以 可 以 对 用 户 提 交 的 每 一 个 任 务 做 到 资 源 使 用 的 监 控 ， 从 而 判 断 用 户 的 资 源 使 用 情 况 ， 所 有 的 metric都 记 录 在 数 据 库 中 ， 甚 至 可 以 为 每 个 用 户 的 每 次 任 务 提 交 计 量 ； < / li >
< li > 日 志 的 变 革 ： 用 户 不 再 通 过 yarn的 web页 面 来 查 看 任 务 状 态 ， 而 是 通 过 pod的 log来 查 看 ， 可 将 所 有 的 kuberentes中 的 应 用 的 日 志 等 同 看 待 收 集 起 来 ， 然 后 可 以 根 据 标 签 查 看 对 应 应 用 的 日 志 ； < / li >
< / ol >
< p > 所 有 这 些 变 革 都 可 以 让 我 们 更 高 效 的 获 取 资 源 、 更 有 效 率 的 获 取 资 源 ！ < / p >
< h2 id = "spark-概念说明" > Spark 概 念 说 明 < / h2 >
< p > < a href = "http://spark.apache.org" target = "_blank" > Apache Spark< / a > 是 一 个 围 绕 速 度 、 易 用 性 和 复 杂 分 析 构 建 的 大 数 据 处 理 框 架 。 最 初 在 2009年 由 加 州 大 学 伯 克 利 分 校 的 AMPLab开 发 ， 并 于 2010年 成 为 Apache的 开 源 项 目 之 一 。 < / p >
< p > 在 Spark 中 包 括 如 下 组 件 或 概 念 ： < / p >
< ul >
< li > < strong > Application< / strong > ： Spark Application 的 概 念 和 Hadoop 中 的 MapReduce 类 似 ， 指 的 是 用 户 编 写 的 Spark 应 用 程 序 ， 包 含 了 一 个 Driver 功 能 的 代 码 和 分 布 在 集 群 中 多 个 节 点 上 运 行 的 Executor 代 码 ； < / li >
< li > < strong > Driver< / strong > ： Spark 中 的 Driver 即 运 行 上 述 Application 的 main() 函 数 并 且 创 建 SparkContext， 其 中 创 建 SparkContext 的 目 的 是 为 了 准 备 Spark应 用 程 序 的 运 行 环 境 。 在 Spark 中 由 SparkContext 负 责 和 ClusterManager 通 信 ， 进 行 资 源 的 申 请 、 任 务 的 分 配 和 监 控 等 ； 当 Executor 部 分 运 行 完 毕 后 ， Driver负 责 将 SparkContext 关 闭 。 通 常 用 SparkContext 代 表 Driver； < / li >
< li > < strong > Executor< / strong > ： Application运 行 在 Worker 节 点 上 的 一 个 进 程 ， 该 进 程 负 责 运 行 Task， 并 且 负 责 将 数 据 存 在 内 存 或 者 磁 盘 上 ， 每 个 Application都 有 各 自 独 立 的 一 批 Executor。 在 Spark on Yarn模 式 下 ， 其 进 程 名 称 为 < code > CoarseGrainedExecutorBackend< / code > ， 类 似 于 Hadoop MapReduce 中 的 YarnChild。 一 个 < code > CoarseGrainedExecutorBackend< / code > 进 程 有 且 仅 有 一 个 executor 对 象 ， 它 负 责 将 Task 包 装 成 taskRunner， 并 从 线 程 池 中 抽 取 出 一 个 空 闲 线 程 运 行 Task。 每 个 < code > CoarseGrainedExecutorBackend< / code > 能 并 行 运 行 Task 的 数 量 就 取 决 于 分 配 给 它 的 CPU 的 个 数 了 ； < / li >
< li > < strong > Cluster Manager< / strong > ： 指 的 是 在 集 群 上 获 取 资 源 的 外 部 服 务 ， 目 前 有 ： < ul >
< li > Standalone： Spark原 生 的 资 源 管 理 ， 由 Master负 责 资 源 的 分 配 ； < / li >
< li > Hadoop Yarn： 由 YARN中 的 ResourceManager负 责 资 源 的 分 配 ； < / li >
< / ul >
< / li >
< li > < strong > Worker< / strong > ： 集 群 中 任 何 可 以 运 行 Application代 码 的 节 点 ， 类 似 于 YARN中 的 NodeManager节 点 。 在 Standalone模 式 中 指 的 就 是 通 过 Slave文 件 配 置 的 Worker节 点 ， 在 Spark on Yarn模 式 中 指 的 就 是 NodeManager节 点 ； < / li >
< li > < strong > 作 业 （ Job） < / strong > ： 包 含 多 个 Task组 成 的 并 行 计 算 ， 往 往 由 Spark Action催 生 ， 一 个 JOB包 含 多 个 RDD及 作 用 于 相 应 RDD上 的 各 种 Operation； < / li >
< li > < strong > 阶 段 （ Stage） < / strong > ： 每 个 Job会 被 拆 分 很 多 组 Task， 每 组 任 务 被 称 为 Stage， 也 可 称 TaskSet， 一 个 作 业 分 为 多 个 阶 段 ， 每 一 个 stage的 分 割 点 是 action。 比 如 一 个 job是 ： （ transformation1 -> transformation1 -> action1 -> transformation3 -> action2） ， 这 个 job就 会 被 分 为 两 个 stage， 分 割 点 是 action1和 action2。 < / li >
< li > < p > < strong > 任 务 （ Task） < / strong > ： 被 送 到 某 个 Executor上 的 工 作 任 务 ； < / p >
< / li >
< li > < p > < strong > Context< / strong > ： 启 动 spark application的 时 候 创 建 ， 作 为 Spark 运 行 时 环 境 。 < / p >
< / li >
< li > < strong > Dynamic Allocation（ 动 态 资 源 分 配 ） < / strong > ： 一 个 配 置 选 项 ， 可 以 将 其 打 开 。 从 Spark1.2之 后 ， 对 于 On Yarn模 式 ， 已 经 支 持 动 态 资 源 分 配 （ Dynamic Resource Allocation） ， 这 样 ， 就 可 以 根 据 Application的 负 载 （ Task情 况 ） ， 动 态 的 增 加 和 减 少 executors， 这 种 策 略 非 常 适 合 在 YARN上 使 用 spark-sql做 数 据 开 发 和 分 析 ， 以 及 将 spark-sql作 为 长 服 务 来 使 用 的 场 景 。 Executor 的 动 态 分 配 需 要 在 cluster mode 下 启 用 " external shuffle service" 。 < / li >
< li > < strong > 动 态 资 源 分 配 策 略 < / strong > ： 开 启 动 态 分 配 策 略 后 ， application会 在 task因 没 有 足 够 资 源 被 挂 起 的 时 候 去 动 态 申 请 资 源 ， 这 意 味 着 该 application现 有 的 executor无 法 满 足 所 有 task并 行 运 行 。 spark一 轮 一 轮 的 申 请 资 源 ， 当 有 task挂 起 或 等 待 < code > spark.dynamicAllocation.schedulerBacklogTimeout< / code > (默 认 1s)时 间 的 时 候 ， 会 开 始 动 态 资 源 分 配 ； 之 后 会 每 隔 < code > spark.dynamicAllocation.sustainedSchedulerBacklogTimeout< / code > (默 认 1s)时 间 申 请 一 次 ， 直 到 申 请 到 足 够 的 资 源 。 每 次 申 请 的 资 源 量 是 指 数 增 长 的 ， 即 1,2,4,8等 。 之 所 以 采 用 指 数 增 长 ， 出 于 两 方 面 考 虑 ： 其 一 ， 开 始 申 请 的 少 是 考 虑 到 可 能 application会 马 上 得 到 满 足 ； 其 次 要 成 倍 增 加 ， 是 为 了 防 止 application需 要 很 多 资 源 ， 而 该 方 式 可 以 在 很 少 次 数 的 申 请 之 后 得 到 满 足 。 < / li >
< / ul >
< h2 id = "架构设计" > 架 构 设 计 < / h2 >
< p > 关 于 spark standalone 的 局 限 性 与 kubernetes native spark 架 构 之 间 的 区 别 请 参 考 Anirudh Ramanathan 在 2016年 10月 8日 提 交 的 issue < a href = "https://github.com/kubernetes/kubernetes/issues/34377" target = "_blank" > Support Spark natively in Kubernetes #34377< / a > 。 < / p >
< p > 简 而 言 之 ， spark standalone on kubernetes 有 如 下 几 个 缺 点 ： < / p >
< ul >
< li > 无 法 对 于 多 租 户 做 隔 离 ， 每 个 用 户 都 想 给 pod 申 请 node 节 点 可 用 的 最 大 的 资 源 。 < / li >
< li > Spark 的 master／ worker 本 来 不 是 设 计 成 使 用 kubernetes 的 资 源 调 度 ， 这 样 会 存 在 两 层 的 资 源 调 度 问 题 ， 不 利 于 与 kuberentes 集 成 。 < / li >
< / ul >
< p > 而 kubernetes native spark 集 群 中 ， spark 可 以 调 用 kubernetes API 获 取 集 群 资 源 和 调 度 。 要 实 现 kubernetes native spark 需 要 为 spark 提 供 一 个 集 群 外 部 的 manager 可 以 用 来 跟 kubernetes API 交 互 。 < / p >
< h3 id = "调度器后台" > 调 度 器 后 台 < / h3 >
< p > 使 用 kubernetes 原 生 调 度 的 spark 的 基 本 设 计 思 路 是 将 spark 的 driver 和 executor 都 放 在 kubernetes 的 pod 中 运 行 ， 另 外 还 有 两 个 附 加 的 组 件 ： < code > ResourceStagingServer< / code > 和 < code > KubernetesExternalShuffleService< / code > 。 < / p >
< p > Spark driver 其 实 可 以 运 行 在 kubernetes 集 群 内 部 （ cluster mode） 可 以 运 行 在 外 部 （ client mode） ， executor 只 能 运 行 在 集 群 内 部 ， 当 有 spark 作 业 提 交 到 kubernetes 集 群 上 时 ， 调 度 器 后 台 将 会 为 executor pod 设 置 如 下 属 性 ： < / p >
< ul >
< li > 使 用 我 们 预 先 编 译 好 的 包 含 kubernetes 支 持 的 spark 镜 像 ， 然 后 调 用 < code > CoarseGrainedExecutorBackend< / code > main class 启 动 JVM。 < / li >
< li > 调 度 器 后 台 为 executor pod 的 运 行 时 注 入 环 境 变 量 ， 例 如 各 种 JVM 参 数 ， 包 括 用 户 在 < code > spark-submit< / code > 时 指 定 的 那 些 参 数 。 < / li >
< li > Executor 的 CPU、 内 存 限 制 根 据 这 些 注 入 的 环 境 变 量 保 存 到 应 用 程 序 的 < code > SparkConf< / code > 中 。 < / li >
< li > 可 以 在 配 置 中 指 定 spark 运 行 在 指 定 的 namespace 中 。 < / li >
< / ul >
< p > 参 考 ： < a href = "https://github.com/apache-spark-on-k8s/spark/blob/branch-2.2-kubernetes/resource-managers/kubernetes/architecture-docs/scheduler-backend.md" target = "_blank" > Scheduler backend 文 档 < / a > < / p >
< h2 id = "安装指南" > 安 装 指 南 < / h2 >
< p > 我 们 可 以 直 接 使 用 官 方 已 编 译 好 的 docker 镜 像 来 部 署 ， 下 面 是 官 方 发 布 的 镜 像 ： < / p >
< table >
< thead >
< tr >
< th > 组 件 < / th >
< th > 镜 像 < / th >
< / tr >
< / thead >
< tbody >
< tr >
< td > Spark Driver Image< / td >
< td > < code > kubespark/spark-driver:v2.1.0-kubernetes-0.3.1< / code > < / td >
< / tr >
< tr >
< td > Spark Executor Image< / td >
< td > < code > kubespark/spark-executor:v2.1.0-kubernetes-0.3.1< / code > < / td >
< / tr >
< tr >
< td > Spark Initialization Image< / td >
< td > < code > kubespark/spark-init:v2.1.0-kubernetes-0.3.1< / code > < / td >
< / tr >
< tr >
< td > Spark Staging Server Image< / td >
< td > < code > kubespark/spark-resource-staging-server:v2.1.0-kubernetes-0.3.1< / code > < / td >
< / tr >
< tr >
< td > PySpark Driver Image< / td >
< td > < code > kubespark/driver-py:v2.1.0-kubernetes-0.3.1< / code > < / td >
< / tr >
< tr >
< td > PySpark Executor Image< / td >
< td > < code > kubespark/executor-py:v2.1.0-kubernetes-0.3.1< / code > < / td >
< / tr >
< / tbody >
< / table >
< p > 我 将 这 些 镜 像 放 到 了 我 的 私 有 镜 像 仓 库 中 了 。 < / p >
< p > 还 需 要 安 装 支 持 kubernetes 的 spark 客 户 端 ， 在 这 里 下 载 ： < a href = "https://github.com/apache-spark-on-k8s/spark/releases" target = "_blank" > https://github.com/apache-spark-on-k8s/spark/releases< / a > < / p >
< p > 根 据 使 用 的 镜 像 版 本 ， 我 下 载 的 是 < a href = "https://github.com/apache-spark-on-k8s/spark/releases/tag/v2.1.0-kubernetes-0.3.1" target = "_blank" > v2.1.0-kubernetes-0.3.1< / a > < / p >
< p > < strong > 运 行 SparkPi 测 试 < / strong > < / p >
< p > 我 们 将 任 务 运 行 在 < code > spark-cluster< / code > 的 namespace 中 ， 启 动 5 个 executor 实 例 。 < / p >
< pre class = "language-" > < code class = "lang-bash" > ./bin/spark-submit < span class = "token punctuation" > \< / span >
--deploy-mode cluster < span class = "token punctuation" > \< / span >
--class org.apache.spark.examples.SparkPi < span class = "token punctuation" > \< / span >
--master k8s://https://172.20.0.113:6443 < span class = "token punctuation" > \< / span >
--kubernetes-namespace spark-cluster < span class = "token punctuation" > \< / span >
--conf spark.executor.instances< span class = "token operator" > =< / span > < span class = "token number" > 5< / span > < span class = "token punctuation" > \< / span >
--conf spark.app.name< span class = "token operator" > =< / span > spark-pi < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driver.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/kubespark-spark-driver:v2.1.0-kubernetes-0.3.1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/kubespark-spark-executor:v2.1.0-kubernetes-0.3.1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.initcontainer.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/kubespark-spark-init:v2.1.0-kubernetes-0.3.1 < span class = "token punctuation" > \< / span >
local:///opt/spark/examples/jars/spark-examples_2.11-2.1.0-k8s-0.3.1-SNAPSHOT.jar
< / code > < / pre >
< p > 关 于 该 命 令 参 数 的 介 绍 请 参 考 ： < a href = "https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html" target = "_blank" > https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html< / a > < / p >
< p > < strong > 注 意 ： < / strong > 该 jar 包 实 际 上 是 < code > spark.kubernetes.executor.docker.image< / code > 镜 像 中 的 。 < / p >
< p > 这 时 候 提 交 任 务 运 行 还 是 失 败 ， 报 错 信 息 中 可 以 看 到 两 个 问 题 ： < / p >
< ul >
< li > Executor 无 法 找 到 driver pod< / li >
< li > 用 户 < code > system:serviceaccount:spark-cluster:defaul< / code > 没 有 权 限 获 取 < code > spark-cluster< / code > 中 的 pod 信 息 。 < / li >
< / ul >
< p > 提 了 个 issue < a href = "https://github.com/apache-spark-on-k8s/spark/issues/478" target = "_blank" > Failed to run the sample spark-pi test using spark-submit on the doc #478< / a > < / p >
< p > 需 要 为 spark 集 群 创 建 一 个 < code > serviceaccount< / code > 和 < code > clusterrolebinding< / code > ： < / p >
< pre class = "language-" > < code class = "lang-bash" > kubectl create serviceaccount spark --namespace spark-cluster
kubectl create rolebinding spark-edit --clusterrole< span class = "token operator" > =< / span > edit --serviceaccount< span class = "token operator" > =< / span > spark-cluster:spark --namespace< span class = "token operator" > =< / span > spark-cluster
< / code > < / pre >
< p > 该 Bug 将 在 新 版 本 中 修 复 。 < / p >
< h2 id = "用户指南" > 用 户 指 南 < / h2 >
< h3 id = "编译" > 编 译 < / h3 >
< p > Fork 并 克 隆 项 目 到 本 地 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > < span class = "token function" > git< / span > clone https://github.com/rootsongjc/spark.git
< / code > < / pre >
< p > 编 译 前 请 确 保 你 的 环 境 中 已 经 安 装 Java8 和 Maven3。 < / p >
< pre class = "language-" > < code class = "lang-bash" > < span class = "token comment" > ## 第 一 次 编 译 前 需 要 安 装 依 赖 < / span >
build/mvn < span class = "token function" > install< / span > -Pkubernetes -pl resource-managers/kubernetes/core -am -DskipTests
< span class = "token comment" > ## 编 译 spark on kubernetes< / span >
build/mvn compile -Pkubernetes -pl resource-managers/kubernetes/core -am -DskipTests
< span class = "token comment" > ## 发 布 < / span >
dev/make-distribution.sh --tgz -Phadoop-2.7 -Pkubernetes
< / code > < / pre >
< p > 第 一 次 编 译 和 发 布 的 过 程 耗 时 可 能 会 比 较 长 ， 请 耐 心 等 待 ， 如 果 有 依 赖 下 载 不 下 来 ， 请 自 备 梯 子 。 < / p >
< p > 详 细 的 开 发 指 南 请 见 ： < a href = "https://github.com/apache-spark-on-k8s/spark/blob/branch-2.2-kubernetes/resource-managers/kubernetes/README.md" target = "_blank" > https://github.com/apache-spark-on-k8s/spark/blob/branch-2.2-kubernetes/resource-managers/kubernetes/README.md< / a > < / p >
< h3 id = "构建镜像" > 构 建 镜 像 < / h3 >
< p > 使 用 该 脚 本 来 自 动 构 建 容 器 镜 像 ： < a href = "https://github.com/apache-spark-on-k8s/spark/pull/488" target = "_blank" > https://github.com/apache-spark-on-k8s/spark/pull/488< / a > < / p >
< p > 将 该 脚 本 放 在 < code > dist< / code > 目 录 下 ， 执 行 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > ./build-push-docker-images.sh -r harbor-001.jimmysong.io/library -t v2.1.0-kubernetes-0.3.1-1 build
./build-push-docker-images.sh -r harbor-001.jimmysong.io/library -t v2.1.0-kubernetes-0.3.1-1 push
< / code > < / pre >
< p > < strong > 注 意 ： < / strong > 如 果 你 使 用 的 MacOS， bash 的 版 本 可 能 太 低 ， 执 行 改 脚 本 将 出 错 ， 请 检 查 你 的 bash 版 本 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > < span class = "token function" > bash< / span > --version
GNU bash, version < span class = "token number" > 3.2< / span > .57< span class = "token punctuation" > (< / span > < span class = "token number" > 1< / span > < span class = "token punctuation" > )< / span > -release < span class = "token punctuation" > (< / span > x86_64-apple-darwin16< span class = "token punctuation" > )< / span >
Copyright < span class = "token punctuation" > (< / span > C< span class = "token punctuation" > )< / span > < span class = "token number" > 2007< / span > Free Software Foundation, Inc.
< / code > < / pre >
< p > 上 面 我 在 升 级 bash 之 前 获 取 的 版 本 信 息 ， 使 用 下 面 的 命 令 升 级 bash： < / p >
< pre class = "language-" > < code class = "lang-bash" > brew < span class = "token function" > install< / span > < span class = "token function" > bash< / span >
< / code > < / pre >
< p > 升 级 后 的 bash 版 本 为 < code > 4.4.12(1)-release (x86_64-apple-darwin16.3.0)< / code > 。 < / p >
< p > 编 译 并 上 传 镜 像 到 我 的 私 有 镜 像 仓 库 ， 将 会 构 建 出 如 下 几 个 镜 像 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1
harbor-001.jimmysong.io/library/spark-resource-staging-server:v2.1.0-kubernetes-0.3.1-1
harbor-001.jimmysong.io/library/spark-init:v2.1.0-kubernetes-0.3.1-1
harbor-001.jimmysong.io/library/spark-shuffle:v2.1.0-kubernetes-0.3.1-1
harbor-001.jimmysong.io/library/spark-executor:v2.1.0-kubernetes-0.3.1-1
harbor-001.jimmysong.io/library/spark-executor-py:v2.1.0-kubernetes-0.3.1-1
harbor-001.jimmysong.io/library/spark-driver-py:v2.1.0-kubernetes-0.3.1-1
< / code > < / pre >
< h2 id = "运行测试" > 运 行 测 试 < / h2 >
< p > 在 < code > dist/bin< / code > 目 录 下 执 行 spark-pi 测 试 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > ./spark-submit < span class = "token punctuation" > \< / span >
--deploy-mode cluster < span class = "token punctuation" > \< / span >
--class org.apache.spark.examples.SparkPi < span class = "token punctuation" > \< / span >
--master k8s://https://172.20.0.113:6443 < span class = "token punctuation" > \< / span >
--kubernetes-namespace spark-cluster < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.authenticate.driver.serviceAccountName< span class = "token operator" > =< / span > spark < span class = "token punctuation" > \< / span >
--conf spark.executor.instances< span class = "token operator" > =< / span > < span class = "token number" > 5< / span > < span class = "token punctuation" > \< / span >
--conf spark.app.name< span class = "token operator" > =< / span > spark-pi < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driver.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-executor:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.initcontainer.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-init:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
local:///opt/spark/examples/jars/spark-examples_2.11-2.2.0-k8s-0.4.0-SNAPSHOT.jar
< / code > < / pre >
< p > 详 细 的 参 数 说 明 见 ： < a href = "https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html" target = "_blank" > https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html< / a > < / p >
< p > < strong > 注 意 ： < / strong > < code > local:///opt/spark/examples/jars/spark-examples_2.11-2.2.0-k8s-0.4.0-SNAPSHOT.jar< / code > 文 件 是 在 < code > spark-driver< / code > 和 < code > spark-executor< / code > 镜 像 里 的 ， 在 上 一 步 构 建 镜 像 时 已 经 构 建 并 上 传 到 了 镜 像 仓 库 中 。 < / p >
< p > 执 行 日 志 显 示 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > < span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:01 INFO Client:54 - Waiting < span class = "token keyword" > for< / span > application spark-pi to finish< span class = "token punctuation" > ..< / span > .
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:01 INFO LoggingPodStatusWatcherImpl:54 - State changed, new state:
pod name: spark-pi-1505372339796-driver
namespace: spark-cluster
labels: spark-app-selector -< span class = "token operator" > > < / span > spark-f4d3a5d3ad964a05a51feb6191d50357, spark-role -< span class = "token operator" > > < / span > driver
pod uid: 304cf440-991a-11e7-970c-f4e9d49f8ed0
creation time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
< span class = "token function" > service< / span > account name: spark
volumes: spark-token-zr8wv
node name: N/A
start time: N/A
container images: N/A
phase: Pending
status: < span class = "token punctuation" > [< / span > < span class = "token punctuation" > ]< / span >
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:01 INFO LoggingPodStatusWatcherImpl:54 - State changed, new state:
pod name: spark-pi-1505372339796-driver
namespace: spark-cluster
labels: spark-app-selector -< span class = "token operator" > > < / span > spark-f4d3a5d3ad964a05a51feb6191d50357, spark-role -< span class = "token operator" > > < / span > driver
pod uid: 304cf440-991a-11e7-970c-f4e9d49f8ed0
creation time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
< span class = "token function" > service< / span > account name: spark
volumes: spark-token-zr8wv
node name: < span class = "token number" > 172.20< / span > .0.114
start time: N/A
container images: N/A
phase: Pending
status: < span class = "token punctuation" > [< / span > < span class = "token punctuation" > ]< / span >
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:01 INFO LoggingPodStatusWatcherImpl:54 - State changed, new state:
pod name: spark-pi-1505372339796-driver
namespace: spark-cluster
labels: spark-app-selector -< span class = "token operator" > > < / span > spark-f4d3a5d3ad964a05a51feb6191d50357, spark-role -< span class = "token operator" > > < / span > driver
pod uid: 304cf440-991a-11e7-970c-f4e9d49f8ed0
creation time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
< span class = "token function" > service< / span > account name: spark
volumes: spark-token-zr8wv
node name: < span class = "token number" > 172.20< / span > .0.114
start time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
container images: harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1
phase: Pending
status: < span class = "token punctuation" > [< / span > ContainerStatus< span class = "token punctuation" > (< / span > containerID< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > image< / span > < span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1, < span class = "token assign-left variable" > imageID< / span > < span class = "token operator" > =< / span > , < span class = "token assign-left variable" > lastState< / span > < span class = "token operator" > =< / span > ContainerState< span class = "token punctuation" > (< / span > running< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > terminated< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > waiting< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > name< / span > < span class = "token operator" > =< / span > spark-kubernetes-driver, < span class = "token assign-left variable" > ready< / span > < span class = "token operator" > =< / span > false, < span class = "token assign-left variable" > restartCount< / span > < span class = "token operator" > =< / span > < span class = "token number" > 0< / span > , < span class = "token assign-left variable" > state< / span > < span class = "token operator" > =< / span > ContainerState< span class = "token punctuation" > (< / span > running< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > terminated< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > waiting< / span > < span class = "token operator" > =< / span > ContainerStateWaiting< span class = "token punctuation" > (< / span > message< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > reason< / span > < span class = "token operator" > =< / span > ContainerCreating, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > < span class = "token punctuation" > ]< / span >
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:03 INFO LoggingPodStatusWatcherImpl:54 - State changed, new state:
pod name: spark-pi-1505372339796-driver
namespace: spark-cluster
labels: spark-app-selector -< span class = "token operator" > > < / span > spark-f4d3a5d3ad964a05a51feb6191d50357, spark-role -< span class = "token operator" > > < / span > driver
pod uid: 304cf440-991a-11e7-970c-f4e9d49f8ed0
creation time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
< span class = "token function" > service< / span > account name: spark
volumes: spark-token-zr8wv
node name: < span class = "token number" > 172.20< / span > .0.114
start time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
container images: harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1
phase: Running
status: < span class = "token punctuation" > [< / span > ContainerStatus< span class = "token punctuation" > (< / span > containerID< span class = "token operator" > =< / span > docker://5c5c821c482a1e35552adccb567020532b79244392374f25754f0050e6cd4c62, < span class = "token assign-left variable" > image< / span > < span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1, < span class = "token assign-left variable" > imageID< / span > < span class = "token operator" > =< / span > docker-pullable://harbor-001.jimmysong.io/library/spark-driver@sha256:beb92a3e3f178e286d9e5baebdead88b5ba76d651f347ad2864bb6f8eda26f94, < span class = "token assign-left variable" > lastState< / span > < span class = "token operator" > =< / span > ContainerState< span class = "token punctuation" > (< / span > running< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > terminated< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > waiting< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > name< / span > < span class = "token operator" > =< / span > spark-kubernetes-driver, < span class = "token assign-left variable" > ready< / span > < span class = "token operator" > =< / span > true, < span class = "token assign-left variable" > restartCount< / span > < span class = "token operator" > =< / span > < span class = "token number" > 0< / span > , < span class = "token assign-left variable" > state< / span > < span class = "token operator" > =< / span > ContainerState< span class = "token punctuation" > (< / span > running< span class = "token operator" > =< / span > ContainerStateRunning< span class = "token punctuation" > (< / span > startedAt< span class = "token operator" > =< / span > < span class = "token number" > 2017< / span > -09-14T06:59:02Z, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > terminated< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > waiting< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > < span class = "token punctuation" > ]< / span >
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:12 INFO LoggingPodStatusWatcherImpl:54 - State changed, new state:
pod name: spark-pi-1505372339796-driver
namespace: spark-cluster
labels: spark-app-selector -< span class = "token operator" > > < / span > spark-f4d3a5d3ad964a05a51feb6191d50357, spark-role -< span class = "token operator" > > < / span > driver
pod uid: 304cf440-991a-11e7-970c-f4e9d49f8ed0
creation time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
< span class = "token function" > service< / span > account name: spark
volumes: spark-token-zr8wv
node name: < span class = "token number" > 172.20< / span > .0.114
start time: < span class = "token number" > 2017< / span > -09-14T06:59:01Z
container images: harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1
phase: Succeeded
status: < span class = "token punctuation" > [< / span > ContainerStatus< span class = "token punctuation" > (< / span > containerID< span class = "token operator" > =< / span > docker://5c5c821c482a1e35552adccb567020532b79244392374f25754f0050e6cd4c62, < span class = "token assign-left variable" > image< / span > < span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1, < span class = "token assign-left variable" > imageID< / span > < span class = "token operator" > =< / span > docker-pullable://harbor-001.jimmysong.io/library/spark-driver@sha256:beb92a3e3f178e286d9e5baebdead88b5ba76d651f347ad2864bb6f8eda26f94, < span class = "token assign-left variable" > lastState< / span > < span class = "token operator" > =< / span > ContainerState< span class = "token punctuation" > (< / span > running< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > terminated< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > waiting< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > name< / span > < span class = "token operator" > =< / span > spark-kubernetes-driver, < span class = "token assign-left variable" > ready< / span > < span class = "token operator" > =< / span > false, < span class = "token assign-left variable" > restartCount< / span > < span class = "token operator" > =< / span > < span class = "token number" > 0< / span > , < span class = "token assign-left variable" > state< / span > < span class = "token operator" > =< / span > ContainerState< span class = "token punctuation" > (< / span > running< span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > terminated< / span > < span class = "token operator" > =< / span > ContainerStateTerminated< span class = "token punctuation" > (< / span > containerID< span class = "token operator" > =< / span > docker://5c5c821c482a1e35552adccb567020532b79244392374f25754f0050e6cd4c62, < span class = "token assign-left variable" > exitCode< / span > < span class = "token operator" > =< / span > < span class = "token number" > 0< / span > , < span class = "token assign-left variable" > finishedAt< / span > < span class = "token operator" > =< / span > < span class = "token number" > 2017< / span > -09-14T06:59:11Z, < span class = "token assign-left variable" > message< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > reason< / span > < span class = "token operator" > =< / span > Completed, < span class = "token assign-left variable" > signal< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > startedAt< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > waiting< / span > < span class = "token operator" > =< / span > null, < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > , < span class = "token assign-left variable" > additionalProperties< / span > < span class = "token operator" > =< / span > < span class = "token punctuation" > {< / span > < span class = "token punctuation" > }< / span > < span class = "token punctuation" > )< / span > < span class = "token punctuation" > ]< / span >
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:12 INFO LoggingPodStatusWatcherImpl:54 - Container final statuses:
Container name: spark-kubernetes-driver
Container image: harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1
Container state: Terminated
Exit code: < span class = "token number" > 0< / span >
< span class = "token number" > 2017< / span > -09-14 < span class = "token number" > 14< / span > :59:12 INFO Client:54 - Application spark-pi finished.
< / code > < / pre >
< p > 从 日 志 中 可 以 看 到 任 务 运 行 的 状 态 信 息 。 < / p >
< p > 使 用 下 面 的 命 令 可 以 看 到 kubernetes 启 动 的 Pod 信 息 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > kubectl --namespace spark-cluster get pods -w
< / code > < / pre >
< p > 将 会 看 到 < code > spark-driver< / code > 和 < code > spark-exec< / code > 的 Pod 信 息 。 < / p >
< h2 id = "依赖管理" > 依 赖 管 理 < / h2 >
< p > 上 文 中 我 们 在 运 行 测 试 程 序 时 ， 命 令 行 中 指 定 的 jar 文 件 已 包 含 在 docker 镜 像 中 ， 是 不 是 说 我 们 每 次 提 交 任 务 都 需 要 重 新 创 建 一 个 镜 像 呢 ？ 非 也 ！ 如 果 真 是 这 样 也 太 麻 烦 了 。 < / p >
< h4 id = "创建-resource-staging-server" > 创 建 resource staging server< / h4 >
< p > 为 了 方 便 用 户 提 交 任 务 ， 不 需 要 每 次 提 交 任 务 的 时 候 都 创 建 一 个 镜 像 ， 我 们 使 用 了 < strong > resource staging server< / strong > 。 < / p >
< pre class = "language-" > < code > kubectl create -f conf/kubernetes-resource-staging-server.yaml
< / code > < / pre > < p > 我 们 同 样 将 其 部 署 在 < code > spark-cluster< / code > namespace 下 ， 该 yaml 文 件 见 < a href = "https://github.com/rootsongjc/kubernetes-handbook" target = "_blank" > kubernetes-handbook< / a > 的 < code > manifests/spark-with-kubernetes-native-scheduler< / code > 目 录 。 < / p >
< h4 id = "优化" > 优 化 < / h4 >
< p > 其 中 有 一 点 需 要 优 化 ， 在 使 用 下 面 的 命 令 提 交 任 务 时 ， 使 用 < code > --conf spark.kubernetes.resourceStagingServer.uri< / code > 参 数 指 定 < em > resource staging server< / em > 地 址 ， 用 户 不 应 该 关 注 < em > resource staging server< / em > 究 竟 运 行 在 哪 台 宿 主 机 上 ， 可 以 使 用 下 面 两 种 方 式 实 现 ： < / p >
< ul >
< li > 使 用 < code > nodeSelector< / code > 将 < em > resource staging server< / em > 固 定 调 度 到 某 一 台 机 器 上 ， 该 地 址 依 然 使 用 宿 主 机 的 IP 地 址 < / li >
< li > 改 变 < code > spark-resource-staging-service< / code > service 的 type 为 < strong > ClusterIP< / strong > ， 然 后 使 用 < strong > Ingress< / strong > 将 其 暴 露 到 集 群 外 部 ， 然 后 加 入 的 内 网 DNS 里 ， 用 户 使 用 DNS 名 称 指 定 < em > resource staging server< / em > 的 地 址 。 < / li >
< / ul >
< p > 然 后 可 以 执 行 下 面 的 命 令 来 提 交 本 地 的 jar 到 kubernetes 上 运 行 。 < / p >
< pre class = "language-" > < code class = "lang-bash" > ./spark-submit < span class = "token punctuation" > \< / span >
--deploy-mode cluster < span class = "token punctuation" > \< / span >
--class org.apache.spark.examples.SparkPi < span class = "token punctuation" > \< / span >
--master k8s://https://172.20.0.113:6443 < span class = "token punctuation" > \< / span >
--kubernetes-namespace spark-cluster < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.authenticate.driver.serviceAccountName< span class = "token operator" > =< / span > spark < span class = "token punctuation" > \< / span >
--conf spark.executor.instances< span class = "token operator" > =< / span > < span class = "token number" > 5< / span > < span class = "token punctuation" > \< / span >
--conf spark.app.name< span class = "token operator" > =< / span > spark-pi < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driver.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-executor:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.initcontainer.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-init:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.resourceStagingServer.uri< span class = "token operator" > =< / span > http://172.20.0.114:31000 < span class = "token punctuation" > \< / span >
< span class = "token punctuation" > ..< / span > /examples/jars/spark-examples_2.11-2.2.0-k8s-0.4.0-SNAPSHOT.jar
< / code > < / pre >
< p > 该 命 令 将 提 交 本 地 的 < code > ../examples/jars/spark-examples_2.11-2.2.0-k8s-0.4.0-SNAPSHOT.jar< / code > 文 件 到 < em > resource staging server< / em > ， executor 将 从 该 server 上 获 取 jar 包 并 运 行 ， 这 样 用 户 就 不 需 要 每 次 提 交 任 务 都 编 译 一 个 镜 像 了 。 < / p >
< p > 详 见 ： < a href = "https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html#dependency-management" target = "_blank" > https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html#dependency-management< / a > < / p >
< h4 id = "设置-hdfs-用户" > 设 置 HDFS 用 户 < / h4 >
< p > 如 果 Hadoop 集 群 没 有 设 置 kerbros 安 全 认 证 的 话 ， 在 指 定 < code > spark-submit< / code > 的 时 候 可 以 通 过 指 定 如 下 四 个 环 境 变 量 ， 设 置 Spark 与 HDFS 通 信 使 用 的 用 户 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > --conf spark.kubernetes.driverEnv.SPARK_USER< span class = "token operator" > =< / span > hadoop
--conf spark.kubernetes.driverEnv.HADOOP_USER_NAME< span class = "token operator" > =< / span > hadoop
--conf spark.executorEnv.HADOOP_USER_NAME< span class = "token operator" > =< / span > hadoop
--conf spark.executorEnv.SPARK_USER< span class = "token operator" > =< / span > hadoop
< / code > < / pre >
< p > 使 用 hadoop 用 户 提 交 本 地 jar 包 的 命 令 示 例 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > ./spark-submit < span class = "token punctuation" > \< / span >
--deploy-mode cluster < span class = "token punctuation" > \< / span >
--class com.talkingdata.alluxio.hadooptest < span class = "token punctuation" > \< / span >
--master k8s://https://172.20.0.113:6443 < span class = "token punctuation" > \< / span >
--kubernetes-namespace spark-cluster < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driverEnv.SPARK_USER< span class = "token operator" > =< / span > hadoop < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driverEnv.HADOOP_USER_NAME< span class = "token operator" > =< / span > hadoop < span class = "token punctuation" > \< / span >
--conf spark.executorEnv.HADOOP_USER_NAME< span class = "token operator" > =< / span > hadoop < span class = "token punctuation" > \< / span >
--conf spark.executorEnv.SPARK_USER< span class = "token operator" > =< / span > hadoop < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.authenticate.driver.serviceAccountName< span class = "token operator" > =< / span > spark < span class = "token punctuation" > \< / span >
--conf spark.executor.instances< span class = "token operator" > =< / span > < span class = "token number" > 5< / span > < span class = "token punctuation" > \< / span >
--conf spark.app.name< span class = "token operator" > =< / span > spark-pi < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driver.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-executor:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.initcontainer.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-init:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.resourceStagingServer.uri< span class = "token operator" > =< / span > http://172.20.0.114:31000 < span class = "token punctuation" > \< / span >
~/Downloads/tendcloud_2.10-1.0.jar
< / code > < / pre >
< p > 详 见 ： < a href = "https://github.com/apache-spark-on-k8s/spark/issues/408" target = "_blank" > https://github.com/apache-spark-on-k8s/spark/issues/408< / a > < / p >
< h4 id = "限制-driver-和-executor-的资源使用" > 限 制 Driver 和 Executor 的 资 源 使 用 < / h4 >
< p > 在 执 行 < code > spark-submit< / code > 时 使 用 如 下 参 数 设 置 内 存 和 CPU 资 源 限 制 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > --conf spark.driver.memory< span class = "token operator" > =< / span > 3G
--conf spark.executor.memory< span class = "token operator" > =< / span > 3G
--conf spark.driver.cores< span class = "token operator" > =< / span > < span class = "token number" > 2< / span >
--conf spark.executor.cores< span class = "token operator" > =< / span > < span class = "token number" > 10< / span >
< / code > < / pre >
< p > 这 几 个 参 数 中 值 如 何 传 递 到 Pod 的 资 源 设 置 中 的 呢 ？ < / p >
< p > 比 如 我 们 设 置 在 执 行 < code > spark-submit< / code > 的 时 候 传 递 了 这 样 的 两 个 参 数 ： < code > --conf spark.driver.cores=2< / code > 和 < code > --conf spark.driver.memory=100G< / code > 那 么 查 看 driver pod 的 yaml 输 出 结 果 将 会 看 到 这 样 的 资 源 设 置 ： < / p >
< pre class = "language-" > < code class = "lang-yaml" > < span class = "token key atrule" > resources< / span > < span class = "token punctuation" > :< / span >
< span class = "token key atrule" > limits< / span > < span class = "token punctuation" > :< / span >
< span class = "token key atrule" > memory< / span > < span class = "token punctuation" > :< / span > 110Gi
< span class = "token key atrule" > requests< / span > < span class = "token punctuation" > :< / span >
< span class = "token key atrule" > cpu< / span > < span class = "token punctuation" > :< / span > < span class = "token string" > " 2" < / span >
< span class = "token key atrule" > memory< / span > < span class = "token punctuation" > :< / span > 100Gi
< / code > < / pre >
< p > 以 上 参 数 是 对 < code > request< / code > 值 的 设 置 ， 那 么 < code > limit< / code > 的 资 源 设 置 的 值 又 是 从 何 而 来 ？ < / p >
< p > 可 以 使 用 < code > spark.kubernetes.driver.limit.cores< / code > 和 < code > spark.kubernetes.executor.limit.cores< / code > 来 设 置 CPU的 hard limit。 < / p >
< p > memory limit 的 值 是 根 据 memory request 的 值 加 上 < code > spark.kubernetes.executor.memoryOverhead< / code > 的 值 计 算 而 来 的 ， 该 配 置 项 用 于 设 置 分 配 给 每 个 executor 的 超 过 heap 内 存 的 值 （ 可 以 使 用 k、 m、 g单 位 ） 。 该 值 用 于 虚 拟 机 的 开 销 、 其 他 本 地 服 务 开 销 。 根 据 executor 的 大 小 设 置 （ 通 常 是 6%到 10%） 。 < / p >
< p > 我 们 可 以 这 样 来 提 交 一 个 任 务 ， 同 时 设 置 driver 和 executor 的 CPU、 内 存 的 资 源 request 和 limit 值 （ driver 的 内 存 limit 值 为 request 值 的 110%） 。 < / p >
< pre class = "language-" > < code class = "lang-bash" > ./spark-submit < span class = "token punctuation" > \< / span >
--deploy-mode cluster < span class = "token punctuation" > \< / span >
--class org.apache.spark.examples.SparkPi < span class = "token punctuation" > \< / span >
--master k8s://https://172.20.0.113:6443 < span class = "token punctuation" > \< / span >
--kubernetes-namespace spark-cluster < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.authenticate.driver.serviceAccountName< span class = "token operator" > =< / span > spark < span class = "token punctuation" > \< / span >
--conf spark.driver.memory< span class = "token operator" > =< / span > 100G < span class = "token punctuation" > \< / span >
--conf spark.executor.memory< span class = "token operator" > =< / span > 10G < span class = "token punctuation" > \< / span >
--conf spark.driver.cores< span class = "token operator" > =< / span > < span class = "token number" > 30< / span > < span class = "token punctuation" > \< / span >
--conf spark.executor.cores< span class = "token operator" > =< / span > < span class = "token number" > 2< / span > < span class = "token punctuation" > \< / span >
--conf spark.driver.maxResultSize< span class = "token operator" > =< / span > 10240m < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driver.limit.cores< span class = "token operator" > =< / span > < span class = "token number" > 32< / span > < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.limit.cores< span class = "token operator" > =< / span > < span class = "token number" > 3< / span > < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.memoryOverhead< span class = "token operator" > =< / span > 2g < span class = "token punctuation" > \< / span >
--conf spark.executor.instances< span class = "token operator" > =< / span > < span class = "token number" > 5< / span > < span class = "token punctuation" > \< / span >
--conf spark.app.name< span class = "token operator" > =< / span > spark-pi < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.driver.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-driver:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.executor.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-executor:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
--conf spark.kubernetes.initcontainer.docker.image< span class = "token operator" > =< / span > harbor-001.jimmysong.io/library/spark-init:v2.1.0-kubernetes-0.3.1-1 < span class = "token punctuation" > \< / span >
local:///opt/spark/examples/jars/spark-examples_2.11-2.2.0-k8s-0.4.0-SNAPSHOT.jar < span class = "token number" > 10000000< / span >
< / code > < / pre >
< p > 这 将 启 动 一 个 包 含 一 千 万 个 task 的 计 算 pi 的 spark 任 务 ， 任 务 运 行 过 程 中 ， drvier 的 CPU 实 际 消 耗 大 约 为 3 核 ， 内 存 40G， 每 个 executor 的 CPU 实 际 消 耗 大 约 不 到 1 核 ， 内 存 不 到 4G， 我 们 可 以 根 据 实 际 资 源 消 耗 不 断 优 化 资 源 的 request 值 。 < / p >
< p > < code > SPARK_DRIVER_MEMORY< / code > 和 < code > SPARK_EXECUTOR_MEMORY< / code > 和 分 别 作 为 Driver 容 器 和 Executor 容 器 启 动 的 环 境 变 量 ， 比 如 下 面 这 个 Driver 启 动 的 CMD 中 ： < / p >
< pre class = "language-" > < code class = "lang-bash" > CMD < span class = "token assign-left variable" > SPARK_CLASSPATH< / span > < span class = "token operator" > =< / span > < span class = "token string" > " < span class = "token variable" > ${SPARK_HOME}< / span > /jars/*" < / span > < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token function" > env< / span > < span class = "token operator" > |< / span > < span class = "token function" > grep< / span > SPARK_JAVA_OPT_ < span class = "token operator" > |< / span > < span class = "token function" > sed< / span > < span class = "token string" > ' s/[^=]*=\(.*\)/< span class = "token entity" title = "\1" > \1< / span > /g' < / span > < span class = "token operator" > > < / span > /tmp/java_opts.txt < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token builtin class-name" > readarray< / span > -t SPARK_DRIVER_JAVA_OPTS < span class = "token operator" > < < / span > /tmp/java_opts.txt < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token keyword" > if< / span > < span class = "token operator" > !< / span > < span class = "token punctuation" > [< / span > -z < span class = "token variable" > ${SPARK_MOUNTED_CLASSPATH+x}< / span > < span class = "token punctuation" > ]< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > then< / span > < span class = "token assign-left variable" > SPARK_CLASSPATH< / span > < span class = "token operator" > =< / span > < span class = "token string" > " < span class = "token variable" > $SPARK_MOUNTED_CLASSPATH< / span > :< span class = "token variable" > $SPARK_CLASSPATH< / span > " < / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > fi< / span > < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token keyword" > if< / span > < span class = "token operator" > !< / span > < span class = "token punctuation" > [< / span > -z < span class = "token variable" > ${SPARK_SUBMIT_EXTRA_CLASSPATH+x}< / span > < span class = "token punctuation" > ]< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > then< / span > < span class = "token assign-left variable" > SPARK_CLASSPATH< / span > < span class = "token operator" > =< / span > < span class = "token string" > " < span class = "token variable" > $SPARK_SUBMIT_EXTRA_CLASSPATH< / span > :< span class = "token variable" > $SPARK_CLASSPATH< / span > " < / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > fi< / span > < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token keyword" > if< / span > < span class = "token operator" > !< / span > < span class = "token punctuation" > [< / span > -z < span class = "token variable" > ${SPARK_EXTRA_CLASSPATH+x}< / span > < span class = "token punctuation" > ]< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > then< / span > < span class = "token assign-left variable" > SPARK_CLASSPATH< / span > < span class = "token operator" > =< / span > < span class = "token string" > " < span class = "token variable" > $SPARK_EXTRA_CLASSPATH< / span > :< span class = "token variable" > $SPARK_CLASSPATH< / span > " < / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > fi< / span > < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token keyword" > if< / span > < span class = "token operator" > !< / span > < span class = "token punctuation" > [< / span > -z < span class = "token variable" > ${SPARK_MOUNTED_FILES_DIR+x}< / span > < span class = "token punctuation" > ]< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > then< / span > < span class = "token function" > cp< / span > -R < span class = "token string" > " < span class = "token variable" > $SPARK_MOUNTED_FILES_DIR< / span > /." < / span > < span class = "token builtin class-name" > .< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > fi< / span > < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token keyword" > if< / span > < span class = "token operator" > !< / span > < span class = "token punctuation" > [< / span > -z < span class = "token variable" > ${SPARK_MOUNTED_FILES_FROM_SECRET_DIR}< / span > < span class = "token punctuation" > ]< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > then< / span > < span class = "token function" > cp< / span > -R < span class = "token string" > " < span class = "token variable" > $SPARK_MOUNTED_FILES_FROM_SECRET_DIR< / span > /." < / span > < span class = "token builtin class-name" > .< / span > < span class = "token punctuation" > ;< / span > < span class = "token keyword" > fi< / span > < span class = "token operator" > & & < / span > < span class = "token punctuation" > \< / span >
< span class = "token variable" > ${JAVA_HOME}< / span > /bin/java < span class = "token string" > " < span class = "token variable" > ${SPARK_DRIVER_JAVA_OPTS< span class = "token punctuation" > [< / span > @< span class = "token punctuation" > ]< / span > }< / span > " < / span > -cp < span class = "token variable" > $SPARK_CLASSPATH< / span > -Xms< span class = "token variable" > $SPARK_DRIVER_MEMORY< / span > -Xmx< span class = "token variable" > $SPARK_DRIVER_MEMORY< / span > < span class = "token variable" > $SPARK_DRIVER_CLASS< / span > < span class = "token variable" > $SPARK_DRIVER_ARGS< / span >
< / code > < / pre >
< p > 我 们 可 以 看 到 对 < code > SPARK_DRIVER_MEMORY< / code > 环 境 变 量 的 引 用 。 Executor 的 设 置 与 driver 类 似 。 < / p >
< p > 而 我 们 可 以 使 用 这 样 的 参 数 来 传 递 环 境 变 量 的 值 < code > spark.executorEnv.[EnvironmentVariableName]< / code > ， 只 要 将 < code > EnvironmentVariableName< / code > 替 换 为 环 境 变 量 名 称 即 可 。 < / p >
< h2 id = "参考" > 参 考 < / h2 >
< ul >
< li > < a href = "http://lxw1234.com/archives/2015/12/593.htm" target = "_blank" > Spark动 态 资 源 分 配 -Dynamic Resource Allocation< / a > < / li >
< li > < a href = "https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html" target = "_blank" > Running Spark on Kubernetes< / a > < / li >
< li > < a href = "https://issues.apache.org/jira/browse/SPARK-18278" target = "_blank" > Apache Spark Jira Issue - 18278 - SPIP: Support native submission of spark jobs to a kubernetes cluster< / a > < / li >
< li > < a href = "https://github.com/kubernetes/kubernetes/issues/34377" target = "_blank" > Kubernetes Github Issue - 34377 Support Spark natively in Kubernetes< / a > < / li >
< li > < a href = "https://github.com/rootsongjc/spark-on-kubernetes" target = "_blank" > https://github.com/rootsongjc/spark-on-kubernetes< / a > < / li >
< li > < a href = "https://github.com/apache-spark-on-k8s/spark/blob/branch-2.2-kubernetes/resource-managers/kubernetes/architecture-docs/scheduler-backend.md" target = "_blank" > Scheduler backend< / a > < / li >
< li > < a href = "https://banzaicloud.github.io/blog/spark-k8s/" target = "_blank" > Introduction to Spark on Kubernetes - banzaicloud.com< / a > < / li >
< li > < a href = "https://banzaicloud.com/blog/scaling-spark-k8s/" target = "_blank" > Scaling Spark made simple on Kubernetes - banzaicloud.com< / a > < / li >
< li > < a href = "https://banzaicloud.com/blog/spark-k8s-internals/" target = "_blank" > The anatomy of Spark applications on Kubernetes - banzaicloud.com< / a > < / li >
< li > < a href = "https://banzaicloud.com/blog/spark-monitoring/" target = "_blank" > Monitoring Apache Spark with Prometheus - banzaicloud.com< / a > < / li >
< li > < a href = "https://banzaicloud.com/blog/zeppelin-spark-k8/" target = "_blank" > Running Zeppelin Spark notebooks on Kubernetes - banzaicloud.com< / a > < / li >
< li > < a href = "https://banzaicloud.com/blog/pipeline-howto/" target = "_blank" > Apache Spark CI/CD workflow howto - banzaicloud.com< / a > < / li >
< / ul >
< footer class = "page-footer" > < span class = "copyright" > < a href = "https://cloudnative.to/contact/" target = "_blank" > 加 入 云 原 生 社 区 · 共 谱 云 原 生 新 篇 章 < / a > < p > < / p > Copyright © 2017-2020 | Distributed under < a href = "https://creativecommons.org/licenses/by-nc-sa/4.0/deed.zh" target = "_blank" > CC BY 4.0< / a > | < a href = "https://jimmysong.io" target = "_blank" > jimmysong.io< / a > all right reserved， powered by Gitbook< / span > < span class = "footer-modification" > Updated at
2020-06-21 15:23:27 +08:00
2020-06-21 07:18:34
2020-06-19 14:52:56 +08:00
< / span > < / footer >
< / section >
< / div >
< div class = "search-results" >
< div class = "has-results" >
< h1 class = "search-results-title" > < span class = 'search-results-count' > < / span > results matching "< span class = 'search-query' > < / span > "< / h1 >
< ul class = "search-results-list" > < / ul >
< / div >
< div class = "no-results" >
< h1 class = "search-results-title" > No results matching "< span class = 'search-query' > < / span > "< / h1 >
< / div >
< / div >
< / div >
< / div >
< / div >
< / div >
< a href = "spark-standalone-on-kubernetes.html" class = "navigation navigation-prev " aria-label = "Previous page: Spark standalone on Kubernetes" >
< i class = "fa fa-angle-left" > < / i >
< / a >
< a href = "serverless.html" class = "navigation navigation-next " aria-label = "Next page: Serverless 架构" >
< i class = "fa fa-angle-right" > < / i >
< / a >
< / div >
< script >
var gitbook = gitbook || [];
gitbook.push(function() {
2020-06-21 15:23:27 +08:00
gitbook.page.hasChanged({"page":{"title":"运行支持 Kubernetes 原生调度的 Spark 程序","level":"6.4.2","depth":2,"next":{"title":"Serverless 架构","level":"6.5","depth":1,"path":"usecases/serverless.md","ref":"usecases/serverless.md","articles":[{"title":"理解 Serverless","level":"6.5.1","depth":2,"path":"usecases/understanding-serverless.md","ref":"usecases/understanding-serverless.md","articles":[]},{"title":"FaaS（ ） < a href = https://cloudnative.to/contact/ > 加入云原生社区·共谱云原生新篇章< / a > < / p > Copyright © 2017-2020 | Distributed under < a href = https://creativecommons.org/licenses/by-nc-sa/4.0/deed.zh > CC BY 4.0< / a > | < a href = https://jimmysong.io > jimmysong.io< / a > ","modify_label":" Updated at ","modify_format":"YYYY-MM-DD HH:mm:ss"},"prism":{"css":["prism-themes/themes/prism-ghcolors.css"]},"github":{"url":"https://github.com/rootsongjc/kubernetes-handbook"},"editlink":{"label":"编辑本页","multilingual":false,"base":"https://github.com/rootsongjc/kubernetes-handbook/blob/master/"},"splitter":{},"codesnippet":{},"sitemap-general":{"prefix":"https://jimmysong.io/kubernetes-handbook/"},"fontsettings":{"theme":"white","family":"sans","size":2},"favicon":{"shortcut":"favicon.ico","bookmark":"favicon.ico"},"lightbox":{"jquery":true,"sameUuid":false},"page-toc-button":{},"back-to-top-button":{},"prism-themes":{},"alerts":{},"github-buttons":{"repo":"rootsongjc/kubernetes-handbook","types":["star"],"size":"small"},"3-ba":{"configuration":"auto","token":"11f7d254cfa4e0ca44b175c66d379ecc"},"copy-code-button":{},"ga":{"configuration":"auto","token":"UA-93485976-1"},"sharing":{"facebook":true,"twitter":true,"google":false,"weibo":false,"instapaper":false,"vk":false,"all":["facebook","google","twitter","weibo","instapaper"]},"theme-default":{"showLevel":true,"styles":{"ebook":"styles/ebook.css","epub":"styles/epub.css","mobi":"styles/mobi.css","pdf":"styles/pdf.css","print":"styles/print.css","website":"styles/website.css"}},"search-plus":{},"image-captions":{"caption":"图 _PAGE_LEVEL_._PAGE_IMAGE_NUMBER_： （ ） ：
2020-06-19 14:52:56 +08:00
});
< / script >
< / div >
< script src = "../gitbook/gitbook.js" > < / script >
< script src = "../gitbook/theme.js" > < / script >
< script src = "../gitbook/gitbook-plugin-github/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-splitter/splitter.js" > < / script >
< script src = "../gitbook/gitbook-plugin-page-toc-button/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-editlink/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-back-to-top-button/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-search-plus/jquery.mark.min.js" > < / script >
< script src = "../gitbook/gitbook-plugin-search-plus/search.js" > < / script >
< script src = "../gitbook/gitbook-plugin-github-buttons/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-3-ba/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-lightbox/js/lightbox.min.js" > < / script >
< script src = "../gitbook/gitbook-plugin-ga/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-copy-code-button/toggle.js" > < / script >
< script src = "../gitbook/gitbook-plugin-alerts/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-sharing/buttons.js" > < / script >
< script src = "../gitbook/gitbook-plugin-fontsettings/fontsettings.js" > < / script >
< / body >
< / html >
