2017-08-21 17:44:43 +08:00
<!DOCTYPE HTML>
2017-09-19 22:01:07 +08:00
< html lang = "zh-hans" >
2017-08-21 17:44:43 +08:00
< head >
< meta charset = "UTF-8" >
< meta content = "text/html; charset=utf-8" http-equiv = "Content-Type" >
< title > 4.3.2 应用日志收集 · Kubernetes Handbook< / title >
< meta http-equiv = "X-UA-Compatible" content = "IE=edge" / >
< meta name = "description" content = "" >
< meta name = "generator" content = "GitBook 3.2.2" >
< meta name = "author" content = "Jimmy Song" >
< link rel = "stylesheet" href = "../gitbook/style.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-splitter/splitter.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-page-toc-button/plugin.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-image-captions/image-captions.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-page-footer-ex/style/plugin.css" >
2017-09-19 21:38:03 +08:00
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-back-to-top-button/plugin.css" >
2017-08-21 17:44:43 +08:00
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-search-plus/search.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-highlight/website.css" >
< link rel = "stylesheet" href = "../gitbook/gitbook-plugin-fontsettings/website.css" >
< meta name = "HandheldFriendly" content = "true" / >
< meta name = "viewport" content = "width=device-width, initial-scale=1, user-scalable=no" >
< meta name = "apple-mobile-web-app-capable" content = "yes" >
< meta name = "apple-mobile-web-app-status-bar-style" content = "black" >
< link rel = "apple-touch-icon-precomposed" sizes = "152x152" href = "../gitbook/images/apple-touch-icon-precomposed-152.png" >
< link rel = "shortcut icon" href = "../gitbook/images/favicon.ico" type = "image/x-icon" >
< link rel = "next" href = "configuration-best-practice.html" / >
< link rel = "prev" href = "service-rolling-update.html" / >
< / head >
< body >
< div class = "book" >
< div class = "book-summary" >
< div id = "book-search-input" role = "search" >
2017-09-19 22:01:07 +08:00
< input type = "text" placeholder = "输入并搜索" / >
2017-08-21 17:44:43 +08:00
< / div >
< nav role = "navigation" >
< ul class = "summary" >
< li class = "chapter " data-level = "1.1" data-path = "../" >
< a href = "../" >
1. 前言
< / a >
< / li >
< li class = "chapter " data-level = "1.2" data-path = "../concepts/" >
< a href = "../concepts/" >
2. 概念原理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.2.1" data-path = "../concepts/concepts.html" >
< a href = "../concepts/concepts.html" >
2.1 设计理念
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2" data-path = "../concepts/objects.html" >
< a href = "../concepts/objects.html" >
2017-09-03 13:29:38 +08:00
2.2 Objects
2017-08-21 17:44:43 +08:00
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.2.2.1" data-path = "../concepts/pod-overview.html" >
< a href = "../concepts/pod-overview.html" >
2.2.1 Pod
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.2.2.1.1" data-path = "../concepts/pod.html" >
< a href = "../concepts/pod.html" >
2.2.1.1 Pod解析
< / a >
2017-08-31 23:28:33 +08:00
< / li >
< li class = "chapter " data-level = "1.2.2.1.2" data-path = "../concepts/init-containers.html" >
< a href = "../concepts/init-containers.html" >
2.2.1.2 Init容器
< / a >
2017-09-03 15:58:39 +08:00
< / li >
< li class = "chapter " data-level = "1.2.2.1.3" data-path = "../concepts/pod-security-policy.html" >
< a href = "../concepts/pod-security-policy.html" >
2.2.1.3 Pod安全策略
< / a >
2017-09-17 15:39:26 +08:00
< / li >
< li class = "chapter " data-level = "1.2.2.1.4" data-path = "../concepts/pod-lifecycle.html" >
< a href = "../concepts/pod-lifecycle.html" >
2.2.1.4 Pod的生命周期
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.2.2.2" data-path = "../concepts/node.html" >
< a href = "../concepts/node.html" >
2.2.2 Node
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.3" data-path = "../concepts/namespace.html" >
< a href = "../concepts/namespace.html" >
2.2.3 Namespace
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.4" data-path = "../concepts/service.html" >
< a href = "../concepts/service.html" >
2.2.4 Service
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.5" data-path = "../concepts/volume.html" >
< a href = "../concepts/volume.html" >
2.2.5 Volume和Persistent Volume
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.6" data-path = "../concepts/deployment.html" >
< a href = "../concepts/deployment.html" >
2.2.6 Deployment
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.7" data-path = "../concepts/secret.html" >
< a href = "../concepts/secret.html" >
2.2.7 Secret
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.8" data-path = "../concepts/statefulset.html" >
< a href = "../concepts/statefulset.html" >
2.2.8 StatefulSet
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.9" data-path = "../concepts/daemonset.html" >
< a href = "../concepts/daemonset.html" >
2.2.9 DaemonSet
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.10" data-path = "../concepts/serviceaccount.html" >
< a href = "../concepts/serviceaccount.html" >
2.2.10 ServiceAccount
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.11" data-path = "../concepts/replicaset.html" >
< a href = "../concepts/replicaset.html" >
2.2.11 ReplicationController和ReplicaSet
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.12" data-path = "../concepts/job.html" >
< a href = "../concepts/job.html" >
2.2.12 Job
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.13" data-path = "../concepts/cronjob.html" >
< a href = "../concepts/cronjob.html" >
2.2.13 CronJob
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.14" data-path = "../concepts/ingress.html" >
< a href = "../concepts/ingress.html" >
2.2.14 Ingress
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.15" data-path = "../concepts/configmap.html" >
< a href = "../concepts/configmap.html" >
2.2.15 ConfigMap
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.16" data-path = "../concepts/horizontal-pod-autoscaling.html" >
< a href = "../concepts/horizontal-pod-autoscaling.html" >
2.2.16 Horizontal Pod Autoscaling
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.17" data-path = "../concepts/label.html" >
< a href = "../concepts/label.html" >
2.2.17 Label
< / a >
2017-09-03 15:58:39 +08:00
< / li >
< li class = "chapter " data-level = "1.2.2.18" data-path = "../concepts/garbage-collection.html" >
< a href = "../concepts/garbage-collection.html" >
2.2.18 垃圾收集
< / a >
< / li >
< li class = "chapter " data-level = "1.2.2.19" data-path = "../concepts/network-policy.html" >
< a href = "../concepts/network-policy.html" >
2.2.19 NetworkPolicy
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.3" data-path = "../guide/" >
< a href = "../guide/" >
3. 用户指南
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.3.1" data-path = "../guide/resource-configuration.html" >
< a href = "../guide/resource-configuration.html" >
3.1 资源配置
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.3.1.1" data-path = "../guide/configure-liveness-readiness-probes.html" >
< a href = "../guide/configure-liveness-readiness-probes.html" >
3.1.1 配置Pod的liveness和readiness探针
< / a >
< / li >
< li class = "chapter " data-level = "1.3.1.2" data-path = "../guide/configure-pod-service-account.html" >
< a href = "../guide/configure-pod-service-account.html" >
3.1.2 配置Pod的Service Account
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.3.2" data-path = "../guide/command-usage.html" >
< a href = "../guide/command-usage.html" >
3.2 命令使用
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.3.2.1" data-path = "../guide/using-kubectl.html" >
< a href = "../guide/using-kubectl.html" >
3.2.1 使用kubectl
< / a >
2017-09-16 20:56:43 +08:00
< / li >
< li class = "chapter " data-level = "1.3.2.2" data-path = "../guide/docker-cli-to-kubectl.html" >
< a href = "../guide/docker-cli-to-kubectl.html" >
3.2.2 docker用户过度到kubectl命令行指南
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
2017-09-07 12:29:13 +08:00
< li class = "chapter " data-level = "1.3.3" data-path = "../guide/cluster-security-management.html" >
2017-08-21 17:44:43 +08:00
2017-09-07 12:29:13 +08:00
< a href = "../guide/cluster-security-management.html" >
2017-08-21 17:44:43 +08:00
2017-09-07 12:29:13 +08:00
3.3 集群安全性管理
2017-08-21 17:44:43 +08:00
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.3.3.1" data-path = "../guide/managing-tls-in-a-cluster.html" >
< a href = "../guide/managing-tls-in-a-cluster.html" >
3.3.1 管理集群中的TLS
< / a >
2017-08-21 18:44:34 +08:00
< / li >
< li class = "chapter " data-level = "1.3.3.2" data-path = "../guide/kubelet-authentication-authorization.html" >
< a href = "../guide/kubelet-authentication-authorization.html" >
3.3.2 kubelet的认证授权
< / a >
< / li >
< li class = "chapter " data-level = "1.3.3.3" data-path = "../guide/tls-bootstrapping.html" >
< a href = "../guide/tls-bootstrapping.html" >
3.3.3 TLS bootstrap
< / a >
2017-08-31 14:23:44 +08:00
< / li >
< li class = "chapter " data-level = "1.3.3.4" data-path = "../guide/kubectl-user-authentication-authorization.html" >
< a href = "../guide/kubectl-user-authentication-authorization.html" >
3.3.4 kubectl的用户认证授权
< / a >
< / li >
< li class = "chapter " data-level = "1.3.3.5" data-path = "../guide/rbac.html" >
< a href = "../guide/rbac.html" >
3.3.5 RBAC——基于角色的访问控制
< / a >
2017-09-07 14:13:59 +08:00
< / li >
< li class = "chapter " data-level = "1.3.3.6" data-path = "../guide/ip-masq-agent.html" >
< a href = "../guide/ip-masq-agent.html" >
3.3.6 IP伪装代理
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.3.4" data-path = "../guide/access-kubernetes-cluster.html" >
< a href = "../guide/access-kubernetes-cluster.html" >
3.4 访问 Kubernetes 集群
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.3.4.1" data-path = "../guide/access-cluster.html" >
< a href = "../guide/access-cluster.html" >
3.4.1 访问集群
< / a >
< / li >
< li class = "chapter " data-level = "1.3.4.2" data-path = "../guide/authenticate-across-clusters-kubeconfig.html" >
< a href = "../guide/authenticate-across-clusters-kubeconfig.html" >
3.4.2 使用 kubeconfig 文件配置跨集群认证
< / a >
< / li >
< li class = "chapter " data-level = "1.3.4.3" data-path = "../guide/connecting-to-applications-port-forward.html" >
< a href = "../guide/connecting-to-applications-port-forward.html" >
3.4.3 通过端口转发访问集群中的应用程序
< / a >
< / li >
< li class = "chapter " data-level = "1.3.4.4" data-path = "../guide/service-access-application-cluster.html" >
< a href = "../guide/service-access-application-cluster.html" >
3.4.4 使用 service 访问群集中的应用程序
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.3.5" data-path = "../guide/application-development-deployment-flow.html" >
< a href = "../guide/application-development-deployment-flow.html" >
3.5 在kubernetes中开发部署应用
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.3.5.1" data-path = "../guide/deploy-applications-in-kubernetes.html" >
< a href = "../guide/deploy-applications-in-kubernetes.html" >
3.5.1 适用于kubernetes的应用开发部署流程
< / a >
2017-08-21 18:44:34 +08:00
< / li >
< li class = "chapter " data-level = "1.3.5.2" data-path = "../guide/migrating-hadoop-yarn-to-kubernetes.html" >
< a href = "../guide/migrating-hadoop-yarn-to-kubernetes.html" >
3.5.2 迁移传统应用到kubernetes中——以Hadoop YARN为例
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.4" data-path = "./" >
< a href = "./" >
4. 最佳实践
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.1" data-path = "install-kbernetes1.6-on-centos.html" >
< a href = "install-kbernetes1.6-on-centos.html" >
4.1 在CentOS上部署kubernetes1.6集群
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.1.1" data-path = "create-tls-and-secret-key.html" >
< a href = "create-tls-and-secret-key.html" >
4.1.1 创建TLS证书和秘钥
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.2" data-path = "create-kubeconfig.html" >
< a href = "create-kubeconfig.html" >
4.1.2 创建kubeconfig文件
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.3" data-path = "etcd-cluster-installation.html" >
< a href = "etcd-cluster-installation.html" >
4.1.3 创建高可用etcd集群
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.4" data-path = "kubectl-installation.html" >
< a href = "kubectl-installation.html" >
4.1.4 安装kubectl命令行工具
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.5" data-path = "master-installation.html" >
< a href = "master-installation.html" >
4.1.5 部署master节点
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.6" data-path = "node-installation.html" >
< a href = "node-installation.html" >
4.1.6 部署node节点
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.7" data-path = "kubedns-addon-installation.html" >
< a href = "kubedns-addon-installation.html" >
4.1.7 安装kubedns插件
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.8" data-path = "dashboard-addon-installation.html" >
< a href = "dashboard-addon-installation.html" >
4.1.8 安装dashboard插件
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.9" data-path = "heapster-addon-installation.html" >
< a href = "heapster-addon-installation.html" >
4.1.9 安装heapster插件
< / a >
< / li >
< li class = "chapter " data-level = "1.4.1.10" data-path = "efk-addon-installation.html" >
< a href = "efk-addon-installation.html" >
4.1.10 安装EFK插件
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.4.2" data-path = "service-discovery-and-loadbalancing.html" >
< a href = "service-discovery-and-loadbalancing.html" >
4.2 服务发现与负载均衡
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.2.1" data-path = "traefik-ingress-installation.html" >
< a href = "traefik-ingress-installation.html" >
4.2.1 安装Traefik ingress
< / a >
< / li >
< li class = "chapter " data-level = "1.4.2.2" data-path = "distributed-load-test.html" >
< a href = "distributed-load-test.html" >
4.2.2 分布式负载测试
< / a >
< / li >
< li class = "chapter " data-level = "1.4.2.3" data-path = "network-and-cluster-perfermance-test.html" >
< a href = "network-and-cluster-perfermance-test.html" >
4.2.3 网络和集群性能测试
< / a >
< / li >
< li class = "chapter " data-level = "1.4.2.4" data-path = "edge-node-configuration.html" >
< a href = "edge-node-configuration.html" >
4.2.4 边缘节点配置
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.4.3" data-path = "operation.html" >
< a href = "operation.html" >
4.3 运维管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.3.1" data-path = "service-rolling-update.html" >
< a href = "service-rolling-update.html" >
4.3.1 服务滚动升级
< / a >
< / li >
< li class = "chapter active" data-level = "1.4.3.2" data-path = "app-log-collection.html" >
< a href = "app-log-collection.html" >
4.3.2 应用日志收集
< / a >
< / li >
< li class = "chapter " data-level = "1.4.3.3" data-path = "configuration-best-practice.html" >
< a href = "configuration-best-practice.html" >
4.3.3 配置最佳实践
< / a >
< / li >
< li class = "chapter " data-level = "1.4.3.4" data-path = "monitor.html" >
< a href = "monitor.html" >
4.3.4 集群及应用监控
< / a >
< / li >
< li class = "chapter " data-level = "1.4.3.5" data-path = "jenkins-ci-cd.html" >
< a href = "jenkins-ci-cd.html" >
4.3.5 使用Jenkins进行持续构建与发布
< / a >
< / li >
< li class = "chapter " data-level = "1.4.3.6" data-path = "data-persistence-problem.html" >
< a href = "data-persistence-problem.html" >
4.3.6 数据持久化问题
< / a >
2017-09-03 15:58:39 +08:00
< / li >
< li class = "chapter " data-level = "1.4.3.7" data-path = "manage-compute-resources-container.html" >
< a href = "manage-compute-resources-container.html" >
4.3.7 管理容器的计算资源
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.4.4" data-path = "storage.html" >
< a href = "storage.html" >
4.4 存储管理
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.4.1" data-path = "glusterfs.html" >
< a href = "glusterfs.html" >
4.4.1 GlusterFS
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.4.1.1" data-path = "using-glusterfs-for-persistent-storage.html" >
< a href = "using-glusterfs-for-persistent-storage.html" >
4.4.1.1 使用GlusterFS做持久化存储
< / a >
< / li >
< li class = "chapter " data-level = "1.4.4.1.2" data-path = "storage-for-containers-using-glusterfs-with-openshift.html" >
< a href = "storage-for-containers-using-glusterfs-with-openshift.html" >
4.4.1.2 在OpenShift中使用GlusterFS做持久化存储
< / a >
2017-09-01 21:04:51 +08:00
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.4.4.2" data-path = "cephfs.html" >
< a href = "cephfs.html" >
4.4.2 CephFS
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.4.4.2.1" data-path = "using-ceph-for-persistent-storage.html" >
< a href = "using-ceph-for-persistent-storage.html" >
4.4.2.1 使用Ceph做持久化存储
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< / ul >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.5" data-path = "../usecases/" >
< a href = "../usecases/" >
5. 领域应用
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.5.1" data-path = "../usecases/microservices.html" >
< a href = "../usecases/microservices.html" >
5.1 微服务架构
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.5.1.1" data-path = "../usecases/istio.html" >
< a href = "../usecases/istio.html" >
5.1.1 Istio
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.5.1.1.1" data-path = "../usecases/istio-installation.html" >
< a href = "../usecases/istio-installation.html" >
5.1.1.1 安装istio
< / a >
< / li >
< li class = "chapter " data-level = "1.5.1.1.2" data-path = "../usecases/configuring-request-routing.html" >
< a href = "../usecases/configuring-request-routing.html" >
5.1.1.2 配置请求的路由规则
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.5.1.2" data-path = "../usecases/linkerd.html" >
< a href = "../usecases/linkerd.html" >
5.1.2 Linkerd
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.5.1.2.1" data-path = "../usecases/linkerd-user-guide.html" >
< a href = "../usecases/linkerd-user-guide.html" >
5.1.2.1 Linkerd 使用指南
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.5.1.3" data-path = "../usecases/service-discovery-in-microservices.html" >
< a href = "../usecases/service-discovery-in-microservices.html" >
5.1.3 微服务中的服务发现
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.5.2" data-path = "../usecases/big-data.html" >
< a href = "../usecases/big-data.html" >
5.2 大数据
< / a >
< ul class = "articles" >
2017-08-30 14:20:52 +08:00
< li class = "chapter " data-level = "1.5.2.1" data-path = "../usecases/spark-standalone-on-kubernetes.html" >
2017-08-21 17:44:43 +08:00
2017-08-30 14:20:52 +08:00
< a href = "../usecases/spark-standalone-on-kubernetes.html" >
2017-08-21 17:44:43 +08:00
2017-08-30 14:20:52 +08:00
5.2.1 Spark standalone on Kubernetes
2017-08-21 17:44:43 +08:00
< / a >
2017-08-31 14:23:44 +08:00
< / li >
2017-09-14 15:57:50 +08:00
< li class = "chapter " data-level = "1.5.2.2" data-path = "../usecases/running-spark-with-kubernetes-native-scheduler.html" >
2017-08-31 14:23:44 +08:00
2017-09-14 15:57:50 +08:00
< a href = "../usecases/running-spark-with-kubernetes-native-scheduler.html" >
2017-08-31 14:23:44 +08:00
5.2.2 运行支持kubernetes原生调度的Spark程序
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
2017-08-30 16:52:33 +08:00
< / li >
< li class = "chapter " data-level = "1.5.3" data-path = "../usecases/serverless.html" >
< a href = "../usecases/serverless.html" >
5.3 Serverless架构
< / a >
2017-08-21 17:44:43 +08:00
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.6" data-path = "../develop/" >
< a href = "../develop/" >
6. 开发指南
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.6.1" data-path = "../develop/developing-environment.html" >
< a href = "../develop/developing-environment.html" >
6.1 开发环境搭建
< / a >
< / li >
< li class = "chapter " data-level = "1.6.2" data-path = "../develop/testing.html" >
< a href = "../develop/testing.html" >
6.2 单元测试和集成测试
< / a >
< / li >
< li class = "chapter " data-level = "1.6.3" data-path = "../develop/client-go-sample.html" >
< a href = "../develop/client-go-sample.html" >
6.3 client-go示例
< / a >
< / li >
< li class = "chapter " data-level = "1.6.4" data-path = "../develop/contribute.html" >
< a href = "../develop/contribute.html" >
6.4 社区贡献
< / a >
< / li >
< / ul >
< / li >
< li class = "chapter " data-level = "1.7" data-path = "../appendix/" >
< a href = "../appendix/" >
7. 附录
< / a >
< ul class = "articles" >
< li class = "chapter " data-level = "1.7.1" data-path = "../appendix/docker-best-practice.html" >
< a href = "../appendix/docker-best-practice.html" >
7.1 Docker最佳实践
< / a >
< / li >
< li class = "chapter " data-level = "1.7.2" data-path = "../appendix/issues.html" >
< a href = "../appendix/issues.html" >
7.2 问题记录
< / a >
< / li >
< li class = "chapter " data-level = "1.7.3" data-path = "../appendix/tricks.html" >
< a href = "../appendix/tricks.html" >
7.3 使用技巧
< / a >
< / li >
< / ul >
< / li >
< li class = "divider" > < / li >
< li >
< a href = "https://www.gitbook.com" target = "blank" class = "gitbook-link" >
2017-09-19 22:01:07 +08:00
本书使用 GitBook 发布
2017-08-21 17:44:43 +08:00
< / a >
< / li >
< / ul >
< / nav >
< / div >
< div class = "book-body" >
< div class = "body-inner" >
< div class = "book-header" role = "navigation" >
<!-- Title -->
< h1 >
< i class = "fa fa-circle-o-notch fa-spin" > < / i >
< a href = ".." > 4.3.2 应用日志收集< / a >
< / h1 >
< / div >
< div class = "page-wrapper" tabindex = "-1" role = "main" >
< div class = "page-inner" >
< div class = "search-plus" id = "book-search-results" >
< div class = "search-noresults" >
< section class = "normal markdown-section" >
< h1 id = "应用日志收集" > 应 用 日 志 收 集 < / h1 >
< h2 id = "前言" > 前 言 < / h2 >
< p > 在 进 行 日 志 收 集 的 过 程 中 ， 我 们 首 先 想 到 的 是 使 用 Logstash， 因 为 它 是 ELK stack中 的 重 要 成 员 ， 但 是 在 测 试 过 程 中 发 现 ， Logstash是 基 于 JDK的 ， 在 没 有 产 生 日 志 的 情 况 单 纯 启 动 Logstash就 大 概 要 消 耗 < strong > 500M< / strong > 内 存 ， 在 每 个 Pod中 都 启 动 一 个 日 志 收 集 组 件 的 情 况 下 ， 使 用 logstash有 点 浪 费 系 统 资 源 ， 经 人 推 荐 我 们 选 择 使 用 < strong > Filebeat< / strong > 替 代 ， 经 测 试 单 独 启 动 Filebeat容 器 大 约 会 消 耗 < strong > 12M< / strong > 内 存 ， 比 起 logstash相 当 轻 量 级 。 < / p >
< h2 id = "方案选择" > 方 案 选 择 < / h2 >
< p > Kubernetes官 方 提 供 了 EFK的 日 志 收 集 解 决 方 案 ， 但 是 这 种 方 案 并 不 适 合 所 有 的 业 务 场 景 ， 它 本 身 就 有 一 些 局 限 性 ， 例 如 ： < / p >
< ul >
< li > 所 有 日 志 都 必 须 是 out前 台 输 出 ， 真 实 业 务 场 景 中 无 法 保 证 所 有 日 志 都 在 前 台 输 出 < / li >
< li > 只 能 有 一 个 日 志 输 出 文 件 ， 而 真 实 业 务 场 景 中 往 往 有 多 个 日 志 输 出 文 件 < / li >
< li > Fluentd并 不 是 常 用 的 日 志 收 集 工 具 ， 我 们 更 习 惯 用 logstash， 现 使 用 filebeat替 代 < / li >
< li > 我 们 已 经 有 自 己 的 ELK集 群 且 有 专 人 维 护 ， 没 有 必 要 再 在 kubernetes上 做 一 个 日 志 收 集 服 务 < / li >
< / ul >
< p > 基 于 以 上 几 个 原 因 ， 我 们 决 定 使 用 自 己 的 ELK集 群 。 < / p >
< p > < strong > Kubernetes集 群 中 的 日 志 收 集 解 决 方 案 < / strong > < / p >
< table >
< thead >
< tr >
< th > < strong > 编 号 < / strong > < / th >
< th > < strong > 方 案 < / strong > < / th >
< th > < strong > 优 点 < / strong > < / th >
< th > < strong > 缺 点 < / strong > < / th >
< / tr >
< / thead >
< tbody >
< tr >
< td > < strong > 1< / strong > < / td >
< td > 每 个 app的 镜 像 中 都 集 成 日 志 收 集 组 件 < / td >
< td > 部 署 方 便 ， kubernetes的 yaml文 件 无 须 特 别 配 置 ， 可 以 为 每 个 app自 定 义 日 志 收 集 配 置 < / td >
< td > 强 耦 合 ， 不 方 便 应 用 和 日 志 收 集 组 件 升 级 和 维 护 且 会 导 致 镜 像 过 大 < / td >
< / tr >
< tr >
< td > < strong > 2< / strong > < / td >
< td > 单 独 创 建 一 个 日 志 收 集 组 件 跟 app的 容 器 一 起 运 行 在 同 一 个 pod中 < / td >
< td > 低 耦 合 ， 扩 展 性 强 ， 方 便 维 护 和 升 级 < / td >
< td > 需 要 对 kubernetes的 yaml文 件 进 行 单 独 配 置 ， 略 显 繁 琐 < / td >
< / tr >
< tr >
< td > < strong > 3< / strong > < / td >
< td > 将 所 有 的 Pod的 日 志 都 挂 载 到 宿 主 机 上 ， 每 台 主 机 上 单 独 起 一 个 日 志 收 集 Pod< / td >
< td > 完 全 解 耦 ， 性 能 最 高 ， 管 理 起 来 最 方 便 < / td >
< td > 需 要 统 一 日 志 收 集 规 则 ， 目 录 和 输 出 方 式 < / td >
< / tr >
< / tbody >
< / table >
< p > 综 合 以 上 优 缺 点 ， 我 们 选 择 使 用 方 案 二 。 < / p >
< p > 该 方 案 在 扩 展 性 、 个 性 化 、 部 署 和 后 期 维 护 方 面 都 能 做 到 均 衡 ， 因 此 选 择 该 方 案 。 < / p >
< figure id = "fig1.4.3.2.1" > < img src = "../images/filebeat-log-collector.png" alt = "logstash日志收集架构图" > < figcaption > Figure: logstash日 志 收 集 架 构 图 < / figcaption > < / figure >
< p > 我 们 创 建 了 自 己 的 filebeat镜 像 。 创 建 过 程 和 使 用 方 式 见 < a href = "https://github.com/rootsongjc/docker-images" target = "_blank" > https://github.com/rootsongjc/docker-images< / a > < / p >
< p > 镜 像 地 址 ： < code > index.tenxcloud.com/jimmy/filebeat:5.4.0< / code > < / p >
< h2 id = "测试" > 测 试 < / h2 >
< p > 我 们 部 署 一 个 应 用 filebeat来 收 集 日 志 的 功 能 测 试 。 < / p >
< p > 创 建 应 用 yaml文 件 < code > filebeat-test.yaml< / code > 。 < / p >
< pre > < code class = "lang-yaml" > < span class = "hljs-attr" > apiVersion:< / span > extensions/v1beta1
< span class = "hljs-attr" > kind:< / span > Deployment
< span class = "hljs-attr" > metadata:< / span >
< span class = "hljs-attr" > name:< / span > filebeat-test
< span class = "hljs-attr" > namespace:< / span > default
< span class = "hljs-attr" > spec:< / span >
< span class = "hljs-attr" > replicas:< / span > < span class = "hljs-number" > 3< / span >
< span class = "hljs-attr" > template:< / span >
< span class = "hljs-attr" > metadata:< / span >
< span class = "hljs-attr" > labels:< / span >
< span class = "hljs-attr" > k8s-app:< / span > filebeat-test
< span class = "hljs-attr" > spec:< / span >
< span class = "hljs-attr" > containers:< / span >
< span class = "hljs-attr" > - image:< / span > sz-pg-oam-docker-hub< span class = "hljs-bullet" > -001.< / span > tendcloud.com/library/filebeat:< span class = "hljs-number" > 5.4< / span > < span class = "hljs-number" > .0< / span >
< span class = "hljs-attr" > name:< / span > filebeat
< span class = "hljs-attr" > volumeMounts:< / span >
< span class = "hljs-attr" > - name:< / span > app-logs
< span class = "hljs-attr" > mountPath:< / span > /log
< span class = "hljs-attr" > - name:< / span > filebeat-config
< span class = "hljs-attr" > mountPath:< / span > /etc/filebeat/
< span class = "hljs-attr" > - image:< / span > sz-pg-oam-docker-hub< span class = "hljs-bullet" > -001.< / span > tendcloud.com/library/analytics-docker-test:Build_8
name : app
< span class = "hljs-attr" > ports:< / span >
< span class = "hljs-attr" > - containerPort:< / span > < span class = "hljs-number" > 80< / span >
< span class = "hljs-attr" > volumeMounts:< / span >
< span class = "hljs-attr" > - name:< / span > app-logs
< span class = "hljs-attr" > mountPath:< / span > /usr/local/TalkingData/logs
< span class = "hljs-attr" > volumes:< / span >
< span class = "hljs-attr" > - name:< / span > app-logs
< span class = "hljs-attr" > emptyDir:< / span > {}
< span class = "hljs-attr" > - name:< / span > filebeat-config
< span class = "hljs-attr" > configMap:< / span >
< span class = "hljs-attr" > name:< / span > filebeat-config
< span class = "hljs-meta" > ---< / span >
< span class = "hljs-attr" > apiVersion:< / span > v1
< span class = "hljs-attr" > kind:< / span > Service
< span class = "hljs-attr" > metadata:< / span >
< span class = "hljs-attr" > name:< / span > filebeat-test
< span class = "hljs-attr" > labels:< / span >
< span class = "hljs-attr" > app:< / span > filebeat-test
< span class = "hljs-attr" > spec:< / span >
< span class = "hljs-attr" > ports:< / span >
< span class = "hljs-attr" > - port:< / span > < span class = "hljs-number" > 80< / span >
< span class = "hljs-attr" > protocol:< / span > TCP
< span class = "hljs-attr" > name:< / span > http
< span class = "hljs-attr" > selector:< / span >
< span class = "hljs-attr" > run:< / span > filebeat-test
< span class = "hljs-meta" > ---< / span >
< span class = "hljs-attr" > apiVersion:< / span > v1
< span class = "hljs-attr" > kind:< / span > ConfigMap
< span class = "hljs-attr" > metadata:< / span >
< span class = "hljs-attr" > name:< / span > filebeat-config
< span class = "hljs-attr" > data:< / span >
filebeat.yml: < span class = "hljs-string" > |
filebeat.prospectors:
< / span > < span class = "hljs-attr" > - input_type:< / span > log
< span class = "hljs-attr" > paths:< / span >
< span class = "hljs-bullet" > -< / span > < span class = "hljs-string" > " /log/*" < / span >
< span class = "hljs-bullet" > -< / span > < span class = "hljs-string" > " /log/usermange/common/*" < / span >
output.elasticsearch:
< span class = "hljs-attr" > hosts:< / span > [< span class = "hljs-string" > " 172.23.5.255:9200" < / span > ]
< span class = "hljs-attr" > username:< / span > < span class = "hljs-string" > " elastic" < / span >
< span class = "hljs-attr" > password:< / span > < span class = "hljs-string" > " changeme" < / span >
< span class = "hljs-attr" > index:< / span > < span class = "hljs-string" > " filebeat-docker-test" < / span >
< / code > < / pre >
< p > < strong > 说 明 < / strong > < / p >
< p > 该 文 件 中 包 含 了 配 置 文 件 filebeat的 配 置 文 件 的 < a href = "http://rootsongjc.github.io/blogs/kubernetes-configmap-introduction/" target = "_blank" > ConfigMap< / a > ， 因 此 不 需 要 再 定 义 环 境 变 量 。 < / p >
< p > 当 然 你 也 可 以 不 同 ConfigMap， 通 过 传 统 的 传 递 环 境 变 量 的 方 式 来 配 置 filebeat。 < / p >
< p > 例 如 对 filebeat的 容 器 进 行 如 下 配 置 ： < / p >
< pre > < code class = "lang-yaml" > < span class = "hljs-attr" > containers:< / span >
< span class = "hljs-attr" > - image:< / span > sz-pg-oam-docker-hub< span class = "hljs-bullet" > -001.< / span > tendcloud.com/library/filebeat:< span class = "hljs-number" > 5.4< / span > < span class = "hljs-number" > .0< / span >
< span class = "hljs-attr" > name:< / span > filebeat
< span class = "hljs-attr" > volumeMounts:< / span >
< span class = "hljs-attr" > - name:< / span > app-logs
< span class = "hljs-attr" > mountPath:< / span > /log
< span class = "hljs-attr" > env:< / span >
< span class = "hljs-attr" > - name:< / span > PATHS
< span class = "hljs-attr" > value:< / span > < span class = "hljs-string" > " /log/*" < / span >
< span class = "hljs-attr" > - name:< / span > ES_SERVER
< span class = "hljs-attr" > value:< / span > < span class = "hljs-number" > 172.23< / span > < span class = "hljs-number" > .5< / span > < span class = "hljs-number" > .255< / span > :< span class = "hljs-number" > 9200< / span >
< span class = "hljs-attr" > - name:< / span > INDEX
< span class = "hljs-attr" > value:< / span > logstash-docker
< span class = "hljs-attr" > - name:< / span > INPUT_TYPE
< span class = "hljs-attr" > value:< / span > log
< / code > < / pre >
< p > 目 前 使 用 这 种 方 式 会 有 个 问 题 ， 及 时 < code > PATHS< / code > 只 能 传 递 单 个 目 录 ， 如 果 想 传 递 多 个 目 录 需 要 修 改 filebeat镜 像 的 < code > docker-entrypoint.sh< / code > 脚 本 ， 对 该 环 境 变 量 进 行 解 析 增 加 filebeat.yml文 件 中 的 PATHS列 表 。 < / p >
< p > 推 荐 使 用 ConfigMap， 这 样 filebeat的 配 置 就 能 够 更 灵 活 。 < / p >
< p > < strong > 注 意 事 项 < / strong > < / p >
< ul >
< li > 将 app的 < code > /usr/local/TalkingData/logs< / code > 目 录 挂 载 到 filebeat的 < code > /log< / code > 目 录 下 。 < / li >
< li > 该 文 件 可 以 在 < code > manifests/test/filebeat-test.yaml< / code > 找 到 。 < / li >
< li > 我 使 用 了 自 己 的 私 有 镜 像 仓 库 ， 测 试 时 请 换 成 自 己 的 应 用 镜 像 。 < / li >
< li > Filebeat的 环 境 变 量 的 值 配 置 请 参 考 < a href = "https://github.com/rootsongjc/docker-images" target = "_blank" > https://github.com/rootsongjc/docker-images< / a > < / li >
< / ul >
< p > < strong > 创 建 应 用 < / strong > < / p >
< p > 部 署 Deployment< / p >
< pre > < code > kubectl create -f filebeat-test.yaml
< / code > < / pre > < p > 查 看 < code > http://172.23.5.255:9200/_cat/indices< / code > 将 可 以 看 到 列 表 有 这 样 的 indices： < / p >
< pre > < code > green open filebeat-docker-test 7xPEwEbUQRirk8oDX36gAA 5 1 2151 0 1.6mb 841.8kb
< / code > < / pre > < p > 访 问 Kibana的 web页 面 ， 查 看 < code > filebeat-2017.05.17< / code > 的 索 引 ， 可 以 看 到 filebeat收 集 到 了 app日 志 。 < / p >
< figure id = "fig1.4.3.2.2" > < img src = "../images/filebeat-docker-test.jpg" alt = "Kibana页面" > < figcaption > Figure: Kibana页 面 < / figcaption > < / figure >
< p > 点 开 没 个 日 志 条 目 ， 可 以 看 到 以 下 详 细 字 段 ： < / p >
< figure id = "fig1.4.3.2.3" > < img src = "../images/kubernetes-filebeat-detail.png" alt = "filebeat收集的日志详细信息" > < figcaption > Figure: filebeat收 集 的 日 志 详 细 信 息 < / figcaption > < / figure >
< ul >
< li > < code > _index< / code > 值 即 我 们 在 YAML文 件 的 < code > configMap< / code > 中 配 置 的 index值 < / li >
< li > < code > beat.hostname< / code > 和 < code > beat.name< / code > 即 pod的 名 称 < / li >
< li > source表 示 filebeat容 器 中 的 日 志 目 录 < / li >
< / ul >
< p > 我 们 可 以 通 过 人 为 得 使 < code > index< / code > = < code > service name< / code > ， 这 样 就 可 以 方 便 的 收 集 和 查 看 每 个 service的 日 志 。 < / p >
2017-09-19 21:38:03 +08:00
< footer class = "page-footer-ex" > < span class = "page-footer-ex-copyright" > © All Rights Reserved < / span >                     < span class = "page-footer-ex-footer-update" > updated 2017-08-21 18:23:34 < / span > < / footer >
2017-08-21 17:44:43 +08:00
< / section >
< / div >
< div class = "search-results" >
< div class = "has-results" >
< h1 class = "search-results-title" > < span class = 'search-results-count' > < / span > results matching "< span class = 'search-query' > < / span > "< / h1 >
< ul class = "search-results-list" > < / ul >
< / div >
< div class = "no-results" >
< h1 class = "search-results-title" > No results matching "< span class = 'search-query' > < / span > "< / h1 >
< / div >
< / div >
< / div >
< / div >
< / div >
< / div >
< a href = "service-rolling-update.html" class = "navigation navigation-prev " aria-label = "Previous page: 4.3.1 服务滚动升级" >
< i class = "fa fa-angle-left" > < / i >
< / a >
< a href = "configuration-best-practice.html" class = "navigation navigation-next " aria-label = "Next page: 4.3.3 配置最佳实践" >
< i class = "fa fa-angle-right" > < / i >
< / a >
< / div >
< script >
var gitbook = gitbook || [];
gitbook.push(function() {
2017-09-19 22:01:07 +08:00
gitbook.page.hasChanged({"page":{"title":"4.3.2 应用日志收集","level":"1.4.3.2","depth":3,"next":{"title":"4.3.3 配置最佳实践","level":"1.4.3.3","depth":3,"path":"practice/configuration-best-practice.md","ref":"practice/configuration-best-practice.md","articles":[]},"previous":{"title":"4.3.1 服务滚动升级","level":"1.4.3.1","depth":3,"path":"practice/service-rolling-update.md","ref":"practice/service-rolling-update.md","articles":[]},"dir":"ltr"},"config":{"plugins":["github","codesnippet","splitter","page-toc-button","image-captions","page-footer-ex","editlink","back-to-top-button","-lunr","-search","search-plus"],"styles":{"website":"styles/website.css","pdf":"styles/pdf.css","epub":"styles/epub.css","mobi":"styles/mobi.css","ebook":"styles/ebook.css","print":"styles/print.css"},"pluginsConfig":{"github":{"url":"https://github.com/rootsongjc/kubernetes-handbook"},"editlink":{"label":"编辑本页","multilingual":false,"base":"https://github.com/rootsongjc/kubernetes-handbook/blob/master/"},"page-footer-ex":{"copyright":"© All Rights Reserved","markdown":false,"update_format":"YYYY-MM-DD HH:mm:ss","update_label":"updated"},"splitter":{},"codesnippet":{},"fontsettings":{"theme":"white","family":"sans","size":2},"highlight":{},"page-toc-button":{},"back-to-top-button":{},"sharing":{"facebook":true,"twitter":true,"google":false,"weibo":false,"instapaper":false,"vk":false,"all":["facebook","google","twitter","weibo","instapaper"]},"theme-default":{"styles":{"website":"styles/website.css","pdf":"styles/pdf.css","epub":"styles/epub.css","mobi":"styles/mobi.css","ebook":"styles/ebook.css","print":"styles/print.css"},"showLevel":false},"search-plus":{},"image-captions":{"variable_name":"_pictures"}},"page-footer-ex":{"copyright":"Jimmy Song","update_label":"最后更新于：","update_format":"YYYY-MM-DD HH:mm:ss"},"theme":"default","author":"Jimmy Song","pdf":{"pageNumbers":true,"fontSize":12,"fontFamily":"Arial","paperSize":"a4","chapterMark":"pagebreak","pageBreaksBefore":"/","margin":{"right":62,"left":62,"top":56,"bottom":56}},"structure":{"langs":"LANGS.md","readme":"README.md","glossary":"GLOSSARY.md","summary":"SUMMARY.md"},"variables":{"_pictures":[{"backlink":"concepts/index.html#fig1.2.1","level":"1.2","list_caption":"Figure: Borg架构","alt":"Borg架构","nro":1,"url":"../images/borg.png","index":1,"caption_template":"Figure: _CAPTION_","label":"Borg架构","attributes":{},"skip":false,"key":"1.2.1"},{"backlink":"concepts/index.html#fig1.2.2","level":"1.2","list_caption":"Figure: Kubernetes架构","alt":"Kubernetes架构","nro":2,"url":"../images/architecture.png","index":2,"caption_template":"Figure: _CAPTION_","label":"Kubernetes架构","attributes":{},"skip":false,"key":"1.2.2"},{"backlink":"concepts/index.html#fig1.2.3","level":"1.2","list_caption":"Figure: kubernetes整体架构示意图","alt":"kubernetes整体架构示意图","nro":3,"url":"../images/kubernetes-whole-arch.png","index":3,"caption_template":"Figure: _CAPTION_","label":"kubernetes整体架构示意图","attributes":{},"skip":false,"key":"1.2.3"},{"backlink":"concepts/index.html#fig1.2.4","level":"1.2","list_caption":"Figure: Kubernetes master架构示意图","alt":"Kubernetes master架构示意图","nro":4,"url":"../images/kubernetes-master-arch.png","index":4,"caption_template":"Figure: _CAPTION_","label":"Kubernetes master架构示意图","attributes":{},"skip":false,"key":"1.2.4"},{"backlink":"concepts/index.html#fig1.2.5","level":"1.2","list_caption":"Figure: kubernetes node架构示意图","alt":"kubernetes node架构示意图","nro":5,"url":"../images/kubernetes-node-arch.png","index":5,"caption_template":"Figure: _CAPTION_","label":"kubernetes node架构示意图","attributes":{},"skip":false,"key":"1.2.5"},{"backlink":"concepts/index.html#fig1.2.6","level":"1.2","list_caption":"Figure: Kubernetes分层架构示意图","alt":"Kubernetes分层架构示意图","nro":6,"url":"../images/kubernetes-layers-arch.jpg","index":6,"caption_template":"Figure: _CAPTION_","label":"Kubernetes分层架构示意图","attri
2017-08-21 17:44:43 +08:00
});
< / script >
< / div >
< script src = "../gitbook/gitbook.js" > < / script >
< script src = "../gitbook/theme.js" > < / script >
< script src = "../gitbook/gitbook-plugin-github/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-splitter/splitter.js" > < / script >
< script src = "../gitbook/gitbook-plugin-page-toc-button/plugin.js" > < / script >
< script src = "../gitbook/gitbook-plugin-editlink/plugin.js" > < / script >
2017-09-19 21:38:03 +08:00
< script src = "../gitbook/gitbook-plugin-back-to-top-button/plugin.js" > < / script >
2017-08-21 17:44:43 +08:00
< script src = "../gitbook/gitbook-plugin-search-plus/jquery.mark.min.js" > < / script >
< script src = "../gitbook/gitbook-plugin-search-plus/search.js" > < / script >
< script src = "../gitbook/gitbook-plugin-sharing/buttons.js" > < / script >
< script src = "../gitbook/gitbook-plugin-fontsettings/fontsettings.js" > < / script >
< / body >
< / html >
