From e6e31c2bf18ce9ae3c2c9930b4a1795eaaff2b66 Mon Sep 17 00:00:00 2001 From: jackfrued Date: Tue, 5 Jun 2018 00:40:00 +0800 Subject: [PATCH] =?UTF-8?q?=E6=9B=B4=E6=96=B0=E4=BA=86Scrapy=E7=9B=B8?= =?UTF-8?q?=E5=85=B3=E6=96=87=E6=A1=A3?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- ...的应用.md => Scrapy爬虫框架入门.md} | 2 +- Day66-75/Scrapy爬虫框架分布式实现.md | 16 ++++++++++++++++ Day66-75/Scrapy爬虫框架高级应用.md | 12 ++++++++++++ README.md | 10 ++++------ 4 files changed, 33 insertions(+), 7 deletions(-) rename Day66-75/{Scrapy爬虫框架的应用.md => Scrapy爬虫框架入门.md} (99%) create mode 100644 Day66-75/Scrapy爬虫框架分布式实现.md create mode 100644 Day66-75/Scrapy爬虫框架高级应用.md diff --git a/Day66-75/Scrapy爬虫框架的应用.md b/Day66-75/Scrapy爬虫框架入门.md similarity index 99% rename from Day66-75/Scrapy爬虫框架的应用.md rename to Day66-75/Scrapy爬虫框架入门.md index d566d63..98978f4 100644 --- a/Day66-75/Scrapy爬虫框架的应用.md +++ b/Day66-75/Scrapy爬虫框架入门.md @@ -1,4 +1,4 @@ -## Scrapy爬虫框架的应用 +## Scrapy爬虫框架入门 ### Scrapy概述 diff --git a/Day66-75/Scrapy爬虫框架分布式实现.md b/Day66-75/Scrapy爬虫框架分布式实现.md new file mode 100644 index 0000000..95af796 --- /dev/null +++ b/Day66-75/Scrapy爬虫框架分布式实现.md @@ -0,0 +1,16 @@ +## Scrapy爬虫框架分布式实现 + +### 分布式爬虫原理 + + + +### Scrapy分布式实现 + + + +### 布隆过滤器 + + + +### Scrapyd分布式部署 + diff --git a/Day66-75/Scrapy爬虫框架高级应用.md b/Day66-75/Scrapy爬虫框架高级应用.md new file mode 100644 index 0000000..70a1995 --- /dev/null +++ b/Day66-75/Scrapy爬虫框架高级应用.md @@ -0,0 +1,12 @@ +## Scrapy爬虫框架高级应用 + +### 中间件的应用 + + + +### Scrapy对接Selenium + + + +### Scrapy部署到Docker + diff --git a/README.md b/README.md index 5f36f76..e79b46f 100644 --- a/README.md +++ b/README.md @@ -253,7 +253,7 @@ #### Day67 - [数据采集和解析](./Day66-75/02.数据采集和解析.md) -#### Day68 - [缓存数据](./Day66-75/03.缓存数据.md) +#### Day68 - [存储数据](./Day66-75/03.存储数据.md) #### Day69 - [并发下载](./Day66-75/04.并发下载.md) @@ -261,13 +261,11 @@ #### Day71 - [表单交互和验证码处理](./Day66-75/06.表单交互和验证码处理.md) -#### Day72 - [ 数据清洗](./Day66-75/07.数据清洗.md) +#### Day72 - [Scrapy爬虫框架入门](./Day66-75/Scrapy爬虫框架入门.md) -#### Day73 - [Scrapy的应用(1)](./Day66-75/Scrapy的应用01.md) +#### Day73 - [Scrapy爬虫框架高级应用](./Day66-75/Scrapy爬虫框架高级应用.md) -#### Day74 - [Scrapy的应用(2)](./Day66-75/Scrapy的应用02.md) - -#### Day75 - [Scrapy的应用(3)](./Day66-75/Scrapy的应用03.md) +#### Day74 - [Scrapy爬虫框架分布式实现](./Day66-75/Scrapy爬虫框架分布式实现.md) ### Day76~90 - [数据处理和机器学习](./Day76-90)