scrapy-redis的安装部署步骤讲解

yum install -y redis

systemctl restart redis

systemctl stop firewalld.service

REDIS_URL = 'redis://192.168.61.130:6379'

# -*- coding: utf-8 -*-from scrapy_redis.spiders import RedisSpiderclass ExampleSpider(RedisSpider):  name = 'myspider'  redis_key = 'test_key'  allowed_domains = ['www.example.com']  def parse(self, response):    print(1111)    pass

scrapy runspider example.py

redis-cli -h 127.0.0.1 -prpush test_key http://test.com