且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

如何从scrapy调用输出文件名

更新时间:2022-10-15 11:20:57

您可以在蜘蛛中使用 self.settings.attributes["FEED_URI"].value 来获取输出文件名.>

scrapy crawl test -o test123.csv

How can I call the Output filename from code i.e I would like to use the filename inputed in terminal in spider_closed function

@classmethod
def from_crawler(cls, crawler, *args, **kwargs):
    spider = super(MySpider, cls).from_crawler(crawler, *args, **kwargs)
    crawler.signals.connect(spider.spider_closed, signal=scrapy.signals.spider_closed)
def spider_closed(self):
    #read test123.csv (whatever the filename is)

You can use self.settings.attributes["FEED_URI"].value in your spider to get output file name.