且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

在Scrapy中访问django模型

更新时间:2023-12-01 22:10:58

如果有其他人有同样的问题,我如何解决它。



我将其添加到我的 scrapy settings.py文件中:



pre $ def setup_django_env(path):
import imp,os
from django.core.management import setup_environ

f,filename,desc = imp.find_module('settings',[path])
project = imp.load_module('settings',f,filename,desc)

setup_environ(project)

setup_django_env('/ path / to / django / project /')

注意:以上是你的django项目文件夹,而不是settings.py文件。



现在,您将可以完全访问您的scrapy项目中的django模型。


Is it possible to access my django models inside of a Scrapy pipeline, so that I can save my scraped data straight to my model?

I've seen this, but I don't really get how to set it up?

If anyone else is having the same problem, this is how I solved it.

I added this to my scrapy settings.py file:

def setup_django_env(path):
    import imp, os
    from django.core.management import setup_environ

    f, filename, desc = imp.find_module('settings', [path])
    project = imp.load_module('settings', f, filename, desc)       

    setup_environ(project)

setup_django_env('/path/to/django/project/')

Note: the path above is to your django project folder, not the settings.py file.

Now you will have full access to your django models inside of your scrapy project.