且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

文件“"在python回溯中

更新时间:2023-12-02 19:20:34

代码不是以传统方式导入;而是 启动器代码 使用 exec 语句 用于加载 __init__.py 文件.

在启动器 load_module() 函数中缩减包的流程(因此不是模块的路径),您会得到:

# fullname 模块尚未加载sys.modules[全名] = imp.new_module(全名)initfile = '__init__' # 或者 u'__init__' 如果使用了 unicode 路径# 如果没有找到 .py 文件,则不是模块mod = sys.modules[全名]mod.__loader__ = selfmod.__file__ = os.path.join(os.getcwd(),filename)mod.__path__ = [文件名]#初始化文件initfile = os.path.join(文件名,initfile+ext)如果 os.path.exists(initfile):使用 open(initfile,'U') 作为 fp:代码 = fp.read()mod.__dict__ 中的执行代码返回模式

这将创建一个空的模块对象,手动加载源并将其作为字符串执行,将模块命名空间作为执行代码的全局变量传入.生成的代码对象总是会在回溯中列出 :

>>>进口进口>>>mod = imp.new_module('foo.bar')>>>mod.__file__ = r'C:\some\location\foo\bar'>>>mod.__path__ = [r'foo\bar']>>>在 mod.__dict__ 中执行 'raise ValueError("oops")'回溯(最近一次调用最后一次):文件<stdin>",第 1 行,位于 <module>文件<string>",第 1 行,在 <module> 中值错误:哎呀

因为没有与代码关联的文件名,PyCharm 也找不到原始来源.

解决方法是使用 compile() 函数首先创建一个代码对象,然后附加一个文件名:

>>>exec compile('raise ValueError("oops")', r'C:\some\location\foo\bar\__init__.py', 'exec') in mod.__dict__回溯(最近一次调用最后一次):文件<stdin>",第 1 行,位于 <module>文件C:\some\location\foo\bar\__init__.py",第 1 行,在 <module>值错误:哎呀

请注意,我在文件名中包含了 __init__.py;将其转换回您将使用的启动器:

如果 os.path.exists(initfile):使用 open(initfile,'U') 作为 fp:代码 = fp.read()exec compile(code, initfile, 'exec') in mod.__dict__

I am in the middle of refactoring a huge py module to packages - to not break existing code I moved its contents to package/__init__.py module (Adding code to __init__.py) and went on splitting it from there. I noticed at some point that in my tracebacks I get:

Traceback (most recent call last):
      File "<string>", line 656, in DoItemMenu
      File "bash\balt.py", line 2109, in PopupMenu
        link.AppendToMenu(menu,parent,*args)
      File "bash\balt.py", line 2225, in AppendToMenu
        for link in self.links: link.AppendToMenu(subMenu,window,data)
    ...

where the lines in File "<string>" correspond to the particular package/__init__.py module. Moreover PyCharm's debugger displays a "frame not available" line and does not step into the lines in the __init__.py. Why? Is it related to the import pattern?

The code is imported by a launcher class:

class UnicodeImporter(object):
    def find_module(self,fullname,path=None):
        if isinstance(fullname,unicode):
            fullname = fullname.replace(u'.',u'\\')
            exts = (u'.pyc',u'.pyo',u'.py')
        else:
            fullname = fullname.replace('.','\\')
            exts = ('.pyc','.pyo','.py')
        if os.path.exists(fullname) and os.path.isdir(fullname):
            return self
        for ext in exts:
            if os.path.exists(fullname+ext):
                return self

    def load_module(self,fullname):
        if fullname in sys.modules:
            return sys.modules[fullname]
        else:
            sys.modules[fullname] = imp.new_module(fullname)
        if isinstance(fullname,unicode):
            filename = fullname.replace(u'.',u'\\')
            ext = u'.py'
            initfile = u'__init__'
        else:
            filename = fullname.replace('.','\\')
            ext = '.py'
            initfile = '__init__'
        if os.path.exists(filename+ext):
            try:
                with open(filename+ext,'U') as fp:
                    mod = imp.load_source(fullname,filename+ext,fp)
                    sys.modules[fullname] = mod
                    mod.__loader__ = self
                    return mod
            except:
                print 'fail', filename+ext
                raise
        mod = sys.modules[fullname]
        mod.__loader__ = self
        mod.__file__ = os.path.join(os.getcwd(),filename)
        mod.__path__ = [filename]
        #init file
        initfile = os.path.join(filename,initfile+ext)
        if os.path.exists(initfile):
            with open(initfile,'U') as fp:
                code = fp.read()
            exec code in mod.__dict__
        return mod

The code is not imported in a traditional manner; instead the launcher code uses an exec statement for loading __init__.py files.

Paring down the flow in the launcher load_module() function for a package (so not a path to a module) you get this:

# the fullname module isn't yet loaded
sys.modules[fullname] = imp.new_module(fullname)
initfile = '__init__'  # or u'__init__' if a unicode path was used

# if no .py file was found, so not a module
mod = sys.modules[fullname]
mod.__loader__ = self
mod.__file__ = os.path.join(os.getcwd(),filename)
mod.__path__ = [filename]
#init file
initfile = os.path.join(filename,initfile+ext)
if os.path.exists(initfile):
    with open(initfile,'U') as fp:
        code = fp.read()
    exec code in mod.__dict__
return mod

This creates an empty module object, loads the source manually and executes it as a string, passing in the module namespace as the globals for the executed code. The resulting code object is always going to list <string> in tracebacks:

>>> import imp
>>> mod = imp.new_module('foo.bar')
>>> mod.__file__ = r'C:\some\location\foo\bar'
>>> mod.__path__ = [r'foo\bar']
>>> exec 'raise ValueError("oops")' in mod.__dict__
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "<string>", line 1, in <module>
ValueError: oops

Because there is no filename associated with the code, PyCharm cannot find the original source either.

The work-around is to use the compile() function to create a code object first, and attaching a filename to that:

>>> exec compile('raise ValueError("oops")', r'C:\some\location\foo\bar\__init__.py', 'exec') in mod.__dict__
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\some\location\foo\bar\__init__.py", line 1, in <module>
ValueError: oops

Note that I included __init__.py in the filename; translating that back to the launcher you'd use:

if os.path.exists(initfile):
    with open(initfile,'U') as fp:
        code = fp.read()
    exec compile(code, initfile, 'exec') in mod.__dict__