What is the difference between `sys.meta_path` and `sys.path_hooks` importer objects?

泪湿孤枕 提交于 2019-12-05 00:53:12

问题


Using importlib, what is the difference between "Meta Path Finder" (found by traversing over sys.meta_path) and Path Entry Finder" (found by traversing over sys.path_hooks)?

The first type is called upon begin of an import, but when is the second type used? Do both return a spec object?

I want to implement a customized import, where a module can be imported from sources other than *.py or *.pyc, e.g. from a stream. How can this be done?


回答1:


sys.path_hooks returns a finder factory.

Path hooks are called as part of sys.path (or package.__path__ ) processing

as we read in PEP 302 relevant part which you should read to do what you want.

Coming to speak of, we use a custom hook in my code but I would not recommend you to copy it verbatim (I am really not sure about the hocus pocus we do with init files)

However the process is a bit like in there - the find_module method returns self or None depending on what you want to accept as a module and the load_module method proceeds to load that by compiling the code and assigning it an entry into sys.modules. By replacing those parts you can pretty much load whatever you want.

Related:

  • Package-specific import hooks in Python
  • Python sys.path_hooks Examples



回答2:


When a module is to be imported, the interpreter first walks through the list of objects in sys.meta_path, calling the find_spec() or (deprecated since 3.4) find_module() method on each. )The interface is documented in the importlib.abc.MetaPathFinder abstract base class.) These are queried before any other importers (including frozen and built-in) are checked and so can override any other import processing.

The PathFinder object in sys.meta_path is what uses sys.path and sys.path_hooks. (Except in Python < 3.4 where the PathFinder functionality is built in to the interpreter to be used when nothing in sys.meta_path can load a module.)

The PathFinder walks through the list of paths in sys.path. For each path, if finder is not already cached for that path in sys.path_importer_cache it walks through the list of callables in sys.path_hooks, calling each one with the path to see if it will produce a finder; it caches the first one it finds in sys.path.importer_cache_.

Once it's got the finder it queries that via the find_spec() or deprecated find_module() method to see if it can find that module. If so, it can continue on to import it, otherwise it starts the step above with the next path on sys.path.

This was initially described in PEP 302, but PEP 451 is pretty much the modern behaviour; the importlib documentation appears to be the current spec.

There's considerably more detail summarized (with more links) in my personal notes.



来源:https://stackoverflow.com/questions/41941079/what-is-the-difference-between-sys-meta-path-and-sys-path-hooks-importer-obj

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!