cprofile

I am using cProfile on a module named bot4CA.py so in the console I type: python -m cProfile -o thing.txt bot4CA.py After the module runs and exits, it creates a file named thing.txt and when I open it, there is some information there, and the rest is a jumble of characters instead of a neatly organized file of data which is what I want. Does any one know how to use cProfile and end up with neatly organized table of data like when using it normally on command line, except in a file? Here's an example of some of the data in the .txt file: {( s) build\bdist.win32\egg\colorama\winterm.pyi' t

I'd like to profile a method of a function in Python, using cProfile. I tried the following: import cProfile as profile # Inside the class method... profile.run("self.myMethod()", "output_file") But it does not work. How can I call a self.method with "run"? Use the profilehooks decorator http://pypi.python.org/pypi/profilehooks EDIT: Sorry, didn't realise that the profile call was in a class method. run just tries to exec the string you pass it. If self isn't bound to anything in the scope of the profiler you are using, you can't use it in run ! Use the runctx method to pass in the local and

I'm struggling to figure out how to profile a simple multiprocess python script import multiprocessing import cProfile import time def worker(num): time.sleep(3) print 'Worker:', num if __name__ == '__main__': for i in range(5): p = multiprocessing.Process(target=worker, args=(i,)) cProfile.run('p.start()', 'prof%d.prof' %i) I'm starting 5 processes and therefore cProfile generates 5 different files. Inside of each I want to see that my method 'worker' takes approximately 3 seconds to run but instead I'm seeing only what's going on inside the 'start'method. I would greatly appreciate if

I have a script that fetches several web pages and parses the info. (An example can be seen at http://bluedevilbooks.com/search/?DEPT=MATH&CLASS=103&SEC=01 ) I ran cProfile on it, and as I assumed, urlopen takes up a lot of time. Is there a way to fetch the pages faster? Or a way to fetch several pages at once? I'll do whatever is simplest, as I'm new to python and web developing. Thanks in advance! :) UPDATE: I have a function called fetchURLs() , which I use to make an array of the URLs I need so something like urls = fetchURLS() .The URLS are all XML files from Amazon and eBay APIs (which

I'm using cProfile to profile my Python program. Based upon this talk I was under the impression that KCacheGrind could parse and display the output from cProfile. However, when I go to import the file, KCacheGrind just displays an 'Unknown File Format' error in the status bar and sits there displaying nothing. Is there something special I need to do before my profiling stats are compatible with KCacheGrind? ... if profile: import cProfile profileFileName = 'Profiles/pythonray_' + time.strftime('%Y%m%d_%H%M%S') + '.profile' profile = cProfile.Profile() profile.run('pilImage = camera.render