grequests

I've been using the python requests library for some time, and recently had a need to make a request asynchronously, meaning I would like to send off the HTTP request, have my main thread continue to execute, and have a callback called when the request returns. Naturally, I was lead to the grequests library ( https://github.com/kennethreitz/grequests ), but i'm confused about the behavior. For example: import grequests def print_res(res): from pprint import pprint pprint (vars(res)) req = grequests.get('http://www.codehenge.net/blog', hooks=dict(response=print_res)) res = grequests.map([req])

I am using Python requests in celery workers to make large number of (~10/sec) API calls(includes GET,POST, PUT, DELETE). Each request takes around 5-10s to complete. I tried running celery workers in eventlet pool, with 1000 concurrency. Since requests are blocking process each concurrent connection is waiting on one request. How do I make requests asynchronous? temoto Use eventlet monkey patching to make any pure python library non-blocking. patch single library # import requests # instead do this: import eventlet requests = eventlet.import_patched('requests') packages erequests and