pyhive, sqlalchemy can not connect to hadoop sandbox

Question

I have installed,

pip install thrift
pip install PyHive
pip install thrift-sasl

and since pip install sasl failed I downloaded sa

Answer 1

Here are steps to build SASL on Windows, but your mileage may vary: A lot of this depends on your particular system's paths and available libraries.

Please also note that these instructions are specific to Python 2.7 (which I see you are using from the paths in your question).

The high-level overview is that you're installing this project: https://github.com/cyrusimap/cyrus-sasl. In order to do that, you have to use the legacy C++ compiler that was used to build Python 2.7. There are a couple of other steps to getting this to work.

Pre-build Steps:

1. Install Microsoft Visual C++ Compiler for Python 2.7. Use the default installation paths - take note of where it got installed for the next 2 steps (2 options are included in the list below)
2. Copy this file to whichever of the include locations is appropriate for your install
3. Make a unistd.h file from this answer in the same include directory

Build steps:

4. git clone https://github.com/cyrusimap/cyrus-sasl
5. Open the "VS2013 x64 Native Tools Command Prompt" that's installed with the Compiler from step 1
6. Change directory to the directory created by step 4, then the lib sub-directory
7. nmake /f ntmakefile STATIC=no prefix=C:\sasl64
8. nmake /f ntmakefile prefix=C:\sasl64 STATIC=no install see note below
9. copy /B C:\sasl64\lib\libsasl.lib /B C:\sasl64\lib\sasl2.lib
10. pip install thrift_sasl --global-option=build_ext \ --global-option=-IC:\\sasl64\\include \ --global-option=-LC:\\sasl64\\lib

'Include' locations:

• "C:\Program Files (x86)\Common Files\Microsoft\Visual C++ for Python\9.0\VC\include\stdint.h"
• "%USERPROFILE%\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\VC\include"

Here's a reference to these same steps, with some additional annotations and explanations: http://java2developer.blogspot.co.uk/2016/08/making-impala-connection-from-python-on.html.

Note The referenced instructions also executed step (8) in the include and win32\include sub-directories, you may have to do that as well.