Hadoop on Windows [closed]

Answer 1

I compiled Hadoop on Windows and it's released as zetabyte's "Apache Hadoop for Windows". There is a core/common package available and also a package with a GNU environment (bash, etc.)

Answer 2

I managed to port Hadoop-1.0.1 on windows-7, cygwin-1.7, jdk1.7_x64.

but it's not for beginners: you will need to patch and recompile hadoop.

http://sourceforge.net/p/win-hadoop/wiki/Hadoop-on-Cygwin/

Answer 3

You can also try Amazon Elastic MapReduce, this is more efficient if you don't have any linux experience.

Answer 4

If your primary objective is to learn Hadoop then it does not matter you learn it on Windows or Linux, because everything is exactly same on both platforms. I have extensively used Hadoop on both platform and found all the commands and processing are identical on Windows and Linux. So here are my suggestions:

1. Download VMware VMPlayer on your Windows Machine
2. Download CDH Virtual Machine for VMware https://ccp.cloudera.com/display/SUPPORT/Downloads

Access virtual machine in your Windows box and follow the tutorials exactly they are on Linux.

Answer 5

You can also try "Syncfusion BigData Studio" to run a single node cluster in your local machine along with required ecosystems installed with it; Also "Syncfusion BigData Platform" allows you to manage clusters in a much easy way without any manual configuration from user's end; These 2 setups are "100% free for everyone";

To download setup and know more, please refer: http://www.syncfusion.com/products/big-data

Answer 6

I use Hadoop natively on Windows as a virtual 2-node cluster running on one machine. It runs inside Cygwin (so no VM). Works well to try Hadoop out and I still use it to test new code in small before putting it on the cluster. You basically get every bit of functionality as with a full cluster. Getting it to work can be a bit tricky though.

I used the following short guide: Stanford Hadoop for Windows guide

Which worked fine for me. Very important is that you use 0.20.0! Higher version do not run under Cygwin. I think it is best to leave the number of default nodes to 2. This way you can test if splitting the work across multiple nodes works, but more simultaneous nodes can give you memory problems.