Comments for Hayes Davis

Comment on Running Hadoop on Windows by Brian

Brian — Sun, 24 Jan 2010 20:40:57 +0000

I have followed this,altough trying a pseudo cluster first, and have come to a roadblock when I try to start up hadoop:

$ bin/start-all.sh
starting namenode, logging to /cygdrive/c/apache/hadoop/hadoop-0.20.1/bin/../logs/hadoop-brian-namenode-xx.out

localhost:/bin/bash: /cygdrive/c/apache/hadoop/hadoop-0.20.1/bin/hadoop-daemon.sh: No such file or directory

The error seems related to a carriage return after logging into the same machine()’localhost’ through ssh, running hadoop as a pseudo-cluster

Comment on Running Hadoop on Windows by Brian

Brian — Mon, 18 Jan 2010 02:45:06 +0000

I’ve started playing with this, as an experiment to try distributing across remote computers, does anyone know if I could use my dreamhost account as a client?

Comment on Running Hadoop on Windows by Gaurav Kumar

Gaurav Kumar — Sat, 08 Aug 2009 15:39:16 +0000

When I was half way through the article, I thought this must be one of those 10 page guides but to my pleasant surprise you managed to sum it up quite clearly and concisely.
Thank you for the your post.

Comment on Running Hadoop on Windows by Aseem Puri

Aseem Puri — Fri, 17 Apr 2009 06:08:07 +0000

Can you please tell when configuring SSH to use default usernames what changes have to be made on hadoop-env.sh. I have made a config file and can do ssh. But when i use command bin/start-all.sh it there it still search in differnt directory for hadoop-deamon.sh file

Comment on Running Hadoop on Windows by Aseem Puri

Aseem Puri — Thu, 02 Apr 2009 07:08:00 +0000

Remove every old data folder where datanode store can store data from your system and the use command bin/hadoop namenode -format

Comment on Austin on Rails Talk: Building TweetReach with Sinatra, Tokyo Cabinet and Grackle by Hayes

Hayes — Mon, 30 Mar 2009 15:34:49 +0000

David,

Glad this helps you out. Sinatra’s a great little framework for doing simple apps. I feel your pain about Rails but it definitely rewards you once you get over the learning curve.

I won’t be releasing all of the TweetReach code as it’s ultimately going to be a commercial web app. However, I have put the Grackle code on github.

There are also quite a few Sinatra examples out there. You might want to take a look at Sinitter (http://github.com/moomerman/sinitter/) which is a demo app using Sinatra + the Twitter OAuth library. I’ve not personally tried it but it might be a good example.

Comment on Austin on Rails Talk: Building TweetReach with Sinatra, Tokyo Cabinet and Grackle by David Fisher

David Fisher — Mon, 30 Mar 2009 03:27:41 +0000

Thanks so much! This is great. I’m just starting into Ruby/Rails and honestly Rails is a bit overwhelming to wrap my head around. I’ve been told to check out Sinatra, and I’m in the process of trying to write one or two quick Twitter apps. This definitely gives me some ideas. Are you going to release the full code for TweetReach (perhaps on Github?) that we could all check out? I’m still learning the language and any/all examples are massively helpful.

Thanks much!

Comment on Running Hadoop on Windows by Vlad Korolev

Vlad Korolev — Sun, 22 Mar 2009 04:57:33 +0000

I just recently made a tutorial on how to set-up hadoop development environment with Eclipse plug-in on the Windows machine.

http://v-lad.org/Tutorials/Hadoop/00%20-%20Intro.html

Comment on Running Hadoop on Windows by Avi

Avi — Wed, 11 Feb 2009 20:33:42 +0000

Absolutely great post.
Thanks a lot – you saved me quite a hassle as hadoop’s docs are as good as a map of Africa when you’re stuck in the middle of Alaska…

Cheers!

Comment on Running Hadoop on Windows by Kim Pham

Kim Pham — Tue, 03 Feb 2009 22:39:07 +0000

If you include package “gzip” when downloading the cygwin packages, you can afterward use the “gunzip” command to extract the hadoop “*.tar.gz” file for “Step 4: Extract Hadoop (All Machines)”.

Run the followings in a cygwin window:
1. Move the “hadoop*.tar.gz’ to /usr/local
2. Run command: gzunzip hadoop*.tar.gz (you will see a hadoop*.tar file)
3. Run command: tar xvf hadoop*.tar