Eric Lucas on 10 Mar 2016 15:42:28 -0800


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

[PLUG] Command line tools faster than Hadoop cluster


I just throw this out for your perusal - I stumbled across it this morning and found it interesting.

http://aadrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html

I knew about the shell behavior but never really thought of it as 'parallel' processing.   DOH!

Even the implementer of the Hadoop solution admitted it was not the right solution but I empathize with his desire to learn while solving problems.

Eric

BTW it was linked from this article: http://idlewords.com/talks/website_obesity.htm
which is amazing

___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug