Evan Weaver on 5 Sep 2007 18:05:27 -0000


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PhillyOnRails] jruby + hadoop?

  • From: "Evan Weaver" <evan@cloudbur.st>
  • To: talk@phillyonrails.org
  • Subject: Re: [PhillyOnRails] jruby + hadoop?
  • Date: Wed, 5 Sep 2007 14:05:04 -0400
  • Dkim-signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=qVjUuqlRV1110jJKpY/POZnTDi7Tkohs3g3R8wU6iEddqLRBp5ji2ZTpCdrrJt/TMEjsTzAJjsg3K21U3L8s1ZLuavxnlxPn2Xq/TNdEZpH9DwLxp3tl0f75oAmVxdqybi52Fx9eI4cDW4HIhLgd6VWq2s+xAvXXdTH9E0ZV9Gc=
  • List-archive: <http://lists.phillyonrails.org/pipermail/talk>
  • Reply-to: talk@phillyonrails.org
  • Sender: talk-bounces@phillyonrails.org

> But for serious applications, I want my RDBMS.  Nothing beats having the
> model data and relationships where they should be -- entirely in the
> database, optimized by procedural functions -- application agnostic.

Just what Oracle wants you to think: "This is serious app. It needs
serious database."

In my view pretty much anything beats having all your data locked up
in a schema'd but not versioned, highly stateful, monolithic DB
process. It's only "application agnostic" because all your
applications already are committed to SQL. If you try to integrate an
RDF app it won't seem so agnostic anymore.

Evan

On 9/5/07, Cassius Rosenthal <cassius@xmodulation.com> wrote:
> If CouchDB makes it out of beta, I would love to use an ActiveRecord
> implementation of this for very simple web sites like blogs.  I think
> the revisions feature should be made optional, otherwise the storage
> file could blow up faster than the log files, requiring its own
> maintenance plan.
>
> This CouchDB approach particularly makes sense for the Rails framework,
> where validation and relationships are specified in the model code,
> making foreign key specifications and constraints redundant.
>
> In terms of performance, I would love to see how the map/reduce
> implementation stacks up to optimized psql statistics, for example.
>
> But for serious applications, I want my RDBMS.  Nothing beats having the
> model data and relationships where they should be -- entirely in the
> database, optimized by procedural functions -- application agnostic.
>
> Thanks!
> -Casey
>
>
> Mat Schaffer wrote:
> > So granted, I'm still reading the map/reduce paper, but this sorta
> > drove it home for me I think.  Thought I'd share it with those of us
> > not subscribed to Labnotes already.
> >
> > http://blog.leetsoft.com/2007/9/2/futuretalk-couchdb
> > (via http://blog.labnotes.org/2007/09/02/couchdb-thinking-beyond-the-rdbms/)
> >
> > Granted, it's not hadoop, but it's website-type data without an RDMBS
> > which put it in perspective pretty nicely.  I can sorta imagine this
> > becoming the norm and RDBMS becoming more of a niche market.
> >
> > -Mat
> >
> > On Sep 1, 2007, at 5:34 PM, Michael Bevilacqua-Linn wrote:
> >
> >> Have you read the google paper (doesn't cover hadoop obviously, but a
> >> great intro to the concept, has a section at the end that has a few
> >> blurbs on what/how google is using it.)  It's very straightforward
> >> and written in plain English, not academe-ese.
> >>
> >> http://labs.google.com/papers/mapreduce.html
> >>
> >> MBL
> >>
> >> On 9/1/07, *Mat Schaffer* < schapht@gmail.com
> >> <mailto:schapht@gmail.com>> wrote:
> >>
> >>     On Aug 31, 2007, at 9:12 PM, Evan Weaver wrote:
> >>     > PS. Thanks Toby for your June mail about Hadoop; it's totally
> >>     on the
> >>     > table now :) .
> >>
> >>     To completely ignore your question and make a selfish comment of my
> >>     own:  I'd love to see some presentational material on how to really
> >>     use hadoop (or map reduce in general).
> >>
> >>     I've looked at it a couple of times and sorta get it, but I keep
> >>     failing to get a firm grasp on what problem spaces it's applicable to
> >>     and how.
> >>     -Mat
> >>     _______________________________________________
> >>     To unsubscribe or change your settings, visit:
> >>     http://lists.phillyonrails.org/mailman/listinfo/talk
> >>
> >>
> >> _______________________________________________
> >> To unsubscribe or change your settings, visit:
> >> http://lists.phillyonrails.org/mailman/listinfo/talk
> >
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > To unsubscribe or change your settings, visit:
> > http://lists.phillyonrails.org/mailman/listinfo/talk
> >
>
> _______________________________________________
> To unsubscribe or change your settings, visit:
> http://lists.phillyonrails.org/mailman/listinfo/talk
>


-- 
Evan Weaver
Cloudburst, LLC
_______________________________________________
To unsubscribe or change your settings, visit:
http://lists.phillyonrails.org/mailman/listinfo/talk