How Facebook keeps 100 petabytes of Hadoop data online

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • res0nat0r
    Someone MARRY ME!! LOL
    • May 2006
    • 14475

    How Facebook keeps 100 petabytes of Hadoop data online



    Hadoop is freaking cool and is one of the most fun things I get to play with for my job. This article is pretty sweet.

    I didn't deal with anything near 100PB, but greping through ~2TB of logfile data each month for interesting stuff is still pretty fun.
  • picklemonkey
    Double hoodie beer monster
    • Jun 2004
    • 15373

    #2
    Re: How Facebook keeps 100 petabytes of Hadoop data online

    I grep through logs every month for personal projects, it's cool to see how people are using your tools

    Comment

    • res0nat0r
      Someone MARRY ME!! LOL
      • May 2006
      • 14475

      #3
      Re: How Facebook keeps 100 petabytes of Hadoop data online

      Hadoop is awesome. You can do some pretty amazing things easily. It's cool launching 100 servers and waiting 10 mins and they are up and having a 500TB distributed filesystem at your fingertips.

      Comment

      Working...