Data Centers

Facebook's Open Compute Project gets the nod from Greenpeace

Greenpeace is praising Facebook for its transparency in energy use and Open Compute Project. Learn about the Open Compute Project, which has resulted in one of the most efficient computing facilities.

opencompute1040914.jpg
 Image created from Greenpeace's Green Internet report

Greenpeace International does more than patrol the oceans -- the organization also keeps a close watch on data centers, making sure the operators use the Earth's resources as efficiently as possible. In Greenpeace's April 2014 report Clicking Clean: How Companies are Creating the Green Internet (PDF), it rated Apple, Google, and Facebook as much improved. In that same report, Greenpeace praised Facebook for its transparency in energy use and Open Compute Project.

Open Compute Project

In 2009, three engineers at Facebook took on a rather daunting challenge: design a data center from the ground up with an emphasis on being as efficient and economical as possible. Two years later, Facebook broke ground on one of the most efficient computing facilities in existence -- Facebook's data center in Prineville, OR. The Prineville campus can accomplish the same amount of work as other Facebook data centers, using 38% less energy -- a significant savings.

In this blog post, Jonathan Heiliger, vice president of Facebook Technical Operations at that time, referred to some of the unique ideas the team put in place to obtain that kind of improvement:

  • 480-volt-in plant electrical distribution system to reduce energy loss
  • Remove anything in our servers that didn't contribute to efficiency
  • Reuse hot aisle air in winter to heat the offices and the outside air flowing into the data center
  • Eliminate the need for a central uninterruptible power supply

Heiliger wrote, in the same blog, the team of engineers felt it important to share their innovations publicly in a manner similar to open-source software. To that end, Facebook created the Open Compute Project: "An industry-wide initiative to share specifications and best practices for creating energy efficient data centers."

Open Compute Project Server

One of the first places engineers looked to optimize was server hardware and the equipment supporting servers. Facebook engineers in the article Inside the Open Compute Project Server provided insight on how they redesigned server hardware from the chassis on up.

Chassis: Facebook removed all unnecessary hardware, even mounting screws in order to lower cost and weight. Something most do not think about is how much a server weighs. Streamlining the server's insides removed six pounds, saving on shipping cost and data center technicians' backs.

opencompute2040914.jpg
 Image: Facebook

Motherboard: The motherboard includes a direct interface for the power supply, no extraneous expansion slots, and is designed to reboot over the LAN. Facebook has two motherboard types: one for Intel processors, and one for AMD processors.

Power supply: According to Facebook, the power supply was the biggest challenge, yet, if redesigned correctly would realize the largest savings. Facebook's new power supply has an efficiency rating of 95%.

The Open Compute power supply at the right has two connectors: one for 48 VDC (UPS) and one for 277 VAC (primary). The higher primary voltage of 277 VAC reduces transmission losses due to "I squared R."

Support equipment

Facebook engineers also took a hard look at rack design and how to provide power efficiently when the primary AC source was interrupted.

Triplet rack

opencompute3040914.jpg
 Image: Facebook
Instead of normal individual racks, Facebook uses what it calls triplet racks, combining three rack cabinets into one. Each triplet rack holds 90 servers. That amount mates up with Facebook's network device, which has 90 connections.

In a move that will garner smiles from those who have installed equipment in racks, Facebook has done away with the rail system, using trays. Just slide the server in, and engage a spring-loaded plunger to hold the server in place.

Battery cabinet (UPS)

Facebook battery backup systems for servers are only required to last 45 seconds; Facebook engineers say the building's generators will be online by then. Each battery cabinet serves two triplet racks, includes an AC/DC rectifier to charge the batteries, and an automated impedance-testing system that monitors each battery alerting technicians if one needs to be replaced. The Facebook article about the Open Compute Project server notes: "This alternative battery system is 99.5 percent efficient (we use some energy to charge batteries) when compared to the 90-95 percent efficiency associated with industry standard UPS systems."

Thermal design

Facebook understands that electricity used for anything other than computing affects the data center's Power Usage Effectiveness (PUE), and cooling is a major part of the "other than computing" category. To improve how a server is cooled, Facebook standardized on a 1.5U (2.63 inches) server chassis height. This allowed larger heat sinks and larger fans to fit in the chassis, increasing cooling efficiency, and reducing the amount of electricity needed to spin the fans. Also, larger fans are significantly quieter; something people who spend any amount of time in data centers will appreciate.

Moving in the right direction

Experts talk of data centers requiring more electricity than the average size town. No doubt, that is why Greenpeace is monitoring data centers, applying pressure when need be to those that are not onboard with conserving resources.

Are you taking steps to make your data center more energy efficient? If so, what have you done so far? Let us know in the discussion.

Also see

About

Information is my field...Writing is my passion...Coupling the two is my mission.

4 comments
mudpuppy1
mudpuppy1

Oh, I'm impressed. Look everybody, Greenpeace has given their stamp of approval! As JTONLY said below: Greenpeace is a terrorist organization.


Having said that, there is nothing wrong with being more efficient with power usage. It makes economic sense.

jaburch1987
jaburch1987

Great rundown, with plenty of specifics!


I'll be interested to see if the Open Compute Project really fosters the development of more efficient data centers - or at the very least rail-less ones! Six pounds off a rack server is okay, but I'd sooner be spared the headache of dealing with rail systems.

JTONLY
JTONLY

Greengarbage is nothing but a Terrorist Organization.

End of Story.

Michael Kassner
Michael Kassner

@jaburch1987  


I agree with you about the rail system. I have been trying to figure out how they handle airflow with the trays.