Discussion Locked

Performance is cool: Exploring processors and energy efficiency

0 helpful
43 replies
Closed to new repliesThis discussion is closed. It stays readable, but it takes no new replies.
Bring on your questions and opinions! This special week-long conversation (October 16-20, 2006) will include Dr. Dileep Bhandarkar of Intel's Digital Enterprise Group. Jump in and ask him anything you want to know about processor architecture, silicon heat issues, competing platform technologies, and energy efficiency. Need to get your creative juices flowing? Read up on the issues surrounding this discussion. This is a unique opportunity to ask an industry leading expert on CPU architecture about issues on energy efficiency and performance.

43 replies

by justin james

One thing that I think would be great to learn about is programming practices that increase scalability so that less hardware is needed, as well as causing less power draw by the CPU and other components. Particularly for Web/application farms, the languages used (PHP, Java, .Net) tend to be a bit slower and give the programmer less control over resource usage than traditional languages (particularly C/C++).

What can programmers do to reduce hardware, energy, and cooling costs while not significantly increasing development cycles?

J.Ja

by georgeou

Virtualization is a nice place to start.

Terminal services or Citrix is another place. If developers can make their code only require one instance of common binaries in terminal services, that would make Terminal services far more scalable.

by dileep.bhandarkar

Intel has made major strides in energy efficiency in its Intel? Core? microarchitecture. The end result shows up in significant increase in performance while reducing power appreciably at the same time.

The new Intel? Xeon? 5100 processor delivers 80% higher server performance at 35% lower power than the previous generation dual core Intel Xeon? 2.8GHz 2x2MB processor. On the desktop, the Intel? Core 2 Duo? processor delivers 40% higher performance at 40% lower power compared to the Pentium? D 950 processor. In notebooks, the Intel? Core 2 Duo? processor delivers 20% higher performance at the same battery life compared to the Intel? Core Duo? T2600 processor. These performance and power metrics are based on SPECint*_rate_base2000 and thermal design power. Other workloads might deliver different results.

Details of the architectural innovations in the Intel? Core? microarchitecture can be found at http://www.intel.com/technology/architecture/coremicro/.

Delivering more performance to support the ever-growing usage demands while maintaining energy efficiency is no easy task. Last week, I addressed how Intel was addressing this challenge in my keynote at the Fall Processor Forum in San Jose. You can reference my keynote slides and supporting information regarding energy efficient performance at http://www.intel.com/technology/eep/index.htm

I will happy to answer your questions about some of the techniques that Intel used to reduce power in a later posting!

by georgeou

You can get the Core Solo processor that designed for 5 watt TDP. You can probably get away with heatsink only if the case is well ventilated. Heck, a well designed case would even allow a 100 watt processor to use a heatsink only.

by dileep.bhandarkar

Intel Corporation is challenging PC designers and manufacturers to think sexy, stylish and small as they design the next generation of home PCs optimized for multimedia entertainment and powered by Intel? Core?2 Duo processors.

The Intel Core Processor Challenge is open to PC designers and manufacturers worldwide. Intel will award the grand prize winner with up to $300,000 to help enable the mass production of the winning system and $400,000 for co-marketing activities with Intel around the winning system. The first-place winner will receive up to $300,000 to help enable the mass production of their winning system.

See details at http://www.intel.com/pressroom/archive/releases/20060926corp_a.htm

by stephen howard-sarin

The fan is a necessary evil, but boy would I like to get rid of it!

HTPC's are the biggest pain point, IMHO. The noise issue is huge when you're trying to get the PC into the living room. Heat is really secondary to noise though.

But I really would prefer cooler machines in corporate desktops and laptops. I think we all know uncomfortable feeling of using a laptop in your actual lap for too long.

by georgeou

Totally fanless systems are not practical, but there are superior designs that use fewer and slower moving fans that make no noise. BTX chasses have superior air flow for example and make very little noise. Even my large desktop computer makes very little noise because I bought a silent CPU FAN and power supply. They even have silent GPU fans.

by justin james

I recently read an artciel about filling the entire computer with a non-conductive fluid (in this case, vegetable oil) to provide cooling. It did an outstanding job. Of course, the price for getting it wrong is an awful mess, but it *is* complete silent and very cool. Heavy too, of course. There are also liquid cooling systems which should be a bit quieter than the standard fans that we are accustomed to.

by stephen howard-sarin

Liquid-filled PCs? Yuck!

Seriously, though, Intel has Viiv (for digital entertainment systems in the home) and vPro (for corporate systems) -- are the heat-saving and quietness benefits of the new Core series really intended for the business customer, or the soccor mom?

by dumphrey

Currently my computer puts out 24 db as measured 2 feet from the case. I use this machine as a HT ste up. Fan noise is not an issue for me, as the computer is across the room and remote controlled. When building/buying a decent HT PC, noise is the easyest problem to solve. Rubber gromets, silicone gaskets, 120mm fans, lots of options.

by viruser

Applications that aren?t yet Intel native on the MACs run much slower now than before (On the MAC G5s) Is there any buzz on that issue in the labs?

by georgeou

Mac universal applications are the only way around this problem. PowerPC code will simply not not run well when it's being translated to Intel code. There is usually a 60% hit on performance. Apple should have done the x86 transition when they shifted over to OS X and that would have killed 2 birds with 1 stone.

by dileep.bhandarkar

How much slower are they? Do you have specific numbers for specific applications?

It is not unusual to see 50% of native performance with translation. If the new processors are 2x the native performance of the old ones, then the translated binaries will run at the same speed as they did on the old processor.

Of course, the performance varies from application to application and the amount of OS and I/O activity will have an impact on performance.

by sclegg88

My system keeps crashing without warning - I think it may be heat related. Which utility is best for testing system and hardware?
Thank you.

by stephen howard-sarin

How many of you have any responsibility at all for the heating/cooling costs?

I ask because while reducing cooling costs in a datacenter is a win for the whole company, I wonder if it's a win for the IT Dept. or Facilities.

Does IT really have enlightened self-interest in making cooling more efficient?

by dileep.bhandarkar

That is a very good question. If the energy costs are borne by facilities, there is very little motivation for the data center manager to procure energy efficient systems if the cost more to buy.

For the overall organization this would be short sighted. In fact, by 2010 IDC expects that for every dollar of new server spending, an additional $0.70 will be needed for power and cooling. This is a dramatic rise from the rate of $0.50 in 2005 and $0.21 in 2000.

by stephen howard-sarin

But I fear Intel (and AMD, and Sun) are out ahead of organizational reality in promoting the ROI for power-saving in the enterprise.

by rexworld

The group I work in manages the reporting servers (Oracle Reports, Oracle Discoverer, and SAS) and heating/cooling are nowhere on the checklist for ordering servers.

I assume somebody somewhere in IT probably does worry about that issue, I'm sure it gets factored somehow into the ordering process. But when we as the front-line organization request upgraded or replacement hardware, all we're concerned about are the computer specs (RAM, disk space, etc). We're not at all involved in determining the appropriate power-management specs for our servers. We worry about meeting the data needs of our reporting customers, and let the tech services team worry about the power consumption issues.

by georgeou

This is what I see all the time. Too many IT departments only worry about the upfront costs and fail to recognize the long term impact on the power bill which costs a lot more than bandwidth. It's funny that people complain about the bandwidth bill or the phone bill or the cable bill but they never bother with the power bill.

by georgeou

They were making a massive change anyways and it wouldn't have been that much more painful to change the CPU along with the OS. It would have avoided the problems they're having today getting everyone onboard with x86 CPUs.

by dileep.bhandarkar

Instruction set transitions are very painful. I have heard some people say that unless there is a 2x improvement in performance, the cahnge is not worth the effort!

I don't recall what the relative performance of PowerPc was to IA32 five years ago.

In 2006, the dual core Intel Core Duo offered an big improvement in both performance and energy efficiency. The more recent Core 2 Duo extends that further. This appears to be the compelling value proposition that can justify a change in isntruction set architecture!

by georgeou

There are much easier ways to build a mostly silent PC. The CPU FAN, GPU FAN, Power supply FAN are the biggest culprits in that order. You control those 3 things and you have very little noise.

by justin james

I would say that low heat, low power, low noise systems make everyone happy. That being said, the data center typically is assumed to be a loud place that needs air conditioning in the winter. It is one of those "accepted facts of life." Raise your hand if you ever saw the noise levels listed in server specs. Neither have I. A dual CPU, 1U Xeon server makes so much noise that even one of them in a room makes it nearly impossible to talk on the phone on the other side of the room. It doesn't really matter how little heat the device puts out, 1U rackmount will always be noisy unless it does not require fans at all, just because of the speed that those little fans turn at to keep the air moving.

J.Ja

by t_mohajir

I have no doubt that Core 2 is ahead of Athlon64/Opterons when it comes to measuring performance per watt at full load. But the reality is that most desktops and servers are not at 100% utilization. I would expect that for most desktops in real world use, they sit idle for long periods of time with small peaks of utilization. For servers, I would expect that they are maybe 40-60% utilized when the majority of users are on the system, and probably close to 10% during off hours. So in this regard it seems that using AMD processors would result in better cost savings because they are much more efficient when idle than Core2. See test from tom's hardware:
http://www.tomshardware.com/2006/09/25/green_machine/page4.html

In addition, I would think that the use of FB-DIMMs by Intel adds to the power utilization of their server platforms by 5-10%.

So how is it that anyone can claim, "The only thing in dispute is the size of Intel's performance and energy efficiency lead." ?

In terms of performance and energy efficiency lead at full load, I would tend to agree. But in terms of real world savings, I'd be interested to see evidence that Intel is ahead of AMD when it comes to power consumption with real world load on the systems.

by dileep.bhandarkar

Thanks for a very interesting post!

There is no standard way of measuring energy efficiency. Mobile clients already deliver the lowest PC energy costs, so users with a great focus on lowering energy costs will identify mobile PCs as the preferred client solution. For the desktop PC, energy efficiency mainly translates into the energy cost required to deliver a required level of performance and capability.

As energy efficiency becomes an interesting element when comparing PCs, it is important that the industry develop a meaningful and broadly adoptable metric that enables a person to make an informed buying decision. There are, however, some challenges with measuring energy efficiency and energy efficient performance. Although, historically, the industry has developed a number of standard practices for gauging performance like SYSmark*, SPEC* CPU as well as battery life for the notebook PC using MobileMark*, there is currently no standard methodology for evaluating client performance coupled with its associated energy cost. The whitepaper at http://www.intelcapabilitiesforum.net/EEP outlines a proposed methodology for evaluating both the performance and AC energy efficiency of the client platform that may serve as an interim solution until an industry developed solution becomes available. In addition to this proposed methodology, Intel will fully participate with industry standards organizations to develop a consortium-based approach to this area of platform evaluation.

For example, Intel has measured the following performance and energy cost for the Intel? Core? 2 Duo E6700 processor with integrated graphics on the Intel? Express Intel? DG965SS motherboard. For full system configuration details, please see http://www.intelcapabilitiesforum.net/EEP?s=12

Note that both Enhanced Intel? SpeedStep? Technology and Minimal Power Management are enabled.

Energy Cost per KWh $0.10

Avg. System Power Idle (watts) 62.4

Avg System Power Standby (watts) 3.4

Avg. System Power OP (watts) 69.4

Avg. System Power ICC (watts) 75.5

Time to Complete - OP (minutes) 47.316

Time to Complete - ICC (minutes) 39.433

Time to Complete - Total (minutes) 86.75

Idle Time After Run (minutes) 15

Standby Time After Run (minutes) 18.25

Performance tests and ratings are measured using specific computer systems and/or components. Actual results may vary.

+++++++++++++++++++++++++++++++++

The previous post pointed to

http://www.tomshardware.com/2006/09/25/green_machine/page4.html which also says:

Author's Opinion

Were Athlon 64 X2 Energy Efficient processors to reduce average power use by 10 W, the average 10 hour per day office system would cost only few dollars less per year to operate.

+++++++++++++++++++++++++++++++++

Energy-efficient performance (EEP) is the intersection of great performance, expanded capabilities and energy efficiency. One needs to compare the energy efficiency of similarly configured systems that deliver similar performance.

You may want to look at reports at other sites.

http://techreport.com/reviews/2006q3/core2/index.x?pg=2 says:

AMD answers with Energy Efficient Athlons:

Anticipating better power efficiency from Intel's new desktop processors, AMD has begun offering Energy Efficient versions of many of its CPUs for the new Socket AM2 infrastructure. Much like the Turion 64 mobile processor and the HE versions of the Opteron server chips, these Energy Efficient Athlon 64s have been manufactured using a tweaked fabrication process intended to produce chips capable of operating at lower voltages. Making these more efficient chips isn't easy, so AMD charges a price premium for the Energy Efficient models that averages about 40 bucks over the non-EE versions.

http://techreport.com/reviews/2006q3/core2/index.x?pg=16 says:

AMD has made substantial progress on this front with its new Energy Efficient processors. Under load, the Athlon 64 X2 4600+ EE system pulls about 20W less at the wall socket than the stock X2 4600+ system, and the 35W-rated X2 3800+ system draws less power than anything else we tested. Still, even these new CPUs can't match the performance of the Core 2 processors that are in the same neighborhood in terms of power draw.

Whoa. Performance is way up with the Core 2 processors, and power draw is way down. The Core 2's mythical "performance per watt"?which is actually a rather slippery thing to quantify?has gotta be the best on the market. The Core 2 Duo E6700 outperforms the Athlon 64 FX-62 more often than not, yet the E6700-based system draws 74 fewer Watts under load.

http://techreport.com/reviews/2006q3/core2/index.x?pg=18 says:

The PC industry can also breathe a collective sigh of relief about power and thermal issues now that Core 2 has arrived. Intel finally has a firm handle on those problems. These processors consume less power?and thus produce less heat?than desktop Pentiums have for quite a while. The E6700 system's total power draw when fully loaded was 156 W, only 14W more than the Pentium Extreme Edition system drew while sitting idle. What's more, even the high-end Core 2 processors' power use was in line with that of the Energy Efficient versions of the Athlon 64 X2. That leaves room for many good things to happen, from less expensive cooling systems to quieter, smaller enclosures and even some righteous overclocking. Combine the low power draw with the performance we've seen, and the Core 2 is clearly the most energy-efficient desktop processor around.

by dileep.bhandarkar

You also asked about server performance and power. We have worked with independent thrird parties on measuring actual energy consumption under several workload coditions compared to the competetion.

You can find the results at:
http://www.principledtechnologies.com/clients/reports/Intel/Intel.htm

SPECjbb2005 performance and power consumption on Intel- and AMD-processor-based servers (May, 2006; 498KB)

64-bit SunGard ACR financial workload performance and power consumption on Intel- and AMD-processor based servers (May, 2006; 350KB)

64-bit Black-Scholes financial workload performance and power consumption on Intel- and AMD-processor based servers (May, 2006; 290KB)

SPEC CPU2000 SPECint_rate_base performance and power consumption on Intel- and AMD-processor based servers (May, 2006; 350KB)

WebBench performance and power consumption on Intel- and AMD-processor based servers (May, 2006; 203KB)

Windows Media Load Simulator performance and power consumption on Intel- and AMD-processor based servers (May, 2006; 726KB)

64-bit financial application-based workload performance on Intel- and AMD-processor based servers (May, 2006; 337KB)

by dileep.bhandarkar

I have not seen anything recent and certainly not aware of the use of vegetable oil. You brought back memories of the Cray 2 Supercomputer which was immersed in Flourinert circa 1985!

http://en.wikipedia.org/wiki/Cray-2

The liquid has to be sealed and circulated. Modifying the hardware is messy too!

by mkc7985

I know that Pentium D is not going to compare to a Core 2 Duo. But with a large power supply and excellent cooling already in place, wouldn't a pentium D be an economical choice for a serious power boost from my 478 running at 2.8? What is the difference between the core duo and D? The way my dad explained it was that Hyper Threading was the begining and the pentium D's were a step closer, but that the Core Duo is the real deal. I can understand that but how much would I really notice the difference? Thanks for the help in advance.

by dileep.bhandarkar

Core 2 Duo and Pentium D are both dual core and they support 64 bit capability. Hyperthreading is only turned on in the Pentium Processor Extreme Edition product family.

Pentium D is based on the older Netburst architecture, while the Core 2 Duo is based on the new Intel Core Microarchitecture.

In general, the Core Microarchitecture delivers higher performance at lower power compared to the Pentium D processor. The exact numbers will vary with the specific model numbers and workload.

For a feature comparison try http://indigo.intel.com/compare_cpu/default.aspx?familyID=1&culture=en-US

However, if you already have an existing PC with a slower Pentium D or Pentium 4, you might be able to get higher performance by upgrading to the fastest available Pentium D processor. Check with your system vendor and/or motherboard supplier to see if your system can be upgraded.

Let me know me if you have any follow up questions.

BTW, what is a 478?

by smorty71

Although it was meant to be a low-cost, small business server, the Dell 400SC runs very quiet. The front of the case has a series of holes (about large enough to stick the tip of your finger in) that allow air to be pulled through from the single fan on the CPU.

I was very skeptical that I would get adequate cooling with a quiet single fan design; however, I ran Motherboard Monitor on it for a few days and found that it stayed in the acceptable range.

Because these machines are so quiet, I have two of them that I have converted to media PCs running MCE2005. They are so quiet that I often have to check the power lights to make sure that they are still running.

by georgeou

Even the cheapest $200 dell boxes are quiet. They use a single case fan which has a duct from the CPU and there is no CPU fan. This is a very silent design that I wish would be popular on generic home built PCs.

by justin james

Bandwidth bill? I can try a different carrier. Hardware? I can call a different vendor. Phone bill? I can go VoIP, all cellular, and choose different LD carriers, and even CLECs in some areas. Power? No choice at all. People see power as an inflexible cost. I look at my friends paying $300+ per month on power bills, because to them setting the thermostat below 80 in the winter and wearing a sweater is not a viable option. It's just like living with children; the only person who cares about shutting the lights off is the person who cuts the check to the power company. Everyone else has zero incentive to turn the lights off. Power for servers doesn't come out of IT. They purchase UPS's and power systems based on what hardware they have, not the other way around. Facilities pays the power bill, and they have zero control over it. Few companies even care about power bills. I worked at one company though, they had "summer hours" where if you worked an extra hour a day, you could have every Friday as a half day or every other Friday completely off. This made a lot of sense, and saved them a bundle of money. But again, few companies care. At my current company, power is included in the rent. From what I know of the rent, and what I know of our power usage, I would not be surprised if we are sucking up at least 25% of the rent in power usage. But again, we don't pay the bill, so we have no incentive to conserve. This is how big companies are (mine is not one). No one actually pays for the consequences of their decisions, so they get to make the decisions that are easiest for them. Imagine if someone tied power usage to IT's budget, and factored it into the CIO's bonus? That company would be greener than Astroturf in three months, guaranteed.

J.Ja

by georgeou

"Everyone else has zero incentive to turn the lights off. Power for servers doesn't come out of IT. They purchase UPS's and power systems based on what hardware they have, not the other way around. Facilities pays the power bill, and they have zero control over it."

You nailed the problem! We even had people balk that Microsoft is adding group policy control of power savings in Vista. People freak out if you try to shut down their machines. A lot of people still believe in the myth that turning off the computer is somehow bad for it. Human behavior and ignorance is the biggest problem.

by nacromancer

The problem I have noticed most of all is the issues not with CPU's but rather the Motherboards that support them. Almost every motherboard review site and or forum I have read up on over the last few months has reported major issues with the motherboards that claim to support the newer high end D9XX and Core Duo CPU's. Especially for those who are die hard Nvidia fan's. As it turns out SLI will become a thing of the past with Intel forcing everyone to buy CrossFire Video Cards in order to make the graphic's work in games and certain applications. This is not right. Intel comes out with CPU's faster than motherboard makers can keep up. It is like your forced to buy Intel boards alone, and forget the graphics performance you are used to from SLI. The best advice I have recieved is to wait and watch. I may end up having to become an AMD fan from here on out once AMD introduces their True 4X4 soon which will blow Intel's best out of the water. Especially if people see that it works great in all kinds of motherboards besides Crossfire supported ones only, unlike Intel's. What good is fast computationally powerful CPU's if you don't have the graphic's to match its abilities? Yes as you can see I am not impressed with Crossfire at all. You have to buy 2 or in some cases 3 video cards plus special 'Y' connectors in order to make it match anything close to what 2 Nvidia cards will do in an SLI configuration. And the developers of software app's that use SLI are giving up the fight, what wimps. Better save your allowances cause those ATI Crossfire Video Cards are not cheap. Nor will most of the games and graphic editing app's that used SLI will work in them. What web's we weave, when we choose to deceive...Intel enjoy your moment of brevado, because it is all your gonna have...

by goc

I've seen this bite two data centers now. One site recently announced it could host no more new systems as they had not more power capacity and another data center is nearing this point. Upgrading power to a data center is not just calling up the power company and asking for another (or larger) feed, UPS and Generator systems have to be upgraded as well. A very expensive proposition.

This discussion is closed to new replies.