General discussion

Locked

Tech Perspective: Who to believe? Micro

By techperspective ·
According to Gartner, administrators shouldn't put much stock in a recent comparison test, funded by Microsoft, which claims that Exchange Server outperforms Lotus Notes Domino Server. Do you think that Microsoft tends to overstate the capabilities of Exchange Server? How much weight should vendor-sponsored comparison tests have when it comes to influencing decisions on software and hardware purchases for an organization? How much do you depend on these comparison tests when making a decision? You can read the related Gartner article, which will be posted on 3 A.M. Monday, at http://www.techrepublic.com/article.jhtml?id=r00220000717ggp01.htm

This conversation is currently closed to new comments.

14 total posts (Page 1 of 2)   01 | 02   Next
| Thread display: Collapse - | Expand +

All Comments

Collapse -

Tech Perspective: Who to believe? Micro

by McKayTech In reply to Tech Perspective: Who to ...

A couple of hackneyed phrases come to mind:
1. there are lies, damned lies and statistics
2. you get what you pay for

The danger in vendor-funded tests is not that they won't be conducted rigorously but simply that bad results will never see the light of day. As an indication of the expected theoretical peak performance of the product, the numbers probably still have some validity with regarded with the usual qualifications about comparing apples to apples.

However, I've been involved with I.S. for a long, long time and I have yet to be involved in a critical product purchase that was more about performance than features. A system that is capable of blinding speed performing transactions you don't want to perform has less value than one that does what you want at some lesser speed.

paul

Collapse -

Tech Perspective: Who to believe? Micro

by techperspective In reply to Tech Perspective: Who to ...

Your answer was featured in our TechPerspective TechMail. To receive your free subscription to the TechPerspective TechMail, sign up at http://www.techrepublic.com/techmails.jhtml

Collapse -

Tech Perspective: Who to believe? Micro

by SimonC In reply to Tech Perspective: Who to ...

1. No.

2. Little to very little.

3. Not much at all.

Collapse -

Tech Perspective: Who to believe? Micro

by techperspective In reply to Tech Perspective: Who to ...
Collapse -

Tech Perspective: Who to believe? Micro

Hi!

I agree with the above and as a commment I can say, if Exchange performed so well how come they couldn't run exchange on hotmail.

They had to use Sun Sparc high end servers and Soalris with unix mail server in order to keep hotmail runningsince exchange couldn't handle the load.

Not sure Notes would be able to handle it either.... but.....

/Hasse

Collapse -

Tech Perspective: Who to believe? Micro

by techperspective In reply to Tech Perspective: Who to ...

Your answer was featured in our TechPerspective TechMail. To receive your free subscription to the TechPerspective TechMail, sign up at http://www.techrepublic.com/techmails.jhtml

Collapse -

Tech Perspective: Who to believe? Micro

by ARWJnPlanoTX In reply to Tech Perspective: Who to ...

The only information I expect to gain from any review is point references. When I read a review I'm looking for what the product does and what it doesn't do. I have had my fingers burnt too many times to believe even an unbiased review. I'm talking about reviewers that are not influienced by the vendors.

If, however, a reviewer makes a point that a software or hardware product stands out above the rest I will take a closer look at that product. I will not accept his/her review as gospel under any circumstances.

My favorite way to make an initial evaluation of a product is to consult associates who have used or are familure with the product. My second way is to obtain an evaluation copy and set up a test project.

By no means would I plan an implementation of a product on reviews alone.

As far as reviews go, I believe most vendors would want an unbiased review so their customers don't find out later that a product doesn't support a needed function. If I were a manufacturer Iwould not want to ha

Collapse -

Tech Perspective: Who to believe? Micro

by techperspective In reply to Tech Perspective: Who to ...
Collapse -

Tech Perspective: Who to believe? Micro

by nishpc In reply to Tech Perspective: Who to ...

The Gartner article was a pretty fair analysis of the issues with any comparative test or any scientific experiment for that matter. They have also included some data that indicates that Msft has systematically overstated the capabilities of Exchange. I ahve to agree with that. We gave up on Exchange's ability to efficiently synchronize data with travellers and tried other solutions after buying Exchange for that very purpose based somewhat on vendor claims.

Vendor-sponsored testing shouldnot be relied on for critical decision points, and I do not rely on them.

An issue worth thinking about may be that the lab conducting the test should have the integrity to provide adequate information to place the test results in the proper perspective. Why should consumers trust future reports of ZDLabs testing in their magazines or other venues when they are party to misleading results/reports like these...?

Collapse -

Tech Perspective: Who to believe? Micro

by techperspective In reply to Tech Perspective: Who to ...
Back to Windows Forum
14 total posts (Page 1 of 2)   01 | 02   Next

Related Discussions

Related Forums