Archives
 
 
 
  Special
 
 
 
  About Us
 
 
 

Newsletter
Free E-mail Newsletter from BYTE.com

 
    
           
Visit the home page Browse the four-year online archive Download platform-neutral CPU/FPU benchmarks Find information for advertisers, authors, vendors, subscribers Request free information on products written about or advertised in BYTE Submit a press release, or scan recent announcements Talk with BYTE's staff and readers about products and technologies

ArticlesHow We Tested


April 1996 / BYTE Lab Product Report / How We Tested

To pick the best multimedia notebooks, we ran performance tests based on widely used applications, as well as NSTL's low-level InterMark performance benchmarks to see which are the fastest notebooks. To round out our evaluation, we also measured the endurance of the portables with our Thumper 2 battery run-down tests, examined their screen quality, and decided which ones were the easiest to use and had the most important features for multimedia applications. We weighted the performance scores most heavily, followed by screen-quality, battery-life, features, and usability scores.

To be included in our test-bed of multimedia notebooks, vendors had to supply us with a notebook with a traveling weight of less than 10 pounds (including the system and its components, such as a floppy drive, adapters, and a battery pack). The notebook s had to have a 75-MHz or higher Pentium processor, at least a 500-MB hard drive, at least 16 MB of RAM, an active-matrix color display, an integrated CD-ROM drive, an integrated sound system, an integrated pointing device, and a 3-1/2-inch floppy drive.

Performance

We assessed the performance of each notebook with our suite of applications-based and low-level InterMark tests. Before testing, we installed Windows 95 onto formatted hard disks after wiping the notebooks' preconfigured hard disks. We restored a mirror image of the hard disks when it came time for our usability and features testing.

The applications benchmarks use popular programs such as Word, Excel, and FoxPro, which help us gauge real-world notebook performance. The Windows applications test suite includes Microsoft Word 6.0 and 7.0, Excel 5.0 and 6.0, and FoxPro 2.6. All applications execute macros that exercise common functions of each application. For example, the Word for Wi ndows test includes file I/O, search-and-replace functions, and formatting subtests.

Our Windows-based, low-level InterMark tests exercise the Windows Graphical Device Interface (GDI), as well as all low-level graphics, CPU, FPU, memory, graphics, and the hard drive components of a computer. The GDI component determines how well a system executes basic graphics calls within Windows. We ran all the Windows-based tests in 640- by 480-pixel resolutions and 256 colors using vendor-supplied graphics drivers.

Screen Quality/Battery Life

We focused on three aspects of screen quality: crispness, intensity/color range, and viewing-angle range. The screen-quality tests measure horizontal and vertical line placement, color and gray-scale depths, and the frequency of LCD streaking. We used Sonera Technology's DisplayMate Professional 1.0 to analyze a wide range of display capabilities.

To determine color quality, we displayed a color bar on each screen and assigned a score that rang es from one (worst) to five (best). The difference between the best and worst screens is not that great, because they are all active-matrix color displays. After plotting the viewing angle using our Heads-Up-Range-Device (HURD), we computed the group's viewing-angle scores.

We measured battery performance with our Thumper 2 system . Thumper emulates a typical word processing session. Robotic arms and optical sensors detect and control each system's power management scheme. Before testing, we completely drained and recharged each notebook's battery according to the manufacturer's instructions. We then configured each system's power management features to spool down the hard disk after 2 minutes of inactivity and shut off the backlighting after 1 minute. We allowed each system to enter standby mode during the test cycle. At intervals, Thumper's robotic arms would wake up each system so that it would run until the battery died.

Usability/Features

We assessed t he quality of each keyboard, concentrating on key placement. We worked extensively with the notebooks to see how comfortable they became after extended use, and we rated the response and feel of the keys. We also evaluated pointing devices and considered the usefulness of status indicators.

Finally, we asked each vendor to complete a lengthy questionnaire to give us a detailed description of each system's features, such as the amount of RAM provided and the service and support options. We then weighted each feature and calculated an overall features score.


Contributors

Jim Kane, Project Manager/NSTL, has been testing hardware and software products for NSTL for the past six years.

John McDonough, Technical Editor/NSTL, has been writing for high-tech publications for several years.

Maggie Bender, Tester/NSTL, has been testing products for the BYTE Lab Reports for the l ast two years.

Susan Colwell, Technical Editor/BYTE, coordinates the combined testing between the BYTE Lab and NSTL.


Mimic and Monitor: BYTE's Thumper 2 at Work

photo_link (24 Kbytes)

BYTE's Thumper 2 tests a notebook's battery life by mimicking a word processing session and monitoring power management capabilities.


Up to the BYTE Lab Product Report section contentsGo to previous article: SearchSend a comment on this articleSubscribe to BYTE or BYTE on CD-ROM  
Flexible C++
Matthew Wilson
My approach to software engineering is far more pragmatic than it is theoretical--and no language better exemplifies this than C++.

more...

BYTE Digest

BYTE Digest editors every month analyze and evaluate the best articles from Information Week, EE Times, Dr. Dobb's Journal, Network Computing, Sys Admin, and dozens of other CMP publications—bringing you critical news and information about wireless communication, computer security, software development, embedded systems, and more!

Find out more

BYTE.com Store

BYTE CD-ROM
NOW, on one CD-ROM, you can instantly access more than 8 years of BYTE.
 
The Best of BYTE Volume 1: Programming Languages
The Best of BYTE
Volume 1: Programming Languages
In this issue of Best of BYTE, we bring together some of the leading programming language designers and implementors...

Copyright © 2005 CMP Media LLC, Privacy Policy, Your California Privacy rights, Terms of Service
Site comments: webmaster@byte.com
SDMG Web Sites: BYTE.com, C/C++ Users Journal, Dr. Dobb's Journal, MSDN Magazine, New Architect, SD Expo, SD Magazine, Sys Admin, The Perl Journal, UnixReview.com, Windows Developer Network