HCT 9.5 Systems Testing Overview |
Last updated on November 15, 1999
|
Welcome to the 1999-2000 Windows Logo Program for Hardware! These pages contain the most current system testing documentation, including the HCT Testing Errata, available on the WHQL website.
Test procedures for Audio Devices, Analog Modems, Networking Devices and Storage Devices are available to download from the WHQL Test Kits page: http://www.microsoft.com/hwtest/testkits/default.htm
The Hardware Compatibility Test (HCT) kits correspond to the PC 99 System Design Guide and the Hardware Design Guide Version 2.0 for Microsoft Windows NT® Server. Manufacturers must read the Design Guides, implement the principals, and pass testing, in order to receive a listing on the HCL. For questions relating to the Design Guides and the implementation of the principles please see the Microsoft developer website at http://www.microsoft.com/hwdev.The requirements in the System or Server Design Guides provide a framework for the WHQL-administered tests that support the Windows Logo Program for Hardware. The Hardware Compatibility Tests (HCT) are used to verify compliance with the Design Guides, as well as WHQL requirements and general compatibility with Microsoft operating systems. To see a list of specific features that will become part of the logo compliance testing timeline visit http://www.microsoft.com/hwdev/winlogo.
The HCT kit supports the Intel® x86 uniprocessor and symmetric multiprocessor (SMP). For a list of other processors that have been tested by WHQL, please see System Submission Procedures.
By running the tests, you can identify and isolate problems with the Windows operating systems and, at the same time, you can help us find possible incompatibilities between Windows and your hardware system.
Microsoft maintains a Windows Hardware Compatibility List (HCL). After your Intel x86-based uniprocessor system passes the HCT, and you return your passing test results to us, Microsoft can then include your system in updates of the Windows HCL.
Note: Systems submitted to WHQL for testing must be identical to one of the configurations of that system that will be sold. Systems sent to WHQL must be complete and fully functional.
You must have the current HCT testing CD-ROM to perform the System tests.
Click here to order the current HCT test CD-ROM
You must have the HCTCD and install the appropriate Microsoft Windows operating system on your test system(s) to start HCT testing.
To begin HCT testing:
Follow these steps to install the HCT and configure it for the type of testing you will be doing:
For example: if your CD-ROM drive is "D:", you would install the HCTs by typing "D:\hct\hwtest.exe" in the Run dialog.
The "Microsoft Windows Hardware Quality Labs" dialog will appear. Select "System, Server, NIC, Storage, Audio, Modem Tests".Selection in Tester Type | Notes: |
---|---|
Desktop Workstation or Mobile Computer System (PC99) | Used for PC 99 System Submissions |
Network Interface Card | |
Modem Device Certification - (PCI Device) | |
Server Testing (SDG 2.0) | Used for PC 99 Servers |
Server Testing - Client Master Setup for the Server Test | Used to configure the client master for the Client-Server Test |
Microsoft Cluster Server | Used for Cluster Server Testing |
SCSI Hard Disk Drive | |
IDE Hard Disk Drive | |
Audio Adapter | |
RAID System | |
RAID Adapter | |
RAID JBOD Device | |
Fibre Channel Hard Drive | |
Fibre Channel Adapter | |
Media Changer | |
RAID Cluster Device | |
Other Storage | |
Desktop Workstation or Mobile Computer System (Windows 2000 Compatible Upgrade) | After the final release of Windows 2000, this option can be used to upgrade PC 98 systems with "Windows 2000 compatible" status on the HCL to the full Windows 2000 logo. The RTM version of Windows 2000 must be used. See the WHQL process page for more information: http://www.microsoft.com/hwtest/process |
Server Testing (Windows 2000 Compatible Upgrade) | After the final release of Windows 2000, this option can be used to upgrade servers with "Windows 2000 compatible" status on the HCL to the full Windows 2000 logo. The RTM version of Windows 2000 Server must be used. See the WHQL process page for more information: http://www.microsoft.com/hwtest/process |
Modem Device Certification - (PC Card Device) | |
Modem Device Certification - (CardBus Device) | |
Modem Device Certification - (USB Device) | |
Modem Device Certification - (AC97 Device) | |
Modem Device Certification - (External COM Device) |
Please make sure all hardware and drivers necessary for testing are installed prior to testing start. If you add hardware/drivers after testing starts, you will be required to delete ALL test logs and restart all testing.
Click OK if hardware/drivers ARE installed, or click Cancel to exit and finish installing hardware/drivers
For system qualification testing, select the System tree, add the tests to the Run list, and click START. For server testing, you must also run the Server test located in the server test tree. You can refer to these HCT documents for instructions on running selected tests.
Notes for Running Test Manager
The 9.5 HCT CD is specifically designed for Windows NT® 4.0 with Service Pack 6 and Windows 98 Second Edition testing. Even if you are pre-installing Windows NT 4.0 with Service Pack 3 or 4 you will be required to do a complete test run with Service Pack 6. Windows 98 Gold can still be tested with HCTCD 9.5 but the Wake on Ring and Wake on LAN tests will not work. Failures of these tests when run under Windows 98 Gold are acceptable.
The HCT 9.5 CD will install a special pool tag enabled feature for Windows NT 4.0 that will cause the system to halt (or blue screen) if drivers are discovered that do not properly allocate memory. All systems should be connected to a debugger or use the crashdump feature of Windows NT® to determine the faulty driver. Fixes to the driver may be required before a submission can be made. See the Pool Tag Testing information to help identify the responsible driver.
The HCT 9.5 CD will install a driver verifier for Windows 2000 that will cause the system to halt (or blue screen) if drivers are discovered that are not properly designed for Windows 2000. The Driver Verifier is a series of checks added to the Windows 2000 kernel to help readily expose errors in kernel mode drivers. Remember that when you're programming in kernel mode, you don't have the protection mechanisms that prevent errant code from inadvertently corrupting memory that doesn't belong to you. Moreover, memory corruption often is not immediately exposed, making it difficult to determine the source of the problem. And let us not forget the complex rules that drivers must follow to safely interact with other drivers and operating system components. For more information, see Using Driver Verifier to Expose Driver Errors
The HCT 9.5 Test Kit has a new feature that will not allow the following changes during HCT testing:
If any of these changes are made in the middle of a testing run with the HCT Preview Pack, you will have to start HCT testing over. Ensure that your system is configured porperly for testing before you start HCT testing, as described in Preparing a System for Testing and System Submission Procedures.
In order for your system(s) to be fully supported by Microsoft Technical Support (MTS), they must be logo'd and listed on the Windows Hardware Compatibility List. If your system(s) are not listed on the HCL and MTS discovers that a problem is hardware related, then they can not give our mutual customers full support. Microsoft reserves the right to reject otherwise passing test results for a system if other incompatibilities are discovered in WHQL test labs.
To run the HCT 9.5 Test Kit for system submissions, you will need the following hardware:
In the Design Guides, hardware features are described as Required, Recommended, or Optional. These terms are used to mean the following:
Required: These basic features must be implemented in order for hardware to comply with the requirements.
Recommended: These features add capabilities that are supported by the Windows family of operating systems. Recommended features take advantage of the native capabilities of the device drivers included with the operating system, usually without imposing major cost increases.
Notice that for compliance testing, if a recommended feature is implemented, it must meet the requirements for that feature as defined in the design guide.
Some recommended features might become requirements in the future.
Optional: These features are neither required nor recommended, but if the feature is implemented in a system, it must meet the specified requirements. Optional features will not become requirements in the future.
Must: Required
Should: Recommended
Important: The requirements and recommendations in this guide are often provided in the form of references to industry specifications. These specifications might contain intellectual property of Intel, Microsoft, or other third parties. Each of these industry specifications might have different intellectual property licensing arrangements. It is the original equipment manufacturer's (OEM's) responsibility to consult these industry specifications or their issuance bodies for licensing specifics or details.
Some component changes may be made to logo'd systems without the need to re-submit the system to WHQL. Any logo'd component in a system can be substituted with another component that was logo'd under the same design guide (or a later release of that design guide). For example, an OEM with a system logo'd in the PC 98 timeframe can substitute the video card in their system for any other video card logo'd in the PC 98 timeframe, or a video card logo'd in the PC 99 (or later) timeframe . Any changes to the motherboard, BIOS, or CPU manufacturer of a logo'd system will require a complete re-test and resubmission to WHQL.
The HCT procedure consists of:
There is no test installation or setup; initially, HCT copies TESTMGR.EXE and accompanying INI, DLL, and TMP files to your hard drive. The HCT transfers test binary files from the CD-ROM or network share point only when needed. Running a test with this new feature is simple. Upon completion, a test automatically saves its results. Although some tests require manual interaction, they too automatically record their results.
Your test results help Microsoft identify incompatibilities and failures; however, a test error or failure does not always indicate that your hardware system is incompatible with Windows. Knowing this, Microsoft designs each Windows release with an enhanced HCT kit that is based on information that users supply. This a continuing process that improves the HCT by verifying genuine incompatibilities and authenticates test results.
The Windows HCT kit includes information on how you can submit problem reports to Microsoft. Please provide us with the most information possible; problem reports must include your:
Use the probrep.txt file in the \HCT\DOCS folder on the HCT CD-ROM to collect this information and send the completed file via e-mail to whqlsys@microsoft.com.
For instructions on how to mail your HCT results directly to Microsoft Corporation, see System Submission Procedures.
The Hardware Compatibility Test program consists of several test groups that correspond to common hardware categories.
Launching the HCT for the first time is an automatic step-by-step process where you enter information into these dialog boxes:
After you have launched the HCT, we recommend one more step before you use the HCT Test Manager. See System Setup for HCT Testing for tips on how you can ensure that your test machine runs the HCT properly.
The System Configuration window is where you record information about your system, processor, video adapter, I/O card and network adapter. This information can be used by Submission Assistant later, so filling it in now saves time when making a submission.
Note | It is important that you provide all requested information completely and accurately. Microsoft reserves the right to refuse test results if the requested information is not accurate. For all items marked by a "*" in the System Configuration dialog boxes, you must provide correct information or your test results may not be accepted. |
Required system information | Example |
Machine ID — ID that you assign | Testbed001 |
Marketed System Model Name — the system name that your company advertises and wants to appear on the HCL | Desktop ExecPro 4000/133 |
Processor Model and Speed | Pentium 133 |
System Bus Type(s) | ISA/PCI |
System BIOS Version and Sub-version | Phoenix 4.05 m6-p14 |
Motherboard Manufacturer and Model | Intel Zappa |
I/O Adapter Manufacturer and Model or Chipset — HCT only recognizes the installed driver and requires that you identify the actual I/O adapter or chipset. | Adaptec 2940 or CMD 640B Dual Channel IDE Controller |
I/O Controller Embedded or Adapter | Check the box in the I/O configuration dialog. |
Video Adapter Manufacturer and Model | Diamond Stealth 64 DRAM |
Video Chipset and Model | S3-768 |
Video BIOS Information | Stealth DRAM version 2.02 |
Video Controller Embedded or Adapter | Check the box in the video configuration dialog. |
You can also change the Machine ID and Product Name in the System Configuration window.
If you do not have all of the necessary information and must exit the System Configuration window, click the Close button, the box with an "X," at the upper right of the window.
To enter System Configuration information
The following table explains what information you type into each System Configuration dialog box:
Use this button | To provide |
System | General system configuration information. |
Processor | Details about the system’s processors. Multiprocessor support in Windows requires that all processors in the system be of exactly the same revision level. If more than one, show the number of processors. |
Video | Information about the video subsystem that the computer uses. |
I/O | Information about all of the host bus adapters and hard disks in the computer. Use the list boxes to make your selections. You can enter up to eight adapters and up to eight hard disks. |
Network | Details about the model of the network interface card. |
After you complete all five dialog boxes, click the Continue button to open the Test Manager window. From Test Manager you can return to the System Configuration window to modify your entries. To do this, go to the View menu and choose the System Configuration command.
After launching the HCT software, we recommend that you read and follow the instructions in Preparing a System for Testing.
Test Manager is a 32-bit Windows application designed to run the compatibility tests and to provide a quick summary of test results.
You start the majority of the HCT tests from the Test Manager. The exceptions are the NDIS Netcard Driver test, the Printer tests, and several of the SCSI/Storage tests, all of which you start from a command prompt session.
After you launch the HCT, HCT creates a Test Manager program group and a Test Manager icon.
To start Test Manager
– Or –
To start the Test Manager from the keyboard
In the Test Manager window, select, Add, Remove, and Start tests. From Test Manager you also set test parameters and view results from completed tests.
Test Manager uses a hierarchical tree listing to display system components and devices. The advantage of this method is that it allows a tester to quickly see what can be tested under the System and Device headings. A "+" box next to an item indicates that there are more items to view; a "-" box next to an item indicates a complete tree listing.
To expand System and Device listings
Test Manager contains these boxes:
To select only the tests necessary for system certification
To run a set of tests from the Test Manager window
To select all available tests
To select one or more available tests
From the Available Tests box, click the "+" test listing, then double-click each test. Individual tests appear in the leaf node view of the tree directory.
– Or –
From the Available Tests box, select each test or test group by clicking once, and then click the Add button to move the tests to the Selected Tests box.
To remove a selected test
To remove all selected tests
You can run the tests individually or in groups, rather than running the entire set in a single session. If you select the manual tests first, you can then run the automated tests unattended.
If you are using the HCTs to include systems on the HCL, you only need to run the system compatibility tests.
This table gives you a reference to the commands you can use in Test Manager:
Menu | Command | Function |
Test | Exit | Use to exit Test Manger. |
View | Test Results | Use to view test results. |
System Configuration | Use to view and change the system and install configuration. | |
Change Initial Run Settings | Use to change initial test run settings. | |
Rescan Test Devices | Use to refresh your system and device listings. | |
Test Group | Load Test Group File | Use when you want to run a saved series of system and device tests. |
Save Test Group File | Use to save a listing of system and device tests. | |
Load Last Running Group | Use to load a listing of system and device tests. | |
Return Test Results | Return System Test Results | Used to prepare test results for return to Microsoft |
Check Test Results | Check System Test Results | Provides a list of the required tests that must still be passed for this system. |
Help | Index | Opens Test Manager Help. |
HCT Docs | Opens the HCT documentation. | |
About Test Manager | Provides information about the version of Test Manager that you are using. |
You can use the Test Group menu to save and load groups of frequently used tests. Select a group of tests, set the appropriate parameter settings, and then save that group to a file on disk using the Save Test Group File command on the Test Group menu. Later, you can load the group of tests and parameters from the file using the Load Test Group File command.
Even though HCT sets parameters automatically and correctly for most tests, some tests may require you to manually set parameters. This ensures that a test has access to necessary resources. Incorrect parameter settings could cause a test to fail inadvertently. To prevent this, please consult the detailed parameter information contained in the individual test descriptions.
To set parameters
Once you have set or verified the parameters for each selected test, you can start the tests.
To start the HCTs
The tests run one at a time and in the order they are listed in the Selected Tests box.
For manual tests, read the test description first, and then carefully follow the on-screen instructions. If it fails a second time, Test Manager logs a FAIL result and runs the next test.
Note | With the exception of the System Stress test, you may stop a test before it ends. To do this, in the Test Manager window, click the Abort button. |
The Test Results window appears when a test run finishes or is aborted. This window lists every selected test and its status — either Pass, Fail, or Not Run. From this window, you can verify that all tests ran and passed.
If a test failed, you can check the detailed results by selecting the test name(s) in the Test Results window, and then choosing the Details button. This displays the test log file(s). Use the arrow keys to scroll through the log. To exit the log file, type q at the command prompt or press the esc key.
There is a separate log file for each test. The system always saves the log file from the last run of each test. If you rerun a test, the old log file is overwritten. When you are done, click the OK button to return to the Test Manager window.
Note | If the system crashes during a test run, look at the log file called LASTRUN.LOG in the \HCT directory. It contains a list of the tests that ran up to the point of the crash. This shows you which test was running when the system crashed. If you are using the kernel debugger, the debug machine also displays the name of the test that was running when the crash occurred. |
After your hardware system passes the HCT system compatibility tests you return your logged test results to us. For more information on returning results, see System Submission Procedures.