Developing and Selecting Appropriate Tests

Test developers should:  

Freely supply test users with appropriate information about their products.

Test users should:  

Only use tests that are suited to the intended purpose, and appropriate for the intended populations

·         Define what each test measures and what the test should be used for

·         Describe the population(s) for which the test is appropriate.

·         Accurately represent the characteristics, usefulness and limitations of each test.

·         Define the purpose of testing and the population to be tested.

·         Select a test for that purpose and population based on a thorough review of the available information.

·         Base decisions on independent test reviews where possible.

Provide a detailed technical manual for each test which should:

·         Describe the process of test development.

·         Explain the relevant measurement concepts at an appropriate level of detail.

·         Provide evidence that the test meets its intended purposes.

·         Become familiar with how and when the test was developed.

·         Ensure that they fully understand  the technical information relating to the tests.

·         Avoid using tests, which provide unclear or incomplete information.

Provide examples of test  questions, instructions, answer sheets, manuals and reports to qualified users to assist informed decision-making.

Familiarise themselves with the type of test content, administration procedures, answer sheets, manuals and results or reports before selecting a test.

Identify and publish any specialised skills needed to administer each test and to interpret scores correctly.

Avoid using tests for which they have not been adequately trained.

 Interpreting scores

Test developers should:  

Help users interpret scores correctly.

Test users should:  

Make every effort to ensure that they interpret test scores correctly.

Only supply tests to users who are qualified  and registeredto interpret such test scores

Only use tests, which they are qualified and registered to administer and interpret.

·         Enable the user to interpret  scores correctly by clearly describing the scales  in the technical manual.

·         Offer consultation and training in support of their tests to users who require such services.

·         Ensure that they fully understand the psychological characteristics the tests measure.

·         Use all available sources of information to further this understanding.

Describe the populations represented by any norms or comparison groups

Take into account any significant differences between the norms or comparison groups and the actual test takers.

Indicate within the manual the likely shelf-life of test scores, i.e. how long test scores are likely to remain valid.

Respect the limited shelf-life of most test scores and

take the time elapsed since test results were obtained into account.

Provide reports that:

·         Are timely and accurate

·         Describe test performance clearly and accurately

·         Integrate the information from standard reports with information from other sources objectively and consistently.

·         Take into account other relevant information about the test taker, which could have a bearing on the characteristics being assessed.

·         Compile interpretative reports, which address the needs of the intended reader with appropriate content, language and style.

Striving for Fairness 

Test developers should:

Strive to make tests that are as fair as possible for test takers of different races, gender, ethnic backgrounds or disabilities.

Test users should:

Select and use tests in such a way as to promote employment equity, avoid unfair discrimination and respect the rights of all respondents.

Review and revise test questions and related materials to avoid potentially insensitive content or language.

Consider the procedures used by test developers to avoid potentially insensitive content or language.

·         When feasible, make appropriately modified forms of tests or administration procedures available for previously disadvantaged individuals.

·         Warn test users of potential problems in using standard norms with modified tests or administration procedures that result in  non-comparable scores.

·         Review the performance of test takers of different races, gender and ethnic backgrounds when samples of sufficient size are available.

·         Objectively determine the extent to which performance differences may have been caused by inappropriate test characteristics.

·         When necessary and feasible, use appropriately modified forms of tests or administration procedures for test takers from disadvantaged groups.

·         Specifically bear in mind the English language proficiency requirements of the tests.

·         Determine the disability status of test takers prior to testing.

·         Interpret standard norms with care in the light of modifications that were made to the test.

Actively collect data and make available research results on the fairness of all published tests.

·         Collect biographical data on persons who are tested.

·         Co-operate with test publishers in efforts to do research on the fairness of tests.

·         Keep up to date with  research and take the results into account in the selection of tests and interpretation of test results.

Informing test takers

Test developers should:  

Promote an open and informed discussion about test materials and procedures.

Test users should:  

Obtain informed consent from test takers.

Provide clear test administration instructions including example test items for completion by test takers.

Provide the test taker with adequate information regarding the

·         Purpose

·         Procedure

·         Duration of the assessment process

·         How the results will be used

Offer guidance and support to test takers

·         Consistent with the administration instructions

·         Without invalidating the assessment process

Provide the test user with information that will facilitate the giving of useful feedback on his/her test results.

Offer constructive and timeous feedback on the test results to test takers if required.

Ensuring Security of Test Information

Test developers should:

Ensure that the integrity of test information is maintained.

Test users should:

Ensure that the integrity and confidentiality of test information is maintained.

Limit access to test questions to trained and registered test users who have a legitimate use for the tests

Store all test materials and software securely

Limit access to trained and registered test users

Ensure that any materials used in the development or validation of tests are returned

Return all research materials when participating in research projects

Maintain copyright on test materials and actively pursue infringements

·         Respect copyright on test materials

·         Inform the test developers of any copyright infringements

Ensure that all identifiable test results collected are

·         Kept secure

·         Only used for the  purpose that was intended and for which consent was obtained

Ensure that all test results are:

·         Kept secure

·         Only used for the intend purpose  for which informed consent was obtained

Avoid publishing any material which could undermine the reliability and validity of their tests

When leaving an organisation, ensure that test materials and confidential test data are kept secure and handed over to an adequately trained person