Reliability | What to Consider #consistentreliability

Burnout among high performers.

Psychometric assessment involves assigning scores to individuals so that they represent some characteristic of the individuals. How do Psychometrists know that the scores actually represent the characteristic, especially when it is a construct like intelligence, self-esteem, depression, or working memory capacity? The answer is that they conduct research using the measure to confirm that the scores make sense based on their understanding of the construct being measured. This is an extremely important point. Psychometrists  do not simply assume that their measures work. Instead, they collect data to demonstrate that they work. 

As an informal example, imagine that you have been dieting for a month. Your clothes seem to be fitting more loosely, and several friends have asked if you have lost weight. If at this point your bathroom scale indicated that you had lost 5kg, this would make sense and you would continue to use the scale. However, if it indicated that you had gained 5kg, you would rightly conclude that it was broken and either fix it or get rid of it. In evaluating a measurement method, Psychometrists consider two general dimensions: Reliability and Validity.

It is a well-known practice to use psychometric testing during the recruitment process to secure the best fit for the role. Typically, psychometric tests will never be used in isolation, rather as one component of a wider, integrated recruitment process. 

What is the value of a psychometric test if the data provided is not reliable? Test reliability refers to the degree to which an assessment tool produces stable and consistent results over time. Therefore, the reliability of the psychometric instruments are critical. Especially as the outcome can affect employee selection, retention, and promotion. 

Even though reliable measures are used, there are factors that are outside our control.  

Given the current Covid-19 pandemic, we would like to share the following factors that could influence candidates’ assessment results:   

  • Anxiety or depression- i.e. perhaps the candidate’s physical or mental state is less than optimal
  • Illness
  • Lack of sleep or fatigue
  • Medication effects (chronic or acute)
  • Severely impaired attention
  • History of trauma
  • Family related (death in the family, recent pregnancy or on maternity leave)
  • Recent retrenchment or divorce
  • Any disabilities (such as visual impairment, hearing loss or physical impairments)
  • Digital anxiety/unfamiliarity i.e. s/he is unfamiliar with the testing materials or they have never been assessed previously nor virtually
  • Accessibility i.e. quality of Wi-Fi and bandwidth during the assessment

Being aware of the above factors and the potential impact on the assessment process is important to ensure maximum performance and accurate results.

The psychometric assessment will be of most value if the candidate is motivated to do their best, is interested, and engaged. This will be assisted by the candidate understanding the purpose of the assessment and perceiving the psychometrist as professional in their conduct. Prior to scheduling a psychometric assessment please consider the list above and discuss with the psychometrist. 

Be assured that we only use measures that comply with the requirements of the HPCSA and South African labour legislation. We also connect with the candidates prior to the virtual assessment to build rapport, confirming they are comfortable with the applications, to answer any questions about the applications beforehand, and to address any additional questions they might have.

Next, we will focus on Validity.  For now, stay healthy, and act with compassion.

“Reliability is the precondition for trust.”     Wolfgang Schauble

Open chat
Hello
Can we help you?
By opting in to receive messages from FAB Consulting via WhatsApp, you acknowledge and agree to the following terms:

Consent for Communication: By providing your contact details and opting in, you consent to receive messages, updates, and communications from FAB Consulting through WhatsApp.

Privacy and Data Protection: FAB Consulting is committed to protecting your privacy and personal information. We will not share your contact details with any third parties, nor will we use them for any marketing purposes, in accordance with the Protection of Personal Information Act (POPIA) and other applicable data protection laws.

Purpose of Communication: Messages sent to you via WhatsApp will primarily be responses to your queries and requests via the website.

Opt-Out: You have the right to opt out of receiving messages from FAB Consulting at any time. To do so, simply text "STOP" to our WhatsApp number or contact us directly through alternative channels provided on our website.