Articles in this section

Risk Score: Training Engagement

Overview

The Training Engagement factor evaluates how consistently a user engages with security awareness education, which is a critical driver of reducing risk. Targets will start with a full risk score of 40 for training. Until the target receives training, they are seen as at risk.

Click from the following to jump to your desired section:

  1. Measuring Training Engagement
  2. Training Engagement Actions
  3. Training Engagement Score Example

 

Measuring Training Engagement

The Training Engagement factor accounts for the following:

  • Formal Training Courses: Completion rates, overdue assignments, and how recently courses were taken all impact the score. 
  • Just-in-Time (JIT) Content: Micro-learning moments triggered by risky behavior help reinforce awareness when it matters most. 
  • SecurityTips: Our proactive, desktop-based training tool. SecurityTips delivers bite-sized lessons and reminders directly to the user's taskbar, encouraging ongoing learning. 
  • Training Campaigns: Interaction with Training Pages that are connected to emails received during Training Campaigns. 

Together, these signals provide insight into how consistently a user is reinforcing good security habits through learning. 

Score Range (Raw) Risk Level Meaning
0 to 20 Very Low Fully engaged, recent training, good JIT usage.
21 to 40 Low Mostly compliant, minor delays or older training.
41 to 60 Moderate Some gaps, overdue items, or outdated training.
61 to 80 High Multiple overdue items, minimal engagement.
81 to 100 Very High Poor or no training activity, major awareness gap.

 

Training Engagement Actions

The following is how the Findings, or Engagement, is valued:

Findings (Engagement) Value
Completed training -20
Failed/overdue training +10
Interacted with training page -5

Note: Completing an overdue course removes the overdue finding and adds a completed-training finding in its place. 

The Training Risk Score is derived from the Security Training Score (higher = better engagement). 

Training risk is inversely correlated: 

Training Risk Score = 100 - Security Training Score (with a minimum of -20 and a maximum of 100).

Users with no training engagement default to the maximum Training Risk Score of 100. 

 

Training Engagement Score Example

Context for this user:

  • User has 6 assigned courses from the past 160 days
  • Training Pages viewed: 1 viewed 40 days ago
Behavior Value (Inverted) Decay Adjusted Value
Course completed 160 days ago 20 12.5% 10
Course overdue from 150 days ago -10 12.5% -5
Course completed 95 days ago 20 12.5% 10
Course completed 70 days ago 20 0% 20
Course completed 50 days ago 20 0% 20
Course completed 20 days ago 20 0% 20
Training page from Phishing Campaign 40 days ago 5 0% 5
Final Raw Score     80

 

Security Training Score: 10 - 5 + 10 + 20 + 20 + 20 + 5 = 80

Training Risk Score: 100 - 80 = 20

Weighted contribution: 20 * 0.40 = 8

Note: If a target's Security Training Score exceeds 100, Training Risk Score can go negative down to -20 (max -8 points after weighting), allowing it to offset risk from other areas. 

The target's score of 20 indicates a good continuous training engagement. The following is a breakdown of what this score tells us:

Indicator Interpretation
5/6 courses completed Good engagement with training, but could use improvement.
6 courses over the past 160 days Target is receiving a steady number of training courses to keep their security knowledge fresh. 
Training Page viewed Engagement with JIT materials helps offset any risk points incurred during a Phishing Simulation Campaign. 

The recommended actions for this target are the following:

  • Keep the consistent training courses coming.
  • Encourage JIT engagement through SecurityTips. Nudging or incentives should be considered.
  • Consider automated reminders or escalation policies to prevent overdue courses. 
Was this article helpful?
0 out of 0 found this helpful