This article describes the Reports section of SMARTFENSE, where you can view user activity for each platform component through three reports: User interactions over time, Percentage distribution of interactions, and Benchmark.
You can access this section from the main menu: Reports.
Overview of the Reports section
The Reports section displays a summary view grouped by component. Each card corresponds to a platform component and provides access to the reports available for that component.
The components included in the view are:
- Training components: Interactive Modules, Videos, Video Games, Newsletters, Exams, Surveys.
- Simulation components: Phishing, Ransomware, Smishing, USB Drop.
- Specific blocks: Correlation and Gamification, which have their own reports documented in their respective articles.
- Key Performance Indicators: Awareness Indicators in Campaigns, documented in its own article.
To access a report's detail, click the eye icon on the corresponding component card.
Reports available for each component
All training and simulation components include the same three reports:
- User interactions over time
- Percentage distribution of interactions
- Benchmark
The logic of each report is the same for all components. What changes between them are the indicators shown (see section Indicators by Component).
User Interactions Over Time
Shows the evolution of user interactions over time.
- Visualization: area evolution chart.
- X-axis: months.
- Y-axis: number of interactions.
- Series: one series for each component indicator.
- Allows viewing details of each point by hovering over the chart.
Percentage Distribution of Interactions
Shows the proportion of each interaction relative to the total sends of the component.
- Visualization: funnel chart.
- Series: one band for each component indicator, with its absolute value and percentage relative to Sent.
Benchmark
Allows you to compare your organization's awareness program results against the historical performance of other SMARTFENSE client organizations.
- Visualization: horizontal bar chart.
- Indicators: the same ones that appear in the other reports for the component (for example, Sent, Started, Completed in Interactive Modules).
The report offers two views selectable via tabs:
- Average per organization: calculates the typical performance of an average organization within the SMARTFENSE ecosystem, giving equal weight to each client regardless of their number of employees or license volume. This is the recommended view for assessing the maturity of your security culture against the corporate standard.
- Global average of users: consolidates all historical platform interactions as if they belonged to a single global entity. The result is influenced by the total number of users; organizations with a larger number of employees have a greater impact on this percentage. This view is useful for analyzing the mass behavior of users at a global scale.
The Benchmark report does not expose date or group filters. This is because the benchmark is calculated based on the complete history of the platform and all client organizations. Applying filters only to your organization's data would produce an asymmetric comparison against an aggregate that includes the entire history and all segments.
Available Filters
Both reports share the following filters:
- Filter by Group
- Filter by Functional Area
- Filter by Hierarchical Level
- Filter by Smart Group
- Filter by Topic (only in training components) or Filter by Scenario (only in simulation components: Phishing, Ransomware, and Smishing)
- Start Month
- End Month
Export and print
Each report allows you to export the information or print it. To open the options menu, click the three-dot (⋯) icon located in the upper-right corner of the chart.
The available options are:
- Export as image: PNG, JPG or PDF.
- Export the data: JSON, CSV, XLSX, PDF or HTML.
- Print: sends the chart to the selected printer.
Exports respect the filters applied at the moment the file is generated.
Indicators by Component
The indicators that appear in each report depend on the selected component.
Training Components
Interactive Modules
- Sent: the campaign assignment to the user was recorded.
- Started: the user began the assigned Interactive Module.
- Completed: the user completed the assigned Interactive Module.
Videos
- Sent: the campaign assignment to the user was recorded.
- Started: the user began the assigned Video.
- Completed: the user completed the assigned Video.
- Answered Correctly: the user answered the Video validation question correctly.
- Answered Incorrectly: the user answered the Video validation question incorrectly.
Video Games
- Sent: the campaign assignment to the user was recorded.
- Started: the user started playing the assigned Video Game.
- Completed: the user completed the assigned Video Game.
Newsletters
- Sent: the Newsletter was sent to the user.
- Opened: the user opened the sent Newsletter.
- Answered Correctly: the user answered the Newsletter reading validation question correctly.
- Answered Incorrectly: the user answered the Newsletter reading validation question incorrectly.
Exams
- Sent: the campaign assignment to the user was recorded.
- Started: the user began the assigned exam.
- Passed: the user passed the assigned exam.
- Failed: the user failed the assigned exam.
Surveys
- Sent: the campaign assignment to the user was recorded.
- Started: the user began the assigned survey.
- Completed: the user completed the assigned survey.
Simulation Components
Phishing
- Sent: the email was sent to the user.
- Opened: the user opened the email.
- Clicks on Link: the user clicked a link within the Phishing simulation email.
- Data Entered: the user entered data in the form on the phishing simulation landing page.
- Teachable Moments Sent by Email: the user performed an action that triggered sending the Teachable Moment by email.
- Teachable Moments Opened: the user viewed the Teachable Moment in their email or instantly in their browser.
- Teachable Moments Answered Correctly: the user answered the Teachable Moment question correctly, used to validate reading.
- Teachable Moments Answered Incorrectly: the user answered the Teachable Moment question incorrectly, used to validate reading.
- Phishing Campaigns Reported: the user reported the phishing campaign using the report button.
Ransomware
- Sent: the email was sent to the user.
- Opened: the user opened the email.
- Ransomware Downloaded: the ransomware was downloaded via a link.
- Ransomware Opened: the ransomware downloaded via a link was opened.
- Ransomware Attachments Opened: the ransomware downloaded via an attachment was opened.
- Possible Encryption in User Folder: an action was detected that could have allowed file encryption in the user’s folder.
- Teachable Moments Sent by Email: the user performed an action that triggered sending the Teachable Moment by email.
- Teachable Moments Opened: the user viewed the Teachable Moment in their email or instantly in their browser.
- Teachable Moments Answered Correctly: the user answered the Teachable Moment question correctly, used to validate reading.
- Teachable Moments Answered Incorrectly: the user answered the Teachable Moment question incorrectly, used to validate reading.
- Ransomware Campaigns Reported: the user reported the ransomware campaign using the report button.
Smishing
- Sent: the SMS was sent to the user.
- Delivered: the SMS was delivered to the user.
- Click on Link: the user clicked a link within the simulation SMS.
- Data Entered: the user entered data in the form on the simulation landing page.
- Teachable Moments Sent by Email: the user performed an action that triggered sending the Teachable Moment by email.
- Teachable Moments Opened: the user viewed the Teachable Moment in their email or instantly in their browser.
- Teachable Moments Answered Correctly: the user answered the Teachable Moment question correctly.
- Teachable Moments Answered Incorrectly: the user answered the Teachable Moment question incorrectly.
USB Drop
- File Opened: the user opened a file contained in the simulation USB drive.
- Macros Activated: the user activated macros in a file opened from the simulation USB drive.
💡 Best Practices
- Apply filters for group, functional area, hierarchical level, or smart group to analyze specific subsets of the organization.
- Use Start Month and End Month to narrow the analysis period and compare evolutions between different times.
- First review the Percentage Distribution of Interactions report to identify conversion between stages, then use User Interactions Over Time to understand how those stages evolved month by month.
- Combine the filter by topic or scenario with organizational filters to evaluate the impact of specific content or a simulation.
- Use the Benchmark report as an orientational reference point, not as an absolute goal. The most reliable indicator of progress is your organization's own historical baseline.
- Document the filtering criteria applied when exporting or sharing results to facilitate interpretation by other teams.