MasterClass at Work

Learning solutions for employees from the world’s best

    Admin Analytics FAQ

    In order to give a better understanding of the activity and engagement of your organization, please read on to learn more about the metrics on the analytics dashboard.

    Minutes Watched - The total minutes watched by all users on the team. Minutes watched is determined based on the minutes consumed on a video.
    Unique Active Users - The total number of users who have consumed 1s of any lesson in the range selected, rather than the 15s threshold previously. A lesson is any individual video on the platform.

    User Movement Across Teams
    When viewing a report filtered for a team, the data will include any actions taken by users who are on that team (or in one or more of the sub-teams of that team) as of today, including their historical data. The report will not include data for any users who were previously on the team.

    🗒️:This means that viewing a report for a team over a certain time range will consistently show you the trend over time for the same set of users. Note that moving users between teams will modify the historical data for a report for a team, since the report will always display data for users who are on the team today.

    Skills 
    The skills displayed in the Top Skills Report are the 10 primary Skills on the platform. To dive deeper, you can find the minutes watched for all sub-skills in the CSV download available in the top right corner of the page.
     
    Minutes are attributed to sub-skills and primary skills based on the lessons watched in a course. For each lesson watched in a course :
    Minutes watched for that lesson are attributed to each sub-skill that lesson is tagged with and the parent skill category that the sub-skill falls under.

    If a lesson is tagged with multiple sub-skills that fall under the same parent skill category, minutes will only be attributed to the parent skill category once. This is why the sum of minutes watched for all sub-skills under a parent skill category may not equal the number of minutes watched for that skill category.

    🗒️ This means any minutes watched attributed to certain skills may be different than what you are used to seeing.
     
    Full Historical User Data 
    There are 3 course types on the Masterclass at Work platform today: classes (including classes with activities), series, and playlists. Today, data for playlists are only included in the Course Progress report and the User Leaderboard report. Data for classes with activities are only included from September 2023 forward.

    With this update, data for all MasterClass at Work content formats (classes, series, and playlists) will be included on all pages of the Analytics dashboard. Historical data for all content formats since the start date of your organization will also be included.

    🗒️ This means you can expect an increase in Minutes Watched and Active Users than what you have been seeing as engagement on all formats across all time gets included in your metrics. The Top Courses, Top Users, Top Skills may also change as all formats get included. 

    To learn more about the Course Progress report metrics, see this article. To learn more about the User Leaderboard report metrics, see "How can I unlock detailed user watch data in the User Leaderboard report?" located in this article.
     
    Custom Range Filtering
    Admins can now select one of the preset time range options or select a custom range using the custom range picker at the top of the page.
    🗒️ The earliest possible date to select in the custom range picker is the start date of the organization.

    The metrics you see below will be aggregated over the preset or custom range you select. If there is a trend graph on the page, the trend graph will display the entirety of the range you select broken up into the intervals selected. For example, the interval selected above is “Monthly”.

    🗒️ Depending on the range and interval selected, partial intervals may exist in the beginning and end of the range. Exact dates will be specified when you hover on a data point in a trend graph.

    Aggregated & Lesson Level Metrics
    Today, some of the metrics that we provide can only be calculated over preset intervals. With this update, you will be able to aggregate these metrics over custom time ranges to better understand the activity and engagement of your organization. The metrics that will now be able to be aggregated over custom ranges are:

    Unique Active Users - The total number of unique users over a preset or custom time range who have consumed 1s of any lesson. A lesson is any individual video on the platform.

    Avg Lessons Watched / User - The total lessons watched divided by the number of unique active users over a preset or custom time range.

    % Active Rate - The # of unique active users divided by the number of unique redeemed users over a preset or custom time range.

    Average Minutes Watched Per User - The total minutes watched divided by the number of unique active users over a preset or custom time range.

    Average Lessons Watched Per User - The total lessons watched divided by the number of unique active users over a preset or custom time range.

    We will be adding additional lesson level metrics to the Admin Analytics Dashboard. For a specific course a user in your organization has watched, you will be able to see the following metrics in the downloadable CSV of your Course Progress and User Leaderboard reports:

    Total Lessons - the total number of lessons in the course

    # of Lessons Watched - the total number of lessons in the course that the user has watched

    % Lesson {X} Completed - for each lesson “X” watched, the % of that lesson that they completed, where % completion is calculated by the minutes watched of the lesson divided by the total duration of the lesson.
    🗒️ This data is only available if you have Individual Member Tracking Turned on, see how to turn it on here.

    Revoked User Data Toggle
    You now have the option to include (default) or exclude revoked users from reports for your organization from the team filter in the top right corner

    If you are an All Access Organization or Workspace Admin, you will have the choice to include or exclude users whose access has been revoked and no longer have an active seat at various reports. The toggle will be available in the following reports: Analytics Overview page, Active Users page, Engagement page, Top Skills page, Top Courses page, and Course Progress page.

    This toggle is only available to Organizations and Workspaces. When filtering for a specific team, that’s not the parent organization or workspace, you will only be able to see data for users who have an active current seat.

    If you are a Team Admin, you will not see the Revoked User Data toggle.



    Top Courses Filtering
    You will now be able to filter your Top Courses page by a specific skill. The skills in this filter correlate to the 10 skills at the top of the MasterClass At Work library.
    • Clicking on a skill in the skill filter will return the top 10 courses (ranked by minutes watched) tagged with that skill at the course level.
    🗒️ The primary skill labeled next to a course may not be the same as the skill selected. This happens when a course is tagged with the skill filtered, but it is not the course’s primary skill.

    How can I view progress on a course that was shared?
    To access progress for any course that has been shared, you can click the "View Progress” button on a course listed on the Shared Content page within your Admin Dashboard. This button will redirect to the Course Progress page under Reports, where you can track the progress of course completion.

    You can also view progress of your users on any course by directly navigating to Reports > Course Progress page and selecting a course from the drop-down. All classes, series and playlists will be listed here.

    The Course Progress page provides you with an overview of the course's overall completion percentage, the date it was shared, and the person who shared it. See details of the metrics available on this page on this article: How are Course Progress metrics defined?



    You can choose to only view progress for users who were assigned or recommended this course, or any user from the organization who already took the course.
     
    How can I unlock detailed user watch data in the User Leaderboard report?
    To better understand and track your team's progress, MasterClass at Work provides the User Leaderboard page. This article will guide you through its features and how to access more detailed watch data for your users.

    By default, the new User Leaderboard page gives you aggregated classes started and lessons started for your individual users.


    For organizations that wish to dive deeper into individual user metrics, we provide an option to access more granular data at the license level.
    In order to do so, we will prompt users to individually grant consent to allow their organization to view their class progress and completions. If consent is granted, you'll have access to detailed metrics for each course a consenting user has watched. These metrics, located in the downloadable CSV report, are:
    • Course Title
    • Course Type
    • Course Duration (in mins)
    • Minutes Watched
    • % Completed
    • Date Last Accessed
    • Course Primary Skill
    • Total Lessons in Course
    • # of Lessons Watched
    • Lesson 1 % Completed
    • Lesson 2 % Completed
    • Lesson 3 % Completed, and more


    See here for details on how those metrics are defined. Data for users who do not grant consent will not be displayed in the CSV download.

    To turn on Individual User Analytics, follow these steps :
    1. Reach out to your Masterclass At Work representative, or send an email to atwork@masterclass.com to better understand the behavior of turning this feature on for your users.
      • See the template located in the Admin Resource Center titled “Individual User Tracking Request Template” for information on how you can request to turn this feature on. The Admin Resource Center is currently only available to All Access Admin.
    2. Communicate to your organization informing them that you have opted in to viewing individual user analytics and to please accept consent so your organization can better report on user engagement.
    • See the template located in the Admin Resource Center titled “Individual User Tracking Organization Communication Template” for information on how to update the users in your organization of the change. The Admin Resource Center is currently only available to All Access Admin.
    3. A MasterClass At Work representative will turn on User Level Analytics for your organization and inform you once that is complete.