Microsoft is integrating new benchmarking features into its Viva Insights platform, allowing managers to monitor and compare the adoption of its Copilot artificial intelligence tool across different teams and departments. This update introduces a dedicated Copilot Dashboard designed to provide detailed analytics on how employees are using the AI assistant within the Microsoft 365 ecosystem.
The new capabilities will enable organizations to measure the return on investment for Copilot licenses by tracking usage patterns. Managers can compare their teams' adoption rates against internal groups and anonymized data from other companies, raising discussions about workplace monitoring and productivity metrics in the age of AI.
Key Takeaways
- Microsoft is adding a Copilot Dashboard with benchmarking tools to its Viva Insights platform.
- The feature allows managers to track and compare Copilot usage by team, region, and job function.
- Organizations can benchmark their AI adoption rates against anonymized data from other companies.
- The tool defines an "active Copilot user" based on intentional use of AI features in Microsoft 365 apps.
- This update is currently in a private preview phase and is scheduled for a wider release to all customers later in October.
New Benchmarking Tools for AI Adoption
Microsoft has announced the introduction of Copilot adoption benchmarks within Viva Insights, an employee experience platform that gathers data on workplace activities. The primary goal of this new feature is to give business leaders a clear view of how effectively the AI tool is being integrated into daily workflows.
The Copilot Dashboard will provide managers with specific metrics, including the percentage of active Copilot users within a selected group. These groups, or cohorts, can be defined by various organizational structures, such as managerial lines, geographical regions, or specific job roles like sales or engineering.
What is Microsoft Viva Insights?
Microsoft Viva Insights is a tool within the Microsoft 365 suite that analyzes data from daily work in applications like Teams, Outlook, and Calendar. It is designed to provide individuals, managers, and leaders with insights into productivity patterns, collaboration habits, and overall employee well-being. The platform aggregates and de-identifies data to show trends in meeting culture, focus time, and network connections.
This granular level of tracking is intended to help companies identify which teams are successfully leveraging AI and which may require additional training or support. By understanding adoption patterns, businesses can better strategize their digital transformation efforts and justify the significant cost associated with enterprise-wide AI licenses.
How the Comparison Metrics Work
The new benchmarking functionality operates on two levels: internal and external comparison. Internally, a manager can see how their team's Copilot usage compares to the company-wide average or to other specific teams.
According to Microsoft, the system calculates a weighted average to create a relevant comparison point. It analyzes the role composition of a selected group and generates an expected usage result based on how similar roles perform across the entire organization.
Defining an Active User
Microsoft provides a specific definition for what it considers an "active Copilot user." An employee is counted as active if they have "performed an intentional action for an AI-powered capability in Copilot" within a range of applications. These include Microsoft Teams, Word, Excel, PowerPoint, Outlook, OneNote, Loop, and the dedicated Microsoft 365 Copilot Chat.
Externally, organizations will be able to compare their overall percentage of active Copilot users with other companies. Microsoft has stated that this cross-company data is anonymized through the use of randomized mathematical models. This process is designed to prevent any single company's data from being identified and to ensure privacy while still providing valuable industry-wide context.
Implications for Workplace Productivity and Monitoring
The introduction of detailed AI usage tracking has sparked conversations about the future of workplace monitoring. While Microsoft positions the tool as a way to enhance productivity and measure ROI, some observers express concern that it could lead to a 'gamified' approach to AI adoption, where usage metrics become a primary performance indicator.
"These insights help identify adoption trends and provide broader context and new opportunities to improve Copilot engagement," Microsoft stated in its announcement.
The system is designed to provide leaders with data to make informed decisions. For instance, if the sales department shows low adoption, it might indicate that the AI's current capabilities are not well-suited for their specific tasks, or that more targeted training is needed. Conversely, high adoption in the engineering department could highlight best practices that can be shared across the company.
Distinguishing License Types
An interesting detail of the new dashboard is its current inability to differentiate between Copilot licenses purchased by the employer and those brought in by employees. Earlier this month, Microsoft announced it would allow users to bring their personal Copilot licenses to the workplace, a move that could complicate tracking efforts for IT departments.
For now, the benchmarks will include usage from all license types, providing a holistic view of Copilot activity within the organization regardless of who paid for the subscription. This approach focuses on overall engagement rather than just company-provisioned asset utilization.
Availability and Future Outlook
The Copilot benchmarking features are not yet available to the general public. Microsoft is currently offering them to a select group of customers in a private preview program. This allows the company to gather feedback and refine the tool before a full-scale launch.
A wider rollout to all Viva Insights customers with Copilot is planned for later in October. As more companies invest heavily in artificial intelligence, the demand for robust analytics to measure its impact is expected to grow. This new dashboard represents Microsoft's effort to provide a quantitative answer to the question of whether expensive AI tools are delivering on their promise of enhanced productivity and efficiency.
The long-term impact will depend on how organizations choose to use this data. If used to support employees and refine AI strategy, it could be a valuable asset. However, if it evolves into a strict performance monitoring tool, it may face resistance from employees concerned about privacy and the pressure to constantly engage with AI.