How do I analyze team radar results?
TeamHealth Radar Assessment Results
Once the team has completed the assessment, you’re ready to analyze the results, usually during a retrospective session with an AgilityHealth Facilitator and your ScrumMaster.
To view the results of your team's assessment, log into AgilityHealth, which will land you on the Team Dashboard. Click on your team's avatar on the Team Dashboard. This will take you to your team’s assessments dashboard. Click on the specific assessment of interest and your results radar will appear in Summary view.
You can explore the Summary view or toggle to the Detailed view where you will see the dots. Each dot represents one person but as the results of the survey are anonymous, you will not know which dot belongs to a specific person. The shading between the dots is the ‘variance’ between answers. Wide variance shows lack of consensus, narrow shading shows consensus.
When analyzing the results, you should:
- View the detail view, with the dots for responses
- Zoom in to focus on each section
- Identify related competencies
- Look for trends and review the textual responses
- Document strengths, improvement areas and any impediments you see
- During the retrospective session, along with the Facilitator and ScrumMaster, build a growth plan in AgilityHealth with a few growth items for the team backlog and a few growth items for leadership/organizational backlog
Additional Insight into Analyzing Results
To help you with results analysis, here are some things to look for:
1. Overall Radar Analysis: When you look at the radar, when the average red line is towards the center, the team has rated themselves less mature, as it expands outwards, the team has rated themselves higher. So, what does the overall radar tell you?
2. Look for Patterns: Dig deeper by looking for specific patterns such as the ones below:
Pattern – Wide range of responses: Could be a symptom of several things: New team members, lack of communication on this area/competency, misunderstanding of what this competency means, different roles experience or view this differently.
Pattern – Very High scores: This should be rare as there are not many teams that have achieved world class maturity and adoption of practices so when you do see very high ratings, look for the following:
- Could be accurate and the team may have developed in maturity this specific area. Look around the rest of the radar to see if other related areas you expect to be high are actually mature as well.
- Too many World Class scores could also reflect fear, misunderstanding or over-rating. Some teams are afraid to rate themselves realistically because they are afraid of looking bad or being judged by management. Teams might also have a misunderstanding of the competency or perhaps they are new and very excited about improvements in this area and reflect this excitement by over-rating as they don’t know what they don’t know. This reduces the confidence in the data quality.
Pattern – Very Low Scores - Lack of Adoption, Low Maturity: Teams may rate themselves on the lower end for adopting specific practices. First, this is a good sign of the team being open and honest and reflecting realistically where they are. Dig to see if these areas could be impacting the team and if this is an area to discuss with the whole group.
3. Read the textual responses and try to understand the context behind the why on how the team rated themselves and what common threads emerge from the collective comments.
When you were taking your survey, you and your team members had the chance to add textual responses. The main sections are Strengths, Improvements, Impediments and the Sub-Dimension Notes (what you filled out as you rated each sub-dimension, see sample below). You will also review these during your retrospective and use them to help create growth plan items. These are anonymous so they should not contain information that can tie them back to one specific team member.
Filter the results by participant groups:
When Team Admins add team members to a team in AgilityHealth, they tag the team member with relevant participant group information. You can view the results on the data by selecting different participant groups, using the two green arrows in the upper left hand corner. Click on the green arrows and select which participant groups you want to see. For example: filter by Leadership Team vs. Technical to analyze how these two groups responded, or Contractor vs. Employee or California vs. India vs. Seattle to see this by geography.
View the analytics table:
Scroll down below the radar to view these four tables which provide a nice summary of the top and lowest 5 competencies (average score), highest 5 consensus (narrowest shading) and lowest consensus (widest shading). During your retrospective, as a team you should review and analyze these as part of your discussion.
Team Maturity Stage:
The Facilitator and ScrumMaster will work with your team to help determine which maturity stage the team believes they are in. You'll use the below maturity roadmap for guidance.
Learn more in our What do Crawl, Walk, Run, Fly mean as Maturity Stages article.
Growth Journey Tab
If a team has taken multiple assessments, you can see trends over time to gain additional insights by visiting the team's Growth Journey tab. The Growth Journey tab displays the average score for each dimension, sub-dimension and competency across all of the assessments completed within a selected time period. You can also switch to the Compare Radar view, to see the average for each time period as a colored line on the radar. This is most helpful when comparing 2-3 time periods, so that the difference between the lines is easy to see.
To get to the Growth Journey tab, log into AgilityHealth, which will land you on the Team Dashboard. Click on your team's avatar on the Team Dashboard and this will take you to your team’s assessments dashboard. Click on the Growth Journey tab.
When viewing the data in the Growth Journey, take care to notice the number of assessments that are included in each time period. If the assessment is only completed once a quarter, then the data point for that quarter is only for one assessment.
You can see the average score, assessment date and name of the assessment by hovering over each data point with your mouse. In the example below, the Q2 Retrospective for this team was taken on Feb 04, 2018. The average score across all of the competencies within the Culture Dimension for this team was 66.
You can adjust the Comparison Filter to compare assessment results over a period of time.
In the Timeline (default) view, you can filter by dimensions, sub-dimensions and competencies to see each level of detail and the percentage increase or decrease between each data point.
Here are a some things to look for:
What is the overall pattern?
- Is there a clear up, down or flat trend across the dimensions, sub-dimensions and competencies?
- Is the trend consistent or varied?
- What does this tell you about how this team is maturing?
What stands out?
- Where are the greatest increases and decreases?
- Is there anything that surprises you?
- What does this tell you about where to focus your efforts?
What organizational/environmental factors need to be considered?
- Were any major changes implemented that would have a big impact on team health and performance at a specific point in time?
The implementation of TeamHealth 2.0 questions is displayed as a milestone in Q4 2017 on the timeline view, as many teams scored themselves lower in most competencies when moving to the Crawl/Walk/Run/Fly format, from our original TeamHealth questions. In addition, the implementation of TeamHealth 2.5 quantitative questions will be displayed as a milestone in Q1 2019 on the timeline view, which may affect results in the Performance dimension.
Keep this in mind when looking at trends that cross these milestones.
Compare Radar Analysis
By using the View dropdown on the Growth Journey tab, you can also switch to the Compare Radar view, to see the average for each time period as a colored line on the radar. This is most helpful when comparing 2-3 time periods, so that the difference between the lines is easy to see.
The Compare Radar Analysis table below the timeline or radar view provides the average score for each of the selected time periods. If you have selected two time periods to compare in the filter, it displays the points change and percentage change as well.
You can also export this data to Excel for further analysis.