Category: Surveys

5 things to consider before launching your own surveys

~ jo-anngarbutt ~ Leave a comment

It is easy to think “I will just create a quick survey for that” and then go off and email a link out to a group of people to collect responses. Looking at the big picture perspective, firstly be clear on your overall survey objectives and how you will use the input you receive.

Once you have defined that, take a few more minutes to think through 5 key aspects of launching a survey before you proceed:

  1. What exactly is the message?
  2. The platform you plan to use
  3. CHECK the text
  4. The intro matters
  5. The thank you

The message

Launching a survey is a message too

(It says: I want to know, I value your opinion, I am listening, Tell me what you think)

Take the time to write down all the messages about the survey that intended participants need to know. What do other stakeholders need to know – think of managers who may need to help you communicate to their groups about the survey. What do you need to make sure they know about it before your launch date?

People need to know what the survey is for and why it is important. What is this survey linked to and how do you hope to use the input to drive decision-making?

When can they expect the survey to be open and how will they access it? Link via email or QR codes around the building/email or will it be an app on their mobile devices?

Will you be emailing out the announcement of the survey or is there a communication plan that is much broader than the survey? Perhaps some messages will be on social media or notice boards? If you need to make a communication plan, this template can help:

annual-communication-plan-templateDownload

Be sure to share this information with intended survey participants when you map out your communication messages:

  • This survey is coming on (date)
  • The reason we do this is (….)
  • What we hope to review/change/update/introduce as a result of this survey is (…)
  • Why we are asking for your input is (…..)
  • It will only take (…..) minutes of your time to complete
  • We will let you know about the results (time) and (how/where)
  • How will you protect their privacy and if the survey contains sensitive information – who will see it and how long will you maintain the data before destroying it?
  • Can they participate anonymously?

The platform

There are various survey platforms available these days – some are free, and others are not. In general, those with paying options come with additional features such as help to analyse your data, automatic graphic creations for communicating your survey results, text analysis options etc.

Whichever platform you choose to use, test it first. Create a quick survey and send out the link to some trusted colleagues or to yourself to see how it displays. Can you access the survey using the link without any firewalls or other error screens interfering with ease of access? Is it easy to complete the survey online? Is there a phone app for it? How well does the phone app work?

Also look at the reports you can get from the platform. To what degree does the platform offer you some level of analysis as a download? Can you download a spreadsheet which you then need to analyse yourself to create a presentation or a report? Knowing what remains for you to do is an important consideration in choosing the right platform for the survey.

Check the text

Make sure you have read each sentence out aloud. Missing words or repeated words can be overlooked when you just glance through your survey. Reading it out loud – word for word – often highlights areas that may need to be reworded or corrected. Answer these questions about your survey wording:

  • Do the instructions make sense? If I ask other people how they would interpret the instructions you plan to use, would they know what to do next?
  • Is each question or statement to be rated constructed in a simple way to avoid confused answers? i.e. do not ask about more than one thing at the same time such as “do you think it was easy to do and did you like the fun tests we handed out at cafeteria last week?” In this case your results could be hard to interpret. If the final scores are low, was it because people thought it was NOT easy or was it because they did NOT like it? Or was it both?
  • If the platform has a spell check function, use it. If it does not, copy and paste the text into a document where you are able to check spelling before you proceed to launch the survey

The intro matters

Even if you did a great job at communicating about the survey in your communication plan activities and presentation messages, people may not have seen or heard all of your early messages. Tell them the highlights in the introduction section of the survey: (after the survey title and before you start with your questions or statements to rate etc).

Intro points:

  • What it is FOR?
  • Why are THEY asked for input?
  • What will you DO with the information obtained?
  • Is it anonymous or will you be telling others what they said in the survey?
  • By WHEN do you expect their response to have been completed after which you will close the survey?
  • HOW LONG is it likely to take participants to complete the survey?

Say thank you

When people answer your surveys, they are prioritizing your request given other tasks that lie before them. They are making time out of often busy days to provide you with feedback. A simple thank you message can go a long way to ensure people are open to respond to future survey participation requests.

And while you are saying thank you, it may be an idea to provide a link to a website to visit if they want to find out more, volunteer or whatever other actions you would like them to take after completing the survey.

Surveys are so easy to create these days and the need to collect recent data and employee feedback is becoming more mainstream in companies than in previous decades. The annual employee survey is no longer the only way that change managers and management obtain feedback. Surveys can be a powerful feedback tool and yet, they can also create confusion and frustration if they are not communicated and launched with some forethought and planning.

Leadership Behavior Scorecard

~ jo-anngarbutt ~ Leave a comment

The behavior of leaders is a very powerful indicator of how a company truly operates from a people perspective. Which aspects of the business are mostly focused on by leaders? How are decisions made and communicated? Most change initiatives include specific behaviors which leaders need to role model in order to ensure a successful outcome for the initiative.

The typical approach to measure how leaders are behaving is to obtain input from those around each leader – those who interact with the leader on a regular basis.  The groups of people asked to provide ratings for each leader could be:

  1. People who report to the leader
  2. People who are colleagues of the leader
  3. People who are more senior than the leader
  4. If appropriate – external parties who interact with the leader on a regular basis.

Process of assessing leaders

The process of assessing leadership behavior typically follows these basic steps: Collecting ratings, consolidating the ratings, providing feedback to leaders and using the results to plan further actions as needed.

201906 process

The mechanism needed for this exercise needs to be developed, reviewed and agreed and then introduced before the process starts. Once the key behavioral elements are defined, create a way to capture feedback from others about leadership behaviors.

leadership-behavior-scorecard-1Download

The resource above can be downloaded. It is a set of behavioral statements which can be shared with those who need to provide ratings and comments. The scores or ratings relate to actual behavior observed against desired behaviors for each leader that they interact with on a regular basis. Some people automate their chosen feedback gathering using a free tool like http://www.surveymonkey.com

Process notes:

  • Behaviors used for ratings have to be very well defined so that they can be observed and does not require someone to guess at the intentions or motivations of the leader. A behavior must be observable or produce visible results.
  • Ask raters to add comments to help you interpret the scores. This understanding enables the creation of realistic follow-up actions after the results are available.
  • Ratings should not be requested too often – raters get “survey-fatigue” and your results become less meaningful.
  • The objective is for the tool to support the leaders by providing helpful and actionable feedback. The tool also helps to understand how the change initiative is progressing towards desired milestones.

You will notice in the shared resource (tool) example that leadership behaviors were defined in 4 categories: Commitment Behaviors, Communication Behaviors,  Teamwork/Collaboration Behaviors, and Safety Behaviors. Your categories will be determined by your own change initiative and you will need to also define the specific behaviors that are desirable for leaders given your project. Simply use the downloaded excel sheet and type over the category names and behavior definitions to create your own Leadership Behavior Scorecard.

Important watch-outs:

  • Be careful when you consolidate the results from various raters. If you had agreed to keep rater identities confidential, summarize the results by subgroup. Provide an average per subgroup for each of the behavioral elements. Do not provide a subgroup score if there were less than 3 raters.
  • Follow-up actions should also include recognition/appreciation for those leaders who are role modeling the desired behaviors in the organization.
  • Consider using some examples from the higher ratings to create case studies to the organization. It is easier for leaders and employees to understand how to apply desired behaviors when they receive actual examples that illustrate how decisions were made or implemented using the desired behaviors. An example makes it easier for others to follow.

The tool is relatively simple to use, but it is vital that it is designed well and introduced correctly into the organization. Assessment tools can be seen as a negative element if the objectives and the way results will be used are not communicated appropriately.

Reference checks

~ jo-anngarbutt ~ Leave a comment

After interviews have taken place you will want to take a few more steps before you decide whether to make an offer to one of the job candidates you have for a vacancy. You may want to ask candidates to complete assessments or you may want to get the perspectives of their former colleagues before you make a decision.

Additional steps after initial interviews or between rounds of interviews could include:

  • Tests or assessments.
  • Practical exercises like a business case or even a presentation to be made to some senior leaders or experts at your company.
  • Reference checking with former colleagues, former direct reports or former supervisors of the candidate(s).

Checking References

The (download) template I am sharing below contains a few questions to help you understand whether one candidate may be preferred compared to another given their experiences and approaches.

reference-check-questionsDownload

Background checks are used in some countries but can be harder to obtain in countries or regions where data and privacy protection laws exist. In most cases, criminal background and/or financial history information can only be obtained if the prospective employer can show a direct link between the requirements of the role and the information it wishes to obtain. Reference checks are typically easier to conduct in most countries, but be mindful of the kinds of information that you would be reasonably able to obtain given local laws.

Be mindful to:

  • Ensure that you notify any impacted job candidates (i.e. in areas such as Europe) about the data you wish to obtain and how you would process this data to avoid the risk of non-compliance. Job candidates need to know this at the start of the process and they must (actively) agree with your proposal for collecting data before you are able to proceed.
  • Ensure that all data obtained during the recruitment process is archived or destroyed after the process has been completed for a specific vacancy. All HR personnel who deal with such data would need to understand that this also includes any data that have been saved to their individual computers during the process.
  • Make sure the data you wish to obtain is relevant to the hiring decisions you wish to make. And make sure that those who would speak with candidates or possible referees can explain the connection.

Assuming that you have taken all precautions to ensure you are not incurring any risks with your planned reference checking approach, use the questions you have selected (the download template above can help) when you contact the list of referees provided by the job candidate.

You can use the template in a few ways:

  • Set up a time to talk to each referee via phone or Skype and go through the questions, capturing his or her responses.
  • Send each referee a form and ask him/her to complete it and return it to you – typically via email. Be aware that this approach does not offer you much opportunity to ask further questions to clarify without creating a few extra emails to the original string.
  • Set up the questions as an online survey (for example using www.surveymonkey.com) and share the link with referees. Note that data interpretation may be an issue here – not knowing what a referee meant by a specific score or comment. This also means you would have to contact referees again to clarify feedback. One way to improve data interpretation is to build in comment fields to explain scores.

Finally, it is important to understand that a reference check is just one of the data points that could support decision-making related to hiring the best candidate for the vacancy.

Feedback may be incomplete for a number of reasons:

  1. The referee wishes to avoid any unpleasant situation with the former employee and wishes to be cautious in his/her responses.
  2. There may be laws in the country which specifies what referees can or should say and what they cannot comment on.
  3. The previous company may have clear policies about what can be shared by referees, which may be limited to job title and years of employment at the company.

Getting feedback from those who previously worked with a job candidate can still be valuable – understanding how the candidate’s knowledge or work methods would fit in with the job requirements or the company culture. For this reason, it can be good to get more perspectives. Just be aware of possible risks given the changing legal environment as you obtain feedback from referees.

Leadership and Trust : Training slides

~ jo-anngarbutt ~ Leave a comment

trust4

Trustworthiness is the undisputed main characteristic that we look for in a leader and frankly also in any other person we encounter on a daily basis.  Trust is a topic that is often discussed in a business context after employee satisfaction or engagement survey results are known in organizations. The topic also often comes up when leadership training or development is considered.

The resource I am sharing consists of some slides highlighting the nature and importance of trust in teams and then it has an exercise which you can do with a group of leaders.

trust-and-leadershipDownload

You can use this (download above) file in a few ways:

  • As a quick exercise (about 20 to 30 minutes) with meeting participants where Trust and Leadership is the topic of conversation or discussion. For example: in a meeting to discuss a recent employee survey where trust came up as an area to be addressed.
  • As a sub-section within a leadership training course where Trust and Leadership is an aspect of the course.
  • As a coaching discussion topic where it is important for someone to learn more about actions and behaviors that can contribute to being viewed as more trustworthy.

These slides won’t teach someone all of the aspects of trust and leadership, but they do provide a context for you to explore the topic. You may always choose to follow-up with more exercises or conversations about the topic in future.

(Note that the last “Slide” in the resource is not for display purposes, but for you to print out so that the small groups in the exercise have a way to capture their thoughts while going through the exercise.)

How to set priorities in an action plan

~ jo-anngarbutt ~ Leave a comment

After a survey, a brainstorming session or a discussion it is often true that you end up with a long list of actions that should be put into an action plan. With many actions, maybe only a small number of people available to execute on those actions and possibly a small budget available for some of the actions, this could seem overwhelming.  The important question is: How can you prioritize the actions so you can make the most of the available resources (people to work on them) and funding (available budget)? And on top of that make sure that the most important actions are completed first?

Rate all the projects or activities on two questions:

  • what is the level of impact on your company, project, company if you completed that project/activity? (high means it would me a very big difference (positively))
  • how hard is it to implement this? (referring to available resources, skills and knowledge needed, tools needed, funding needed) (very difficult means you have very limited resources and budget and this project or activity would need more than you have available right now)

Use the scores obtained to plot your planned projects or activities onto this graphic: (the graphic shows an example based on the table and ratings above)

priority-setting-of-actions-agreed-templateDownload

What to focus on?

Use the guide below to understand which of your projects or activities should be a high priority, low priority or medium priority with possible additional research needed.

One the one hand the question is: can you overcome what is difficult about that particular activity or project? Can you (for example) convince someone make more funding available if you present a very solid business case to highlight the value to the company or the project?

Or can you get more people to help? The other question to look into is whether the impact is really as low as you imagine? Speak to others to hear their views of how such a project or activity could possibly benefit more areas than you think. Perhaps the project is much more valuable than you think and it moves into the “green” quadrant meaning it should be a high priority for you to work on and complete.

If your dots appear in one of the yellow sections, you have some questions to ponder. If you can solve the question in each case you may be able to move that particular action into a different “zone” by changing the score. This means you are able to for example make it easier to implement by solving an issue which made it particularly difficult to implement. Or it could mean you realize the business impact is bigger than you previously realized because the company could gain a competitive edge if you implemented that particular action.  Your final action plan for immediate focus areas should contain those actions which finally end up in the green zone on the legend.

Be sure to communicate the reasoning behind your high priority actions to the key stakeholders in the outcomes of the action plan. They may have additional insights to share which could further cause you to change the scoring of actions.

You can use the Action Plan posted here to capture the actions that you will implement, monitor status of and report on regularly.

Coaching Effectiveness Survey

~ jo-anngarbutt ~ Leave a comment

While it is a good idea for coaches to periodically discuss how well the process may be working for those that they are coaching, it is also a good idea for HR/Learning and Development to get feedback on the coaching program on an annual basis. Occasional informal feedback from the person being coached to the coach directly may help the coach improve the person’s coaching experience and outcomes reached.

A formal annual survey helps the department responsible for managing and monitoring the coaching program to understand a few things:

  • General questions that coaching participants may still have about the process or program objectives.
  • How to improve the training of coaches to improve developmental outcomes.
  • How well the relationships are working between coaches and those being coached. Perhaps an intervention may be needed in cases where a high level of dissatisfaction is recorded?
  • Whether the coaching process is working well in general – meetings are held on a regular basis and the right topics are being discussed.

Coaching survey

coaching-effectiveness-surveyDownload

The coaching survey above (see download option) contains questions you may want to consider for your annual coaching effectiveness survey and it also contains some suggested wording for the introduction email to those who are being coached to explain the survey and its purposes.

Gather the survey feedback and analyze it for overall coaching program effectiveness, but also look at individual responses to see if anyone is having a particularly negative view about his or her coach or the coaching process.  When you take action on individual responses pay close attention to the confidentiality statement you put in the email that went with the survey. Do not reveal someone’s input to his or her coach unless it was expressly established that the survey respondent consent to this course of action. Also use the information gathered from the survey to improve your orientation slides for the next coaching program and to improve future training you offer to coaches.

Other coaching resources that may be useful for setting up your coaching program: preparing for coaching, coaching questions, coaching program orientation slides.

Internal Communication Effectiveness SURVEY

~ jo-anngarbutt ~ Leave a comment

comms

Internal communications should go at least in two directions: from the leaders to the people and from the people to the leaders. Employees should receive regular updates from management about the company and should be informed about planned changes, successes achieved in the company and how their efforts have lead to good outcomes and wins for the company. Communication should also go in the other direction where employee opinions and feedback are sought and captured to help managers make better decisions and improve efforts in areas where company actions or activities are not as effective as they had imagined.

Ensuring that employees receive important and relevant information internally on a regular basis and in the right ways is mostly the responsibility of the HR function. In some cases HR shares this responsibility with the Communications department. Whomever is responsible for managing this, there should be planned moments of checking outcomes of the internal communication plan against original objectives set.

Internal Communication Checkup Survey

internal-communication-effectiveness-surveyDownload

Effectiveness of internal communication should be evaluated periodically. I would not repeat a survey like this one on a monthly basis unless you are going through a specific change initiative in this regard and would like to ensure you have a good understanding of how well your change process is going. Once per year or once in 18 months should be a good evaluation period. Keep it short to optimize your chances of getting good feedback and a high level of participation.

Tips:

  • Ensure your questions are specific and simple – survey respondents should know what exactly you are asking about. Do not combine more than one question into one.
  • Always make a post-survey action plan and share that with survey respondents and other stakeholders in the success of internal communications.
  • If you are an HR Director or in HR Management – stay close to the creation of internal communications. Read everything before it is released or published internally in your area of responsibility. The tone of communications and the contents of messages that are sent into the company very closely link to how employees are interpreting how the company’s management “feels” about them and you will often find disconnects started with some internal message that was misinterpreted.

HR Function checkup – Feedback from internal customers

~ jo-anngarbutt ~ Leave a comment

In the same way that companies would approach external customers to gather their views on what is going well and what needs improvement (customer satisfaction), the HR function should reach out to its internal customers to find out how satisfied they are with the services and support that they receive. It is true that there are more than one model for HR service delivery, but that does not change the fact that it is wise to gather feedback on the services and support that you do provide given the structure and focus for HR in your company.

The HR function is often guilty of focusing its developmental and improvement efforts exclusively on helping other departments and neglects using those same skills and expertise to improve the HR function as a whole and developing the people who deliver the HR services to others.

HR Function – Feedback Survey

This survey can help you gather the information you need from your internal customers to help you identify specific areas of excellence in HR and also those areas where improvement may be needed. When improvement is needed it will often imply additional training and development of some HR representatives (HRBPs or Generalists) and may also  include communicating the HR vision and goals more clearly within the HR function. Remember to recognize and reward those who were part of delivering excellent services when you review the survey results.

feedback-from-internal-customers-about-hr-functionDownload

Tips:

  • Add comment fields next to scores if you want to be certain to capture specific comments about the scores.
  • Do be sure to provide survey participants with feedback on the outcome of the survey and the actions that you plan to take as a result of the survey. This motivates participants to continue providing you with valuable feedback in the future.
  • Create an action plan and communicate that clearly within the HR function so that everyone understands which areas you plan to address and how you plan to do that. It may help to set specific metrics around your planned improvements to make it easier to report progress.
  • Regularly update stakeholders – internal to the HR function and those who are internal customers in your company – on the progress of improvement efforts as you implement the post-survey action plan.
  • Remember to celebrate successes (milestones and outcomes achieved) and be prepared to add additional actions to your plan in cases where your improvement efforts are not reaping the results you had planned for.

Having a standard survey which you use ever year gives the opportunity to track the progress in specific questions over time and helps with trend analysis and showing % improvements over time.

Team Effectiveness Check

~ jo-anngarbutt ~ 1 Comment

The strength of teams lies in their ability to achieve more as a group working together than as individuals working independently on various parts of a project or activity.  The main obstacle to a team achieving the optimal performance level is the ability of the individual team members to work together collaboratively.

You can select the right team members based on the knowledge you need, the skills and competencies you need and the experience levels you need for a project. And the team performance can still be very disappointing if the team members do not communicate effectively, are not sharing information in a comprehensible way, and are not clear on how to coordinate with each other to avoid rework or waste their efforts working on the wrong items.

The success of a team is measured by more than one aspect. Examples include:

  • Achieving project milestones and objectives
  • Satisfied stakeholders
  • How well team members are working together – getting more done with more innovation and inclusiveness in a shorter period of time
Team Success Measures

Phases of a team

Any team will go through developmental phases starting from the first day the team members spend together. If these phases are navigated successfully, they can help team members build a high level of trust which enables the team to achieve a high performance level. The leader of a team has an important role to play throughout the phases of team development to help the team achieve their goals in the most effective and efficient .

Measuring team outcomes

Setting out to measure the progress of a team’s efforts is simply about communicating and then monitoring KPIs (Key Performance Indicators) on a regular basis. KPIs are typically set around costs, time to completion, quality of the product etc.

Measuring the cohesion between team members and how well the team is functioning is not that simple. Every team member most likely has his or her own opinion of how well the team is functioning and where improvements may be needed. Team members also would have opinions about whose “fault” it may be that things are not better. The question is often whether it is a lack of knowledge, a lack of motivation or actually interpersonal conflicts and distrust which is contributing the most to dysfunctions.

Team effectiveness Check

team-effectiveness-survey-templateDownload

Using this short team effectiveness check, is a great way for leaders to take a quick look at how each of the team members see the team at that moment in time and identify where discussions may be needed to clarify or remove issues that may be hampering team functioning.

The purpose of this quick survey is to gather input from the team on their own perspectives. Remember that a perspective is just how one person sees things at that moment in time. It does not mean that the perspective of one person holds true for the rest of the team. It is important though that you understand whether one or more team members are not feeling included, engaged or unable to contribute based on a lack of internal alignment with other team members on goals etc

As the team leader or team coach, ask your team members to fill this out maybe once a month – more often if you are going through a difficult phase as a team and you are concerned about how well things are going for each team member. I would not do this more than once per week.

Note that your team dynamics will most likely change when you add members, remove members or when your project enters a completely new phase of functioning and performance expectations. At those moments you are likely to see a decline in previously recorded good scores for team effectiveness and functioning.

Use this tool as a way to quickly diagnose where the team is at and use it as a starting point for some team or one-on-one discussions to address concerns raised. Include an external person to facilitate difficult team discussions if you feel it may be helpful – someone from HR/Learning and Development/team coach may be able to use their expertise and skills in group dynamics, conflict resolution and interpersonal relationships to get your team out of a rough spot when it occurs.

Exit Interview Template

~ jo-anngarbutt ~ Leave a comment

Unexpected employee resignations can often be alarming. More so if the resignations come from star employees whom you had high hopes for in terms of future expert or leadership roles at your company. How will it impact your project and your team, you may wonder? The question I would ask is, was it avoidable?

The Exit Interview helps with gathering feedback on employees’ decisions to leave the company and what next steps they are planning to further their careers elsewhere. This structured interview can greatly support your ability to narrow down the reasons for the exit and whether you have any large internal issues to address to avoid more people leaving the company.

While it appears to be a written survey, it works well as an interview conducted in person and then the interviewer (usually from HR) can complete the survey later in order to capture the answers from exiting employees in a structured way. Based on your company set-up and employee conditions you may want to add some questions or statements to be rated. Just avoid overloading the employee with too many questions. Perhaps you can remove some of the existing questions if you decide to add any?

exit-interviews-templateDownload

Tips:

  • You could  choose to use this as a survey which the departing employees complete independently. I would however recommend that you ask these questions as part of an exit interview conducted in person as it offers the opportunity to ask follow-up questions to clarify answers to make sure you really understand the factors that led to the decision to leave the company.
  • There is a good chance that the departing employee may not tell you the truth. Sometimes they are afraid you may give them a bad reference in future if a prospective employer called you up. Other times they may be worried about being the whistle-blower on an existing organizational issue in terms of potential impact on any friends they still have at the organization. It may be worth considering the use of an outsourced vendor to gather feedback from departing employees before or just after they have left.
  • Do take the time to review feedback received from exit interviews to determine whether you or anyone else at your company may need to take actions to improve a situation, revise benefits, improve communications to employees on specific topics etc. These actions may be exactly what is needed to avoid other employees from leaving for similar reasons.
  • Mind confidentiality around these interviews. Be sure to be honest with the departing employee on who will get to know about the information shared and stick to the agreement.
  • Talk to those employees who remain with the company and make sure they understand how much you value their continued service and loyalty to the team/organization. When a prominent person leaves – whether a subject matter expert or a much-liked leader – people may start wondering about their own careers and consider leaving too. Taking employee retention actions and communicating especially to those in key roles will go a long way towards putting people’s minds at rest.

It is never easy when you lose good employees and respected leaders and experts to the competition. The best you can do is make sure you learn from the event and take the actions you need to avoid recurrence of an unplanned exit.