Sustaining a Community of Practice
Nurture long-term growth, measure impact, and adapt with care.
Evaluating Your Community of Practice
Ongoing evaluation is important to ensure that your CoP is effectively supporting youth serving practitioners as they learn to strengthen relationships in their organizations. Consider the following tips as you develop your plan for evaluating your community of practice.
Accordion Content
Your learning objectives are what grounds the structure and experience of your CoP. It is crucial to evaluate to what extent your community of practice is meeting your intended learning objectives, as your results will help inform how you might need to improve your programming. As you develop your evaluation strategy, begin by reviewing your learning objectives and consider how you might collect data related to each of your objectives.
The more information you gather about your community of practice, the better you will understand how and what youth serving professionals are learning in your community. Examples of useful data sources include:
- Brief feedback surveys. Develop a brief survey with 3-5 questions that participants can complete at the end of each session of your CoP. Draft questions that are relevant for every session, regardless of how the content or structure of sessions might shift over time. In this way, you have a consistent metric that is easy to compare across sessions. These questions can be multiple choice (e.g., “On a scale of 1-5, how relevant was today’s session for your professional learning?”) and open-ended (e.g., “What was the most valuable thing you learned today?”).
- Interviews and focus groups. While surveys can be a quick and convenient way to gather feedback, survey responses can sometimes lack nuance and depth. To account for this, consider conducting interviews or focus groups to foster a more open dialogue about what your participants are experiencing in the CoP and the extent to which it is supporting their learning and growth. You can use these conversations to dig deeper into findings from survey results and develop a clearer understanding of how to support youth serving professionals.
- Data that participants collect about their organizations’ performance. The organizations that are represented in your CoP might already be collecting data that is relevant to your learning objectives. This can yield valuable insight about whether or not this learning experience is impacting outcomes within these organizations. Talk with each of your participants to understand what types of data they collect in their organizations, and ask if you can establish a data sharing agreement with their organizations.
Communities of practice are most successful when participants are actively engaged over an extended period of time. Consider how long you expect participants to be involved in your community of practice and determine appropriate intervals for collecting different types of data. These intervals will likely be determined by your capacity to collect and analyze that data. For example, you may want to implement a brief feedback survey at the end of every session, as that information can be collected in a few minutes and analyzed over a few hours. On the other hand, interviews and focus groups require a lot more capacity to conduct and analyze; as such, you might only collect that type of data once or twice a year. In either case, being consistent in the timing of your data collection will improve your ability to analyze the data across time points.
You will want to analyze data at different levels of your CoP. When you analyze all of your data collectively, you can understand how well your CoP is going overall and identify strengths and growth opportunities in your curriculum and programming. When you examine the data that you have for specific individuals, you can identify personalized supports for participants who might be in different places in their professional learning journey.
Improving Your Community of Practice
The data that you collect about your CoP will help you identify how you can improve the experience and better support your participants. Consider the following tips for making improvements to the structure, content, and supports embedded in your community.
Think like a user experience designer.
When analyzing the data that you’ve collected from your participants and their organizations, try to identify the overarching story that the data conveys about their learning experience in the CoP. What do your findings reveal about participants shared experiences in the community of practice? Look for similarities in how participants describe their development throughout the program, including common challenges and successes in their learning. Outline your findings to tell a narrative about the typical ‘learning journey’ that participants are experiencing throughout the community of practice. Be intentional to draft this narrative only based on the data that you’ve collected, as you don’t want your expectations for the community of practice to cloud your understanding of the reality of what participants are experiencing.
Revisit your curriculum with new insights.
Once you have a sense of the typical ‘user experience’ in your CoP, revisit your learning objectives and curriculum to examine whether there is alignment in what you expect participants should have experienced and learned and what participants say that they’ve actually experienced and learned. In doing so, you’ll be able to identify the strengths and areas of improvement. When you notice gaps between expectations and reality, return to your data to identify insights about how you might improve the learning experience for participants.
Identify new resources and supports for participants.
Often, the data might reveal that participants need additional support for some parts of their learning journey. This might include
- Udates to the curriculum,
- Trying new ways to engage participants in collaborative learning,
- Incorporating new tools and resources to help them overcome common challenges, or
- Identifying areas in which participants might need individualized coaching.
Keep in mind that improvement is an iterative process. Your data might reveal more insights than what you’re able to implement at any given time, which is okay. Focus on implementing a few improvements that you believe will have the greatest impact. As you continue to collect data about your CoP, there will be future opportunities to make further adjustments.
Engagement Survey
As part of our commitment to making our CoP, Excel Academy sessions as meaningful and impactful as possible, we asked participants to take a few minutes to complete a ‘Rapid Feedback Survey’. This brief survey helped us understand:

How useful did the participant find the session

What specific changes they planned to make in their work

How confident they felt about implementing those changes

What obstacles did they anticipate and supports they might need
Their feedback also allowed us to hear participants’ reflections—their takeaways, their wins, and their challenges. This allowed UP Partnership and Search Institute to continue to shape the sessions around participants’ real needs and experiences.
Start Building Your Community
To learn more email or contact our Excel team!