Quarterly Reports NTAE Year 3 Qtr 3

NTAE 2021-22 Quarterly Reports - Quarter 3

Funding Opportunity Number: USDA-NIFA-OP-006747 Award Number: 2019-41595-30123 Awarded to Oklahoma State University Total Award: $3,408,000.00

Reporting Period: March 1, 2022 to May 31, 2022 (Year 3, Quarter 3) Date Submitted:

Prepared by: Extension Foundation (Dr. Beverly Coberly, Extension Foundation PI and Tira Adelman, Extension Foundation Grants and Program Manager) ℅ Bryan Cave LLP One Kansas City Place 1200 Main Street, Suite 3800

Submitted to:

Dr. Thomas Coon Dr. Damona Doye Oklahoma State University OSU Division of Agricultural Sciences and Natural Resources

139 Agricultural Hall Stillwater, OK 74708

Project Narrative Summary

The NTAE project, under the leadership of Oklahoma State University, will continue to build upon the strengths and capacities of the Extension Foundation, including its experience providing technology tools for Cooperative Extension professionals and catalyzing professional development innovation in Year 3. NTAE funding allows OSU and its partners to advance the Strategic Goals and ECOP Program Priorities. Additionally, the NTAE project is designed to achieve the objectives of the New Technologies for Ag Extension initiative and to align with USDA FY22 Priorities which are: A. Addressing Climate Change via Climate Smart Agriculture & Forestry

B. Advancing Racial Justice, Equity and Opportunity C. Creating More and Better Market Opportunities D. Tackling Food and Nutrition Insecurity

Key Strategies: Technology Learning and Networking Platform NTAE Competitive and NIFA NTAE Preselected Projects

The key strategies for achieving project objectives and strategic goals include the following:

❖ Technology for CES : Partnering with Eduworks and North Carolina State University (NCSU) to enhance existing functionalities to increase the amount of content available and improve access to content. The most significant enhancement involves building Artificial Intelligence into Extension’s Ask Extension tool. The current version, Ask an Expert, is a searchable repository of 50,000 questions posed by the public and answers supplied by 2,600 Extension educators is now replaced by Ask Extension. ❖ National Program and Asset Registry: Another significant accomplishment is theNational Registry of Cooperative Extension Programs and Assets launched to house searchable program information and resources such as presentations, information sheets and evaluation tools for CES. This tool was developed with a CDC/NIFA program called Extension Collaborative on Immunization Teaching and Engagement (EXCITE) and enables Cooperative Extension to create a dynamic geographic map about the incredible work happening system-wide on immunization education and show the strength and value that Cooperative Extension brings to our communities.

❖ Learning and Networking Platform for CES: Connect Extension is a co-learning environment that expands professional development opportunities to all Land-Grant Universities, NTAE partners, and their constituents. Launched in response to Covid-19 in March 2020, the platform currently has 5,063 Extension users participating in subgroups from Health, Urban Agriculture, to Climate. The accounts represent 4581 from 1862 institutions, 370 from 1890 institutions, 25 from 1994 institutions, 84 from federal agencies (USDA, HHS, EPA, NIH), and three from USDA-NIFA certified NLGCA's. Since September 1, 2021, there were 562,123 users representing 700,954 sessions. 88.6% were new visitors to the platform. 54.7% were on mobile, 43% on Desktops and 2.3% were on tablets. They represented a total of 1,074,073 pageviews since September 2021. The Hubspot platform was added in Year 3 Quarter 1 to further enhance communication and connectedness with CES. ❖ USDA Related NTAE Projects: Research and Extension Catalysts mobilize talent among networks within Extension and from private- and public sector partners. The Catalysts recruited projects from across the Land Grant system. Project teams submitted an online nomination form. Projects that applied went through an application process where the projects were scored in a vetted rubric by outside reviewers. Final selection for projects rested on the scored rubrics and advice from catalysts about project readiness. All NTAE project topics related to the USDA Strategic Goals. Catalysts provide a lead mentor role with projects. Additionally, in Year 3, NIFA identified a number of preselected projects to fund that are placed in our project accelerator for Catalysts to mentor and Key Information Services to provide additional resources to. Catalysts serve as program advisory support past senior program or administrative CES personnel. Catalysts have many years of experience with programming and networks across the country. Catalysts are: Dr. Scott Reed, Dr. Fred Schlutt, Dr. Rick Klemme, Dr. Chuck Hibberd, Dr. Jimmy Henning, Dr. Dawn Mellion, Dr. Chuck Ross, and Dr. Dyremple Marsh. ➢ Communication and Marketing: Targeted communication and marketing strategies to ensure resources are available to CES professionals to create a national network of CES involved in a focused effort and provide greater visibility for CES. The Extension Foundation now uses HubSpot as the customer resource management tool and as a platform for communications and email. ➢ NTAE Competitive and Preselected Project Information: These strategies are described in length in this report starting on page 14. ➢ Partnerships for Expansion and Sustainability: Leadership by individual stakeholders is necessary but not sufficient to drive transformational and systemic change. Collective action and collaboration is essential. It is needed among projects themselves, in specific sectors, around specific issues and locations. It is also needed on a cross-sector or multi-stakeholder basis between companies,

governments and organizations like the Cooperative Extension System. Projects expand current partnerships and organizational networks for the CES system by connecting the fellows to various public, private and corporate partners. Extension Key Informant Services Extension provides a menu of “key informant services” designed to accelerate innovative projects. The services and Extension lead staff are: ● Program Design and Educational Technology encourages all projects to share their processes and products via Connect.Extension.org. Professional development is about a learning process for the projects and CES. Fellows share their learning through social media and virtual Professional Development. This is led by Molly Immendorf, WI. ● Digital Publishing and Engagement support for digital learning and instruction used by the project is needed and also for Extension professionals to share the process and learnings which are expected to be shared digitally from each project. Each project is expected to use Connect Extension. This is led by Ashley Griffin , KY and Rose Hayden-Smith, CA. ● Leadership and Leadership Development support and training for adaptation to a digital environment is provided (helping Fellows be leaders in a digital environment) as well as team building for each project is a part of this support system. Leadership learning is embedded in each project. This is led by Karl Bradley, CO. ● epub publishing or Flipping Books of resources and processes used by the project are important for sharing content and processes. This publishing process allows the content and process of the project to be documented and researchable by others to support project expansion and project adoption. This is led by Ashley Griffin, KY. ● Market research, and/or strategic messaging strategies are provided as needed for projects to better understand their audiences and increase participation in their program. Market research, media audits and strategic communications are a part of this accelerating strategy. This is led by Aaron Weibe, NC and Melanie Pugsley, TX. ● Partnership and Development works with fellows and projects by assisting with early partner development for co-creation of ideas and implementation where possible. This effort seeks to develop partners for early stage co-creation and long term support of the project. This is led by Megan Hirschman, MI and Hellina Tadesse, NY. ● Evaluation is embedded in each project to help ensure impact data is gathered about the outcomes of the project itself. Evaluation for understanding growth and development of a project is expected learning of each project. This is led by Ashley Griffin, KY, Marie Ruemenapp, MI and Paulina Velez, OK.

● Grant Reporting and Administrative Support is provided by Tira Adelman, NC and Brenna Kotar, TX.

Advancing Technology for CES

Objective 1. Foster opportunities for innovation by connecting CES personnel with new and innovative technologies that engage a wide array of learners. ● Enhance and upgrade existing functionalities ● Provide customer support, including help-desk staffing, web hosting, training and software licenses. ● Provide infrastructure support for technical and architectural standards. Why is this important? Advancing technology for CES databases and for CES program delivery is critical for CES professionals to have access to newly developed information and to advance on critical issues and educational endeavors. ● Ask Extension is redesigned to replace Ask An Expert. This redesign is built to use artificial intelligence to provide additional power for database searches and the ability to answer and respond to customer questions across the US. Ask Extension is a national initiative that leverages machine learning and artificial intelligence (AI) to pull together data sources from the Extension ecosystem to answer questions directly and accurately and connect to local citizens with their local Extension professionals, products and services. ● Continued bug fixes and maintenance for Ask Extension. Some major features are server performance improvements, improved administration navigation, addition of automated surveys for groups and initial implementation of mindbreeze search. ● Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ○ Continued bug fixes and system maintenance. ● Helpdesk ○ In the specified date range, 458 clients were helped and received an 81% satisfaction rating from thos. 45% of the requests were resolved in our first response and typically responded within 14 hours from the time a request was first submitted.

○ Significant Results:

■ The number of clients helped increased from 339 to 458 in this quarter.

○ Anticipated work for the next reporting period (March 1, 2021 - May 31, 2022): ■ Continue to maintain high quality service to help

desk customers. No other major objectives or goals are needed at this time.

● Search.extension.org - ○ MindBreeze was utilized to build out the custom search engine and provided access. ○ Significant Results: ■ Two NTAE staff with North Carolina State, completed the introductory MindBreeze Connector course. ■ Eduworks implemented a sitemap XML for Ask Extension to allow MindBreeze to efficiently crawl the ~500k pages on the site. ■ The Search tool has been embedded on Ask Extension and we are currently testing it. ○ Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ■ Replace the existing search function on Ask Extension with the MindBreeze instance. ● The Artificial Intelligence work continues with the California Integrated Pest Management. Eduworks is working with California Integrated Pest Management (IPM) to triangulate questions/answers and images used to answer IPM questions, making sure the correct data tags are in place for machine learning. AI efforts are also underway with the University of Georgia Food Preservation NTAE Project. ○ California IPM Chatbot - ■ Updated the QA server for the chatbot (https://qa.chat.ask.eduworks.com/) with backend performance improvements and front-end UI updates: ● The updated Scout avatar is in place. ● More revisions to the chatbot’s dialog responses have been incorporated based on UC IPM feedback. ● The new chatbo search results visual component has been integrated and is ready for review/feedback.

● A temporary URL-replacement script has been put into place so that UC IPM images that are still on the HTTP server can be viewed while Chinh gets a proxy set up to support HTTPS. ( Note there are still some images that are being blocked by browser security occasionally in our data, such as those that are being directed to a UC Davis server. We have also put in a “Missing Image” placeholder that appears when this happens. )

● UC IPM’s feedback on the test set has been integrated into our evaluation cycles. ● Since our last report, we have been through numerous iterations on the backend, represented by the following gains in our performance metrics.

Baseline Metrics for Valid Responses Top 1 result - 33% Top 3 results - 40%

Top 5 results - 44%

Top 10 results - 53%

Recall for NA - 67%

Metrics as of June 22 Top 1 results - 36%

Top 3 results - 63%

Top 5 results - 67%

Top 10 results - 74%

Recall for NA - 79%

● Web Hosting continues to be an important aspect of NTAE/Extension for managing access to content through technology. ○ Hosting 108 websites. Continuing to monitor sites per the new archiving and deletion policy to sunset underperforming and abandoned sites. ○ Significant Results: ■ All applicable sites have been updated to include the proper NIFA attribution footer. Have started the GDPR compliance plugin deployment. Have been testing the Google Analytics 4 (GA4) in anticipation of Universal Analytics (UA) which will stop processing data on July 1, 2023. ○ Anticipated work for the next reporting period (June 1, 202 - August 31, 2022): ■ Review test sites which are currently running UA and GA4 concurrently to ensure continuity of data reports.

Learning and Networking Platform for CES

Why are these important? A co-learning environment is needed for CES to be a system response for national issues that make impact at the local level.. Networking, sharing information through educational offerings (webinars, blog posts) and learning in groups of similar interest advance the development of content, curriculum and processes for CES to utilize across the nation. ● Connect Extension is a co-learning environment that adapts existing Extension technology to expand professional development opportunities to all Land Grant Universities, NTAE partners, and their constituents. Connect Extension was implemented in Year One and is powered by a commercial tool called Crowdstack. The main features include the Learn Calendar for Cooperative Extension to advertise online events to the public, a blog for amplifying the reach of Cooperative Extension professionals, and subgroups (NTAE project groups) for Cooperative Extension to collaborate internally. In the 1st quarter of year 3 new subgroups were created for Broadband Access and Digital Literacy, Tourism/Recreation/Hospitality. Additionally, the creation of a new Publication database for NTAE Projects within Connect Extension. ○ During this quarter Connect Extension crossed 5000 active accounts ○ NUEL subgroup was developed in Connect Extension and has amassed approximately 700 subscribers. ○ Significant Results: ■ 185K users ■ 227K sessions ■ 86 events advertised ■ Weekly Digest - 50,483 emailed delivered with a 31% open rate, 3.71% click rate, 12.33% click-through rate, and a 0.11% unsubscribe rate. ■ 404 new individuals added to the Weekly Digest ○ Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ■ Development of the Diabetes Prevention Team subgroup in Connect Extension ● National Registry: ○ There were no major updates or improvements to the national registry during the third quarter.

○ Significant Results:

■ 208 submissions total ■ 683 unique users accessed the registry in this reporting period

○ Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ■ Workforce Development questions to add ■ Implementation of approval flows in the registry for evidence-based programs, and for others interest in some controls for specific program areas (e.g. DEI Promising Programs) ● Social Media Presence: ○ ExF communication channels include a large social media presence. Here is social media data from March 1, 2022 through May 31, 2022:

Social Media

Audience Published Posts

Interactions Clicks

Impressions

Facebook 3408

142

5220

Twitter

2326

286

LinkedI

1546

195 253

100

3980

Sessions total: 10,754

● Additional exploratory work underway: ○ Established health.extension.org and pats.extension.org to serve as a landing page for ECOP PATs, and beginning work on individual PAT websites. ○ Completed subgroup and website for nuel.extension.org. 700 new subscribers. ○ Partnering with ASRED on the development of a subgroup and website to replace their existing website.

NTAE Competitive and NIFA Preselected Projects

Why are these important? NIFA funding allows various types of projects to be developed through teams to serve important local and national issues across the country. Projects are led by Fellows who are lead educational efforts regarding the issue. Fellows demonstrate enhanced leadership and advanced project efforts to develop content, curriculum, delivery methods, partnerships and learn about additional methods to understand audiences. They fine tune their marketing strategies extends the use of federal dollars applied to projects related to USDA and ECOP priorities brought to local issues. This leads to increased impacts of CES efforts across the country. These combined objectives and efforts represent the acceleration of NTAE projects. Projects may use some or all of the NTAE funded resources to accelerate their project. NTAE Projects include a total of 20 competitive projects that went through an application selection phase, and projects preselected by NIFA. Research and Extension Catalysts mobilize talent among networks within Extension and from private and public sector partners. The Catalysts consulted with Land Grant Institutions and their networks to identify topics related to the Strategic Goals, and located resources that address each topic to encourage applications for the competitive NTAE projects. Project teams submitted a nomination form, the application was reviewed by a team of outside scorers through the use of a rubric and once applications were selected by the outside team for the NTAE Project, the Catalysts provided insight as to project readiness. Year 3 Catalysts include: Dr. Scott Reed, Dr. Fred Schlutt, Dr. Rick Klemme, Dr. Chuck Ross, Dr. Dyremple Marsh, Dr. Jimmy Henning, Dr. Dawn Mellion and Dr. Chuck Hibberd. Catalysts assisted with the following:

1) Identifying topics for publishing. 2) Refining unique value statements and project roadmaps for project implementation

3) Providing support for expanding project networks 4) Providing input for selected Fellows for each topic 5) Working with Key Informants and projects:

Identifying key partners and building relationships with projects Conducting surveys and working with the evaluation of projects Advising the Audience Engagement Initiative and projects timing Connecting team building and leadership building strategies with teams Seeking to embed evaluation into projects

Assisting with connecting with digital engagement and professional development strategies with project teams.

Selected projects work with the Extension Foundation “Key Informant Services” to enhance, expand, and accelerate the projects. Extension Foundation Key Informant Services include the following: ❏ Program Design and Educational Technology encourages projects to share their processes and products via Connect.Extension.org. Professional development is about a learning process for the projects and CES where Fellows work through digital and online methods to network and share their newly developed content and processes. If a team’s project calls for producing events such as a conference, we can also help with objective and agenda creation. If a team’s project is developing a curriculum (especially an online curriculum), we can also consult on adult learning theory and instructional design. ❏ Molly Immendorf, WI serves as lead. ❏ Digital Engagement and Publishing support for digital learning and instruction used by the project is needed and also for Extension professionals to share the process and learnings which are expected to be shared digitally from each project. Each project is expected to use Connect Extension. The Digital Engagement KI service helps teams use technology tools and strategies to engage, inform, deepen learning, and increase connections. Specific advice around successful ways to engage peers virtually may include developing engagement objectives and outcomes and then matching educational technology tools and techniques to achieve those outcomes. Example tools include Connect Extension Virtual Chats, using Zoom tools effectively, and using third-party engagement tools (Mentimeter, Quizizz, Google Suite, Mural, etc.) ❏ Ashley Griffin, KY; Rose Hayden-Smith, CA; and Heather Martin serve as leads. ❏ Leadership and Leadership Development support and training for adaptation to a digital environment is provided (helping Fellows be leaders in a digital environment) as well as team building for each project is a part of this support system. Leadership learning and team building are embedded in many of the NTAE projects. ❏ Helps combine the ability of self-awareness with social awareness to think and act strategically. ❏ Supports a healthy environment as it relates to interactions between individuals and teams inside the system in which they operate. ❏ Assists individuals and teams with challenging environments defined by volatility, uncertainty, complexity and ambiguity. Develop agility for continuous observation, learning and adjusting. ❏ Balances experiential learning includes but is not limited to: ❏ Connection to purpose

❏ Relating experiences in dialogue and reflection to elevate levels of thinking ❏ Work on values/beliefs to support authentic behavior change ❏ Leadership as a relationship ❏ Positive transformation with sustainable changes in attitudes, behaviors & performance should be the minimum expectation ❏ This is led by Karl Bradley, CO. ❏ Flipping Book/s or epub publishing of resources and processes used by the project are important for sharing content and processes. This publishing process allows the content and process of the project to be documented and researchable by others to support project expansion and project adoption. In year 3, publishing Key Informants, alongside team Catalysts, will identify Published NTAE projects from the recent past can be found on the Extension Foundation Bookshelf. This bookshelf is evolving so updates will be expected. All publications that make the bookshelf have been peer reviewed. Details in regard to contributor rights for author contributions are summarized from the foundation Terms of Use. A summary for Catalyst convenience and talking points has been compiled in the Extension Foundation Publication Contributor Terms of Use. ❏ This is led by Ashley Griffin, KY. ❏ Market research, and/or strategic messaging strategies are provided as needed for projects to better understand their audiences and increase participation in their program. Market research, media audits and strategic communications are a part of this accelerating strategy. The marketing and communication Key Informant service works with projects to identify strategies for better connecting with your target audiences, assessing digital presence, assististing with creative projects, and helping equip teams with skills and tools needed for successful audience engagement and marketing and communication campaigns. ❏ This is led by Aaron Weibe, NC and Melanie Pugsley, TX. ❏ Partnership and Development Partnership and Development works with fellows and projects by assisting with early partner development for co-creation of ideas and implementation where possible. This effort seeks to develop partners for early stage co-creation and long term support of the project. Projects develop case statements during the year to be ready for partnership development beyond the NTAE Project year. Partnership and development strategies help strengthen teams effectiveness for fostering new partnerships and innovations ❏ Prepares teams to engage with key organizations, and successfully cultivate new funding opportunities. ❏ Empowers NTAE Teams to develop new program possibilities, new funding and new partnerships ❏ Identifies and shares funding opportunities through grant resources

❏ Elevates projects at the national level through internal (to CES) and external organizational collaborations. ❏ This is led by Megan Hirschman, MI and Hellina Tadesse, NY. ❏ Evaluation and Evidence Based Programming is embedded in each project to help ensure impact data is gathered about the outcomes of the project itself. Evaluation for understanding growth and development of a project is expected learning of each project. NTAE Team projects/programs that are demonstrating Evidence-based Programming (EBP) to be shared with CES through an ePub publication. Publishing will also consider how integration of digital engagement strategies can enhance these publications, and to incorporate any digital content/assets created through work with the Marketing and Communications and Program Design and Educational Technology. A systematic approach guided the evaluation support for year 3 that began with each team’s Impacts Worksheet submitted during application. From a team’s initial worksheet, in combination with catalysts input and project evolution with Key Informants, the Impacts Worksheet will be updated to guide project evaluation. ❏ Support is provided to each team in developing their evaluation methods and instruments with input from evaluation specialists used as reviewers (ie: peer reviewers) to hone these methods and instruments for implementation. Key Informants work with teams in evaluation and bring in assistance and reviewers as needed, based on speciality, to fine tune instruments and methods for collection. The process of pairing teams with evaluation specialists with appropriate expertise may be expanded whereby assignments to specific teams may occur based on evaluation needs. ❏ This is led by Ashley Griffin, KY, Marie Ruemenapp, MI and Paulina Velez, OK. ❏ Grant Reporting and Administrative Support is provided by Tira Adelman, NC and Brenna Kotar, TX.

An Extension Implementation Toolkit for the Diabetes Prevention Program

Fellow: Vanessa Da Silva, University of Arizona Roadmap

Fellow Report: Meetings:

● 3/8 - Monthly check-in ● 3/10 - Sent draft 1-pagers to Chuck, Rick, Rose and Hellina ● 3/11 - Team meeting to go over website toolkit ● 3/15 - Meeting with CDC folks ● 4/7 - Vanessa, and Rick met with personnel from the University of California CalFresh program to learn about their DPP. Turns out they don’t do DPP. ● 4/11 - Team meeting, discussed presentation at NHOC ● 4/12 - Monthly catalysts meeting ● 4/26 - Team meeting, discussed presentation at NHOC ● 5/3 - NTAE Expansion Project workshop 1 - Vanessa, Carlin, Ali, Soghra and Jennifer attended ● 5/9 - Team meeting ● 5/10 - Monthly catalysts meeting ● 5/24 - NTAE Expansion Project workshop 2 - Vanessa and Ali attended

NHOC session on Friday, May 6th NEAFCS webinar proposal accepted

This quarter, the team got a working version of their Toolkit up and running. ExF helped us create a Connect Extension subgroup for Diabetes Prevention. Additional conversations with Roger Rennekamp, the ExF Partnership Team and the CDC about potential opportunities for the Extension Foundation to support DPP implementation by providing billing/reimbursement assistance. The Team presented at the National Health Outreach Conference (NHOC) and got feedback on the Toolkit. They realized they needed to better understand facilitators and barriers to implementing the DPP in different Extension organizations, and decided to pursue a NTAE Year 4 Expansion project. Experience(s) working with your Catalysts and Key Informants: Rick and Chuck have been great. They are responsive and readily available, and their perspective as former Extension administrators enriches our discussions. It is very helpful to have the perspective of Extension professionals who are not as familiar with the Diabetes Prevention Program, and whose objectivity helps clarify our goals.

The key informants have been wonderful to work with as well.

Does your project work with veterans or veteran farmers? No Does your project work with diverse, under-served, and underrepresented audiences? Yes Please explain briefly how your project works with these audiences. Our project aims to increase access to diabetes prevention programs, particularly underserved communities who are disproportionately affected by diabetes.

Significant Results:

● One pager developed ● We have a first draft of our Toolkit! ● Presentation at NHOC. Session as NHOC allowed us to get feedback on the Toolkit ● Subgroup on Connect Extension created Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Submit NTAE expansion project proposal ● Improve on working version of the Toolkit ● Add resources to our Connect Extension subgroup ● Continue conversations about how to engage Extension leadership and increase support for the DPP in their states. ● Present informational webinar through NEAFCS in August ● Work with Roger and Kerry to explore idea of financial sustainability for DPP through reimbursement and/or direct funding from CDC for Extension ● Meet with the Junto team to learn how they engaged Extension professionals and got buy in for their program.

Key Informant Services Reports:

Digital Publishing and Engagement The publishing team has interviewed the fellows/team (in two groups) and completed a draft publication. Significant Results: ● Using writing prompts we interviewed the team and created a draft publication. Team members have started editing the draft document. ● Reviewed and provided input on website outline/drafted content.

Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Review and revise the draft publication if the team still has this as a goal. ● Complete peer review and publishing process. Marketing and Communications We established a subgroup in Connect Extension for this team and can be found here. No content has been added yet.

The team has also developed a brand new website with support from North Carolina State, Ben MacNeil here.

Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Work with the group on getting their subgroup updated with content, invite individuals to the subgroup, and provide training on how to administer a subgroup in Connect Extension. Partnership and Development The Partnership and Development team connected the Diabetes Prevention Program(DPP) team with the Center for Disease Control and Prevention(CDC) and worked with the DPP team on drafting and editing a one-page case statement for digital use. Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Continue conversations with CDC and start working with the new Extension Health Program Action Team(PAT) Fellow

UNH Engagement Hub Fellow: Cathy Leach, University of New Hampshire Roadmap

Fellow Report: ● Project Team, primarily Project Lead, Pam Doherty, has continued consistent communication, collaboration and support with the HUB vendor including:

○ Acting as liaison between the vendor and UNH IT and other staff to ensure APIs with UNH master calendar, Destiny One registration system and Salesforce are implemented. ○ Developing numerous demos of HUB for smaller and larger UNH audiences, providing input on how these can be more successful. ○ Weekly check in meetings to review progress on front and back-end design ○ Team worked further on persona development, as well as potential hub categories, subcategories, and filters. ● Extension Foundation KI Aaron Weibe secured a marketing research firm, EG Integrated & Wiese Research to provide numerous services, including: ○ Assist in persona development ○ Conduct market research to create key messaging and marketing strategies ○ Create an overall HUB marketing strategy ○ Provide best practices from lessons learned from similar higher education and other organizations that have overcome similar challenges. ● The UNH team is extremely grateful for this marketing research. Through May 31, the UNH team worked with Aaron and other firms to review and provide input to the initial proposal and scope of services. The final contract was agreed upon in early Mary. ● The UNH team continued to work with EGI/Wiese to develop a phone survey to be conducted with 400 NH residents. This includes a couple initial revisions. ● UNH team created a case statement draft at the urging of the EF team, specifically KI Hellina Tadesse, who provided input for the document, it's used and consideration of the needs of various audiences and how the cast statement can be adapted to meet those needs. ● UNH Team members Pam Doherty and Cathy Leach, at the urging of our Catalysts Dyreymple Marsh, completed the team health survey and met with Karl Bradley regarding leadership and team development. Three one-hour workshops were agreed to be the most applicable for the UNH project team: Busy is a Choice, Strategic Planning and Teamwork. UNH team to consider team member involvement, likely broadening it out from our smaller core group. ● EF Publishing and Digital Engagement team, Rose Hayden-Smith, and Heather Martin,

met with the UNH team to discuss creating a digital presence outlining the HUB project and lessons learned, such as a Flipping Book. The UNH team is excited about the prospect of creating such a document. Workload of UNH team members during this reporting period time frame prohibited them from contributing to this work. ● Cathy Leach attended all NTAE Year 4 grant introduction and workshops and began work on the UNH Engagement Hub Year 4 NTAE grant proposal. Experience(s) working with your Catalysts and Key Informants: We have had so much great support from our catalysts and key informants that we are very grateful for! The KI support is outlined in question one. Our catalysts, Dyremple Marsh and Scott Reed, along with Tira Adelman, provide unwavering support. They exude excitement about our project, provide ‘right on’ observations, encourage us to utilize the EF services, as well as to push ourselves to think more broadly about the project impact. Much of the progress accomplished are items we never would have considered, or potentially would not have seen to fruition. Our catalysts, Tira, and all KIs have truly made this happen. The key informants have been wonderful to work with as well.

Does your project work with veterans or veteran farmers? Yes

Please explain briefly how your project works with veterans or veteran farmers. UNH offers programming and support for Veterans through its veteran's affairs office. These offerings will be part of a future Hub implementation iteration.

Does your project work with diverse, under-served, and underrepresented audiences? Yes

Please explain briefly how your project works with these audiences. UNH is committed to its work with these audiences. In this project, our initial hub implementation will include programs for UNH Extension 4-H and adult audiences, as well as non-Extension youth programming that includes these audiences, particularly Educational Talent Search, Upward Bound, and others. Lastly, faculty and staff engage in numerous outreach to educators and students in school districts from underrepresented communities in the State, particularly those in rural communities. It is the goal that all these activities will be included in the Engagement Hub to raise awareness and create higher collaboration and participation.

Significant Results: ● Engagement HUB initial front-end demos were presented to the UNH K-12 Engagement Implementation Core Team, and the HUB Implementation Team. Feedback was encouraging, and helpful input/questions were received. The smaller grant team felt this generated more excitement about the HUB and began to pique interest more fully. Members of both teams will be requested to be beta testers when that state is reached. ● Although outcomes are not yet available, the EGI/Wiese phone survey market research will provide key data on State resident current awareness and perceptions of UNH youth and professional development programs. Additionally, the data will include observations and opinions about Engagement Hub development and potential usage from key audiences. ● As stated above, the UNH team, with constant support from our Catalysts and Key Informants, have created a case statement, provided input on the marketing research proposal and phone survey, received information and began work on a digital process document and team development. Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● UNH team will continue working with HUB the vendor for “real-data” demo and implementation. ● Undergo HUB beta testing internally and conduct further testing with external audiences. ● Work with EGI/Wiese through phone surveys and final outcomes reports. UNH team to

develop plan for implementation of marketing strategy recommendations. ● Explore publishing and leadership development options more fully.

Key Informant Services Reports:

Leadership and Leadership Development Met with the project Fellow to discuss options for team development sessions and priorities for the next steps. Digital Publishing and Engagement The Fellow/team has met with the publishing/DE team and catalysts to share information about the project, what the Fellow/team hopes to accomplish with publishing/DE, and explore publishing/DE possibilities. Discussed writing support and DE services.

Significant Results:

● The publishing team has taken the lead on ghostwriting a thematic publication exploring the work of three NTAE projects that are creating hubs as part of their work.

Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Complete draft publication, and put out for team and peer review

● Format for EF library ● Create registry entries ● Produce a marketing announcement

Partnership and Development Partnership and Development team worked with the UNH team on their draft one page case statement, to be shared with Senior Leadership at their university and beyond. Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Continue working on the one-page case statement and explore partnership and funding opportunities.

Oklahoma Master Irrigator Program Fellow: Sumit Sharma, Oklahoma State University Roadmap

Fellow Report: A publication was produced on the Master Irrigator Program during this period with help of Heather Martin. An evaluation report on the program has been written during this period, and it is being finalized. The next program's advisory panel was scheduled with a meeting on June 9. Experience(s) working with your Catalysts and Key Informants: During this period, we had a meeting regarding publication with the team. The team also started to reach out to other states for forming a national/regional irrigation extension network.They are working with Paulina on an evaluation report of the program and have also worked with Heather and Rose with production of a publication on our program. Both were very helpful and our team achieved our goals on evaluation reporting and publication. Significant Results: ● The participants of our program have shown interest in post program services, especially well audits and irrigation uniformity tests. We have started providing post program services to the participants of the program. So far three producers have benefited from these services. ● The next round of well audits will be conducted during the fourth week of June depending on the availability of producers and our team. Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Host panel advisory meetings. ● Finalize curriculum for next master irrigators program. ● Finalize the dates for the program. ● Have marketing materials ready for the program. Key Informant Services Reports: Program Design and Educational Technology Had an initial meeting with the team to discuss the curriculum development process including identifying audience and learning objectives. Shared adult learning considerations.

Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Continued consultation for curriculum development

Digital Publishing and Engagement The publication process has been completed. The publication is available here.

Significant Results: ● Publication completed via ghostwriting services. ● Publication peer-reviewed and edited ● Publication formatted and put in EF library, put in the national registry, and publicized via marketing blurb. Partnership and Development The Partnership and Development team discussed and started working with the Oklahoma Master Irrigator Program Fellow on drafting a one-page case statement. Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): ● Continue edits for one-page case statement in time for Fellow's upcoming speaking engagements and explore partnership and funding opportunities.

Evaluation The Evaluation KIs worked closely with the Fellow and the publishing KIs to report outcomes from the last two years of programming for their Extension Foundation publication.

New American Farmer

Fellow: Jeff Young, University of Kentucky Roadmap

Fellow Report: The Fellow hired two post docs to complete the inventory this summer. Further follow-ups will occur in June - August.

Project Demeter

Fellow: Andrew “Drew” Carson, University of the District of Columbia Roadmap

Fellow Report: From Beverly Coberly, PI. Andrew Carson had to withdraw from this project due to a job change. Bill Hare is picking up the project and will work with PI on revised deliverables.

Remote Online Initiative

Fellow: Paul Hill, Utah State University Roadmap

Fellow Report: Nearly all of my project deliverables were completed this quarter: 1. Affiliate onboarding plan 2. Affiliate Adoption workflow 3. Affiliate Journey Map 4. Affiliate program introductory presentation outline and slides 5. Case statement

The Affiliate program introductory presentation outline and slides will be used for a national webinar panel discussion being hosted with Aaron Weibe on July 27th at 2 pm eastern.

In addition to the goal to recruit 10 affiliates, this project started with 4 approved affiliates and have on-boarded another 4 through the time period of this NTAE funding and is in the process of onboarding 3 more LGUs, (Kentucky, Idaho, and North Carolina.) Here are a list of all the approved affiliates of the ROI program: 1. Montana State University Extension 2. Iowa State University Extension 3. Washington State University Extension

4. Purdue University Extension 5. North Dakota State Extension 6. South Dakota State Extension 7. Kansas State University Extension 8. Soloworks - New Mexico

With respect to my leadership development, I have met with Karl Bradley 3 times and he has provided my team and I with 2 workshops related to the alignment of our core values and teamwork. We have another training coming up in June and we are in the process of collecting data on our third team health survey.

Updated website with case statement Edited report authored by Heather Martin Affiliate Journey Map Affiliate Program Adoption Workflow

Case Statement Presentation outline in process

Experience(s) working with your Catalysts and Key Informants: It has been wonderful, they have been very supportive.

Does your project work with veterans or veteran farmers? Yes

Please explain briefly how your project works with veterans or veteran farmers. The ROI program is open to all people who want to learn remote work skills and how to find remote job opportunities. The ROI program has had participants who are veterans and farmers.

Does your project work with diverse, under-served, and underrepresented audiences? Yes

Please explain briefly how your project works with these audiences. The ROI program teaches remote work skills and provides career counseling support to people in rural areas, including those in tribal communities.

Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022) ● The next big project will be finishing the Affiliate program introductory presentation outline and slides for a national webinar panel discussion I am hosting with the help of Key Informant, Aaron Weibe, on July 27th at 2 pm eastern. ● All of this work thus far has been building to this moment where the Fellow will pitch the ROI Affiliate program to a national audience. To this point, recruitment has just been through word of mouth. For driving participation in this webinar, I am relying heavily upon the email list of economic/workforce/business development Extension professionals that Aaron Weibe has curated.

Key Informant Services Reports:

Program Design and Educational Technology Scheduled a webinar during the new series Program Center Stage in August 2022.

Anticipated work for the next reporting period (June 1, 2022 - August 31, 2022): Prep and delivery of Program Center Stage webinar

Leadership and Leadership Development Met with the project Fellow three times and delivered two sessions on personal core values and “Busy is a Choice.” Significant Results: ● Increased understanding of self and others on the team during the personal core values discovery. ● Helped team collaboration through the discovery of the secret to concentration is elimination. Anticipated Work for Next Reporting Period (June 1, 2022 - August 31, 2022): ● Have additional meetings on the schedule for the next quarter. ● Will determine session topics based on team health survey results .

Digital Publishing and Engagement The publication process has been completed. The publication is available here.

Significant Results: ● Publication completed via ghostwriting services. ● Publication peer-reviewed and edited ● Publication formatted and put in EF library, put in the national registry, and publicized via marketing blurb. Anticipated Work for Next Reporting Period (June 1, 2022 - August 31, 2022): ● Online presence/social media planning and training for the Fellow has been offered and accepted. This will occur in quarter 4. Marketing and Communications Coordinated marketing requirements and targeting segments for August webinar with Fellow Paul Hill.

Anticipated Work for Next Reporting Period (June 1, 2022 - August 31, 2022): ● Market August webinar internal to Cooperative Extension.

Partnership and Development The Partnership and Development team suggested edits to the 1-2 page case statement and the p&d team spoke with NECI regarding the ROI fellow potentially participating as a guest speaker for a future NECI Professional Development meeting.

Anticipated Work for Next Reporting Period (June 1, 2022 - August 31, 2022): ● Discuss potential partnership and funding opportunities.

Evaluation The evaluations KIs worked closely with the publishing KIs to help report outcomes and impacts of the program for their Extension Foundation publication.

Significant Results:

● Project results can be found here.

Program Evaluation for Farm and Ranch Stress and Suicide Prevention

Fellow: Amy Patillo, University of Missouri Roadmap

Fellow Report: First draft of publication is in progress after meeting with Catalysts and Key Informants the team restructured the paper. After the Farm and Ranch Stress project was selected as Missouri’s showcase Program in the NIFA Annual Report, the Program was selected as a focus project in MU Extension.

The team is creating an infographic and has updated the case statement for additional reporting for stakeholders to demonstrate outcomes and impacts.

Experience(s) working with your Catalysts and Key Informants: Our catalysts team: 1. Quick to help us navigate through the vast amount of data challenges we had because several programs are being delivered at the same time. It seems like a small step; however, it was the most important strategy to move the project ahead quickly. (Mental Health First Aid (Adult, Youth and Teen), Question, Persuade, Refer focusing on suicide prevention, Weather the Storm, Taking Care of You, and Tai Chi.) a. Focusing on a Missouri specific program because we controlled our own data allowed us to move forward quickly. 2. The Catalysts were able to spend time listening and understanding a very complex program that delivered several programs, worked with very large multi-state teams, and had several challenges around access to data and data management. a. We have benefited the most from their mentoring and encouragement. As we knocked out one challenge after the other the catalysts consistently provided suggestions, feedback and guidance that allowed us to quickly solve roadblocks and move the project forward. b. We had clear goals after each monthly meeting and we committed our time to doing more than we planned. c. The Catalysts team understood our challenges, were sympathetic to our needs and encouraged us every step of the way. d. It is rare, if ever at all that our education and program directors cheer for our accomplishments. As our Catalysts, Dawn and Jimmy cheer for us, applaud when we overcome problems, and encourage us to continue the great work. 3. The expertise, experience and knowledge the Catalysts share, allow us to engage with the

Page 1 Page 2 Page 3 Page 4 Page 5 Page 6 Page 7 Page 8 Page 9 Page 10 Page 11 Page 12 Page 13 Page 14 Page 15 Page 16 Page 17 Page 18 Page 19 Page 20 Page 21 Page 22 Page 23 Page 24 Page 25 Page 26 Page 27 Page 28 Page 29 Page 30 Page 31 Page 32 Page 33 Page 34 Page 35 Page 36 Page 37 Page 38 Page 39 Page 40 Page 41 Page 42 Page 43 Page 44 Page 45 Page 46 Page 47 Page 48 Page 49 Page 50 Page 51 Page 52 Page 53 Page 54 Page 55 Page 56 Page 57 Page 58 Page 59 Page 60 Page 61 Page 62 Page 63 Page 64 Page 65 Page 66 Page 67

impact.extension.org