Senior Evaluation and Research Manager

Julianne Manchester, Ph.D., LSSBB

Residence: Fairfax, VA

Email: ********@*****.***

571-***-**** (Cell)

Last update: May 2022

EXPERIENCE HIGHLIGHTS

Senior Research and Evaluation Specialist- National Environmental Health Association (NEHA). 2022-Current.

Lead evaluation planning, needs assessments, logic modeling, survey design, analytic plans and execution for retail food protection grants.

Use collaborative evaluation to lead internal research and evaluation capacity efforts to improve evaluation practice at the organizational level.

Lead Consultant- Ready & Resilient Integration for Suicide Prevention. Army Resilience Directorate (ARD). 2020-2021.

Led needs assessment and survey development for prevention workforce assessments to identify knowledge needs and capabilities.

Led development of data collection tools to support resource development and risk reduction efforts across the Army enterprise.

Led capacity building efforts (provide trainings, create models and frameworks through program stakeholder collaborations) across suicide prevention, employee assistance program, risk reduction program, and substance abuse program.

Senior Methodologist for Program Evaluation and Improvement office (DHA). 2016-2018

Created and wrote evaluation plans for over 200 TBI and psychological health programs using multi-domain, evaluability assessment data.

Conducted internal trainings with contract staff (clinicians, process improvement experts) on evaluation planning, logic modeling, fidelity assessment and stakeholder analysis.

Lead Evaluation SME for Defense and Veterans Brain Injury Center (DHA). 2015-2016

Conducted Lean Six Sigma project with the Traumatic Brain Injury (TBI) Recovery Support Program aimed at linking veterans discharged with traumatic brain injury to community resources.

Project increased rate of on-line survey ordering across 14 case managers, resulting in the program’s ability to demonstrate improvements in neurobehavioral symptoms, lifestyle changes, and other wellness indicators.

Conducted on-line needs assessment for clinical affairs division to query 86 TBI clinic providers on knowledge and training needs around TBI topics (e.g., psychopharmacology, alcohol use, complementary and alternative medicine). Results led to prioritization of clinical recommendations and publication in Military Medicine.

Principal Investigator for National Training and Coordination Collaborative (DHHS-HRSA). 2008-2014

In Level 1 trauma center, evaluated (using descriptive and prediction models) evidence-based practices of health professionals across over 40 clinical settings to improve patient safety through multi-factor falls risk assessments and improve diabetes care.

Developed evaluation capacity building resources, including observational checklists for use with patient charts, logic model templates, and instructional webinars, for health professions grantees.

Created central data repository of clinical provider practices for DHHS-HRSA reporting.

Conducted interviews and analyzed health provider interview findings to demonstrate motivational factors leading to uptake (early to adoption) of program resources.

COMPETENCIES

Program Evaluation (20 yrs)

Program and Project Management (20 yrs)

Quantitative Analysis (20 yrs)

E-Learning Development and Presentation (15 yrs)

Research Planning (14 yrs)

Peer-Review Publications Writing/ Editing (8 yrs)

Process Improvement (Lean Six Sigma) (6 yrs)

Professional and Academic Presentations (19 yrs)

Business and Evaluation Consulting (14 yrs)

Survey/ Instrumentation Development (20 years)

Visual Data/ Graphs/ Charts (19 yrs)

Technical Writing/ Government Reports (14 yrs)

EDUCATION

Ph.D. Quantitative Research, Evaluation and Measurement in Education, The Ohio State University, 2007

M.A. Educational Policy and Leadership, The Ohio State University, 2006

M.A. University of West Florida, Industrial-Organizational Psychology, 2000

B.A. University of West Florida, Psychology, 1998

CERTIFICATIONS

(October, 2018). Lean Six Sigma Black Belt. Earned through Thayer School of Engineering at Dartmouth College. Accreditation: Commission on Institutions of Higher Education (CIHE); New England Association of Schools and Colleges (NEASC).

AWARDS AND RECOGNITIONS

(September, 2020) Booz Allen Hamilton. Silver Award for demonstrating Collective Ingenuity in creating a Developmental Evaluation Plan for Women in Data Science that seeks to further the mission of improving gender parity in data science.

(July, 2019) Booz Allen Hamilton. Silver Award for demonstrating Champion’s Values as a thought leader, proposing and executing Disability Evaluation System (DES) and Defense Suicide Prevention Office (DSPO) innovative client solutions.

(July and December, 2015) General Dynamics Health Solutions. Employee Recognition Certificates of Achievement (2) for evaluating 2015 Brain Injury Awareness Month national activities and 2015 DCoE Psychological Health and TBI Providers Summit.

SUMMARY OF SKILLS, TOOLS, AND TECHNOLOGIES:

Software: SPSS (18 yrs), Excel (21 yrs), NVivo (5 yrs), Tableau (1 yr), Minitab (1 yr), MS Word (21 yrs), Power Point (21 yrs), Survey Monkey (10 yrs), Visio (2 yrs), Publisher (6 yrs)

On-Line Platforms: MS Teams (3 years), Skype (2 yrs), Adobe Connect (2 yrs), Max.gov (DoD-OMB) (1 yr), Interactive Customer Satisfaction (ICE) (DoD) (1 yr), Blackboard (10 yrs)

Operating Systems: PC (23 yrs) and Macintosh (9 yrs) Windows

PEER-REVIEWED PUBLICATIONS

Manchester, J. (2022). Issue Brief 1: Community Resource Teams – Bridging The Gap Between Public Health And Behavioral Health, retrievable from https://saebhc.com/community-resource-teams-bridging-the-gap-between-public-health-and-behavioral-health/.

Manchester, J., Marion, D., & Eschel, I. (2017). The benefits and risks of energy drinks for young adults in the military. Military Medicine, 182.

Manchester, J., Gray-Miceli, D., Metcalf, J., Paolini, C., Coogle, C., & Owens, M. (2014). Facilitating Lewin’s change model with collaborative evaluation in promoting evidence-based practices of health professionals. Evaluation and Program Planning, 47, p. 82-90.

Manchester, J. (2013). Evaluating evidence-based practice behaviors in team contexts. Performance Improvement, 52 (7), p. 24-31.

SUCCESSFUL GRANTS AND CONTRACTS (LEAD AUTHOR)

DHHS-HRSA-BHPr. National Training and Coordination Collaborative (NTACC). Evaluation capacity building contract. September 2012 to September 2014. Total Award: $3,131,532. January 2013 to September 2014 (Principal Investigator at 100% Effort- Julianne Manchester, PhD).

Ohio Commission on Minority Health (OCMH). (Principal Investigator- Julianne Manchester, PhD). Provider and Workforce Outcomes from Expanding the Chronic Disease Self-Management Program in the Metro Health System. Total Award: $12,000. April to August, 2013.

National AHEC Organization. Area Health Education Center Training and Coordination Collaborative (A-TRACC). Evaluation consultation contract. (Principal Investigator- Julia Rose, PhD). Julianne Manchester, PhD, Project Director. Total Award: $20,000. (April 1 – September 30, 2010).

AFFILIATIONS and PROFESSIONAL ACTIVITIES

(2019 to Present). Maryland Writer’s Association (MWA). Member.

(2006 to Present). American Evaluation Association (AEA). Member.

Annual conference abstract reviewer (2015 to Present)

Program Co-Chair: Military and Veterans Topical Interest Group (2016 to 2019)

Program Co-Chair: Community Psychology Topical Interest Group (2013 to 2015)

(February 2019). DHHS-Health Resources and Services Administration (HRSA), Primary Care Training and Enhancement- Physician Assistant Program, Proposal Reviewer for five-year grants.

(May 2014). National and Community Service/ Social Innovation Fund. Proposal reviewer for five-year cooperative agreements.

(2008-2012). Ohio Program Evaluator’s Group (OPEG). Board of Trustees Member

CAREER DETAILS

National Environmental Health Association (NEHA)

Senior Research & Evaluation Specialist 01/2022 to Present

Fairfax, VA (Remote)

Lead research and evaluation efforts for multi-year, NEHA-FDA retail food protection grant, creating and executing evaluation plans, testing instruments (rubrics, interviews) for inter-rater reliability, content validity, needs assessment, SOP development, logic models, data analysis, stakeholder analysis, and objectives planning, using collaborative evaluation principles.

Lead internal research and evaluation team to build evaluation practice across organizational functions (finance, marketing, training, conference planning).

Goldbelt Glacier Health Solutions, Inc., Senior Consultant & Suicide Prevention

SME Management Analyst for Army Resilience Directorate 11/2020 to 01/2022

Alexandria, VA (Remote)

As Lead Consultant and five-person (suicide prevention analyst, employee assistance program SME, technical editor, drug testing management analyst) Team Lead for Army Resilience Directorate (ARD)/ Ready and Resilience Integration, led needs survey development for prevention workforce assessments to identify knowledge needs and capabilities.

Collaborated with online platform assets (Army Strategic Management System; Resource & Performance Reporting) to refine and develop data collection tools (multi-scaled prioritization for prevention topics; multi-factor performance assessments) to support resource development and risk reduction efforts across the Army enterprise.

Led capacity building efforts (provide webinars, create models and frameworks through program stakeholder collaborations) across suicide prevention, employee assistance program, risk reduction program, and substance abuse program.

Contributed heavily to technical writing and reporting to Army Senior Leaders in the form of briefs, info papers, executive summaries, guidebooks, and policies (e.g., Army regulation for suicide prevention).

Booz Allen Hamilton, Inc., Associate 4/2018 – 11/2020

Arlington and Alexandria, VA

As Deputy PM- Quality Management and Evaluation for Disability Evaluation System (DES), OUSD-P&R, built process improvement and evaluation capacity across workstreams (Modeling & Simulation; Quality Assurance Program; Analytics). Created an evaluation model that led to quarterly collection of internal evaluation data from Military Departments, allowing for earlier identification of short term and intermediate outcomes prior to quarterly metrics reporting. Created developmental evaluation plan with logic models and metrics with internal and external Special Compensation for Assistance with Activities of Daily Living (SCAADL) stakeholders.

As Senior Program Evaluator, developed evaluation plans, logic models and assessments in support of Defense Suicide Prevention Office (DSPO), Department of Defense (DoD). Collaborated with other Senior Program Evaluator and suicide content experts for evaluation of processes and outcomes related to education, such as “Counseling on Lethal Means” with Military Family Life consultants and Military OneSource counselors, and social media campaigns. Evaluated reliability and utility of scoring protocol of media articles aligned with World Health Organization guidelines. Created metrics and evaluation plans for multi-site evaluation of research portfolio. Contributed to technical reports, manuscripts, presentations and organizational thought pieces. As Evaluation SME Consultant, provided evaluation framework recommendations, annotated bibliographies and program management planning around site visits and data calls to build capacity of military service academies through Sexual Assault Prevention and Response Office (SAPRO), Department of Defense (DoD).

As Project Manager, led the Implementation Science Support contract, Psychological Health Centers of Excellence (PHCoE), Research and Development (J9), Defense Health Agency.

Managed tasking for professional team of psychologists, analysts (health, data, cost) and deliverables support (graphics).

Led completion of project deliverables, establishing timelines for milestones and final products, communicating tasks and timelines with Government POCs and team members, facilitating completion of process steps, and approving final deliverables submitted to Government leads.

Liaison between team members and Government action officer (AO), contracting officer’s representative (COR), section chief and deputy director (PHCoE).

Firm Intellectual Capital and Sponsored-Volunteer Activities

05/2020 to 11/2020. Lead Program Evaluator, Women in Data Science, Booz Allen professional group under Strategic Innovation Group (SIG) leadership. Creating and writing evaluation plan with logic models, stakeholder-based evaluation questions across program pillars, and data analytic plans to demonstrate near term outcomes and mark progress toward strategic goals and objectives.

10/2019. Manchester, J. “Evaluation Foundations.” DES Support contract internal Brown Bag presentation. Crystal City.

01/2019 to 04/2019. Co-lead on Booz Allen-sponsored, Lean Six Sigma Black Belt project to improve triage processes at Mary’s Center clinical locations, Silver Spring, MD. Volunteer hours.

11/2018 to 3/2019. Strategic investment “Redesigning Military Readiness: The Human Dimension” within the Global Defense Group (GDG). Lead white paper author to illustrated advanced, readiness analytic platforms predicting lethality and resiliency with Department of Defense clients.

01/2019 to 02/2019. Capture SME and Writer- Defense Health Agency (DHA), Strategy, Plans and Functional Integration Directorate (J-5) “Evaluation and Improvement Capability Support (EICS) Services.” Lead evaluation consultant on strategizing approaches to tasks in capture effort on military health evaluations.

11/2018 to 03/2019. Workstream lead on Knowledge Management (KM) Working Group to collect, analyze and present quantitative and qualitative data from leaders in Health sub-accounts to map and standardize KM processes.

10/2018. Manchester, J. & Axelrad, S. “Building Collaborative Evaluations from Stakeholder Analysis”. Military Health Brown Bag series presentation. Fairview Park Booz Allen office.

Engility Corporation (currently SAIC), Senior Methodologist 11/2016 – 4/2018

Remote

As Senior Methodologist for Program Evaluation Enhancement Support Services contract, Strategy, Plans and Functional Integration (J5), Defense Health Agency (DHA), guided education and consultation efforts with psychological health and traumatic brain injury programs.

Collaborated across work streams to develop tools and resources to build evaluation capacity of military health programs.

Created evaluation protocols in areas of care coordination, treatment, provider training, community outreach and outcomes (resiliency, stigma reduction, care access, reporting, functional status, return to duty, etc.)

Created coding scheme and statistically analyzed qualitative evaluability assessment from over 200 military health system programs.

General Dynamics Health Solutions, Principal Statistician and Senior Evaluation SME 1/2015 - 11/2016

Silver Spring, MD

Led program evaluation (PE) initiatives for Defense and Veteran’s Brain Injury Center (DVBIC) divisions (clinical affairs, education, research, and Chief of Staff office) within Defense Health Agency (DHA). These included piloting of evaluation and process improvement templates for use with DVBIC stakeholders to build capacity. Co-led PE office operations with continuous process improvement (CPI) lead and government (DoD) lead.

Conducted Lean Six Sigma project with Recovery Support Program aimed at linking veterans discharged with traumatic brain injury to community resources. Applied Define, Measure, Analyze, Improve and Control phases to increase the rate of survey ordering according to predefined time intervals across 14 case managers.

Evaluated 2015 and 2016 Brain Injury Awareness Month educational and outreach events on awareness, knowledge, and intention to use information across 16 Regional Educational Centers.

Evaluated Hybrid (On-Line and In-Person Attendees) Psychological Health and Traumatic Brain Injury Professional Summit for Providers (Defense Centers of Excellence)- September 2015 and 2016.

Created capacity building resources with DVBIC stakeholders, including: one-on-one consultations, monthly internal trainings on evaluation and process improvement topics, facilitation of evaluation projects, completion of program evaluations on DVBIC products, services, and programs.

Conducted needs assessment (created scales and instrument, deployed survey, collected and analyzed responses) with providers in traumatic brain injury clinics to prioritize and rank needed resources based on frequency of patient issues (e.g., substance use, headache management) in support of developing clinical recommendations.

Case Western Reserve University (CWRU), Principal Investigator/ 2/2008 - 9/2014

Senior Research Associate. Cleveland, OH

Led evaluation capacity building initiative for 45 Geriatric Education Centers (GECs) funded through DHHS-HRSA-BHPr.

Architect of various evaluation resources (e.g., webinars, methods and measures workgroup sessions). Consulted with GECs in targeting evaluation assets and opportunities for improving methods and measures.

Advised GECs on longitudinal data analysis with secondary data sets, evaluation planning, instrumentation development, and fidelity assessment.

Managed and executed multi-site evaluation of GEC grantee data. Wrote evaluation plans, developed on-line reporting with informatics vendor, collected quantitative and qualitative data (two years), conducted focus groups with health professionals, and analyzed data (descriptive and logistic regression).

Approved work of vendors and subcontractors, including the refinement of electronic data management systems in response to federal performance measures, website updates and evaluation data (evidence-based practice) entry prompts to facilitate data reporting from GECs to HRSA.

Developed reliable, on-line data collection mechanism to demonstrate longitudinal, capacity building outcomes with GECs. Evaluated quantitative practice outcomes using discrepancy analysis.

Created and implemented five pre-conference institutes (4-hour sessions) and three workshops at two academic conferences per year. Developed and presented content for health professions audiences, outlined breadth of topics, recruited presenters and panelists.

Supervised work of program coordinator. Advised medical student on research section of master’s thesis related to Veteran’s Administration cancer study.

FREELANCE PROJECTS

SAE Behavioral Health Consulting, Senior Evaluation Consult- Agency Operations 8/2022 - Present

Remote

Build evaluation capacity with Certified Community Behavioral Health Clinics receiving Substance Abuse and Mental Health Services Administration (SAMHSA) grants. Conduct learning collaboratives with grantees on the use of data for process improvement and evaluation, write and publish issue briefs, contribute writing, editing, content development for SAE publications.

Healthmonix, Inc. Freelance Evaluator 9/2015 – 10/2017

Remote

Created and executed methodology for inter-rater reliability psychometrics (Cohen's Kappa) on variables to extract dermatology and pulmonary rehabilitation measures for American Academy of Dermatology and American Thoracic Society. Prepared reports and presented results to professional association representatives.

Public Health- Dayton & Montgomery County, Independent Consultant 6/2011-6/2018

Remote

Created and executed evaluation plans with public health department to guide methods and measures in meeting objectives of Ohio Commission on Minority Health and Centers for Disease Control- CTG grants.

Developed instrumentation for assessing initial and intermediate outcomes of programs. Analyzed primary (educational session surveys) and secondary data (e.g., Ohio Department of Health) to answer guiding evaluation questions.

Through key informant interviews, adapted the National Stakeholder Strategies for Achieving Health Equity into a checklist for completion at the organizational level through agency website. Created on-line assessment for child-care setting initiative to revise center policies on nutrition and physical education.

McGraw-Hill Publishing Company, Freelance Evaluator 12/2006 – 7/2007

Columbus, OH

Wrote and executed evaluation of SRA Snapshots Video Science, now marketed through McGraw-Hill Publishing. Crafted Implementation Module, Evaluation Plan, wrote Evaluation Report, and Marketing Results Brief.

Collected and analyzed quantitative and qualitative classroom data from three participating sites, 3rd, 4th, and 5th grade levels (Florida and Ohio schools). Contributed reliable instrumentation to quasi-experimental evaluation study.

Conducted reliability and validity analysis on Kentucky Math Intervention Program (1st -3rd grade). Interpreted observational student and teacher data for inter-item and inter-rater reliability, and construct validity using Cronbach’s α and principal components analysis.

Supported marketing and sales through developing Open Court Reading (OCR) Marketing Results Brief. Summarized research findings (pre and post-tests, OCR and comparison classes from five school districts).

FACULTY POSITIONS

Cuyahoga Community College, Adjunct Faculty 8/2010 – 3/2015

Cleveland, OH

Taught in-classroom and on-line liberal arts courses. Courses included Introductory Psychology, Lifespan Development, Health Psychology, Educational Technology, Theories of Personality. Developed syllabi, course materials and exams.

University of Phoenix. School of Business, Adjunct Faculty 6/2010 – 9/2014

Remote

Facilitated on-line Quantitative Reasoning in Business (average 20 students per 6-weeks) course for MBA program.

Columbus State Community College, Adjunct Faculty 1/2001 – 12/2008

Columbus, OH.

Taught in-classroom and on-line psychology courses. Courses included Introductory Psychology, Social Psychology, Adolescent Psychology and Human Development. Developed syllabi, course materials and exams.

PROFESSIONAL PRESENTATIONS (NATIONAL and STATE) (previous 10 years)

(2021) Manchester, J. “Getting to Individual and Organizational Resilience Outcomes through Logic Models.” Webinar. US Army, IMCOM, Employee Assistance Program Professional Development Training. Crystal City. VA.

(2019) Manchester, J. “Building Collaborative Evaluations from Stakeholder Analysis”. Webinar. Lunch & Learn series of the Washington Evaluators Group. Washington, DC.

(2018) Manchester, J. & Axelrad, S. “Building Collaborative Evaluations from Stakeholder Analysis”. Paper. Annual Meeting of the American Evaluation Association (AEA). Cleveland, OH.

(2017) Perkins, J. Manchester, J. Best, R., Heffner, C. “Evaluation Capacity Building: Toward Program and Cost Effectiveness in the Military”. Paper. Annual Meeting of the American Evaluation Association (AEA). Washington, DC.

(2017) Heffner, C., Best, R., Manchester, J. Perkins, J. “Improving Program and Cost Effectiveness in Military and Veterans Prevention and Treatment Programs.” Roundtable. Annual Meeting of the American Evaluation Association (AEA). Washington, DC.

(2015) Manchester, J., Taylor-Ritzler, T. Wolfe, S.M. “Addressing Social Justice in Evaluations: Capturing Racism, Sexism, and the Other "isms." Think Tank. Annual Meeting of the American Evaluation Association (AEA). Chicago, IL.

(2015) Manchester, J., Guajardo, A., Vaughn, L. “Considering Context of Community-Based Programs with Underserved Populations”. Paper presentation. Annual Meeting of the American Evaluation Association (AEA). Chicago, IL.

(2014) Manchester, J. “Building Organizational Capacity through the National Partnership for Action Strategies to Address Health Disparities”. Paper. Annual Meeting of the American Evaluation Association (AEA), Denver, CO.

(2013) Weiss, J., Manchester, J., O’Toole, E., Byrd, E., Bartels, S., Cigolle, C. “Evidence-Based Practice and Systems Change: Implications for Community Health”. DHHS-HRSA Technical Assistance Workshop, Pre-Conference Institute. Annual Meeting of the Gerontological Society of America (GSA), New Orleans, LA.

(2013) Weiss, J., Peplinski, K., Manchester, J., Brown, L., & Cabin, W. “Learning to Improve Care: Evidence-Based Practice from GECs, Hospice and Challenges for Preparedness”. Paper. Annual Meeting of the Gerontological Society of America (GSA), New Orleans, LA.

(2012) Manchester, J., Weiss, J. “Strategies for Implementing Evidence-Based Practice (EBP) Continuing Education (CE) Projects in Geriatrics”, DHHS-HRSA Technical Assistance Workshop, Pre-Conference Institute. Annual Meeting of the Gerontological Society of America (GSA), San Diego, CA.

Contact this candidate