Adult Mobile Crisis Services Pilot Evaluator for DBH

 Part 1: Mission The mission of the Ohio Department of Behavioral Health (DBH) is to provide statewide leadership of a high-quality mental health and substance use prevention, treatment and recovery system that is effective and valued by all Ohioans. DBH strives to be a national leader in implementing a comprehensive, accessible, and quality-focused system behavioral health care and wellness for all Ohio citizens. 1.1 Purpose DBH is seeking proposals from qualified contractors to design and implement a comprehensive, multi-faceted evaluation strategy for the Adult Mobile Crisis Pilot Project. The goal of this evaluation is to generate objective and validated findings that will inform program and service development improvement, assess scalability, and guide policy decisions regarding crisis response services in Ohio.The evaluator is expected to: Measure the extent to which each pilot site achieves its stated goals, deliverables and outcomes using a common set of core measurables with a regular and routine reporting component. Assess the overall design and fidelity of the adult mobile crisis model chosen, including implementation consistency across sites. Collect, analyze, and interpret quantitative and qualitative data submitted by pilot programs. Conduct a return on investment (ROI) assessment, including cost-benefit or cost-effectiveness analyses, to evaluate the economic impact of the pilot programs. Identify systemic, operational, and policy barriers that may impede program effectiveness or limit statewide expansion. Identify cost implications, including cost savings within the community behavioral health system as well as other systems (e.g. hospitals, law enforcement, emergency medical services). Provide actionable recommendations and best practices to inform the future development and potential statewide rollout of adult mobile crisis services.
The evaluation must be rigorous, transparent, and collaborative, ensuring that findings are meaningful to DBH leadership, pilot participants, community providers, members and stakeholders. Ultimately, the evaluation will support Ohio’s efforts to align with national best practices in crisis response and strengthen the state’s behavioral health system.Cost proposals for this project shall not exceed $200,000 for the entire scope of work and deliverables. 1.2 Background DBH oversees the state’s efforts to promote mental health, prevent substance misuse, and support recovery for individuals and families affected by behavioral health challenges. In alignment with national best practices and Ohio’s broader crisis care continuum, DBH is launching the Adult Mobile Crisis Pilot Project to expand access to timely, community-based crisis intervention services for adults aged 21 and over experiencing behavioral health crises.Adult mobile crisis services are a critical component of a modern behavioral health crisis response system. They are designed to provide immediate, person-centered responses in the community, reducing reliance on law enforcement, diverting individuals from emergency departments and inpatient hospitalizations when appropriate, and connecting individuals to ongoing treatment and supports. By intervening early and outside of institutional settings, these services improve outcomes for individuals, enhance public safety, and reduce overall system costs.Nationally, the launch of the 988 Suicide & Crisis Lifeline in July 2022 has accelerated the need for robust crisis care systems capable of providing timely, coordinated responses. The Substance Abuse and Mental Health Services Administration (SAMHSA) has identified mobile crisis services as one of the three pillars of an effective crisis system, along with crisis call centers and crisis stabilization facilities. DBH’ Adult Mobile Crisis Pilot represents a key step toward aligning Ohio’s behavioral health system with these national standards.Given the importance of this initiative, DBH seeks to rigorously evaluate the pilot program to determine its effectiveness, identify opportunities for improvement, and assess the feasibility of scaling mobile crisis services statewide. The evaluation will inform Ohio’s strategy to build a sustainable, integrated crisis response system that is accessible, cost-effective, and responsive to the needs of individuals, families, and communities across the state.Part 2: Scope of Work and Deliverables The selected evaluator will be responsible for carrying out a comprehensive evaluation of the Adult Mobile Crisis Pilot Project in alignment with DBH objectives. The evaluator shall complete the following: 2.1 Deliverables Collaboration and Planning Work with DBH and key stakeholders to refine evaluation goals, methodology, and timelines. Participate in project planning meetings and maintain regular communication with DBH staff.
Process Evaluation Examine the fidelity of model implementation across pilot sites. Document variations in service delivery, staffing models, and community engagement.
Outcome Evaluation Assess short- and intermediate-term outcomes, such as response times, hospital and law enforcement related diversions, and consumer outcomes. Analyze results across pilot sites to identify trends, successes, and areas for improvement.
Return on Investment (ROI) Analysis Conduct cost-benefit and/or cost-effectiveness analysis of the pilot program. Provide clear documentation of methodology, assumptions, and findings.
Data Collection and Reporting Strategy Develop and test a data collection and reporting framework that can be applied to future program expansion. Recommend methods to ensure consistency, accuracy, and sustainability in data reporting.
Barriers and Enablers Assessment Identify systemic, operational, and policy barriers that may affect statewide scaling. Highlight enabling factors and best practices to support broader implementation
Systems Integration Needs Assess statewide systems integration requirements to support the adult mobile crisis model, including interoperability with existing behavioral health, emergency response, and healthcare systems.
Model Integrity Monitoring and Evaluation Provide support to pilot participants. Support pilot participants in ongoing monitoring of their selected model of AMC to assure continuity and consistency withing the RPH region they are serving. Lead pilot participants in continuous improvement activities informed by collected data and DBH feedback. Synthesize evaluation findings into actionable recommendations for program improvement and statewide expansion. Provide guidance on statewide feasibility and strategies for sustainability.
Cost Analysis Perform a cost analysis and comparison of AMC model costs obtained from each AMC Service Pilot site.  This would be completed at the AMC team level for the entire RPH region the pilot site is serving. Include an evaluation, narrative analysis, and AMC Service Pilot site findings analysis in the final report and presentation and include all AMC Service Pilot site submitted cost materials as an attachment to the report.
Final Report Presentation and Overall Evaluation Report Submit a comprehensive final written report that includes all evaluation findings, analyses, and recommendations. Deliver an executive summary suitable for policymakers and stakeholders. Present findings in at least one formal presentation to DBH leadership and other designated stakeholders. A comprehensive final report on the overall AMC pilot to include a summarization of the overall experience and recommendations on how to continue to move forward toward statewide implementation.

  2.2 Functions and Responsibilities The successful applicants will be responsible for carrying out the functions described below as part of their contracted award. Proposals should clearly demonstrate the applicant’s competence and prior experience in providing high-quality program evaluation services.Respondents must demonstrate their ability to: Design and Implement Evaluation FrameworksDevelop appropriate methodologies, tools, and approaches tailored to program goals, objectives, and outcomes. Collect and Analyze DataGather both qualitative and quantitative data from diverse stakeholders, ensuring accuracy, integrity, and compliance with ethical standards. Measure Program EffectivenessAssess program performance against established metrics and benchmarks, identifying strengths, areas for improvement, and opportunities for innovation. Provide Actionable RecommendationsTranslate evaluation findings into clear, practical recommendations that support evidence-based decision-making and program improvement. Produce Reports and DeliverablesPrepare comprehensive evaluation reports, presentations, and other deliverables in a timely manner, ensuring accessibility to a range of audiences including funders, program staff, and community stakeholders. Engage StakeholdersCollaborate with DBH staff, participants, and partners throughout the evaluation process to ensure inclusivity, transparency, and shared understanding of outcomes. Ensure Compliance and ConfidentialityMaintain adherence to applicable regulations, guidelines, and ethical standards, safeguarding the confidentiality of participant data.
2.3 Minimum Qualifications of Contractor In order for a proposal to be considered responsive, the respondent must demonstrate the following credentials and experience: Program Evaluation Experience A minimum of five (5) years of experience in program evaluation, with preference for experience in behavioral health, crisis intervention, or public health. Demonstrated experience conducting both process and outcome evaluations for pilot programs or statewide initiatives. Evidence of prior work engaging stakeholders such as state agencies, community providers, and individuals with lived experience.
Analytical Expertise Documented expertise in return on investment (ROI), cost-benefit, or cost-effectiveness analyses in health or human services programs. Proficiency in quantitative and qualitative research methods, including survey design, data collection, analysis, and reporting.
Organizational Capacity Adequate staffing and organizational resources to complete the scope of work within the required timeframe. Demonstrated ability to manage projects of similar size and complexity.
Past Performance Submission of at least two (2) examples of prior evaluation projects completed within the last five (5) years that are comparable in size and scope. Each example must include a client reference with current contact information (name, title, organization, phone, and email).

  2.4 Ethical and Conflict of Interest Requirements No contractor or individual, company or organization seeking a contract shall promise or give to any DBH employee any item of value that is of such character as to manifest a substantial and improper influence upon the employee with respect to his or her duties.No contractor or individual, company or organization seeking a contract shall solicit any DBH employee to violate any of the conduct requirements for employees.Any contractor acting on behalf of DBH shall refrain from activities that could result in violations of ethics and/or conflicts of interest. Any contractor or potential contractor who violates the requirement and prohibitions defined Section 102.03 or Section 102.04 of the Ohio Revised Code is subject to termination of the contract or refusal by DBH to enter into a contract.