| |
1 |
2 |
3 |
4 |
5 |
G1. Program Philosophy. The program is committed to a
clearly articulated philosophy consistent with the specific evidence-based
model, based on the following 5 sources:
? Program leader
? Senior staff (e.g., executive director, psychiatrist)
? Practitioners providing the EBP
? Clients and/or families receiving EBP
? Written materials (e.g., brochures) |
No more than 1 of the 5 sources shows clear understanding of the program
philosophy
OR
All sources have numerous major areas of discrepancy |
2 of the 5 sources show clear understanding of the program philosophy
OR
All sources have several major areas of discrepancy |
3 of the 5 sources show clear understanding of the program philosophy
OR
Sources mostly aligned to program philosophy, but have one major area of
discrepancy |
4 of the 5 sources show clear understanding of the program philosophy
OR
Sources mostly aligned to program philosophy, but have one or two minor
areas of discrepancy |
All 5 sources display a clear understanding and commitment to the program
philosophy for the specific EBP |
| *G2. Eligibility/Client Identification. All clients with
severe mental illness in the community support program, crisis clients,
and institutionalized clients are screened to determine whether they qualify
for the EBP using standardized tools or admission criteria consistent with
the EBP. Also, the agency tracks the number of eligible clients in a systematic
fashion. |
= or < 20% of clients receive standardized screening and/or agency
DOES NOT systematically track eligibility |
21%-40% of clients receive standardized screening and agency systematically
tracks eligibility |
41%-60% of clients receive standardized screening and agency systematically
tracks eligibility |
61%-80% of clients receive standardized screening and agency systematically
tracks eligibility |
>80% of clients receive standardized screening and agency systematically
tracks eligibility |
*G3. Penetration. The maximum number of eligible clients
are served by the EBP, as defined by the ratio:
# clients
receiving EBP
# clients eligible for EBP |
Ratio = or < .20 |
Ratio between .21 and .40 |
Ratio between .41 and .60 |
Ratio between .61 and .80 |
Ratio > .80 |
G4. Assessment. Full standardized assessment of all clients
who receive EBP services. Assessment includes history and treatment of medical/psychiatric/
substance use disorders, current stages of all existing disorders, vocational
history, any existing support network, and evaluation of biopsychosocial
risk factors. |
Assessments are completely absent or completely non-standardized |
Pervasive deficiencies in two of the following:
Standardization,
Quality of assessments, Timeliness, Comprehensive-ness |
Pervasive deficiencies in one of the following:
Standardization,
Quality of assessments, Timeliness, Comprehensive-ness |
61%-80% of clients receive standardized, high quality assessments at least
annually
OR
Information is deficient for one or two assessment domains |
>80% of clients receive standardized, high quality assessments, the
information is comprehensive across all assessment domains, and updated
at least annually |
| G5. Individualized Treatment Plan. For all EBP clients,
there is an explicit, individualized treatment plan related to the EBP that
is consistent with assessment and updated every 3 months. |
= or < 20% of clients served by EBP have an explicit individualized
treatment plan, related to the EBP, updated every 3 mos. |
21%-40% of clients served by EBP have an explicit individualized treatment
plan, related to the EBP, updated every 3 mos. |
41%-60% of clients served by EBP have an explicit individualized treatment
plan, related to the EBP, updated every 3 mos.
OR
Individualized treatment plan is updated every 6 mos. for all clients |
61%-80% of clients served by EBP have an explicit individualized treatment
plan, related to the EBP, updated every 3 mos. |
>80% of clients served by EBP have an explicit individualized treatment
plan related to the EBP, updated every 3 mos. |
| G6. Individualized Treatment. All EBP clients receive
individualized treatment meeting the goals of the EBP. |
= or < 20% of clients served by EBP receive individualized services
meeting the goals of the EBP |
21%-40% of clients served by EBP receive individualized services meeting
the goals of the EBP |
41%-60% of clients served by EBP receive individualized services meeting
the goals of the EBP |
61% - 80% of clients served by EBP receive individualized services meeting
the goals of the EBP |
>80% of clients served by EBP receive individualized services meeting
the goals of the EBP |
| G7. Training. All new practitioners receive standardized
training in the EBP (at least a 2-day workshop or its equivalent) within
2 months of hiring. Existing practitioners receive annual refresher training
(at least 1-day workshop or its equivalent). |
= or < 20% of practitioners receive standardized training annually |
21%-40% of practitioners receive standardized training annually |
41%-60% of practitioners receive standardized training annually |
61%-80% of practitioners receive standardized training annually |
>80% of practitioners receive standardized training annually |
| G8. Supervision. EBP practitioners receive structured,
weekly supervision (group or individual format) from a practitioner experienced
in the particular EBP. The supervision should be client-centered and explicitly
address the EBP model and its application to specific client situations.
|
= or < 20% of practitioners receive supervision |
21% - 40% of practitioners receive weekly structured client-centered supervision
OR
All EBP practitioners receive supervision on an informal basis |
41%-60% of practitioners receive weekly structured client-centered supervision
OR
All EBP practitioners receive supervision monthly |
61%-80% of EBP practitioners receive weekly structured client-centered
supervision
OR
All EBP practitioners receive supervision twice a month |
>80% of EBP practitioners receive structured weekly supervision, focusing
on specific clients, in sessions that explicitly address the EBP model
and its application |
G9. Process Monitoring. Supervisors and program leaders
monitor the process of implementing the EBP every 6 months and use the data
to improve the program. Monitoring involves a standardized approach, e.g.,
use of a fidelity scale or other comprehensive set of process indicators.
|
No attempt at monitoring process is made |
Informal process monitoring is used at least annually |
Process monitoring is deficient on 2 of these 3 criteria: (1) Comprehensive
& standardized; (2) Completed every 6 mos.; (3) Used to guide program
improvements OR
Standardized monitoring done annually only |
Process monitoring is deficient on one of these three criteria: (1) Comprehensive
and standardized; (2) Completed every 6 months; (3) Used to guide program
improvements |
Standardized comprehensive process monitoring occurs at least every 6
mos. and is used to guide program improvements |
| G10. Outcome Monitoring. Supervisors/program leaders
monitor the outcomes for EBP clients every 3 months and share the data with
EBP practitioners. Monitoring involves a standardized approach to assessing
a key outcome related to the EBP, e.g., psychiatric admissions,
substance abuse treatment scale, or employment rate. |
No outcome monitoring occurs |
Outcome monitoring occurs at least once a year, but results are not shared
with practitioners |
Standardized outcome monitoring occurs at least once a year and results
are shared with practitioners |
Standardized outcome monitoring occurs at least twice a year and results
are shared with practitioners
|
Standardized outcome monitoring occurs quarterly and results are shared
with EBP practitioners |
| G11. Quality Assurance (QA). The agency has a QA Committee or implementation
steering committee with an explicit plan to review the EBP, or components
of the program, every 6 months. |
No review or no committee |
QA committee has been formed, but no reviews have been completed |
Explicit QA review occurs less than annually OR
QA review is superficial |
Explicit QA review occurs annually |
Explicit review every 6 months by a QA group or steering committee
for the EBP |
| G12. Client Choice Regarding Service Provision. All clients receiving
EBP services are offered choices; the EBP practitioners consider and abide
by client preferences for treatment when offering and providing services. |
Client-centered services are absent (or all EBP decisions are made by
staff) |
Few sources agree that type and frequency of EBP services reflect client
choice |
Half sources agree that type and frequency of EBP services reflect client
choice |
Most sources agree that type and frequency of EBP services reflect client
choice OR
Agency fully embraces client choice with one exception |
All sources agree that type and frequency of EBP services reflect client
choice |
*These two items coded based on all clients with SMI at the site or sites where
the EBP is being implemented; all other items refer specifically to those receiving
the EBP.
