Program Inventory Glossary: Terms & Filters

A database that collects many program evaluations, often organized by subject area (e.g., education, health, criminal justice). Clearinghouses use rigorous criteria for the studies included, and often limit studies to studies with comparison groups, like randomized control trials (RCTs) and quasi-experimental designs (QEDs). The Results First Clearinghouse Database combines information from nine national clearinghouses into one searchable location, and it is the suggested starting place to search for rigorous evidence.

The location in which a program or service is delivered. Note that some programs might have several delivery settings.

• Correctional facility
• Court
• Home
• Hospital/treatment center
• Inpatient
• Mobile
• Organization/Business/Local Government
• Outdoor Space
• Outpatient
• Residential facility
• School
• Workplace
• Other community setting: Any other location that may be utilized for services. This could include community centers, places of worship, non-profit facilities, virtual settings, or others not included in the settings above.

The following executive state agencies and commissions own and implement programs in the inventory:

• Agriculture
• Children’s Services
• Commerce & Insurance
• Correction
• Disability & Aging
• Economic & Community Development
• Education
• Environment & Conservation
• Finance & Administration
• General Services—Early Literacy Foundation
• Health
• Higher Education
• Human Resources
• Human Services
• Labor and Workforce Development
• Mental Health & Substance Abuse Services
• Military
• Revenue
• Safety & Homeland Security
• TEMA
• TennCare
• Tourist Development
• Transportation
• Veterans Services

One of the five classifications within the Tennessee Evidence Framework. Steps include Logic Model, Outputs, Outcomes, Evidence, and Strong Evidence. See Evidence Framework & Clearinghouses for more information about each evidence step.

At least one rigorous study has been done on the program or program model. Programs in this category fall at the Evidence or Strong Evidence step in the framework. This includes any studies that show mixed, no, or negative results; see Impact Continuum for more information on how those appear in the inventory.

The use of research and evidence to inform funding decisions in a way that improves outcomes for Tennessee citizens.

Programs at the Evidence and Strong Evidence steps have at least one quality study that shows how the program affects the expected outcomes. Often, these studies will show positive effects. This is the case for most inventoried programs, which will have a green Evidence or Strong Evidence step indicator. However, sometimes studies will show that programs have no, mixed, or negative effects. Programs in the inventory with these study results will display the associated impact indicator.

1. Negative Effects
2. N No Effects
3. M Mixed Effects
4. Positive Effects

A program planning tool designed to support an intended change; it is a visual representation of how a program works toward a set of outcomes. During the program inventory process, agencies write an if/then statement, which summarizes the most important elements of a logic model into one (sometimes long) sentence that describes how the program is expected to work.

Program measures; the changes in the behavior or wellbeing of a participant or recipient of a program or service. Outcomes measure what the program or service influences or impacts. To what extent is the program working?

Checking “Data Reported” in this filter will show only programs that are actively reporting data, and have provided two or more years of data, for at least one outcome.

Process measures; the concrete, countable results of the activities. Often, outputs are products or services that can be measured in tangible terms, and may measure efficiency or quality (e.g., dollars spent, number of people served, number of items delivered, etc.). What does the program do or provide?

Refers to one of five Tennessee Learning Agenda areas. These areas are:

• Education Quality & Access
• Government Efficiency & Effectiveness
• Rural Development & Conservation
• Strong Families & Communities
• Workforce Development & Employment

For more information, visit OEI’s Program Evaluation & Research pages.

A systematic activity that engages participants to achieve desired outcomes. Terms often used in its place can include service, intervention, or practice. If a systematic activity has participants and has its own name, it is likely a program.

The primary populations or communities a program serves. Definitions of these categories may vary across human and social service sectors, and programs in the inventory may be assigned multiple demographic categories to accurately reflect the populations they serve. For example, a program serving children ages 3–10 may be categorized under both “Infancy/Early Childhood” and “Children,” while a program may also serve overlapping populations such as families, veterans, or rural communities. Specific eligibility criteria or age ranges may also be included in program descriptions and/or on program websites.

• Infancy/Early Childhood: Birth to age 5
• Children: Age 5-17
• Adolescents/Young Adults: Age 10-21
• Adults: Age 18+
• Aging Adults: Age 65+
• Families: Units of at least one adult and one child in the same household
• Gender-specific: A program designed for a primary gender
• Persons with Disability: Individuals who live with a physical or mental impairment that substantially limits one or more major life activities
• Veterans: Individuals who have served in the military or armed forces
• Justice-involved: Individuals who have interacted with the criminal justice system
• Businesses/Entrepreneurs: Organizations/Individuals who operate or seek to operate a business
• Rural Focus: Concentrated efforts on lightly populated areas
• Communities: Particular areas or places considered together with their inhabitants; may include towns, cities, districts, etc.

The catalog of programs and services the state provides to Tennesseans included in the annual budget. The inventory includes each program’s evidence step and impact level. This term also refers to the process that state agency teams use in partnership with OEI to develop and maintain the catalog.

Section in a listing for a program at the Evidence or Strong Evidence level of the framework. This is a link to the study or studies that show a program is evidence based; any important supplemental information will be noted in this section along with the link.

A study that uses high-quality experimental or quasi-experimental designs that include a comparison group. For the purposes of the Tennessee Evidence Framework, this includes quasi-experimental studies (QEDs), randomized control trials (RCTs), and systematic reviews. See Evidence Framework & Clearinghouses for more information about rigorous evaluation.

The standard language used across state government to classify programs in Tennessee based on the level of available evidence supporting the program.

The framework used to classify Tennessee programs based on the level of available supporting evidence. In this model, five evidence steps build from left to right. Many factors might prevent a program from having a rigorous evaluation, but all Tennessee programs should be measuring outcomes. See other listings in this glossary or the Evidence Framework & Clearinghouses for more information about each evidence step in the framework.

Logic Model

"If we do x, y, and z activities, then we expect to see a, b, and c results."

Outputs

Process measures support continuous improvement.

Outcomes

Data collected over time demonstrate a change or benefit for participants.

Evidence

At least one rigorous evaluation supports the program model.

Strong Evidence

Two or more rigorous evaluations support the program model.

Strength of Evidence