Browsed by
Month: February 2024

Usability Evaluation of the ezParent Administrative Dashboard

Usability Evaluation of the ezParent Administrative Dashboard

A team from Ohio State University and Klein Buendel has published results from the usability testing of the ezParent administrative dashboard in JMIR Formative Research. ezParent is a web-based training program for parents of children ages 2-6 years. It provides behavioral training through brief videos, interactivity, reflection questions, and assessments to parents of young children. 

Web-based parent training programs can strengthen parent-child relationships. They can help equip caregivers with knowledge and evidence-based strategies to manage behavior. They also can help surmount some logistical and personal barriers of in-person parent training. Web-based administrative dashboards provide administrators, facilitators, researchers, and others with detailed information about their participants’ usage, which can strengthen delivery of the intervention. Despite the utility of administrative dashboards, the authors know of no other research studies that have explored the perspectives and insights of dashboard users.

The study described in JMIR Formative Research used a descriptive, single-group survey design with four administrators who were overseeing implementation of the ezParent program and 19 trained facilitators for hybrid ezParent delivery. Participants were instructed to spend 30 minutes reviewing and assessing the ezParent dashboard and then prompted to complete a survey of their interaction with it. The survey included the validated 10-item System Usability Scale (SUS) and some open-ended questions.

Fifteen respondents indicated high usability of the ezParent dashboard, with a total mean SUS score of 83.5. Most participants (87%) rated the user-friendliness of the dashboard as good (20%), excellent (60%), or best imaginable (7%). Open-ended questions revealed the dashboard would be useful to monitor parent progress (40%), communicate with parents (13%), to review topics for discussion (20%), and to identify trends in parent participation (13%). ezParent administrators identified real-time data for ezParent users helps overall management of program uptake. Suggestions for features to add to the dashboard included the ability to track partial progress of program modules (29%), total time spent per module (14%), and exportable reports (7%). Other ideas for improvement included direct messaging capabilities, video-conferencing platform integration, and the ability to modify participant account and contact information.

Results indicate that the dashboard is easy to use and provides functional information to facilitators and administrators in delivering ezParent. Providing resources to aid in facilitation of the hybrid intervention may foster improved parent uptake and outcomes. Integrating suggested features into the dashboard may help provide a smoother experience for facilitators, administrators, and parents using the program.

This research was sponsored by a grant from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (HD104072; Dr. Susan Breitenstein, Principal Investigator, Ohio State University). Collaborating authors include Ms. Julia Berteletti and Mr. Charlie Barger from Klein Buendel; and Shea Smoske, Kyrie Tipps, and Nathan P. Helsabeck from The Ohio State University. The ezParent web-based program and administrative dashboard were programmed by the Creative Team at Klein Buendel.

Professional Development to Improve Responsible Beverage Service Training 

Professional Development to Improve Responsible Beverage Service Training 

Research collaborators from Klein Buendel and the Prevention Research Center at the Pacific Institute for Research and Evaluation (PIRE) have published formative research results and a protocol for a randomized controlled trial in JMIR Research Protocols.  

The full trial will be evaluating an addition to a responsible beverage service (RBS) training because improved interventions are needed to reduce the rate of driving while intoxicated. RBS training has reduced service to intoxicated patrons in licensed premises in several studies. Its efficacy might be improved by increasing the proper application and continued use of RBS with a professional development program in the 3 to 5 years between the required RBS retraining. 

The formative research published in JMIR Research Protocols reports on the addition of a professional development component to an existing RBS training to improve the effectiveness of the web-based training alone. Semi-structured interviews with owners and managers of licensed establishments and focus groups and a survey with alcohol servers in New Mexico and Washington State were conducted to examine support for RBS and the need, feasibility, acceptability, and potential effectiveness of ongoing professional development. A prototype of a professional development component, WayToServe Plus, was produced and delivered in social media posts on advanced RBS skills, support from experienced servers, professionalism, and basic management training. The prototype included 50 social media posts. The prototype was evaluated in a usability survey and a field pilot study with alcohol servers in California, New Mexico, and Washington.  

Although owners and managers and alcohol servers were favorable toward RBS, they endorsed the need for ongoing support for RBS for servers and identified topics of interest. Servers felt that the professional development component was highly usable and appropriate for themselves and the premises in the usability survey (n=20) and field pilot test (n=110), with 85% and 78%, respectively, saying they would use it. Servers receiving the professional development component had higher self-efficacy and response efficacy for RBS compared with untreated controls. 

The article also includes a protocol for a planned randomized controlled trial. This phase of the project will include full production of the professional development component. It will be delivered in Facebook private groups over 12 months and evaluated with a sample of licensed premises (bars and restaurants) in California, New Mexico, and Washington (n=180) in a 2-group randomized field trial (WayToServe training only compared to WayToServe training and WayToServe Plus). Licensed establishments will be assessed for refusal of sales to apparently intoxicated pseudo-patrons at baseline and 12 months after the intervention commences. 

Owners, managers, and servers believed that an ongoing professional development component on RBS would benefit servers and licensed premises. Servers were interested in using such a program, a large majority engaged with a prototype, and servers receiving the prototype improved on theoretic mediators of RBS. The authors believe that the professional development component may improve RBS training and save lives. 

This research was supported by a grant to Klein Buendel from the National Institute on Alcohol Abuse and Alcoholism (AA029364; W. Gill Woodall and David Buller, Multiple Principal Investigators). Collaborating authors on the paper include Dr. Robert Saltz from the PIRE Prevention Research Center in Berkley, California, and Ms. Lila Martinez from Klein Buendel.