As the first designer hired at Aperture, I introduced user research, prototyping, and lean experiments to the credentialing team and its stakeholders. The hands-on, human-centered work I did solved process inefficencies with small solutions rather than big deliverables. We created $1M+ in annual savings in our first ten months.
I led user research and synthesis on the Synergy product. I designed protoypes, lean experiments, and stories. I worked with the product managers to define business metrics and gather data.
Our first release improved the quality of imported office address data. Synergy users went from manually keying offices in 82% of files to just 12%, while overall file quality improved by 4% to 93%.
Our second release eliminated a mandatory 45 minute wait and has initially increase file-per-hour from 2.00 to 2.44, an annual savings of $850k.
Figma (Requires Account)Aperture Health is a credentialing verification organization (CVO). Insurance payers (eg. Kaiser) and medicaid programs contract healthcare providers (doctors, nurses) to their health plans. Aperture then credentials by confirming application information and verifying data from third-party sources.
Verification Coordinators (VCs) are solely responsible for an application from start to finish. They Kick Off a file to make sure:
National Provider Data Bank (NPDB) holds malpractice records on providers nation-wide. An individual's NPDB record comes back clean or with hits.
To run NPDB, VCs must mark the application "App Complete" and wait a variable amount of time for the system to return NPDB. So instead, they kick off as many files as possible and come back the next day to Close Out files with NPDB. This means re-checking the entire file, finishing any work left over from Kick Off, and finally submitting to the client.
The credentialing process just outlined wasn't known to us. On day 1, our stakeholders wanted to increase file-per-hour (FPH, or overall total output) and credentialing quality (fewer mistakes = happier customers).
For the past 15 years, Aperture's workforce has been using Advantage to credential providers. In the past year, VCs have been using Synergy, a front-end replacement for Advantage. However, specialists did not have their own version of Synergy. Our stakeholders' first idea: get specialists on to Synergy and reap FPH benefits.
With that in mind, we interviewed the gamut of credentialing users, over 20 Aperture employees in a week. We asked open-ended questions about their process, tools, and pain points.
We used first-hand accounts to build out a credentialing service blueprint. This helped us understand our team's knowledge gaps where we needed to re-interview. It also ensured we identified "vertical" pain points, issues that affect the whole system rather than a single user type.
I led the team through "going wide" and "narrowing" in a problem space. The team picked two starting points: improving data imports into Synergy and eliminating NPDB wait time.
To finish a file during Kick Off, users have to request and receive the NPDB before they finish their first pass. This means they have to understand, like, and use our new NPDB feature page.
When VCs saw the new NPDB page in the prototype, they were confused, unwilling to click new buttons, and apprehensive about moving NPDB "up" in the process. VCs expected the NPDB to return much later or possibly kick them out of the file. They were overwhelmed by the queries and application content below the banner. However, they were excited and surprised to get back the NPDB immediately and could explain the value of immediate return. This moment of delight was strong enough that it was worth iterating on the concept to simplify the layout and better set expectations.
Over the course of four iterations with 4-6 VCs, we validated user interest and increased comprehension. I then proposed we do a lean experiment with real files. It was important to quantify the business value of new NPDB and understand if interview attitude (I like this) translated to real-life behavior (I will submit the file in one pass).
Across two lean experiments with 6 users, 5 users noticed NPDB, trusted the result, and Closed Out their application. For files with no outreach required, VCs were 80 to 100% faster than their normal FPH. NPDB goes into production in September '21 with estimated annual savings of $850k.
By ramping up the fidelity of the prototypes, I was able to to determine user excitement, comprehension, and value in that order. Also, by running 86 user interviews with 64 users (65% of the userbase), training was already half-done.
Synergy imports the new application PDF and merges it with existing Aperture provider data. This theoretically saves a VC from keying everything from scratch off an image of the PDF. A VC should instead edit, add, or remove information based on how "right" Synergy merged data things.
Through VC interviews, we determined office location was the most frequently edited, easiest imported data to fix. Synergy was regularly a newest office's address rather than the fixed mailing address.
From there, the PMs and I went into the files ourselves. It was important to see the data and the extent of data quality fails first-hand. To do this, we became experts at the VC office process. We went through over 60 files to establish types of import errors, error rate (85%) and potential fixes.
After improving the import, merge, and affiliation of offices, we worked offices for all newly imported credentialing files for a week. This helped us check for any new issues, determine what hadn't been fixed, and establish a new fail rate for office import. It was also important to develop empathy for our users by experiencing the work they did and making sure we didn't make their process worse.
In three rounds of releases, offices imported and affiliated correctly 88% of the time, up from 18%. Eating our own dogfood was the key to releasing worthwhile, safe, and incremental import releases. The overall file quality has improved from 89% to 93% since release.
The Advantage/Synergy project was data-heavy and full of complex flows. My user interviews and tests are only as worthwhile as the content put in them, and the project was an opportunity to collaborate with PMs, users, and SMEs to become an expert at our product. We ultimately found, validated, and delivered two features that speed up credentialing and increase quality.
In retrospect, the hardest part of the NPDB service was integrating the request and response into Synergy/Advantage itself. Earlier in the project, the PM and I discussed creating NPDB as a standalone site where users could request and download NPDBs themselves. Users specifically had issues with file upload in Synergy and we worried this would create a roadblock for users. While integrating NPDB was the right user decision, I wish I had brought up testing with the standalone site to see if we could simplify the design.