Project

Establish and grow a user research practice

Outcome
  • 6,000% increase in research performed each year
  • $27,000 saved per usability lab

Established user research practice, and in only three years, trained up and led a team of two to perform 111 free or inexpensive studies (50+ performed by me) compared to only six outsourced usability labs in the previous 10 years.

Presented about my experience at UXPA MN October 11, 2018: So, you decided to have a baby start a research program

Studies performed:

  • Qualitative research (usability labs, interviews, click tests, tree tests, card sorts, surveys)
  • Quantitative research (data analysis, top tasks, analytics, surveys)
  • Competitive review
  • Heuristics review
Problem definition

Fortune 250 company Interactive Marketing department was lacking user insights to inform digital products.

Agile teams needed affordable information and user input mechanisms for discovery and delivery phases of work to create digital products of use to and usable by end users.

Solution

Research methods and process

Research process and sample images showing step 1 research plan to step 2 test creation to step 3 test to step 4 results
  • Lean process that documented conversations into a research plan document (for stakeholder engagement and buy-in) that practically wrote the test and provided the framework for the results document.
  • Learned how to submit all testing materials for compliance review (for FINRA filing) and worked with legal to create an NDA. Proved permission to perform research as many thought, “You can’t talk to users.”
  • Procured tools such as Optimal Workshop for click, tree and card sort tests, and Qualtrics, an advanced survey and participant management tool.
  • Determined logistics including test equipment to record sessions via a laptop (from any location) and WebEx for moderated testing (remote and in-person), secure data storage and HTML email template for online distribution via specific user research email box.

Participants

Feedback Teams words on top of three different shaped speech bubbles
  • Data pulls to determine target participant groups
  • Privacy and data requests to pull client and advisor lists from other parts of the business to meet specific recruitment targets by demographics, website usage (separate analytics pulls) and more.
  • Pre-recruited various audiences (yes, they volunteered) to join feedback teams available to perform tests for free on a monthly basis Worked with various vendors to purchase audiences, when desired
  • Guerilla recruitment

Team

Bi-directional arrows in between three silouettes in a triangle formation
  • Trained two staff in all processes
  • Established peer review for key deliverables (plan, test and results) to improve results and disseminate knowledge

Report results

Overlapping PowerPoint, Word and HTML email report images
  • Maintained report templates for adaptable reporting of various qualitative and quantitative test methodologies
  • Presented results to teams and published results on Confluence, to user research Slack channel and in email newsletter

Increase use of research

Silouette with thought bubble
  • Made team accessible by establishing office hours for drop-in conversations
  • Created discovery research template with questions and related free research activities available to all roles.
  • Offered and suggested research assistance to designers during design reviews, Slack messages and eavesdropping.
  • Presented user research capabilities and results in small and large groups
  • Spurred research work through discussions with agile teams about work planned and in progress

Contact

melanie at melanieclarke dot com