How might we improve the career and internship search experience for students?
[User Research] [Mobile Application]
I worked with three other UX researchers on this project.
We were each in charge of more than one aspect of this project. I was in charge of the survey design and analysis, concept testing, as well as the usability testing.
We worked closley with the developers and CEO of Boj App on this project.
User research, interviews, concept tester, report writer, survey creator and analyst
3 months (Jan-Apr 2019)
Rochelle Campbell - UX Researcher
Shih-Ting Huang - UX Researcher
Corbet Griffith - UX Researcher
Carlo Sugatan - UX Researcher
Boj is a startup company that matches job and internship seekers with companies that match their culture and values.
Boj is going through a major redevelopment of their product in order to succeed in the job-service industry.
Problem Scope --
Boj faces many user drop-off rates in their application. They want to understand the reasoning behind this through a dive deep into their product and usability.
We worked with Boj to help them transition to their new and reimagined product by working with potential job seekers to understand their motivations for using job matching services.
Boj has a new idea...
Boj has an idea to implement interactive games to encourage users to complete their profile or as a way to make the job or internship process less stressful.
Boj streamlines the job search for both college students and companies in order to match one another based on cultural fit, education, and skills. This allows business find the best talent effectively while also ensuring that students are working with companies that match their values.
But, how did we get here?
We used various reserach methodologies in order to identify ways to improve Boj.
We focused on the needs assessments. We did this through interviews, a comparative evaluation, a survey, and a concept test to better understand users’ behaviors, wants, and needs when using a job-matching service.
We interviewed college students and recent graduates about their values in looking for a company to apply to and about their pain points in job searching.
We were able to create two personas of one student and one recent graduate to help us inform and guide the rest of the study design.
Comparative Evaluation --
We investigated different competitors within the job seeking industry to get a better idea of industry’s landscape.
We deployed a survey to quantitatively measure people's behaviors and choices in their job search journey.
Implementing interactive games in a job-matching service application had negative reviews (statistically significant at p<0.05).
Concept Test --
We deployed a concept test where we asked users how they feel about different gamification features. This allowed us to dig deeper as to why gamification may not work for Boj.
The gamification features we included on the concept test were:
Heuristic Evaluation --
We conducted a heuristic evaluation using Jakob Nielsen's ten heuristics to conduct the comprehensive usability of evaluation.
We evaluated the app individually with a ranking system to prioritize the major issues based on the severity. Afterwards, we conducted an interpretation session to identify and consolidate the the most-pressing issues and key findings, and to brainstorm solutions.
Usability Test --
We conducted a usability test to investigate the salient usability issues around the current Boj job-matching application.
Boj currently faces high fall-off rates during this process so we wanted to investigate these reasons so they can improve on these issues in the redevelopment process. We created four tasks centered around profile creation and exploration. Upon completion, we asked participants’ feedback about the app.
Overall Recommendations --
After a deep investigation of the Boj mobile app, many interesting and unexpected insights were revealed.
After synthesizing the results from each methodology, we summarize the high-level recommendations as:
Learning and Insights --
Listen to the users!
Many users did not favor implementing gamification features onto a job-search application. Boj had this idea and was supported by others who are not the target population. By understanding the wants and needs of users, we were able to show how Boj should reconsider adding gamification features, or to use it to have users understand their skills, rather than something to be used by employers, in which case, has the potential to be used against them.
Use different methodologies to reveal different insights
It was useful to go through different research/UX methodologies to reveal different issues and learn about the users. Doing a survey wasn't useful for gauging the potential of gamification featuers, in which a concept test was proven more useful.
We only interviewed one part of the users base, which was job-seekers. However, companies would also be using Boj to upload their job searches and to decide on how to pick a candidate. Further reserach should increase representation of the product. In addition, further research should look into the benefits and negative consequences of gamification on the product, maybe using participatory design.