This article deals with improving digital user interfaces (UI), interaction design, and overall user experience (UX) using data about people’s behavior. In the highly competitive market, where success may directly depend on a product’s look-and-feel, every product development team is bound for a continuous iterative UX design process.
For example, they have to regularly address questions such as:
… and periodically conduct UX audits.
In this post, we’d like to pay attention to the UX metrics and key performance indicators (KPIs) used to measure design. Namely, we will list some of the most popular user experience KPIs and explain how Onix’s teams use them to improve digital products.
But let’s start with the significance of such KPIs for design teams and others.
The meaning of a relevant KPI for UI/UX designer is comparable to students’ grades for a school teacher or growth metrics for a startup founder.
Data obtained from tracking UX design KPIs suggests and supports the best design decisions, helping improve the overall product performance and the bottom line.
If you are interested in data-driven improvements to your product, please don’t hesitate to contact Onix. We may discuss your organization’s unique needs and suggest ways to meet them.
Every metric or KPI quantifies a specific aspect of a user’s experience, e.g., counting the average minutes spent in an app daily to evaluate the user’s involvement and satisfaction with the product.
There is neither a general hierarchy nor a universally adopted classification of the UX and UI metrics. For example, when the team needs to understand customers’ needs and how they use software, they are likely to use two categories of UX KPIs: behavioral and attitudinal.
Read also: Most Important SaaS Metrics and KPIs
User experience metrics help understand how people really use and what they do in a digital product at each step of the customer journey, where they come from, what problems they encounter and where, etc.
Behavioral UX KPIs are gathered via task-based usability testing. Usability itself is the lowest standard in user experience design. The UX/UI designer and app developers must ensure at least that the users can do what they want to do with the product. The four dimensions of usability testing are:
The primary behavioral UX metrics are monitored using specialized tools and services, the most popular including Google Analytics, Hotjar, Mixpanel, Heap, Localytics, Kissmetrics, Crashlytics, Firebase, and Crazy Egg.
Google Analytics (GA) (mobile and web analytics) is arguably the best tool to overview your UX design efficiency, and it’s free. Heap is a decent substitute to GA that helps users examine the most crucial data and build their own system of UX success metrics. Localytics for mobile analytics is an excellent freemium multi-platform tool with advanced segmentation.
However, instruments tell only a part of the story. User research involving relevant KPIs is needed to understand why things happen. Here are three behavioral UX KPI examples.
It’s crucial to clearly define a realistic task success, e.g., to complete a profile in an online dating application. TS is typically calculated as a percentage. For instance, if 8 out of 10 participants succeeded and two failed, TS would be 80%, but given the small sample size, we only can be 90% confident that the TS percentage lies somewhere between 55% to 100%. The margin of error will be smaller with a larger group of representative users.
This is normally an absolute number. For instance, dating app developers can measure how long it took the participants to sign up and e-commerce developers — to make an order. Then, the team calculates the Average Task Time either for the whole group or only for those who accomplished the task. Generally, faster task completion is desirable, but sometimes — just the opposite is optimal.
The best way is to ask the participants to think aloud while using a mobile app or site. This KPI for UI/UX designers may be the number of problems identified or the percentage of users that encountered a certain issue.
The collected behavioral KPIs are eventually compared with the same product’s KPIs over some time (e.g., quarterly) or with rival software.
Attitudinal UX KPIs show how users feel about a product and brand before, during or after using a product. Web and mobile developers can learn this directly from customer feedback, including opinions, complaints, and suggestions. UX design metrics often require running surveys towards the end of a task-based usability study.
Among the attitudinal UX KPIs, three seem to be most important:
NPS helps measure customer loyalty based on direct questions like ‘How likely are you, on a ten-point scale, to recommend this dating application to your friends?. Those who responded with a score of 9 or 10 are ‘promoters,’ those with a score of 7 or 8 are called ‘passive,’ and with 0-6 – ‘detractors.’ Calculate the percentages. NPS = Promoters – Detractors.
Even measured on a small-size sample, SUS can indicate whether the user experience has improved or not. For every usability test carried out, users complete a questionnaire of ten items. They may click on an option from ‘strongly agree’ to ‘strongly disagree,’ e.g., “I think the app is easy to use.”
Each respondent’s scores for the questions are added together and multiplied by 2.5 to convert the original scores of 0-40 to a SUS score between 0 and 100 points. A score of 68 is considered the average SUS score; everything else is either above or below average.
CSAT is calculated by asking questions about the user’s experience, e.g., ‘How satisfied were you with searching for a date?’ A corresponding survey scale is used, which can be 1-3, 1-5, or 1-10.
Ideally, for measuring UX metrics, the behavior-related metrics should be matched with financial and sales and marketing-related measurements. The latter category includes, but is not limited to, social media impressions, brand trackers, and search metrics.
It makes sense to pay special attention to the financial aspect: after all, increased revenue is the goal and the ultimate measure of success for all who work on a product’s visual design, information architecture, deployment, marketing campaigns, and other activities.
To be more specific, the following metrics allow for evaluation of ROI in UI and UX design:
The conversion rate is the number of visitors who performed the desired action, e.g., completed registration or purchased a yearly subscription, divided by the number of those who had the opportunity. One may even call it the ultimate KPI for UX designers: an optimization based on this figure can dramatically improve the sales numbers.
For example, creators of a landing page may need to conduct user tests to understand why specific components of its UX and UI convince users to accept the offer or drive them away. Brand elements and accessibility are also relevant. If the number of conversions grew after a visual design change, and you can measure that user experience KPI accurately, you can also be confident the change made an impact.
The drop-off rate, the opposite of conversion, generally shows how many people left the conversion funnel without performing the desired action.
GA calculates this rate in different segments, tracking bounces over pages and screens and helping identify the steps in the funnel that are causing most visitors to ‘drop off.’ For instance, on an online store, we will likely look into the percentage of users who give up on filling out payment details.
Once the bottlenecks have been found, we can analyze the design and usability and suggest the necessary improvements. To learn why more users bounce, we combine this metric with attitudinal UX KPIs.
Standardized SUM measures task completion rates, task time, and user satisfaction, and counts errors. The analysis of design errors helps to understand how to avoid them, create the best UX design, and drive users into your conversion funnel.
The above UX KPI examples can also be classified as low-level metrics, along with indicators like:
The following chapter describes high-level UX KPI metrics.
Google’s HEART framework combines the essential KPIs listed above and adds others to deepen the understanding of how a product’s design works:
H – Happiness. This measures the extent to which users enjoyed using your product. The data is often collected via surveys at the end of UX tests.
E – Engagement. It’s rather easy to measure weekly numbers of visits per user, taps, screen refreshes, steps taken, or other actions that show the extent to which users are involved in a mobile app or website, a direct indicator of its quality.
A – Adoption. This means gaining new users of a product or feature. Adoption can be traced, e.g., by the number of upgrades to the latest version, new subscriptions, or purchases made by new users.
R – Retention. This includes the number of people that are consistently using the app or visiting the website within a specified time frame, repeat purchases, renewal or churn rates, and so on.
T – Task Success. In this case, Task Success covers a broader range of metrics tracking a user’s actions, such as how well the task was accomplished, how long it took, and how many errors occurred.
The HEART metrics framework is integral to our company’s UX design process too. Let us share some advice drawing on Onix teams’ experience.
Onix’s experts start by analyzing the existing website or mobile app from a business point of view, and namely its business model, monetization methods, and strategy. Simultaneously, they explore the competitors to find out any shortcomings and what can attract customers.
This research helps define the goals of the planned design improvement, determine the signals of success, and convert those signals into actionable metrics.
Then, we make sure that everything is configured correctly in GA and that all data is relevant. It is important to understand where the data comes from, how it moves, and how to perceive each KPI for the design team.
Key UX metrics are those that bring the most value to customers and greater profit to the business. The more relevant data is available for each metric, the higher the likelihood of making the right decision.
Our UX efficiency toolkit normally includes at least:
Then, the team brainstorms how to improve performance and develops actionable plans.
Onix’s UX experts don’t rely exclusively on numbers, e.g., monthly visitors, but always dig deeper to find out why they visit the site, where they come from, how they behave on the website and why, and so forth.
GA helps by tracking behavioral metrics critical to each particular case, such as:
By establishing correlations between this UX data and how the interface works, we can hypothesize possible improvements. For example, the conversion rate may be affected by the number of text fields on the registration page, especially if compared with competitors. Reducing their number or changing the visitors’ perception of the online form’s length might improve the situation. Read Also: Correlation vs. Regression
Sometimes, A/B testing provides the answers. In the case of a registration form, half of the audience would see fewer text fields and half — a new layout for the same number of text fields. The number of registrations on either page would be counted over some period. After that, the team would approve the version that proved more popular with the end-users.
Sometimes, we prove or disprove the hypotheses by basically comparing the past indicators with numbers obtained after the changes. Here is a recent example.
Onix was tasked with improving the UX design of a content subscription platform. It generates revenue through commissions from transactions, such as subscriptions and tips to the content creators. The owner wanted to increase revenue by encouraging consumers to spend more.
The main UX metrics we were interested in included the average session duration, user engagement (basically, the frequency of interactions with content), and conversion rate. The designer started with competitor analysis and compared the services’ KPIs. Among other facts, he found out that:
The designer suggested a number of improvements to the app’s UI and UX, such as:
The first two ideas have been realized already. The change to ‘Tips’ is a particularly good example of data-driven design improvement. The little € next to the heart and comment icons makes donating seem as natural and easy as giving a like or writing a compliment. Users can do it in just two clicks or taps: first on the € icon and then, after indicating the amount, on the ‘Send’ button.
The UX design metrics proved that the hypothesis was correct. After the subtle change was released unannounced in early October, the app received 1.5 times more tips than the monthly average in less than a month. The average amount of individual donations doubled.
Learn more: How to design a Mobile App UI
The UI and UX design process is all about constant improvement through endless iterations. Product development teams need to plan the process and keep their design efficiency measurement running.
Various user experience KPIs enable teams to measure and enhance the convenience and comfort of the end-users, the popularity of the product, and ultimately its success on the market.
Choose the UX KPIs that matter most to the business, get users involved, and obtain instant feedback from experimental design phases.
The conversion rate is arguably the definitive KPI for UI design assessment, but avoid making decisions based solely on low-level metrics or marketing or financial numbers: they can be misleading unless you consider the users’ opinions. Run surveys and interviews, user journey research, and analyze feedback from those in direct contact with end-users, such as the customer support team and salespeople.
Only a combination of various data will give you the correct vision for steering your product towards success.
If yes, please don’t hesitate to contact us today!
UI stands for “user interface,” the point of human-computer interaction and communication. In web and mobile development, UI design is about arranging a product’s graphical layout and content into a consistent and appealing experience according to the best design principles.
UX means “user experience.” UX design is a human-first approach to digital product development and improvement that focuses on identifying and solving problems and ensuring an efficient, easy, relevant, and delightful interaction with the product for as many people as possible.
UI design complements UX design by taking care of a digital product’s visuals, presentation, and interactivity. Both elements work closely together and are essential for success.
The development of most successful products is data-driven, i.e. backed by quantitative data that helps understand the target audience. The product’s UI and UX also have to be measured so that the team can improve them.
Particularly, teams measuring user experience can determine whether one version of their design is better than another or a competitor’s product, see what exactly users are doing with the product, what problems they need to solve, and more.
UX KPIs (Key Performance Indicators) are metrics that product development teams collect and analyze to measure the success of their design activities in a quantitative manner. They turn various data about the users’ behavior and interaction with the UI into digestible information for the teams to draw conclusions and make decisions. Tracked over time, they indicate how close the developers have come to achieving the set design goals.
The Net Promoter Score, bounce rate, and returning users rate are prominent UX design KPI examples.
Software developers should address design metrics and KPIs at least: