Top KPIs for OTT UX Design
What are some of the best ways to measure what is both effective and ineffective in OTT user experience (UX) design? Four leading industry figures discuss how their streaming companies measure what is working and what isn’t regarding the quality of their UX.
Nadine Krefetz, Consultant, Reality Software, Contributing Editor, Streaming Media, commences the discussion by asking Eileen Jackson, Director of Product, Vevo, how Vevo measures the quality of their UX.
“When we added linear programming, we obviously increased our session time dramatically,” Jackson says. “Return visitors is a big one for us. And that's a matter of we're going to increase that by giving trust that they can have a stable app or they can find whatever content is needed, whether that be from the curation standpoint of our linear programming or our shelves in our browse section, or they can find it in their search.”
Krefetz next asks Thijs Lowette, Product Lead, Philo, “What about you? What's your KPI that really resonates?”
“There are a lot that I'm interested in,” Lowette says. “But maybe a good one is being able to measure the stickiness on a streaming service. Every OTT service suffers from it. We have Yellowstone on file at the moment, meaning a lot of new signups. And when the season is over, they will all be gone, or a lot of them will be gone. So I think it is important to be able to measure that. And one way we do that is [by looking at] what is the unique number of shows that a user watches? That is one means to measure such stickiness.”
Solan Strickling, Senior Director of Streaming, Hartbeat, says that they look at UX KPIs in two different ways: the number of unique visitors and the level of retention. “What we're thinking of from a KPI standpoint is how many unique visitors come to watch our content, especially if there's been any type of major changes,” he says. “We want to see how many people are coming in. When we measure our own performance, we're looking at engagement, and that's based on how long people are staying on our channel, how long before they click off. And the other thing that we'll look at will be retention. If people are coming back, we're seeing a consistent high level of repeat viewers.”
Jason Williams, Senior Director of Product and Design, Plex, talks about how they focus on length of engagement. “Once we really started rolling out OTT and FAST within our ecosystem, we kind of started hinging on minutes watched,” he says. “Obviously, it's easier to protect your ad revenue if you've got a gauge on that, and being able to see what content is performing. So while we looked at…total playbacks, retention, like minutes watched, was where we focused for a while. Although I think now in some of the other services and features that we're offering, it's going to be repeat visits…because right now we've got the watch list, we've got the ability to discover content in other places, so I think it's a lot harder to discern in the metrics, like what everybody's doing on the platform.”
Williams says that to gather a complete picture of UX performance, it is essential to monitor repeat visits. “I think at least if we see that they're coming back twice a week, three times a week, five times a week, we can start understanding what our trust level is with the consumer, that it's something they want to look at on our platform every day or twice a week. And I think that is now more of a sign for how much they're beginning to trust us. Plex is solving a problem for them no matter what their particular problem may be.”
Learn more about OTT UX design and KPIs at Streaming Media East 2023.
Related Articles
What does it take to be a streaming app designer and director of product in 2024? According to YouTube TV's Esther Ahn, Crunchyroll's Tom Hurlbutt, and Philo's Brandon Yap, embracing the evolution of that role means rolling with ongoing changes in the device ecosystem, viewer behavior and device preferences, and the modernization of the TV viewing experiences, as they discuss in this clip from Streaming Media Connect 2024.
20 Mar 2024
A new study from Hub Entertainment Research reveals that viewers are still chasing shows rather than specific streaming brands, which poses challenges for programming providers looking to create a consistent brand identity across various platforms. James Lauzun of MagellanTV and Tom Hurlbutt of Crunchyroll also weighed in on this issue during a recent Streaming Media Connect 2024 session.
12 Mar 2024
The CTV viewing experience continues to evolve as new UX developments arise. Still, many experts and users agree that the experience is essentially broken, with too much choice and too little personalization as users' #1 complaint, far from where it needs to be. According to Google TV Senior Director of Engineering Shobana Radhakrishnan in her Streaming Media Connect Keynote, the critical challenge is understanding what viewers want and letting that drive other decisions.
16 Feb 2024
70 percent of FAST channel viewing happens on connected TVs, and the vast array of FAST channels that quietly insinuate themselves into viewers' living rooms as soon as they plug in their Samsung and LG CTV sets are the most accessible and easily tracked FAST viewing experiences imaginable, as they require no additional app installations to gain front-and-center visibility. How critical is the preeminence of specific CTV OEM brands in the success of FAST channels? Alan Wolk of TVREV and Chris Pfaff of Chris Pfaff Tech Media discuss the market dynamics of FAST and the CTV ecosystem in this clip from Streaming Media Connect 2023.
26 Jan 2024
What does the data tell us about OTT consumer preferences and trends, and how can platform providers interpret it to improve reach and reduce churn? ESHAP's Evan Shapiro, Hub Entertainment Research's Jon Giegengack, and Erickson Strategy's Paul Erickson discuss in this clip from their panel at Streaming Media Connect 2023.
16 Oct 2023
How much choice is too much choice for OTT media and entertainment consumers? Is content and channel overwhelm ruining the user experiences for OTT audiences who just want to find something to watch? And is more bundling the solution? Find out what Media Cartographer Evan Shapiro and Applicaster Co-founder Jonathan Laor have to say on the subject in this clip from Streaming Media Connect 2023.
12 Apr 2023
What are the best ways to improve the OTT user experience, especially for FAST platforms? Four industry experts weigh in on specific areas that could use improvement and streamlining in order to improve the overall UX for OTT subscribers with both targeted advertising and programming.
25 Oct 2022
SeaChange Lead Solutions Architect explains how dynamic server-side ad insertion (SSAI) improves the streaming user experience by enabling ads to be served with the same QoS as content in this clip from Streaming Media East Connect 2021.
16 Jul 2021
UI Centric's Sam Drury discusses the need for cross-platform UX design and the value of assigning a design gatekeeper to make sure platform conventions are followed in this clip from Streaming Media West 2019.
08 Apr 2020
UI Centric's Sam Drury underscores the importance of keeping performance in mind at all stages of OTT UX development in this clip from Streaming Media West 2019.
01 Apr 2020
UI Centric Head of User Experience Sam Drury discusses how to design your OTT app to facilitate svod subscription growth in this clip from his presentation at Streaming Media West. Learn more at hak2.daikuan918.com.
18 Mar 2020
Companies and Suppliers Mentioned