Mixpanel: Social Game Developers Use Tutorials to Get Crucial Early Retention

[Editor's Note: Facebook may be making significant changes to the platform, but developers aren't standing still -- they're busy continuing to find new ways to engage users. Here's a guest post by Tim Trefren, cofounder of real-time analytics company Mixpanel, looking at the latest trends his company is tracking among developers.] Because a range of our customers are social game developers, we can get a high-level look at trends they're seeing in their Facebook applications. One of the big trends we're seeing is that games are using tutorials to generate strong retention among new users. A related trend is that this initial retention is critical to the health of your game, in the weeks following launch. Here's a closer look. Impressive Results From Tutorials One thing we're seeing succeed is the tutorial-based signup process. A well-crafted tutorial removes all the ambiguity out of getting started and helps teach a new user how to play the game. If you're not familiar with this technique, the FarmVille signup process is a good example. FarmVille explicitly teaches you how to harvest, plow, and plant seeds with a 3-step tutorial. Now that you're familiar with the concept, let's take a look at the data I've compiled from a number of games. By The Numbers The most impressive finding of this analysis is that individual steps in a tutorial convert at over 90% on average. Meaning, once a user has started a tutorial, they have a greater than 90% chance of continuing at each step. This doesn't include the first step, however - as you might expect, it's harder to get users to start a tutorial than it is to get them to complete additional steps. First step conversion rate: 71.4% Additional step conversion rate: 95.06% Overall completion rate: 37.9% Many companies are now utilizing the tutorial technique, and it clearly deserves its popularity. Conversion rates of 95% are practically unheard of, but tutorials appear to be delivering these results. An Interesting Trend in Visitor Retention Another thing I noticed was a strong trend in retention behavior. There are some remarkable similarities in the *pattern* of visitor retention across games, despite the differences in the actual numbers. Before I go any further, here's a quick overview of the concept: Visitor retention is the percentage of visitors who come back and interact with an application after their first visit. Visitors are chunked into groups—also known as 'cohorts'—and then analyzed based on the the behavior of the group as a whole. The most common method is to group by visit date. For example, one group might consist of all the visitors who were first seen in the week starting May 3rd. Once you have grouped your visitors, you can track them over the following weeks and see how many from each cohort return to the site. Now let's look at some actual retention numbers for a variety of different games. To compile this data, I first took a sample of the different social games using our service. Then I looked at the average week-over-week retention for each game. Here's a graph of the average weekly retention rates for the different games: You can see that on the surface, the retention numbers are pretty different - some of these games have long-term retention rates close to 50%, while others rapidly approach 0%. However, the interesting thing to note is that while the absolute retention rates are different, the pattern of retention is very similar across games. They all have a massive dropoff after the first week, with relatively flat retention in the following weeks. If you take a closer look, the 'flat' parts of the graph run nearly parallel, meaning they have very similar weekly conversion rates. We can take a closer look by calculating the "conversion rate" - (e.g. week 3 divided by week 2, etc) between adjacent weeks. Here's a graph with this transformation: See a pattern? At the first point on the x-axis (Week 0-1), we can see that the initial conversion rate ranged from 1.76% on the low end to 62.83% on the high end. The interesting part comes later, though - no matter what the initial conversion rate between weeks 0 and 1, the following weeks convert at close to 80% across all of the games. Basically, this means that once you've had a user for at least a week, they have an 80% chance of coming back each following week. This suggests that your initial retention rate is critical, because once you've retained users for a week you are likely to keep them for quite a while. This behavior also raises another question: why do almost all of the games in our sample exhibit this behavior? Is it possible that this is just how social games work - retained users have an 80 - 95% chance of returning each week? If so, this could mean that the only thing you have control over is the initial retention rate. Time to write and polish your tutorials. Tim Trefren is the cofounder of real-time analytics company Mixpanel.

Social Pro Daily

Mixpanel: Social Game Developers Use Tutorials to Get Crucial Early Retention

Guest

About

Subscriptions

Events

Publications

WORK SMARTER - LEARN, GROW AND BE INSPIRED.

Subscribe today!

Guest