Facebook Announces Several Metrics Updates, Corrected Bugs

Facebook Wednesday announced several metrics-related updates: corrections of several bugs that resulted in inaccurate data, increased third-party verification, more measurement solutions and an internal review process.

Facebook Wednesday announced several metrics-related updates: corrections of several bugs that resulted in inaccurate data, increased third-party verification, more measurement solutions and an internal review process.

The bugs affected organic reach in page insights, video watches, time spent on Instant Articles, referrals in Analytics for Apps and follower counts in interest lists. More details from the social network are included below.

Facebook pointed out that it already taps companies including comScore, Moat, Nielsen and Integral Ad Science for third-party verification, and it is exploring additional options.

The social network also launched the ability to verify display impression data via its third-party viewability verification partners, and it announced that it is teaming up with Nielsen to include viewership of videos and Facebook Live videos in its Digital Content Ratings, giving publishers third-party verification options and data comparable with digital and TV metrics in Nielsen’s Total Audience Measurement.

On the measurement front, Facebook detailed plans to form a Measurement Council:

Our global Client Council has helped shape the direction of our products and how we approach measurement. Innovations such as conversion lift and mobile polling came out of direct conversations with our Client Council members. Given the Council’s valuable insights and the growing need for measurement standards tied to business outcomes, we’re now working with its members and other business and measurement executives to form a Measurement Council. We’ll announce more details in the coming weeks.

Facebook also said it would provide more regular communication about findings from its new internal review process via the following channels:

  • In-product definitions: As we’ve routinely done in the past, we’ll continue to include updates in-product where partners buy ads or access our reporting. When we make meaningful updates going forward, we’ll continue surfacing them in-product.
  • Through our client teams: We’ll continue to communicate important updates to metrics that impact our partners directly through our partner teams.
  • Metrics FYI blog: We know how important it is to be open about meaningful updates we make to our metrics, so we’re creating a new channel for regular information on metrics enhancements. (This blog will be similar to our News Feed FYI blog.)

And the social network detailed several changes aimed at clarifying its metrics and making them easier to understand:

  • More descriptive names: We’ll make updates now and in the coming months to ensure that our metrics are clearly named (e.g. “view content” → “website view of content,” and “video views” → “3-second video views”).
  • Clarified calculations: We’ll clarify some calculations to make sure they reflect how our products are being used by advertisers. For example, with the launch of Canvas in February, we gave advertisers the ability to create an immersive native experience on Facebook. Within Canvas, they can also link to offsite content on Facebook’s in-app browser. While this experience is valuable to advertisers, the original intention of the Canvas View Duration metric was to capture time spent in Canvas. So we’re clarifying the metric calculation to reflect that it excludes time spent outside Canvas (linking to offsite content).
  • More consistent definitions: We’ll also update our tips section and glossaries across all of our ads tools to make sure that we are explaining our metrics in consistent ways (including noting which insights are estimates). For example, as we have rolled out new immersive experiences on Facebook like Canvas and lead forms, the link clicks metric has evolved over time to include clicks to those on-Facebook destinations, in addition to clicks to a website off of Facebook. We had updated the definition of links clicks in our ad creation tools, and we are now updating it across all of our ads tools. We’re also clarifying the description of our video views metrics (3, 10 and 30 seconds) to include the term “aggregate,” so as to more clearly explain that it’s based on aggregate view time of at least the specified number of seconds.
  • Better categorization: We’re making it easier for marketers to select certain metrics to include in their reports. To do this, we’re creating a way to customize the columns in reports to reflect how marketers set up their ads. This will let advertisers have a specific advertising objective map directly to the metrics we show, like checkouts, leads or registrations.

FBMetricsPageLikes FBMetricsCustomizeColumns

These efforts are long-term investments, and we’ll continue to share updates on the Metrics FYI blog.

Finally, here are the details on the bugs that were corrected by Facebook:

We’ve uncovered a bug in Page Insights. On one of our pages dashboards, one summary number showing 7-day or 28-day organic page reach was miscalculated as a simple sum of daily reach instead of de-duplicating repeat visitors over those periods (see red circle in screenshot below). However, the vast majority of reach data in the Page Insights dashboard (marked green in screenshots below) was unaffected, including all the graphs, daily and historical reach, per-post reach, exported and API (application-programming interface) reach data, and all data on the Reach tab. The de-duplicated 7-day summary in the overview dashboard will be 33 percent lower on average and 28-day will be 55 percent lower; data in other fields is unaffected. This bug has been live since May; we will be fixing this in the next few weeks. It does not affect paid reach.

FBMetricsOrganicReachOverview FBMetricsOrganicReach

Additionally, we’re making an improvement to page organic reach to match what we’ve done for paid reach. Reach counts will now be based on viewable impressions. On pages, we’ve historically defined reach as a person refreshing their News Feed and the post being placed in their feed. For paid ads reports, we’ve moved to a stricter definition that only counts reach once the post enters the person’s screen (“viewable impressions”). With the stricter definition, we estimate that reported reach will be 20 percent lower on average. We’ll provide an update to all pages in-product and via the Metrics FYI blog when we make this change, which will happen in the coming months.