35%The leading online ad platforms have a metric for measuring ad quality. The better your ad quality, the lower your costs and the more users see your ads. For Google AdWords, that metric is Quality Score. For Facebook advertising, that metric has been called Relevance Score.

To date, Relevance Score was Facebook’s measure of the quality and engagement level of your ads. It’s important because it determines both your cost per click on Facebook and how frequently Facebook shows your ad. It’s Facebook’s way of telling you that your ads are amazing or their terrible and it’s time to go back to the drawing board.

 

Facebook’s Recent Changes to Relevance Score

The original Relevance Score attempted to aggregate various signals around ad quality and relevance to give a marketer an idea of how well their ad creative performed compared to other ads targeting the same audience. To get this score it used positive signals based on campaign objective (video view, click, conversion, engagement, etc.) and negative signals (hiding an ad) to come up with an overall singular score. This could then be used as part of understanding their ad performance in the auction and when it might be time for an ad or audience refresh. It gives an overall view of your performance while meant to work in concert with other performance metrics.

Ad Relevance Diagnostics

Facebook recently revamped the relevance score metric to offer more information to marketers on what might be affecting ad performance. The new relevance score measurement isn’t based on a singular metric or even called a relevance score anymore. It’s actually three new metrics grouped under the name “Ad Relevance Diagnostics” that give you a more holistic view of the ad experience as compared to other ads in the auction. The three new metrics include quality ranking, engagement rate ranking, and conversion rate ranking.

These taken together give a marketer a better behind the scenes look at how the Facebook algorithm perceives its ad in the auction when compared to other ads targeting the same audience. This, in turn, allows marketers to make more informed decisions on testing creatives, or modifying their ads and audiences.

 

Why Replace It?

As much as one all-encompassing metric is nice in its simplicity, the original Relevance Score didn’t convey all the information you really would need to make decisions regarding your ads. If an ad had a low relevance score and negative feedback you could assume it was getting hidden a lot, but otherwise you were left to look at other performance metrics and try to guess why your relevance score was low. You didn’t have the detail necessary to make a more informed decision.

Without that detail, it was more difficult than it needed to be to assess why Facebook was assigning a low relevance score and what you should do to fix it through Facebook creative testing. If an ad appeared to be getting good engagement metrics and was converting, you wouldn’t know why it might be getting assigned a lower score.

 

Measuring Ad Relevance Diagnostics

The three new metrics that Facebook campaigns take into account are as follows:

Quality Ranking: Measures perceived ad quality with your audience as compared to other ads targeting the same audience. It considers signals such as people viewing the ad, people hiding the ad, and assessments of clickbait and/or engagement bait.

Engagement Rate Ranking: Measures your ads expected engagement rate with your audience as compared to other ads targeting the same audience. It considers signals such as the likelihood someone will click, comment, share, react to or expand an ad.

Conversion Rate Ranking: Measures your ad’s expected conversion rate compared to other ads with a similar optimization goal targeting the same audience. It considers the likelihood that someone who viewed your ad will complete a conversion.

Each metric will get a rating from one of the five options below.

  1. Above Average
  2. Average
  3. 35% of the bottom (Below Average)
  4. 20% of the bottom (Below Average)
  5. 10% of the bottom (Below Average)

 

How to Use these Metrics to Diagnose Ad Performance

You should always focus on your advertising objective first. If your ad is meeting your goal it is likely not worth focusing on the ad relevance diagnostics listed above. Ads that are high performing can at times have below average scores in these metrics. You would not want to hurt existing performance to chase a higher score in one of these metrics.

Where these metrics truly help is when an ad is not performing well. You need to try and improve that performance. The three ad relevance diagnostics are now more useful in figuring out where Facebook sees a problem with your ad and can help you move the needle toward better performance.

While all three metrics point to potential copy and audience issues, they do have slight differences in what you might want to address to improve your ad performance through creative testing.

Audience Perception 

The quality ranking focuses on the overall ad and the perception of its relevance to an audience compared to other ads. Are people viewing or hiding it? Does it contain clickbait or other poor user experiences? If not, perhaps the ad is a poor fit for the audience. In that case, a new audience might be needed.

Audience Fit

Engagement rate ranking similarly looks at an ad and audience fit but considers things like clicks, comments, reactions, etc. to rank the ad compared to others on whether people are engaging with it. High engagement leads to a high score and a perception of ad fit to the audience. Low engagement leads to the opposite.

Audience Conversion

Conversion rate ranking considers the likelihood of conversion and is relevant to conversion related campaign objectives. A poor ranking here would lead you to look at call-to-action in your ad copy, possible landing page issues, or potentially switching to an audience more likely to convert.

 

Conclusion

The original Facebook Relevance Score offered an accessible and direct way to assess ad performance. But it just didn’t offer enough detail to make accurate changes to ads. They introduced three new metrics. Now you have more insight into what Facebook is seeing in the auction and how your ads rank within.

If some of your ads are below average, it’s time to start fixing them now. Check out our creative services offerings here in our Creative Studio.

 

READ OUR whitepapers for creative best practices for Facebook & Google social advertising.