35%The leading online ad platforms have a metric for measuring ad quality. The better your ad quality, the lower your costs and the more users see your ads. For Google AdWords, that metric is Quality Score. For Facebook advertising, that metric has been called Relevance Score.

To date, Relevance Score was Facebook’s measure of the quality and engagement level of your ads. It’s important because it determines both your cost per click on Facebook and how frequently Facebook shows your ad. It’s Facebook’s way of telling you that your ads are amazing or their terrible and it’s time to go back to the drawing board.


Facebook’s Recent Changes to Relevance Score

The original Relevance Score attempted to aggregate various signals around ad quality and relevance to give a marketer an idea of how well their ad creativeperformed compared to other ads targeting the same audience. To get this score it used positive signals based on campaign objective (video view, click, conversion, engagement, etc.) and negative signals (hiding an ad) to come up with an overall singular score. This could then be used as part of understanding their ad performance in the auction and when it might be time for an ad or audience refresh. It gives an overall view of your performance while meant to work in concert with other performance metrics.

Ad Relevance Diagnostics

Facebook recently revamped the relevance score metric to offer more information to marketers on what might be affecting ad performance. The new relevance score measurement isn’t based on a singular metric or even called a relevance score anymore. It’s actually three new metrics grouped under the name “Ad Relevance Diagnostics” that give you a more holistic view of the ad experience as compared to other ads in the auction. The three new metrics include quality ranking, engagement rate ranking, and conversion rate ranking.

These taken together give a marketer a better behind the scenes look at how the Facebook algorithm perceives its ad in the auction when compared to other ads targeting the same audience. This, in turn, allows marketers to make more informed decisions on testing creatives, or modifying their ads and audiences.

Why Replace It?

As much as one all-encompassing metric is nice in its simplicity, the original Relevance Score didn’t convey all the information you really would need to make decisions regarding your ads. If an ad had a low relevance score and negative feedback you could assume it was getting hidden a lot, but otherwise you were left to look at other performance metrics and try to guess why your relevance score was low. You didn’t have the detail necessary to make a more informed decision.

Without that detail, it was more difficult than it needed to be to assess why Facebook was assigning a low relevance score and what you should do to fix it through Facebook creative testing. If an ad appeared to be getting good engagement metrics and was converting, you wouldn’t know why it might be getting assigned a lower score.


Measuring Ad Relevance Diagnostics

The three new metrics that Facebook campaigns take into account are as follows:

Quality Ranking: Measures perceived ad quality with your audience as compared to other ads targeting the same audience. It considers signals such as people viewing the ad, people hiding the ad, and assessments of clickbait and/or engagement bait.

Engagement Rate Ranking: Measures your ads expected engagement rate with your audience as compared to other ads targeting the same audience. It considers signals such as the likelihood someone will click, comment, share, react to or expand an ad.

Conversion Rate Ranking: Measures your ad’s expected conversion rate compared to other ads with a similar optimization goal targeting the same audience. It considers the likelihood that someone who viewed your ad will complete a conversion.

Each metric will get a rating from one of the five options below.

  1. Above Average
  2. Average
  3. 35% of the bottom (Below Average)
  4. 20% of the bottom (Below Average)
  5. 10% of the bottom (Below Average)


How to Use these Metrics to Diagnose Ad Performance

You should always focus on your advertising objective first. If your ad is meeting your goal it is likely not worth focusing on the ad relevance diagnostics listed above. Ads that are high performing can at times have below-average scores in these metrics. You would not want to hurt existing performance to chase a higher score in one of these metrics.

Where these metrics truly help is when an ad is not performing well. You need to try and improve that performance. The three ad relevance diagnostics are now more useful in figuring out where Facebook sees a problem with your ad and can help you move the needle toward better performance.

While all three metrics point to potential copy and audience issues, they do have slight differences in what you might want to address to improve your ad performance through creative testing.

Audience Perception

The quality ranking focuses on the overall ad and the perception of its relevance to an audience compared to other ads. Are people viewing or hiding it? Does it contain clickbait or other poor user experiences? If not, perhaps the ad is a poor fit for the audience. In that case, a new audience might be needed.

Audience Fit

Engagement rate ranking similarly looks at an ad and audience fit but considers things like clicks, comments, reactions, etc. to rank the ad compared to others on whether people are engaging with it. High engagement leads to a high score and a perception of ad fit to the audience. Low engagement leads to the opposite.

Audience Conversion

Conversion rate ranking considers the likelihood of conversion and is relevant to conversion related campaign objectives. A poor ranking here would lead you to look at call-to-action in your ad copy, possible landing page issues, or potentially switching to an audience more likely to convert.


The original Facebook Relevance Score offered an accessible and direct way to assess ad performance. But it just didn’t offer enough detail to make accurate changes to ads. They introduced three new metrics. Now you have more insight into what Facebook is seeing in the auction and how your ads rank within.

If some of your ads are below average, it’s time to start fixing them now. Check out our creative services offerings here in our Creative Studio.


Consumer Acquisition Q3 2020: Special Offers

free creative testingwhy does the control video always win

  • For the first time, anyone who becomes a client will have access to FREE Facebook Creative Testing.
  • You can remove the burden of A/B testing creative from your internal UA team.
  • You cover the media fees and Consumer Acquisition’s world-class UA team will manage the media buying of creative split tests for FREE
    (0% of spend) using our proven 3-step methodology detailed above.
  • Check out our funny explainer video Why Does The Control Always Win?
  • Contact: Sales@ConsumerAcquisition.com if you would like to take advantage of this offer.

Free Creative Inspirationcreative studio image

  • Want to know which of your competitors’ video creative really drives their best performance?
  • View +1,000,000 video ads from competitive apps and see which creatives work.
  • To get full access to all FREE Creative Inspiration, please register for a free AdRules account or contact Sales@ConsumerAcquisition.com for more information.

free mobile industry benchmarksMobile Industry Benchmarks

  • Ever wonder how your mobile game or app KPIs perform vs industry benchmarks?
  • Check out our Mobile App Industry Benchmarks dashboard and it is 100% FREE.
  • See competitive KPIs like CTR, CPM, CPC, CPI, IPM, Conv%, country breakdowns, and more.
  • To get full access to FREE industry benchmarks, please register for a free AdRules account or contact Sales@ConsumerAcquisition.com
    for more information.

Let's Talk!

Please prove you are human by selecting the Star.

FAQ Banner

What Is Facebook Creative? Ad Types, Specs & Ideas

FAQ Banner

How Much Does Facebook Advertising Cost? Tips for Creating Successful Campaigns

Read our Blog Posts

5 Facebook Best Practices For A|B Testing New Ad Creative

5 Facebook Best Practices For A|B Testing New Ad Creative

Facebook Power5: New Best Practices for Facebook Advertising in 2019

Facebook Power5: New Best Practices for Facebook Advertising in 2019

3 Ways to Take Advantage of Facebook’s New Advertising Algorithm

3 Ways to Take Advantage of Facebook’s New Advertising Algorithm

Let's Talk!

Contact Image

Please prove you are human by selecting the House.

Read our Whitepapers!

Creative Best Practices for Facebook & Google social advertising.

You have Successfully Subscribed!