Deriving Album Scores from Chart Positions

Pitchfork Reviews vs Rankings

Pitchfork scored BRAT at 8.6 on release. Five months later, they ranked it #7 on their "Best Albums of the 2020s So Far" list.

These represent two distinct signals: the review score captures critical assessment at release, while the chart position captures retrospective evaluation in the context of a larger canon. We developed a model to convert chart positions into numerical scores, allowing us to combine both signals into a unified rating system.

We built this for Wavelength, a Letterboxd-style app for rating and tracking music.

Background: Score Distribution Over Time

Contemporary reviews show a compressed score distribution compared to retrospective assessments.

  • Contemporary reviews (within 1 year of release): 2.3% score 9.0+
  • Retrospective reviews (classic albums, 5+ years old): 27.7% score 9.0+

Contemporary vs Retroactive Reviews

This isn't surprising—retrospective reviews benefit from selection bias (only notable albums get re-reviewed) and reduced uncertainty (the album's influence and staying power are known). The question is how to quantify this difference and use it to interpret chart data.

Methodology: Chart Position → Implied Score

We derived a mapping from chart positions to implied scores by merging two distributions:

1. Retrospective Distribution (1994–1998)

To understand how Pitchfork scores "canonical" albums, we analyzed their reviews of albums from 1994–1998—a period now ~25 years in the past with clear critical consensus.

Dataset: 327 albums, deduped to one album per artist per year (65/year). The deduping prevents prolific artists from skewing the distribution—we care about "how many slots at each score level," not "how many reviews."

The 18 albums that received a perfect 10:

YearAlbums
1994Illmatic (Nas), Ready to Die (Notorious B.I.G.), Liquid Swords (GZA), Live Through This (Hole), Selected Ambient Works Vol. II (Aphex Twin), Crooked Rain, Crooked Rain (Pavement), Weezer (Weezer)
1995The Infamous (Mobb Deep), Post (Björk)
1996Pinkerton (Weezer)
1997OK Computer (Radiohead), Homogenic (Björk), Either/Or (Elliott Smith), Ladies and Gentlemen We Are Floating in Space (Spiritualized)
1998In the Aeroplane Over the Sea (Neutral Milk Hotel), Music Has the Right to Children (Boards of Canada), The Singles (Bikini Kill), Is This Desire? (PJ Harvey)

These are albums that have achieved canonical status over decades. At 3.6 albums/year, this represents the "ceiling" of the distribution—albums that transcend their era.

2. Contemporary Distribution

Reviews published within 1 year of release. This establishes the realistic floor—even great contemporary albums rarely score above 9.0 due to the uncertainty of initial assessment.

Merging the Distributions

For each score level, we take the maximum of the two distributions. This preserves the retrospective premium at the top (more 10s) while using the contemporary floor at the bottom (no album ranked #100 should score below 8.0).

Merged Distribution

ScoreRetro/yrContemp/yrMAX
103.60.73.6
9.70.20.20.2
9.52.00.92.0
9.41.80.81.8
9.32.61.02.6
9.22.01.42.0
9.12.41.32.4
9.03.05.15.1
8.90.61.51.5
8.82.03.63.6
8.72.64.44.4
8.62.86.16.1
8.53.89.99.9
8.42.210.910.9
8.31.812.212.2
8.21.811.711.7
8.13.014.014.0
8.03.446.146.1

The retrospective distribution dominates at scores ≥9.2 (where canonization inflates scores), while the contemporary distribution dominates below (establishing the realistic floor).

Half-Decade Mapping (Top 100 from 5 Years)

For a list like "Best Albums of the 2020s So Far" covering 5 years, we multiply the per-year counts by 5 to get the position cutoffs:

ScorePositions
101–18
9.5–9.719–29
9.430–38
9.339–51
9.252–61
9.162–73
9.074–100

Chart Position to Implied Score

The top 18 positions (3.6/yr × 5 years) receive a 10. The floor of a half-decade Top 100 is 9.0, since position 100 represents only the top 20% of a 500-album universe.

Validation: Comparing Review Scores to Implied Scores

Applying this model to Pitchfork's 2020s list, we observe the following patterns:

AlbumReview ScoreList PositionImplied ScoreΔ
Fetch the Bolt Cutters10#1100.0
Whole Lotta Red8.3#210+1.7
BRAT8.6#710+1.4
Mr. Morale & The Big Steppers7.6#289.5+1.9
Future Nostalgia7.5#539.2+1.7

The mean delta across all reviewed albums on the list is +1.00 points.

Control Group: High-Scoring Albums Not on the List

To validate that chart inclusion is itself a signal (not just a proxy for review score), we identified albums that received scores ≥8.5 but did not appear on the Top 100 list:

AlbumArtistReview Score
Rough and Rowdy WaysBob Dylan9.0
IgnoranceThe Weather Station9.0
EndureSpecial Interest8.8
songsAdrianne Lenker8.8
græMoses Sumney8.6
JavelinSufjan Stevens8.6

This demonstrates that review scores and chart placement are partially independent signals. An album can score well on release but not achieve canonical status, and conversely, an album with a moderate review score can later be ranked highly.

Application: Score Aggregation

For each album, we now have access to two potential scores:

  1. Review score (S_r): Original critical assessment at release
  2. Chart-implied score (S_c): Derived from list position using the mapping above

Our aggregation approach:

  • If both signals exist: Use S_c (the more recent assessment)
  • If only S_r exists: Use S_r
  • If only S_c exists (unreviewed album on list): Use S_c

This produces a unified score that incorporates both initial reception and subsequent canonization.

Appendix: Full Dataset

All 100 albums from Pitchfork's "Best Albums of the 2020s So Far" with review scores, chart-implied scores, and delta.

Original vs Implied Scores

#ArtistAlbumReviewImpliedΔ
1Fiona AppleFetch The Bolt Cutters10100.0
2Playboi CartiWhole Lotta Red8.310+1.7
3Cindy LeeDiamond Jubilee9.110+0.9
4SZASOS8.710+1.3
5BeyoncéRENAISSANCE910+1.0
6VeezeGanger810+2.0
7Charli xcxBRAT8.610+1.4
8ROSALÍA & The WeekndMOTOMAMI +8.410+1.6
9Chuquimamani-CondoriDJ E810+2.0
10WaxahatcheeSaint Cloud +38.710+1.3
11Big ThiefDragon New Warm Mountain I Believe In You910+1.0
12Caroline PolachekDesire, I Want to Turn Into You8.710+1.3
13ML BuchSuntub810+2.0
14billy woods & Kenny SegalMaps8.910+1.1
15AlvvaysBlue Rev8.810+1.2
16Lana Del ReyDid you know that there's a tunnel under Ocean Blvd8.310+1.7
17FKA twigsMAGDALENE9.410+0.6
18Floating Points, Pharoah Sanders, London Symphony Orchestra & Sam ShepherdPromises (feat. London Symphony Orchestra)910+1.0
19Cash CobainPretty Girls Love Slizzy7.49.5+2.1
20AmaaraeFountain Baby8.79.5+0.8
21Nourished by TimeErotic Probiotic 28.29.5+1.3
22Jazmine SullivanHeaux Tales8.49.5+1.1
23Sexyy RedHood Hottest Princess89.5+1.5
24Alex GGod Save the Animals8.49.5+1.1
25LowHEY WHAT8.49.5+1.1
26Jessie WareWhat's Your Pleasure?8.39.5+1.2
27AsakeMr. Money With The Vibe—9.5—
28Kendrick LamarMr. Morale & The Big Steppers7.69.5+1.9
29TurnstileGLOW ON8.49.5+1.1
30L'RainFatigue8.59.4+0.9
31Jessica PrattHere in the Pitch8.89.4+0.6
32WednesdayRat Saw God8.89.4+0.6
33Jane RemoverFrailty89.4+1.4
34JockstrapI Love You Jennifer B8.49.4+1.0
35Fever RayRadical Romantics8.49.4+1.0
36KelelaRaven8.49.4+1.0
37454Fast Trax 3—9.4—
38Faye WebsterI Know I'm Funny haha8.39.4+1.1
39ANOHNIMy Back Was A Bridge For You To Cross8.79.3+0.6
40Perfume GeniusSet My Heart On Fire Immediately99.3+0.3
41Arooj AftabVulture Prince8.29.3+1.1
42Yves TumorHeaven To a Tortured Mind8.59.3+0.8
43Mdou MoctarAfrique Victime8.49.3+0.9
44Phoebe BridgersPunisher8.79.3+0.6
45Sudan ArchivesNatural Brown Prom Queen99.3+0.3
46Kim GordonNo Home Record8.49.3+0.9
47Sofia KourtesisMadres8.59.3+0.8
48Dean BluntBLACK METAL 28.19.3+1.2
49100 gecs10,000 gecs8.29.3+1.1
50Dry CleaningNew Long Leg8.69.3+0.7
51The WeekndDawn FM89.3+1.3
52Bad BunnyUn Verano Sin Ti8.49.2+0.8
53Dua LipaFuture Nostalgia7.59.2+1.7
54Bill OrcuttMusic for Four Guitars7.89.2+1.4
55MJ LendermanManning Fireworks8.79.2+0.5
56Nilüfer YanyaPainless8.49.2+0.8
57BjörkFossora8.49.2+0.8
58Bladee & Ecco2kCrest89.2+1.2
59Yasmin WilliamsUrban Driftwood89.2+1.2
60Mach-HommyPray For Haiti8.89.2+0.4
61Tirzahtrip9love...???7.89.2+1.4
62The MicrophonesMicrophones in 2020—9.1—
63Chief Keef4NEM89.1+1.1
64Jenny HvalClassic Objects89.1+1.1
65Jeff ParkerMondays at the Enfield Tennis Academy8.49.1+0.7
66Rio Da Yung OGCity On My Back7.69.1+1.5
67Taylor Swiftfolklore89.1+1.1
68YaejiWith A Hammer8.59.1+0.6
69Soul GloDiaspora Problems8.59.1+0.6
70The 1975Being Funny In A Foreign Language89.1+1.1
71Charlotte Adigéry & Bolis PupulTopical Dancer8.29.1+0.9
72Yaya BeyRemember Your North Star8.69.1+0.5
73FloristFlorist8.59.1+0.6
74Helado NegroPHASOR8.39+0.7
75The SmileA Light for Attracting Attention8.69+0.4
76HiTechDÉTWAT7.49+1.6
77yeuleGlitch Princess8.39+0.7
78Lil Uzi VertEternal Atake8.49+0.6
79HAIMWomen In Music Pt. III8.69+0.4
80Rx Papi & GudForeign Exchange7.49+1.6
81DestroyerHave We Met8.59+0.5
82KMRUPeel—9—
83KeiyaAForever, Ya Girl8.29+0.8
84The Soft Pink TruthShall We Go On Sinning So That Grace May Increase?8.39+0.7
85Hurray for the Riff RaffThe Past Is Still Alive8.39+0.7
86Ken CarsonA Great Chaos7.89+1.2
87Mannequin PussyI Got Heaven8.89+0.2
88Nala SinephroSpace 1.88.39+0.7
89DijonAbsolutely7.29+1.8
90Huerco S.Plonk8.49+0.6
91Mk.geeTwo Star & The Dream Police7.89+1.2
92Tyler, The CreatorCALL ME IF YOU GET LOST8.49+0.6
93DaphniCherry8.29+0.8
94Jim Legxacyhomeless n***a pop music7.89+1.2
95Blood IncantationHidden History of the Human Race8.39+0.7
96NonameSundial8.89+0.2
97Jaimie BranchFly or Die Fly or Die Fly or Die ((world war))8.59+0.5
98Vampire WeekendOnly God Was Above Us8.69+0.4
99DJ TravellaMr Mixondo7.39+1.7
100jaydesheartpacing—9—

See These Rankings in Action

Download Wavelength to explore music rankings powered by this model. Rate albums and songs to contribute to the collective wisdom.

Download on the App Store