Seoul newsroom films a week inside the algorithm
Five days with the team that decides what a recommendation system is allowed to optimise for, and the editors who audit it afterwards.
2 min read
Most newsroom recommendation systems are built once and then inherited. This one is reviewed every Friday by two editors with the authority to change what it weights, and the meeting is on camera.
The weekly audit
The review takes an hour and covers three numbers. What share of readers saw a story from outside their usual sections. How far the system drifted from the editorial mix the desk intended. And which corrections failed to reach the people who read the original.
The third is the one no other newsroom in the film’s reporting could produce. A correction that reaches a tenth of the original audience is, functionally, not a correction, and until it is measured nobody has to think about it.
An optimisation target is an editorial position. Someone should have to defend it out loud.
Where it gets uncomfortable
The system performs better on engagement when it narrows. That is not a subtle effect: the version tuned for session length recommends more of what a reader already reads, and it wins on every metric the business side tracks.
Holding the mix costs measurable attention. The film includes the argument about whether that trade is the newsroom’s to make or the reader’s, and it does not resolve it, largely because the two editors disagree.
What the camera changed
Being filmed made the meeting slower and the reasoning more explicit. Both editors say decisions they would previously have made by instinct now get articulated, and about one in five gets reversed in the articulating.
It also made them more conservative, which they regard as a cost. A recorded meeting is a meeting where nobody proposes the reckless idea that occasionally turns out to be right.
What to watch
Watch whether the audit survives a bad quarter, since a control that only operates when performance is comfortable is not a control. Watch whether the correction-reach number is ever published. And watch how many newsrooms adopt the Friday meeting rather than the model behind it, because the meeting is the transferable part.
