How Peter Jackson Used Artificial Intelligence to Restore the Video & Audio Featured in The Beatles: Get Back

Much has been made in recent years of the “de-aging” process­es that allow actors to cred­i­bly play char­ac­ters far younger than them­selves. But it has also become pos­si­ble to de-age film itself, as demon­strat­ed by Peter Jack­son’s cel­e­brat­ed new docu-series The Bea­t­les: Get Back. The vast major­i­ty of the mate­r­i­al that com­pris­es its near­ly eight-hour run­time was orig­i­nal­ly shot in 1969, under the direc­tion of Michael Lind­say-Hogg for the doc­u­men­tary that became Let It Be.

Those who have seen both Lin­day-Hog­g’s and Jack­son’s doc­u­men­taries will notice how much sharp­er, smoother, and more vivid the very same footage looks in the lat­ter, despite the six­teen-mil­lime­ter film hav­ing lan­guished for half a cen­tu­ry. The kind of visu­al restora­tion and enhance­ment seen in Get Back was made pos­si­ble by tech­nolo­gies that have only emerged in the past few decades — and pre­vi­ous­ly seen in Jack­son’s They Shall Not Grow Old, a doc­u­men­tary acclaimed for its restora­tion of cen­tu­ry-old World War I footage to a time-trav­el-like degree of verisimil­i­tude.

“You can’t actu­al­ly just do it with off-the-shelf soft­ware,” Jack­son explained in an inter­view about the restora­tion process­es involved in They Shall Not Grow Old. This neces­si­tat­ed mar­shal­ing, at his New Zealand com­pa­ny Park Road Post Pro­duc­tion, “a depart­ment of code writ­ers who write com­put­er code in soft­ware.” In oth­er words, a suf­fi­cient­ly ambi­tious project of visu­al revi­tal­iza­tion — mak­ing media from bygone times even more life­like than it was to begin with — becomes as much a job of tra­di­tion­al film-restora­tion or visu­al-effects as of com­put­er pro­gram­ming.

This also goes for the less obvi­ous but no-less-impres­sive treat­ment giv­en by Jack­son and his team to the audio that came with the Let It Be footage. Record­ed in large part monau­ral­ly, these tapes pre­sent­ed a for­mi­da­ble pro­duc­tion chal­lenge. John, Paul, George, and Ringo’s instru­ments share a sin­gle track with their voic­es — and not just their singing voic­es, but their speak­ing ones as well. On first lis­ten, this ren­ders many of their con­ver­sa­tions inaudi­ble, and prob­a­bly by design: “If they were in a con­ver­sa­tion,” said Jack­son, they would turn their amps up loud and they’d strum the gui­tar.”

This means of keep­ing their words from Lind­say-Hogg and his crew worked well enough in the whol­ly ana­log late 1960s, but it has proven no match for the arti­fi­cial intelligence/machine learn­ing of the 2020s. “We devised a tech­nol­o­gy that is called demix­ing,” said Jack­son. “You teach the com­put­er what a gui­tar sounds like, you teach them what a human voice sounds like, you teach it what a drum sounds like, you teach it what a bass sounds like.” Sup­plied with enough son­ic data, the sys­tem even­tu­al­ly learned to dis­tin­guish from one anoth­er not just the sounds of the Bea­t­les’ instru­ments but of their voic­es as well.

Hence, in addi­tion to Get Back’s rev­e­la­to­ry musi­cal moments, its many once-pri­vate but now crisply audi­ble exchanges between the Fab Four. “Oh, you’re record­ing our con­ver­sa­tion?” George Har­ri­son at one point asks Lind­say-Hogg in a char­ac­ter­is­tic tone of faux sur­prise. But if he could hear the record­ings today, his sur­prise would sure­ly be real.

Relat­ed Con­tent:

Watch Paul McCart­ney Com­pose The Bea­t­les Clas­sic “Get Back” Out of Thin Air (1969)

Peter Jack­son Gives Us an Entic­ing Glimpse of His Upcom­ing Bea­t­les Doc­u­men­tary The Bea­t­les: Get Back

Lennon or McCart­ney? Sci­en­tists Use Arti­fi­cial Intel­li­gence to Fig­ure Out Who Wrote Icon­ic Bea­t­les Songs

Arti­fi­cial Intel­li­gence Pro­gram Tries to Write a Bea­t­les Song: Lis­ten to “Daddy’s Car”

Watch The Bea­t­les Per­form Their Famous Rooftop Con­cert: It Hap­pened 50 Years Ago Today (Jan­u­ary 30, 1969)

How Peter Jack­son Made His State-of-the-Art World War I Doc­u­men­tary They Shall Not Grow Old: An Inside Look

Based in Seoul, Col­in Mar­shall writes and broad­casts on cities and cul­ture. His projects include the book The State­less City: a Walk through 21st-Cen­tu­ry Los Ange­les and the video series The City in Cin­e­ma. Fol­low him on Twit­ter at @colinmarshall or on Face­book.


by | Permalink | Comments (5) |

Sup­port Open Cul­ture

We’re hop­ing to rely on our loy­al read­ers rather than errat­ic ads. To sup­port Open Cul­ture’s edu­ca­tion­al mis­sion, please con­sid­er mak­ing a dona­tion. We accept Pay­Pal, Ven­mo (@openculture), Patre­on and Cryp­to! Please find all options here. We thank you!


Leave a Reply

Quantcast