Tech giants are racing to ward off a carbon time bomb caused by the massive data centres they’re building around the world.
A technique pioneered by Google is gaining currency as more power-hungry artificial intelligence comes online: using software to hunt for clean electricity in parts of the world with excess sun and wind on the grid, then ramping up data centre operations there. Doing so could cut carbon and costs.
There’s an urgent need to figure out how to run data centres in ways that maximise renewable energy usage, said Chris Noble, co-founder and CEO of Cirrus Nexus, a cloud computing manager tapping data centres owned by Google, Microsoft and Amazon.
The climate risks sparked by AI-driven computing are far-reaching — and will worsen without a big shift from fossil fuel-based electricity to clean power. Nvidia CEO Jensen Huang has said AI has hit a “tipping point”. He has also said that the cost of data centres will double within five years to power the rise of new software.
Already, data centres and transmission networks each account for up to 1.5% of global consumption, according to the International Energy Agency. Together, they’re responsible for emitting about as much carbon dioxide as Brazil annually.
Hyperscalers — as the biggest data centre owners like Google, Microsoft and Amazon are known — have all set climate goals and are facing internal and external pressure to deliver on them. Those lofty targets include decarbonising their operations.
Wreaking havoc
But the rise of AI is already wreaking havoc on those goals. Graphics processing units have been key to the rise of large language models and use more electricity than the CPUs used in other forms of computing. Training an AI model uses the more power than 100 households in a year, according to IEA estimates.
“The growth in AI is far outstripping the ability to produce clean power for it,” he said.
Moreover, AI’s energy consumption is volatile and more akin to a sawtooth graph than a smooth line that most data centre operators are used to. That makes decarbonisation a challenge, to say nothing of ensuring grid stability.
Read: Data centres are straining electricity grids worldwide
AI’s growth is being driven by North American companies, keeping computing power — and energy usage — concentrated there, said Dave Sterlace, account director for global data centres at Hitachi Energy. That’s a trend he didn’t expect two years ago.
To lower data centre carbon emissions, hyperscalers and other data centre providers have financed massive amounts of solar or wind farms and used credits to offset emissions. (In the case of credits, some have failed to have a meaningful impact on emissions.)
But that alone won’t be enough, especially as AI use ticks up. That’s why operators are turning to the strategy employed by Google called load shifting. The idea: lower emissions by upending the way data centres function.
Today, most data centres seek to operate in a “steady state”, such that their energy consumption is fairly stable. That leaves them at the mercy of the grid they’re connected to and whatever the day’s mix of natural gas, nuclear and renewable power generation is given the lack of transmission lines between regions. To break their reliance on dirtier grids, tech giants are looking for opportunities to shift daily or even hourly data centre operations around the world in an effort to soak up excess renewable energy production.
Google launched the first effort to match its power usage at certain data centres with zero-carbon power on an hourly basis in a bid to get its machines running on clean energy 24/7. No one has fully achieved that goal yet. And, to be sure, the strategy of shifting loads around the world might be complicated by countries pushing for data sovereignty policies that attempt to restrict and safeguard the flow of data across borders. But what Cirrus Nexus and Google are testing could still be a critical piece of the puzzle for cutting emissions.
Manhattan-based Cirrus Nexus scours the world’s power grids and measures emissions in five-minute increments to find the least polluting computing resources for itself and its clients in industries that range from pharmaceuticals to accounting. The company had a chance to put that search into practice last year.
The Netherlands was in the midst of its sunniest June on record, causing the cost of solar power on the grid to drop. That made it cheaper and less carbon-intensive to run servers. Cirrus Nexus then shifted its computing load to California once the sun went down in the Netherlands, allowing it to draw on solar power just coming online for the day in the Golden State.
By chasing the sun from Europe to the US west coast and back again, the company was able to slash computing emissions for certain workloads for itself and clients by 34% rather than relying on servers in either location alone, according to company data. Making operations flexible to do that comes with both benefits and risks.
Formidable goal
Being able to pursue spare zero-carbon megawatts can help reduce stress on grids, such as during a heatwave or frigid winter storm. But data centres need to cooperate with utilities and grid operators because big swings in demand can throw electric systems into disarray, boosting the odds of blackouts. Dominion Energy, which is seeing data centre demand soar at its Virginia utility, is working on a programme to harness load shifting at data centres to ease stress on the grid during extreme weather.
In recent years, Google and Amazon have tested shifting data centre use for their own operations and for clients that use their cloud services. (Cirrus Nexus, for instance, uses cloud services offered by Amazon, Microsoft and Google.) In Virginia, Microsoft inked a deal with Constellation Energy that guarantees more than 90% of the power for its area data centre will be zero-carbon energy. Reaching 100%, though, remains a formidable goal for it and other hyperscalers.
Read: How data centres are battling South Africa’s energy crisis
Google’s data centres run on carbon-free energy about 64% of the time, with 13 of the regional sites getting to 85% and seven at just over 90% globally, said Michael Terrell, who leads Google’s 24/7 carbon-free energy strategy.
“But if you’re not displacing fossil assets, then you’re not completely achieving your climate goals,” said Terrell. — Naureen S Malik, (c) 2024 Bloomberg LP