{"id":751,"date":"2024-05-21T01:03:48","date_gmt":"2024-05-21T01:03:48","guid":{"rendered":"https:\/\/isog.xyz\/?p=751"},"modified":"2024-05-21T01:03:48","modified_gmt":"2024-05-21T01:03:48","slug":"cj5ll89dy2mo-amp","status":"publish","type":"post","link":"https:\/\/isog.xyz\/?p=751","title":{"rendered":"Electricity grids are cracking as AI requirements rise"},"content":{"rendered":"
\n
\n
<\/p>\n

Image source, <\/span>Getty Images<\/p>\n<\/div>

Image caption, <\/span>The electricity demand of data centers is expected to double between 2022 and 2026<\/span><\/span><\/figcaption><\/figure>\n
Item information<\/strong><\/p>\n
    \n
  • Author, <\/span>Chris Baraniuk<\/span><\/span><\/li>\n
  • Role, <\/span>Technology reporter<\/span><\/span><\/li>\n
  • \n

    \n

    There’s a big problem with generative AI, says Sasha Luccioni of Hugging Face, a machine learning company. Generative AI is an energy hog.<\/b><\/p>\n<\/div>\n

    \n

    \u201cEvery time you query the model the whole thing is activated, so from a computational perspective it’s hugely inefficient,\u201d she says.<\/p>\n<\/div>\n

    \n

    Take the Large Language Models (LLMs) that are at the heart of many generative AI systems. They are trained in the large amount of written information, which allows them to produce text in response to almost any question.<\/p>\n<\/div>\n

    \n

    \u201cWhen you use generative AI\u2026 it generates content from scratch, it essentially makes up answers,\u201d Dr. Luccioni explains. That means the computer has to work quite hard.<\/p>\n<\/div>\n

    \n

    According to a recent study by Dr. Luccioni and colleagues, a generative AI system could consume about 33 times more energy than machines running task-specific software. The work has been peer-reviewed but has yet to be published in a journal.<\/p>\n<\/div>\n

    \n

    However, it’s not your PC that’s using all this energy. Or your smartphone. The calculations we increasingly rely on happen in gigantic data centers that are out of sight and out of mind for most people.<\/p>\n<\/div>\n

    \n

    \u201cThe cloud,\u201d says Dr. Luccioni. \u201cYou don’t think about these huge boxes of metal that get hot and use so much energy.\u201d<\/p>\n<\/div>\n

    \n

    The world’s data centers are consuming more and more electricity. By 2022, they will have consumed 460 terawatt hours of electricity, and the International Energy Agency (IEA) expects this to double in just four years. Data centers could use a total of 1,000 terawatt hours per year by 2026. \u201cThis demand is approximately equivalent to Japan’s electricity consumption,\u201d the IEA said. Japan has 125 million inhabitants.<\/p>\n<\/div>\n

    \n

    Data centers store vast amounts of information so it can be retrieved from anywhere in the world \u2013 from your emails to Hollywood movies. The computers in those faceless buildings also power AI and cryptocurrency. They form the basis of life as we know it.<\/p>\n<\/div>\n

    Image caption, <\/span>AI can be “extremely inefficient” in using computing resources, says Sasha Luccioni<\/span><\/span><\/figcaption><\/figure>\n
    \n

    National Grid’s boss said in a speech in March that demand for electricity from data centers in Britain will increase sixfold in just a decade, largely fueled by the rise of AI. However, National Grid expects that the energy required to electrify transport and heat will be much greater in total.<\/p>\n<\/div>\n

    \n

    Utilities in the US are starting to feel the pressure, says Chris Seiple of consultancy Wood Mackenzie.<\/p>\n<\/div>\n

    \n

    \u201cThey are facing data center demands at exactly the same time that \u2013 thanks to government policy \u2013 \u200b\u200bthere is a renaissance in domestic manufacturing,\u201d he explains. Lawmakers in some states are now reconsidering the tax breaks offered to data center developers due to the enormous strain these facilities place on local energy infrastructure, according to reports in the US.<\/p>\n<\/div>\n

    \n

    Mr Seiple says there is a ‘land grab’ for data center locations near power stations or renewable energy hubs: \u201cIowa is a hotbed of data center development, there is a lot of wind energy generated there.\u201d<\/p>\n<\/div>\n

    \n

    Some data centers today can afford to move to more remote locations because latency \u2013 the delay, usually measured in milliseconds, between information being sent from a data center and the user receiving information \u2013 is not a major problem for the increasingly increasingly popular generative AI systems. In the past, data centers that handled emergency communications or financial trading algorithms, for example, were placed in or near major population centers for the absolute best response times.<\/p>\n<\/div>\n

    \n
    <\/p>\n

    Image source, <\/span>Getty Images<\/p>\n<\/div>

    Image caption, <\/span>Nvidia CEO Jensen Huang shows off the new Blackwell chip in March<\/span><\/span><\/figcaption><\/figure>\n
    \n

    There is little doubt that data center energy demands will increase in the coming years, but there is great uncertainty about how much, Mr. Seiple points out.<\/p>\n<\/div>\n

    \n

    Part of that uncertainty is due to the fact that the hardware behind generative AI is constantly evolving.<\/p>\n<\/div>\n

    \n

    Tony Grayson is a managing director at Compass Quantum, a data center company, and he points to Nvidia’s recently launched Grace Blackwell supercomputer chips (named after a computer scientist and a mathematician), which are specifically designed to power high-performance processes, including generative AI. , quantum computers and computer-aided drug design.<\/p>\n<\/div>\n

    \n

    Nvidia says that in the future, a company could train AIs many times larger than the largest AI systems currently available, in 90 days, using 8,000 previous-generation Nvidia chips. This requires an electricity supply of 15 megawatts.<\/p>\n<\/div>\n

    \n

    But the same work could be done in the same time by just 2,000 Grace Blackwell chips, and according to Nvidia, they would require a four-megawatt power supply.<\/p>\n<\/div>\n

    \n

    That equates to a consumption of 8.6 gigawatt hours of electricity \u2013 about as much as the entire city of Belfast uses in a week.<\/p>\n<\/div>\n

    \n

    \u201cThe performance increases so much that your overall energy savings are significant,\u201d says Mr Grayson. But he agrees that energy demand determines where data center operators locate their facilities: \u201cPeople are going to places where there is cheap power.\u201d<\/p>\n<\/div>\n

    \n

    Dr. Luccioni notes that the energy and resources required to manufacture the latest computer chips are significant.<\/p>\n<\/div>\n

    More technology from business<\/strong><\/section>\n
    \n

    Still, it’s true that data centers have become more energy efficient over time, argues Dale Sartor, a consultant and partner at the Lawrence Berkeley National Laboratory in the US. Their efficiency is often measured in terms of energy consumption effectiveness, or PUE. The lower the number, the better. State-of-the-art data centers have a PUE of around 1.1, he notes.<\/p>\n<\/div>\n

    \n

    These facilities still create significant amounts of waste heat and Europe is ahead of the US in finding ways to use that waste heat \u2013 such as heating swimming pools \u2013 says Mr Sartor.<\/p>\n<\/div>\n

    \n

    Bruce Owen, UK managing director at Equinix, a data center company, says: \u201cI still think demand will grow beyond the efficiency gains we’re seeing.\u201d He predicts more data centers will be built, including on-site power generation facilities. Equinix was denied planning permission for a gas data center in Dublin last year.<\/p>\n<\/div>\n

    \n

    Mr. Sartor adds that cost may ultimately determine whether generative AI is worth it for certain applications: \u201cIf the old way is cheaper and easier, there won’t be much of a market for the new way.\u201d<\/p>\n<\/div>\n

    \n

    Dr. However, Luccioni emphasizes that people need to clearly understand how the options before them differ in terms of energy efficiency. She is working on a project to develop energy assessments for AI.<\/p>\n<\/div>\n

    \n

    \u201cInstead of choosing this GPT-derived model that is very clunky and uses a lot of energy, you can choose this A+ Energy Star model that will be a lot lighter and more efficient,\u201d she says.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Image source, Getty Images Image caption, The electricity demand of data centers is expected to double between 2022 and 2026 […]<\/p>\n","protected":false},"author":2,"featured_media":752,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[30],"tags":[334,403,404,405,381],"class_list":["post-751","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-business","tag-cracking","tag-electricity","tag-grids","tag-requirements","tag-rise"],"_links":{"self":[{"href":"https:\/\/isog.xyz\/index.php?rest_route=\/wp\/v2\/posts\/751","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/isog.xyz\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/isog.xyz\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/isog.xyz\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/isog.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=751"}],"version-history":[{"count":0,"href":"https:\/\/isog.xyz\/index.php?rest_route=\/wp\/v2\/posts\/751\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/isog.xyz\/index.php?rest_route=\/wp\/v2\/media\/752"}],"wp:attachment":[{"href":"https:\/\/isog.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=751"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/isog.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=751"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/isog.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=751"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}