The development of large language models (LLMs) is a complex process, requiring specialized infrastructure and skills, as well as the ability to differentiate the result — since there is little value in replicating the work done by others. It is becoming clear that few organizations will choose to train their own LLMs, opting instead to […]
The pursuit of training ever-larger generative AI models has necessitated the creation of a new class of specialized data centers — facilities that have more in common with high-performance computing (HPC) environments than traditional enterprise IT. These data centers support very high rack densities (130 kW and above with current Nvidia rack-scale systems), direct-to-chip liquid […]
Each new generation of server silicon is pushing traditional data center air cooling closer to its operational limits. In 2025, the thermal design power (TDP) of top-bin CPUs reached 500 W, and server chip product roadmaps indicate further escalation in pursuit of higher performance. To handle these high-powered chips, more IT organizations are considering direct […]
“Reasoning” models — and their offshoots, such as “deep research” — have emerged as a major trend in generative AI, helping improve the accuracy and reliability of responses to complex problems. However, this approach significantly increases the computational costs of generating responses. The imitation of reasoning means a higher consumption of server capacity, requiring additional […]
Despite their role as enablers of technological progress, data center operators have been slow to take advantage of developments in software, connectivity and sensor technologies that can help optimize and automate the running of critical infrastructure. Most data center owners and operators currently use building management systems (BMS) and / or data center infrastructure management […]
Corporate data centers have been the backbone of enterprise IT since the 1960s and continue to play an essential role in supporting critical business and financial functions for much of the global economy. Yet, while their importance remains, their prominence as part of an enterprise’s digital infrastructure appears to be fading. Today, businesses have more […]
The topic of artificial intelligence (AI) has captured the public’s imaginations, and now barely a week goes by without reports of another breakthrough. Among the many, sometimes dramatic predictions made by experts and non-experts alike is the potential elimination of some, or even many, jobs. These expectations are partly — but only partly — mirrored […]
European countries narrowly avoided an energy crisis in the past winter months, as a shortfall in fossil fuel supplies from Russia threatened to destabilize power grids across the region. This elevated level of risk to the normally robust European grid has not been seen for decades. A combination of unseasonably mild weather, energy saving initiatives […]
Up until two years ago, the cost of building and operating data centers had been falling reasonably steeply. Improving technology, greater production volumes as the industry expanded and consolidated, large-scale builds, prefabricated and modular construction techniques, stable energy prices and the low costs of capital have all played a part. While labor costs have risen […]
The thousands of gallons of diesel that data centers store on-site to fuel backup generators in the event of a grid outage are hard to ignore — and do little to assist operators’ drive toward tougher sustainability goals. In the past two years, an alternative to diesel made from renewable materials has found support among […]