Filter by categories
Filter by dates
Beyond the Plumbing: Engineering Direct-to-Chip Cooling for AI Workloads
uptime, engineering, operations Albert Wong uptime, engineering, operations Albert Wong

Beyond the Plumbing: Engineering Direct-to-Chip Cooling for AI Workloads

The Hidden Engineering Challenge of Direct‑to‑Chip Cooling

AI workloads don’t just run hotter – they run differently. Training a large language model can ramp GPU utilisation from 60% to 100% and back down within milliseconds, pushing coolant temperatures above 45°C in closed loops. That rapid thermal cycling demands response times measured in seconds, not minutes.

Direct‑to‑Chip (D2C) liquid cooling is the industry’s answer, but it introduces new risks: fluid inches from $40,000 GPUs, hundreds of potential leak points, and coolant chemistry that can corrode piping from the inside out.

And if a cooling anomaly strikes? You have roughly 5–10 seconds before the silicon throttles – or crashes a multi‑day training job.

Traditional data centre operations weren't built for this. Managing D2C requires fluid chemistry expertise, concurrent maintenance procedures for live liquid loops, and unified IT‑facilities alarm chains.

That’s the new engineering reality of AI infrastructure.

Read More
AI Training Boom: Is Your Data Centre Ready for the New Rules?
insights, engineering Albert Wong insights, engineering Albert Wong

AI Training Boom: Is Your Data Centre Ready for the New Rules?

The New Rules of AI Data Centre Engineering

The race to build AI factories isn’t just a technological challenge - it’s redefining the physical limits of our data centres. A new Uptime Institute survey shows average rack density for AI training hardware has hit 56 kW, with the share of sites exceeding 100 kW more than doubling in just one year.

At the same time, the Australian Government has published five formal expectations for AI infrastructure - from underwriting renewable energy to using water‑efficient cooling. Projects that align will be prioritised; those that don’t will face significant headwinds.

For organisations building or upgrading AI infrastructure, the message is clear: business as usual is no longer an option. Specialised engineering is the difference between delay and delivery.

Read More