#52: The Power of the Cloud

Posted on November 8, 2024 by ewand

Being shown around a modern datacenter is a pretty awesome experience. The huge rooms full of servers, networking gear and storage can be reminiscent of that last scene in Raiders of the Lost Ark. Dig a little deeper, though, and it’s the power systems that are truly jaw-dropping; how much power the DC uses when it’s running and what to do if the power supply goes away is a big part of building these operations.

At one point, Microsoft used huge Caterpillar diesel generators, each of which could generate several megawatts and was kept ready and waiting by continually pumping hot oil inside, so the machine could be started and running at full tilt in a fraction of a second in the event of power failure. Moves are afoot to use hydrogen fuel cells or other means of storing and generating backup power.

AI and Datacenter boom

As much traditional computing has moved into the cloud over the last decade or two, and faster and more mobile internet access drives end-user demand, datacenters have been getting bigger and more numerous. They almost can’t build them fast enough. About 1/3 of all worldwide DCs are in the US, and together they soak up about 6% of all electricity.

Datacentres worldwide used about 460 TWh of electricity in 2022; that’s 460 billion KWh, or enough to run 35 trillion lightbulbs continuously – about 4,300, 24×7, for each person on the planet. That’s quite a lot of power. Expect that amount to double by 2026. Google and Microsoft reportedly consumed 24TWh each in 2023.

[source – Electricity 2024 – Analysis and forecast to 2026]
https://iea.blob.core.windows.net/assets/6b2fd954-2017-408e-bf08-952fdd62118a/Electricity2024-Analysisandforecastto2026.pdf

Generative AI is VERY power hungry: estimates vary but research showed that generating one image used as much power as over 500 smartphone charges, averaging around 3KWh per image. Better make sure your ChatGPT / Copilot / Microsoft Designer usage is worthwhile and not just creating stupid images of cats and dogs.

To put the commensurate CO2 output into context, however, 1,000 of such images would be the equivalent emissions of driving a car for 4.1 miles. It’s thought that Generative AI on its own could well consume 100TWh or more by 2027.

DC providers are also looking for ways to ensure they can get enough power into the datacenter – Microsoft has even committed to restarting one of the Three Mile Island nuclear reactors and buying all of its power for 20 years. A nod to the old commitment of being carbon negative by 2030, perhaps, but the massive DC expansion to fuel demand for AI makes achieving that target seem increasingly unlikely.

Maybe new governmental administrations will incentivize clean power and reward efficiency?

Local PC power usage

There is something of a dichotomy in power usage on a local computer, especially if it’s powered from the wall rather than using a battery. You want to buy the highest performing, most feature-laden machine you can afford, so (apart from preserving battery life) why would you deliberately knobble its performance to save power? Like buying a Ferrari and driving everywhere at 20mph.

Some quick wins, especially on laptops, could be to reduce the brightness of the screen and use Dark Mode. Check the Power settings on your PC for recommendations on how to lower its energy use. Reduce the number of background apps and trim the ones which start automatically.

If you have an Intel-powered computer (PC, Mac or Linux), they have a free power usage gadget which might give you some idea about the total power consumption of your system, though doesn’t really shed much light as to what’s making it do what it’s doing…

You could try firing up Task Manager (CTRL+SHIFT+ESC) and adding a couple of columns to its default view (right-click on the column headings); useful to know which apps or processes are causing the power usage to shoot up, but devoid of actual numbers for the more data-obsessed.

Edge browser has an Efficiency mode – click the … settings menu in the top right and look under Browser essentials.

If you need more data on overall system performance, try GPU-Z – it gives detailed stats on the Graphics Processing Unit and other main components of your system, including current, maximum / minimum / average power consumption …

In the screenshot above, the Power Consumption (%) shows how much of the graphics board’s maximum power consumption is currently being used. A similar utility, CPU-Z, can give data about the TDP of the main CPU and how it’s doing too.

629 – Edge Task, Man

Posted on May 6, 2022 by ewand

Following on from ToW #627, which talked about the efficiency of the latest versions of the Chromium-based Edge browser, avid reader Brad Wilson commented on another natty feature of the ~~ChrEdge~~ ~~Edgmium~~ Edge browser: the built-in Task Manager.

If you’re in Edge already, press SHIFT+ESC, or go to the “…” menu in the top right, choose More Tools > and find Browser task manager under there. Even though the main Windows Task Manager has been overhauled recently with extended support for Edge, the browser task man gives even more insight into what’s going on with the various tabs, extensions and supporting processes.

For one, you can see specifics about the different bits of the browser to find out if things are bogging down and start to troubleshoot why, and kill off potentially rogue processes if you feel like living dangerously.

Right-click in the task list to add more columns to the display, like CPU Time to show longer-term vampire processes, or Profile, to display which of the potentially multiple browser profiles are hosting that tab or extension.

If the browser is taking up a bit more CPU or memory than you think it should, it may be time to prune the installed extensions list somewhat (disabling certain extensions from lesser-user profiles or removing some altogether), or engage in a more protracted exercise to find out where the memory is being used.

In further Edge updates, a new built-in VPN feature is being tested; powered by Cloudflare, it will give users signed in with a Microsoft Account an encrypted channel with up to 1Gb of data every month to run through what it calls “Microsoft Edge Secure Network” – it’s not there to let you watch iPlayer or Netflix while you’re abroad, but it could be handy for syncing email on a coffee shop Wi-Fi network. Presumably, when your free 1Gb runs out, you’ll get some warning and an opportunity to add some more coins to the meter.

Also, Edge is now 101, though there’s not much excitement for most users.

533 – Revisiting TaskMgr

Posted on June 18, 2020 by ewand

If you’ve ever had problems with your PC’s performance, you may have turned to Task Manager. It’s been in Windows since the NT4.0 days, when developer Dave Plummer came up with a bit of software he was planning to sell, but decided to donate it to his employer instead:

I’m the Microsoft developer that wrote TaskMgr at home in my den in about 1994 and then the NT silverback devs [ie Dave Cutler] let me check it into the main tree even though I was a greenhorn at the time. So that meant I got to bring it into work and polish it up and make it an official part of Windows, where it remains to this day.

Dave tells his career story from a talk a couple of years back, but hit the news recently through a Reddit post from which the italic text above originates.

He was inspired to apply to Microsoft in 1993 – having read the Hard Drive book (an excellent historical tome, having inspired at least a few great Microsofties to join up), then went on to write various money-saving optimisations for MS-DOS, and ended up in the NT team, leaving the company 10 years later.

Dave also recommends another great history book – Showstopper!

Back to the current era, Task Manager is still a really useful tool when it comes to figuring out issues with your Windows PC. If you think something is wrong (app starts bogging down, feels like the PC is in a bad way), you can quickly start Task Manager with the shortcut CTRL+SHIFT+ESC (easy to hit with one hand…)

In an emergency (if it feels like your laptop it about to blow up, with fan blaring, screen blinking, UI non-responsive etc – maybe joining a Teams call or opening an Excel spreadsheet), it’s usually possible to throw TASKMGR its own special three-fingered-salute, since it isn’t tied to the Windows Shell – you can use even Task Manager to kill or restart the EXPLORER.EXE that sits under the Start menu, task bar etc.

If you can get to Task Manager, you can run a CMD or Powershell prompt, start explorer or msedge etc.

Practical Example

A colleague pleaded recently that he was having a poor experience with Teams, and queried, did he need to upgrade his 150Mbps internet connection?

To check what kind of network performance you’re actually receiving, there are many speed test apps and sites.

If you’re using the new Edge (if not, why not? Don’t use IE – it’s too old; stop using old Edge – it’s obsolete; the new Edge is fast and it’s better than Chrome), and you have Bing as your default search engine, all you need do is enter ? speed test into the address bar and you’ll get a speed test gadget to give you an idea of performance.

If the base speed looks OK, use Task Manager to inspect what’s happening – fire it up in your favoured way (clicky-clicky-menu, right-click the taskbar, CTRL-ALT-DEL > Task Manager, if not CTRL-SHIFT-ESC) and by default you’ll see the near-useless list of what’s running with no other context. Time to show more details…

On the Processes tab, click on the CPU column to sort by what’s using the processor most – its also worth casting an eye on some other resources to make sure they’re not running out of steam; if you see an app consuming a huge amount of memory, it might be leaking, and shutting it down completely could make all the difference.

Task Manager lets you kill processes (“End Task”) too, if the app has hung and won’t close cleanly. In fact, Dave said there should be nothing that Task Manager can’t kill (apart from some critical system processes – TM might have been able to kill them, but will also bluescreen the machine … so some protection has been added to prevent the user from doing something that would be instantly fatal to Windows – though TM is able to kill itself).

Back to the Teams troubleshooting scenario – If you don’t see the PC getting nailed by some process (that isn’t Teams itself), then it’s worth looking at the Performance tab, and leave it running for a short while, paying particular attention to WiFi/Ethernet.

If you see sustained high throughput, then switch back to the Processes tab, sort by Network and you can see what service/app it is that’s hammering the connection. You could fire up Resource Monitor if you want to dig in even further, started from the bottom of the Performance tab. ResMon lets you drill down to see what a single process is doing, what it’s connecting to, how much network traffic is going to and from it, and so on. Useful, if you like that sort of thing.

Finally, your network might perform brilliantly most of the time, but every so often you get a blip that feels like it’s dragging, then it picks up again. This could be spikes in latency, the enemy of anything real-time, like video calls.

Try running the Microsoft Research Speed Test app – the nice thing is that it keeps a history log, so if you ever think your connection is bogging down, try running a realtime test.

The Network delay is actually key here – if you had more than 1Mbps upload and 5Mbps download speed, that should be plenty – but if your network delay is commonly more than ~150ms, it’s going to start causing problems.

If you have a network connection whose latency fluctuates a lot, there are a bunch of things you could do to seek and troubleshoot:

Is something else on your network uploading huge amounts of data (a backup process, or OneDrive sync maybe) ? This is particularly important if you use an ADSL type connection, where choking the upload will also dramatically reduce download throughput too.
Is your wireless network getting interference? (try switching to a wired network, or use a Wifi Analyzer app to see if the channel it’s using has a noisy neighbour?)
Pin the blame on your service provider by keeping a log of latency performance over time, using something like http://ping-test.net/. If you can prove that your own network is stable, but there are glitches upstream somewhere, then you may be able to make your ISP turn their attention to their own network – tools like WinMTR will help you validate the performance of the network all the way between your machine and some endpoint; so if your ISP has networking problems, you might see spikes happening.