Considering that several companies are planning on using nuclear power to run ai data services, instead of providing power to cities.

Google turns to nuclear to power AI data centres

How is Amazon Using Nuclear to Power AI & Reach Net Zero?

I'm pro-nuclear power, but why not use those reactors and replace fossil fuel sites instead? We don't ai to consume that much power, which in turn requires morec graphite/uranium/thorium mining, which causes direct environmental damage

Google turns to nuclear to power AI data centres

The tech giant says it will use energy from small reactors to power its use of artificial intelligence.

^{João da Silva (BBC News)}

I think this is a bad faith argument because it focuses specifically on chatgpt and how much resources it uses. The article itself even goes on to say that this is actually only 1-3% of total AI use.

People don't give a shit about chatgpt specifically. When they complain about chatgpt they are using it as a surrogate for ai in general.

And yes, the amount of electricity from ai is quite significant.
iea.org/news/ai-is-set-to-driv…

It projects that electricity demand from data centres worldwide is set to more than double by 2030 to around 945 terawatt-hours (TWh), slightly more than the entire electricity consumption of Japan today. AI will be the most significant driver of this increase, with electricity demand from AI-optimised data centres projected to more than quadruple by 2030.

I'm not opposed to ai, I use a lot of AI tools locally on my own PC. I'm aware of how little electricity they consume when I am just using for a few minutes a day.
But the problem is when it's being crammed into EVERYTHING, I can't just say I'm generating a few images per day or doing 5 LLM queries. Because it's running on 100 Google searches that I perform, every website I visit will be using it for various purposes, applications I use will be implementing it for all kinds of things, shopping sites will be generating images of every product with me in the product image. AI is popping up everywhere, and the overall picture is that yes, this is contributing significantly to electricity demand, and the vast majority of that is not for developing new drugs, it's for stupid shit like preventing me from clicking away from Google onto the website that they sourced an answer from.

Its very complex and overkill but its not a bad idea if you want to do it. I believe there is a youtuber SomeOrdinaryGamer who runs a linux base OS with hypervisor OSs on top with GPU passthrough. He has some videos explaining his setup and how it all works and how to configure it.

You could also take a look at this linux distro designed for exactly what you want to do qubes-os.org/.

Qubes OS: A reasonably secure operating system

Qubes is a security-oriented, free and open-source operating system for personal computers that allows you to securely compartmentalize your digital life.

^{Qubes OS}

Can't comment on everything, but given you mentioned audio production: a couple of years ago I tried to get ASIO working from within a VM on a Linux host OS and wasn't having a whole lot of luck.

I think I read somewhere that someone had come up with a special ASIO driver to send the audio directly into the host Linux OS audio subsystem, but I've not tried that or measured latency yet.

I think that's possible. Some people regularly do their work in virtualized environments. Some developers, some people do this for security. And some companies have their employees run everything over network via a thin client / VNC.

It'll be more complex, and you'll probably spend some time setting it up and dealing with some edge cases and unforeseen annoyances. You'll spread your data over several (virtual) computers and probably need some network share or file sync. And whether dynamic assigning of GPUs works, depends on the exact circumstances. Linux has a few tricks available to reset GPUs, mess with the firmware and reassign devices, or pass through things. But last time I tried, that was a lot of manual work. So does audio production if you need real time. And I think the "ease of updates" will be overshadowed a bit by now five times as many operating systems to keep up to date. And I don't know much about anti-cheat. I usually skip those games altogether and the rest runs fine on my main distro.

Other possibilities: You could just use one main operating system and install some virtualization software there. And for development and ML you could also use something like Distrobox.

It'd be interesting project but it seems overkill and over complicatiion when the simplest solution is dual booting and giving each OS complete access to the hardware. Hypervisors for all your systems would be a lot of configuration, and some constant overhead you can't escape for potentially minimal convenience gain?

Are you hoping to run these OS at the same time and switch between them? If so I'm not sure the pain of the set up is worth it for a little less time switching between OS to switch task? If you're hoping to run one task in one machine (like video editing) while gaming in another, it makes more sense but you're still running a single i7 chip so it'll still be a bottleneck even with all the GPUs and that RAM. Sure you can share out the cores but you won't achieve the same performance of 1 chip and chip set dedicated to 1 machine that a server stack gives (and which Hypervisors can make good use of).

Also I'd question how good the performance you'd get on a desktop motherboard with multiple GPUs assigned to different tasks. It's doubtful you'd hit data transfer bottlenecks but it's still asking a lot of hardware not designed for that purpose I think?

If you intend to run the systems 1 at a time then you might as well dual boot and not be sharing system resources with an otherwise unneeded host for hypervisor software.

I think if you wanted to do this and run the machines in parallel then a server stack or enterprise level hardware probably would be better. I think it's a case of "just because you can do something doesn't mean you should"? Unless it's just a "for fun" project and you don't mind the downsides? Then I can see the lure.

But if I were in your position and wanted the "best" solution I'd probably go for a dual boot with Linux and Windows. In Linux I'd run games natively in the host OS, and use Qemu to have a virtual machine for development (passing through one of the GPUs for AI work). The good thing in this set up is you can back-up your whole development machine hard drive and restore it easily if you make big changes to the host Linux. Windows I'd use for kernel anti cheat games and just boot into it when I wanted.

Personally I dual boot Linux and windows. I barely use windows now but in Linux I do use Qemu and have multiple virtual machines. I have a few test environments for Linux because I like to tinker, plus a docker server stack that I use to test before deploying to a separate homelab device. I do have a Win11 VM, barely used - it doesn't have a discrete GPU and it's sluggish. If you're gaming I'd dual boot and give it access to the best GPU as and when you need it.

And if you want the best performance, triple boot. Storage is cheap and you could easily have separate drives for separate OS. I have an Nvme for Linux and another Nvme for Windows for example. You could easily have 2 separate discrete Linux installs and a Windows installs. In some ways it may be best as you'd separate Linux gaming from Linux working and reduce distractions.

Windows vms for beating kernel level anticheat takes a lot of work to prevent detection. I recommend dual booting instead for that use case.

For the Linux environments I'd recommend using containers/podman/docker, systemd-nspawn or libvirt. These three solutions use the host kernel as the hypervisor and don't require much setup.

Containers can also share the GPU with the host easily.

Your setup would be
Hardware > Windows | Bazzite > Ubuntu(container) | OSX (libvirtd)

Edit: You can also triple boot with windows, Bazzite and Ubuntu or add a proxmox/whatever hypervisor disk and try it out without touching your working system.

Conceptually, not a problem. Windows 11 runs on top of HyperV with no performance issues. In reality, I think you will spend a lot of time, hit lots of weird edge cases and performance issues, especially with trying to get the Linux and windows hosts to coexist nicely.

That said, I'd love to watch you try 😀

honestly I think you're better off trying to figure out how to get it all done in one distro. two other vms hogging resources in the background is not something that can be optimized well. but two applications in the background can be optimized excellently by the os

but that said, keep us posted on what u do and how it works out...

If you are fine with having things on the same OS, look into distrobox. It would let you set up an Ubuntu environment/container on top of your Bazzite install. You could also use something like OSX-KVM for MacOS with GPU passthrough (assuming you use a compatible GPU) which would simplify your setup greatly. That way you could technically have all 3 environments on one OS with one set of hardware but now the only thing being virtualized is MacOS.

(You could also dual-boot with MacOS if you wanted and it would be slightly faster than a VM but also more of a headache to setup)

Edit: Missed that you mentioned Windows but the setup for that would be pretty much the exact same as MacOS except getting GPU passthrough to work on Windows is easier (again, same limitations as MacOS though, and games with anticheats would be able to tell that Windows is in a VM).

I use VMs a lot for desktops doing development work. It's certainly possible, with some caveats. Here's a bit of a knowledge-dump that may be helpful.

Multiple displays can be tricky. If you just want a single monitor you're fine. But hypervisors have varying support for more than one display and some do it better than others. VirtualBox had the absolute best support for it. Hyper-V has "support" for it but only really if you use their preferred Ubuntu install. I'm not sure how libvirt handles it. Remote display protocols have varying support and can be options - rustdesk seems to support it very nicely (one window per display like VirtualBox) but I've had lots of keyboard issues with that.

Running VMs is less efficient, you'll need more memory in the base system to handle each VM but it sounds like you're pretty decked out there.

Access to hardware can be tricky. Hyper-V sucks at this - don't use it if you can help it. I've never quite done gaming in a VM but I suspect this would be the most problematic. I have done libvirt pass-through of an nvidia card but only for video encoding/decoding with Jellyfin - which does work just fine. But VM displays tend not to be well accelerated so I would expect other issues. As an example my hyper-v Linux guest can't play video above a small resolution without the audio skipping and losing track.

I'd avoid Hyper-V entirely. It absolutely sucks as a desktop environment. It relies heavily on RDP "enhanced mode" for everything, has shitty support for hardware pass-through, etc. Just a complete fail.

VirtualBox was really quite good for a desktop environment - but Oracle is more lawfirm than software company these days. There are hidden license issues with using any extensions (for, e.g. accelerated displays).

Libvirt I don't have as much experience with unfortunately. I've usually emulated Linux on Windows not the other way 'round.

I work four days a week on a remote windows vm. It has everything I need, and I remote from /that/ onto whatever other vm I might need. I connect over a vpn using, well, anything. As you've pointed out, the local machine doesn't need much in the way of specs, although in my case I have three monitors - all given over to the remote, and it's a clean way to separate work's environment and network from my own and it's a very common work pattern. The hypervisor there is vmware, but that doesn't matter.

But.. Gaming is a different. There is latency over the conn, and audio/graphic lag would make FPS and gpu-heavy games particularly poor. I don't know of a way to totally overcome that, although game-streaming services exist, so presumably it is possible.