I token dell'AI diventano sempre più economici, ma la memoria diventa sempre più costosa. I costi dell'inferenza sono diminuiti di 280 volte in soli due anni; nonostante ciò, la spesa delle imprese per l'AI è triplicata e i prezzi contrattuali della DRAM hanno appena registrato un aumento record del 90-95% in un solo trimestre. William Stanley Jevons aveva già osservato questo fenomeno nel 1865 con il carbone. Uno sguardo a ciò che riequilibrerà davvero il mercato dei chip e al motivo per cui la risposta sono le nuove fabbriche di semiconduttori previste per la fine del 2027, non modelli più intelligenti o ASIC.

buysellram.com/blog/cheaper-to…

#AI #Semiconduttori #DRAM #CarenzaDiMemoria #DataCenter #HBM #GPU #SSD #ITAD #BuySellRam #ParadossoDiJevons #Hardware #Tecnologia

As AI clusters become larger and GPUs become faster, networking and optical communication are becoming just as important as the compute hardware itself. Copper connections consume too much power and suffer from signal loss at very high speeds, so the industry is gradually moving toward optical interconnects. TrendForce forecasts the combined CPO/NPO market could grow from roughly $100 million in 2025 to over $39 billion by 2030, illustrating how strategic this technology is expected to become.

AI isn't just becoming a compute problem anymore—it's becoming a networking problem. Faster GPUs don't help much if data can't move between them efficiently, so it's not surprising to see optical interconnects becoming a strategic technology for future AI data centers.

trendforce.com/presscenter/new…

#AI #AIInfrastructure #DataCenter #GPU #OpticalNetworking #SiliconPhotonics #CPO #HighSpeedNetworking #HPC #Semiconductors #TechNews #FutureOfAI

Running AI in production? A lot of the bill is memory. Every token a model generates is served from fast memory next to the GPU — and that memory, HBM, is scarce and expensive.
High Bandwidth Flash (HBF) is built to attack that cost: much of HBM's bandwidth at a fraction of the price per GB. A new explainer covers what HBF is, how it could lower inference costs, and how close it actually is.

How HBF could make AI inference cheaper

#HBF #HighBandwidthFlash #AIinference #HBM #AImemory #GPU #DataCenter #Semiconductors #NAND #SKhynix #SanDisk #MemoryWall