One Article Review

Accueil - L'article:
Source ErrataRob.webp Errata Security
Identifiant 2957418
Date de publication 2021-06-20 20:34:42 (vue: 2021-06-21 01:05:30)
Titre When we\'ll get a 128-bit CPU
Texte On Hacker News, this article claiming "You won't live to see a 128-bit CPU" is trending". Sadly, it was non-technical, so didn't really contain anything useful. I thought I'd write up some technical notes.The issue isn't the CPU, but memory. It's not about the size of computations, but when CPUs will need more than 64-bits to address all the memory future computers will have. It's a simple question of math and Moore's Law.Today, Intel's server CPUs support 48-bit addresses, which is enough to address 256-terabytes of memory -- in theory. In practice, Amazon's AWS cloud servers are offered up to 24-terabytes, or 45-bit addresses, in the year 2020.Doing the math, it means we have 19-bits or 38-years left before we exceed the 64-bit registers in modern processors. This means that by the year 2058, we'll exceed the current address size and need to move 128-bits. Most people reading this blogpost will be alive to see that, though probably retired.There are lots of reasons to suspect that this event will come both sooner and later.It could come sooner if storage merges with memory. We are moving away from rotating platters of rust toward solid-state storage like flash. There are post-flash technologies like Intel's Optane that promise storage that can be accessed at speeds close to that of memory. We already have machines needing petabytes (at least 50-bits worth) of storage.Addresses often contain more just the memory address, but also some sort of description about the memory. For many applications, 56-bits is the maximum, as they use the remaining 8-bits for tags.Combining those two points, we may be only 12 years away from people starting to argue for 128-bit registers in the CPU.Or, it could come later because few applications need more than 64-bits, other than databases and file-systems.Previous transitions were delayed for this reason, as the x86 history shows. The first Intel CPUs were 16-bits addressing 20-bits of memory, and the Pentium Pro was 32-bits addressing 36-bits worth of memory.The few applications that needed the extra memory could deal with the pain of needing to use multiple numbers for addressing. Databases used Intel's address extensions, almost nobody else did. It took 20 years, from the initial release of MIPS R4000 in 1990 to Intel's average desktop processor shipped in 2010 for mainstream apps needing larger addresses.For the transition beyond 64-bits, it'll likely take even longer, and might never happen. Working with large datasets needing more than 64-bit addresses will be such a specialized discipline that it'll happen behind libraries or operating-systems anyway.So let's look at the internal cost of larger registers, if we expand registers to hold larger addresses.We already have 512-bit CPUs -- with registers that large. My laptop uses one. It supports AVX-512, a form of "SIMD" that packs multiple small numbers in one big register, so that he can perform identical computations on many numbers at once, in parallel, rather than sequentially. Indeed, even very low-end processors have been 128-bit for a long time -- for "SIMD".In other words, we can have a large register file with wide registers, and handle the bandwidth of shipping those registers around the CPU performing computations on them. Today's processors already handle this for certain types of computations.But just because we can do many 64-bit computations at once ("SIMD") still doesn't mean we can do a 128-bit computation ("scalar"). Simple problems like "carry" get difficult as numbers get larger. Just because SIMD can do multiple small computations doesn't tell us what one large computation will cost. This was why it took an extra decade for Intel to make the transition -- they added 64-bit MMX registers for SIMD a decade before they added 64-bit for normal computations.The abo
Envoyé Oui
Condensat 128 1990 2010 2020 2058 256 512 about above accessed added address addresses addressing adopting ago alive all almost already also amazon anything anyway applications apps are argue arm around article average avx away aws bandwidth barrier became because been before behind beyond big bit bits blogpost both bunch business but bypassed can carry certain changes claiming close cloud combining come computation computations computers computing concern consumption contain cost could cpu cpus current databases datasets day deal decade decades delayed description desktop desktops device devices did didn difficult direction directions discipline discussion doesn doing dominated dominates else end enough even event ever evolved exceed exceeding expand extensions extra file first flash form from future get getting gpus growing growth hacker handle happen happened happening has have history hold how ibm identical if storage increasingly indeed industry initial instead integrated intel internal isn issue jumping just laptop large larger last late later law least left let libraries like likely live long longer look lots low machines mainframe mainframes mainstream make many market math maximum may mean means memory merges microsoft might mips mmx mobile modern moore more most move moving much multiple need needed needing never new news nobody non normal not notes now numbers offered often old once one only operating optane ossified other packs pain parallel pentium people perform performing petabytes platters points post power practice pretty previous pro probably problems processor processors promise question r4000 radical rather reading really reason reasons register registers release remaining retired rotating rust sadly same scalar see separately sequentially server servers shipped shipping shows side simd simple size small solid some sooner sort specialized speed speeds standard starting state stops storage such supercomputers support supports sure suspect systems tags take taught technical technologies technology tell terabytes than them theory thing think those though thought time today took toward transition transitions trending two types use used useful uses very what when which why wide will windows won words working worth write x86 year years your
Tags
Stories
Notes
Move


L'article ne semble pas avoir été repris aprés sa publication.


L'article ne semble pas avoir été repris sur un précédent.
My email: