Collection

Tag: parallel-computing

Lamport and Sequential Consistency: Defining What Parallel Memory Should Mean

Leslie Lamport's 1979 definition of sequential consistency gave shared-memory programmers a precise contract: concurrent execution should look like one interleaving that preserves each processor's program order.

↗

Gene Amdahl and the Serial Fraction: Why Parallel Speedup Has a Ceiling

Gene Amdahl's 1967 argument showed that speeding up only the parallel part of a workload leaves a stubborn serial remainder, creating a mathematical ceiling on strong-scaling speedup.

↗

MPI and the Standardization of Message Passing for Scientific Computing

MPI turned a fragmented landscape of parallel message-passing libraries into a portable standard that could span supercomputers, clusters and scientific applications.

↗