This series records my understanding about High Performance Computing, including scale-up (intra-node performance improvement) and scale-out (cross-node performance elevation).