Tensor Parallelism Explained for Multi-GPU Inference
Learn what tensor parallelism splits, when it helps memory fit, and why topology and communication matter.
Hostnot GPU engineering
GPU, AI, and infrastructure guides
Practical notes for choosing hardware, connecting safely, and building dependable AI workloads. Every guide reflects what the platform actually does today.
Showing 1–2 of 2 published articles
Multi-GPU Setup with PyTorch: Data Parallel and Distributed
Understand when to use one process per GPU, how to launch distributed jobs, and how to verify that work is actually parallelized.