Multiple computers are connected with a network in a distributed processing system (or a parallel processing system). Each computer of such a system is called a `node’. In a centralized system, one host computer manages the whole system. In a distributed-parallel processing system, on the other hand, every node cooperates with each other to manage the system.