METHODS OF PARALLEL COMPUTING IN PROGRAM DESIGNING. GRANULARITY

At this time of modern high-speed technologies attention is increasingly focused on parallel computing. In this article some methods of parallel computing, that are useful during program designing, for instance, to improve efficiency or to reduce program execution time, are considered. Among them are load balancing, synchronization, data dependencies and granularity. First and foremost attention is paid to granularity and its types, such as coarse-grained, fine-grained and mediumgrained parallelism.