UNIT I

1. Evolution of Distributed computing:

1.1 Scalable computing over the Internet
1.2 Technologies for network based systems
1.3 clusters of cooperative computers

2. Grid computing Infrastructures

2.1 cloud computing
2.2 service oriented architecture

3. Introduction to Grid Architecture and standards

3.1 Elements of Grid
3.2 Overview of Grid Architecture
1.1 SCALABLE COMPUTING OVER THE INTERNET

a. The Age of Internet Computing

huge numbers of Internet users.
supercomputer sites and large data centers.
high-performance computing (HPC) no longer optimal
demand for high-throughput computing (HTC).
upgrade data centers fast servers, storage
systems, and high-bandwidth networks.
1.1 SCALABLE COMPUTING OVER THE INTERNET

a. The Age of Internet Computing

a.1 Platform evolution

From 1970 to 1990 personal computers with VLSI.

From 1980 to 2000 portable computers and

pervasive devices wireless capabilities.

Since 1990 use of HPC and HTC systems hidden in

clusters, grids, or Internet clouds.
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.1 Platform evolution

On the HPC side,
- Supercomputers (massively parallel processors
or MPPs) replaced by clusters of cooperative
computers to share computing resources.
- The cluster collection of homogeneous
compute nodes physically connected in close
range to one another.

On the HTC side,

- P2P for DFS.
- Cloud
- Web services
 FIGURE 1.1
Evolutionary trend toward parallel, distributed, and cloud
computing
with clusters, MPPs, P2P networks, grids,
clouds, Web services, and the Internet of Things
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.2 High-Performance Computing

- Emphasize the raw speed performance.

- Increased from Gflops in the early 1990s to now

Pflops in 2010.

- Demands from scientific, engineering, and

manufacturing communities.

- However, the number of supercomputer users is

limited to less than 0% of all computer users.
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.3 High-Throughput Computing

- a strategic change from an HPC paradigm to an

HTC paradigm.

- main applications are Internet searches and

Web services.

- number of tasks completed per unit of time.

- improve in terms of batch processing speed.

- address the acute problems of cost, energy

savings, security, and reliability at many data and
enterprise computing centers.
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.4 Three New Computing Paradigms

- radio-frequency identification (RFID)

- Global Positioning System (GPS).

- sensor technologies has triggered the

development of the Internet of Things (IoT).
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.5 Computing Paradigm Distinctions

- centralized computing, parallel computing,

distributed computing, and cloud computing.

- centralized computing
:All resources (processors, memory, and storage)
are fully shared and tightly coupled within one
integrated OS.
:data centers and supercomputers.
: used in parallel, distributed, and cloud
computing applications
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.5 Computing Paradigm Distinctions

- centralized computing, parallel computing,

distributed computing, and cloud computing.

- parallel computing
: all processors are either tightly coupled with
centralized shared memory or loosely coupled
with distributed memory.
: Inter-processor communication through shared
memory or via message passing.
: parallel computer, parallel programs, parallel
programming
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.5 Computing Paradigm Distinctions

- centralized computing, parallel computing,

distributed computing, and cloud computing.

- distributed computing
: A distributed system with multiple autonomous
computers, having its own private memory,
communicating through a computer network.
: communication through message passing.
: distributed system, distributed program,
distributed programming
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.5 Computing Paradigm Distinctions

- centralized computing, parallel computing,
distributed computing, and cloud computing.

- cloud computing
: either a centralized or a distributed
computing system.
: applies parallel or distributed computing, or
both.
: built with physical or virtualized resources over
large data centers centralized or distributed.
: cloud computing to be a form of utility
computing or service computing
: concurrent computing, Ubiquitous computing,
Internet of Things
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing

a.6 Distributed System Families

- Massively distributed systems are intended to
exploit a high degree of parallelism or concurrency
among many machines.
- In October 2010, the highest performing
cluster machine was built in China with 86016 CPU
processor cores and 3,211,264 GPU cores
in a Tianhe-1A system.
- The largest computational grid connects up to
hundreds of server clusters.
- A typical P2P network may involve millions of client
machines working simultaneously.
- Experimental cloud computing clusters have been
built with thousands of processing nodes.
1.1 SCALABLE COMPUTING OVER THE INTERNET
a. The Age of Internet Computing
a.6 Distributed System Families
- HPC HTC are in demand for computing power in
terms of throughput, efficiency, scalability, and reliability.
- efficiency: HPC: utilization rate of resources. HTC:
job throughput, data access, storage, and power
efficiency.
- dependability: measures the reliability and self-
management.
- Adaptation in the programming model: the ability
to support billions of job requests over massive data sets
and virtualized cloud resources under various workload
and service models.
- Flexibility in application deployment measures the
ability of distributed systems to run well in both HPC
(science and engineering) and HTC (business)
applications.
1. SCALABLE COMPUTING OVER THE INTERNET
b. Scalable Computing Trends and New Paradigms

Jim Grays paper Rules of Thumb in Data

Engineering.
Moores law indicates that processor speed doubles
every 18 months.
Gilders law indicates that network bandwidth has
doubled each year in the past.

price/performance ratio of commodity hardware

future of these computing trends

1. SCALABLE COMPUTING OVER THE INTERNET
b. Scalable Computing Trends and New Paradigms
b.1 Degrees of Parallelism
- Fifty years ago computers designed bit-serial fashion.
- bit-level parallelism (BLP) converts bit-serial processing
to word-level processing gradually.
- 4-bit microprocessors to 8-,16-, 32-, and 64-bit CPUs.
- instruction-level parallelism (ILP)
- VLIW (very long instruction word) architectures
- multi-threading
- Data-level parallelism (DLP) SIMD (single instruction,
multiple data) and vector machines using vector or
array types of instructions.
- multicore processors and chip multiprocessors (CMPs)
- task-level parallelism (TLP)
- As we move from parallel processing to distributed
processing computing granularity to job-level
parallelism (JLP)
1. SCALABLE COMPUTING OVER THE INTERNET
b. Scalable Computing Trends and New Paradigms
b.1 Innovative Applications
- data access, resource allocation, process location,
concurrency in execution, job replication, and failure
recovery should be made transparent to both users
and system management.
- applications spread across many important domains
in science, engineering, business, education, health
care, traffic control, Internet and web services, military,
and government applications.
- For example, distributed transaction processing is
often practiced in the banking and finance industry.
Transactions represent 90 percent of the existing
market for reliable banking systems. Users must deal
with multiple database servers in distributed
transactions. Maintaining the consistency of replicated
transaction records is crucial in real-time banking
services.
UNIT I

1. Evolution of Distributed computing:

1.1 Scalable computing over the Internet
1.2 Technologies for network based systems
1.3 clusters of cooperative computers

2. Grid computing Infrastructures

2.1 cloud computing
2.2 service oriented architecture

3. Introduction to Grid Architecture and standards

3.1 Elements of Grid
3.2 Overview of Grid Architecture
2. Grid computing Infrastructures
cloud computing
service oriented architecture
3. Introduction to Grid Architecture and standards
Elements of Grid
Overview of Grid Architecture