Lecture : 1-2

GridSimToolkit:
Modeling and Simulation of Global
Grids
Instructor: Anum Masood
1
2
Contents
Motivation
System Architecture
GridSimEntities
Visual Modeller
Advanced Reservation
3
Performance Evaluation:
With Large Scenarios
Varying the number of
Resources (1 to 100s..1000s..).
Resource capability.
Cost (Access Price).
Users.
Deadline and Budget.
Workload.
Different Time (Peak and Off-Peak).
We need a repeatable and controllable environment.
Can this be achieved on Real Grid testbed ?
4
Grid Environment
Dynamic:
1. Resource and User Properties vary with time.
Experiment cannot be repeated.
2. Resources are distributed and owned by different
organisations. Heterogeneous users.
It is hard to create a controllable environment.
Grid testbed size is limited.
Also, creating testbed infrastructure is time
consuming and expensive.
Hence, grid computing researchers turn to modelling
and simulation.
5
GridSim Toolkit
GridSim1.0 released in Dec. 2001
GridSimand GridBroker.
GridSim2.0 released in Nov. 2002
Improvements in GridSimand GridBroker.
Add Visual Modeler.
GridSim5.2 released recently.
Few functionalities of GridSim:
Allows modelling of heterogeneous of resources & users.
Supports simulation of both static & dynamic schedulers.
Simulates applications with different parallel models.
6
System Architecture
Basic Discrete Event Simulation Infrastructure
Virtual Machine (Java, cJVM, RMI)
PCs Clusters Workstations
. . .
SMPs
Distributed Resources
GridSim Toolkit
Application
Modeling
Information
Services
Resource
Allocation
Grid Resource Brokers or Schedulers
Statistics
Resource Modeling and Simulation (with Time and Space shared schedulers)
Job
Management
Clusters Single CPU Reservation SMPs Load Pattern
Application
Configuration
Resource
Configuration
Visual
Modeler
Grid
Scenario
Network
SimJava Distributed SimJava
Resource
Entities
Output
Application, User, Grid Scenarios Input and Results
7
GridSim Entities
J obs
Appli
cation
Scheduler
User #i Broker #i Output
Input
Output
Input
Resource #j
J ob In Queue
J ob Out Queue
Process
Queue
Resource
List
Information
Service
Internet
Input Output
8
GridSim Entities Relationship
GridSim
GridInformationService
GridResource
Resource Characteristics
Broker
communication
registration
message
passing
9
GridSim Resource Extensibility
GridResource
AllocPolicy
TimeShared SpaceShared ARPolicy
ARSpaceShared
GridSim
Advance Reservation (AR)
New architecture allows flexibility to add new scheduling
policies for AR and non-AR resources.
. . .
. . .
10
E
A
Output_E
A
Input_E
A
E
B
Output_E
B
Input_E
B
body()
Send(output, data, E
B
)

body()
body()

body()

body()

body()
Receive(input, data, E
A
)

Timed Event Delivery

data, t2
GridSim Entities Communication Model
11
Time Shared: Multitasking and
Multiprocessing
PE1
PE2
G1
G2
G3
G1
G2
G2
G2
G3
G3
P1-G2 P1-G1 P3-G2 P1-G3 P2-G3
Time
G1
G1: Gridlet1 Arrives
G1F G3
G1F: Gridlet1 Finishes
G2 G2F G3F
Gridlet1 (10 MIs)
Gridlet2 (8.5 MIs)
Gridlet3 (9.5 MIs)
P2-G2: Gridlet2 finishes at the 2
nd
prediction time.
P1-G2: Gridlet2 didnt finish at the 1
st
prediction time.
Tasks on
PEs/CPUs
2 6 9 12
16 19 26 22
P2-G2
12
Space Shared: Multicomputing
G1
G2
G3
G1 G3
G2 G3
P1-G1 P1-G2 P1-G3
Time
G1
G1: Gridlet1 Arrives
G1F G3
G1F: Gridlet1 Finishes
G2 G2F G3F
Gridlet1 (10 MIs)
Gridlet2 (8.5 MIs)
Gridlet3 (9.5 MIs)
P1-G2: Gridlet2 finishes as per the 1
st
Predication
Tasks on
PEs/CPUs
2 6 9 12
16 19 26 22
PE1
PE2
13
Visual Modeler
Available in GridSim 2.0
Functionalities:
Create and delete many users and resources.
Able to save and load the model file (XML format).
Generate Java source code.
14
Main Window of Visual Modeler
15
View User Property Dialog
16
View Resource Property Dialog
17
GridSim with AR capability
GridSim 3.0 has the framework to handle:
1. Creation of a new reservation
2. Commitment of a new resevation
3. Activation of a reservation once it is started
4. Modification of an existing reservation
5. Cancellation of an existing reservation
6. Query of an existing reservation
18
State Transition Diagram for AR
Request
Rejected
Accepted
Change
Request Committed
Cancelled Active
Completed Terminated
Request Accepted
Request Rejected
Commit Expired
Cancellation
Request
Change Specification
Change Accepted / Rejected
Finish Time
Start Time
Termination
Request
Commit Accepted
19
1. Create a New Reservation
Required information:
1. Start time
2. Duration time or Finish time
3. Number of Processing Elements (PEs)
4. Designated resource id
If successful: returns booking id
(resID_reservID) e.g. 8_1 & expiry time
If not successful: returns approx. busy time
interval (1, 5, 15, 30, 45 seconds or minutes)
20
Steps of making a reservation
Create a
Request
Request Result
Send to
Resource
Generate
Reservation
Booking ID
Check for
conflicts
Receive
Request
NO
YES
Add to List
User or Broker AllocPolicy
21
Finding Empty Slots
If (reservation list is empty) then accept
reservation & put into the list
Else
1. Find the begin and end interval in the list
2. Find the exact slot for a new reservation
3. Find empty slot
1. Remove redundant reservations
2. Calculate total PE used during the interval
22
2. Commit a Reservation
If a request for reservation has been
successful, then need to commit or to
confirm it before an expiry time
When committing a reservation, need to
submit:
1. Booking ID
2. Job or a list of jobs
23
3. Activation of a Reservation
Once a reservation has committed:
Put the job(s) into a queue list
Set the timer
Send event to itself
Once the time is up:
If PEs are full, then:
Remove unreserved jobs
Remove reserved jobs that run longer than duration
Look through the queue list and move into
execution list
24
4. Modification of a Reservation
Required information:
1. Start time
2. Duration time or Finish time
3. Number of Processing Elements (PEs)
4. Booking ID
At the moment, only able to reduce
reservation
Important: If modification fails, the original
reservation must not be lost.
25
5. Cancellation of a Reservation
Required information:
Booking ID
Resource ID
Cancellation issues:
Before a reservation has been committed
Before a reservation has been activated
During an active
After a reservation has been finished
26
6. Query of a Reservation
Required information:
Booking ID
Resource ID
Status:
NOT_STARTED
ACTIVE
FINISHED
CANCELED
EXPIRED
27
GridSimAdvanced Networking
28
GrangeNet and Grid Modelling
31
Selected GridSim Users
32
Conclusion
GridSim toolkit is suitable for application
scheduling simulations in Grid computing
environment.
GridSim is available to download:
www.gridbus.org
Questions
33