Professional Documents
Culture Documents
Modeling
Comparison through experimentation
General conclusion and perspectives
Presented by
Ihsan Ullah
Supervised by
Dr. Guillaume Doyen & Prof. Dominique Gaïti
November 3, 2011
Ihsan Ullah User-aware P2P live streaming systems 1/50
Context
Modeling
Comparison through experimentation
General conclusion and perspectives
Outline
1 Context
Introduction
Performance issues
Related work
2 Modeling
Non-contextual approach
Contextual approach
3 Comparison through experimentation
Optimization for improved quality
Experimental evaluation
4 General conclusion and perspectives
Outline
1 Context
Introduction
Performance issues
Related work
2 Modeling
Non-contextual approach
Contextual approach
3 Comparison through experimentation
Optimization for improved quality
Experimental evaluation
4 General conclusion and perspectives
Video streaming
Streaming is the transfer of media such as audio or video
over a network as a steady and continuous stream [HB05]
Video-on-Demand (VoD)
Receiver-driven
Users can request for any video, any time
Extended buffering
Push Pull
Problem statement
Impact of user behavior
Peers relay content, which are controlled by users
Users join and leave freely (churn), which result into:
Stream disruption;
Streaming quality degradation and
Buffer underflow
Global models
Incomplete models
Outline
1 Context
Introduction
Performance issues
Related work
2 Modeling
Non-contextual approach
Contextual approach
3 Comparison through experimentation
Optimization for improved quality
Experimental evaluation
4 General conclusion and perspectives
Hypotheses
A receiver-driven approach
Start
A
Join/Schedule
move
Continue
B F
When the scheduled time is up C
E D G
Attempt a move to NO
the most stable
Yes H I
Leave the Yes
previous
End
Experimental framework
Simulated behaviors
Dynamic: Uncorrelated consecutive sessions
(Pearson correlation coefficient ρ = 0.002)
Persistent: Strongly correlated consecutive sessions
(Pearson correlation coefficient ρ = 0.8)
Measured parameters
Frame losses
Video frames lost due to abrupt departures
Shows the efficiency of the approach in terms of
reducing the stream disruption
Attempted moves
A move is attempted to switch from the current parent
to a new one
Shows the communication cost
Successful moves
The actual switching of a peer from its current parent
to a new one
Shows the efficacy of the optimization strategy
Experimental results
Dynamic case
x 10
5 Frame loss Attempted moves Successful moves
500 500
Total number of lost frames
4 EMA
2
200 200
Scribe
1 EMA20 100 EMA 100
20
Bayes Bayes
0 0 0
0 1000 2000 3000 0 1000 2000 3000 0 1000 2000 3000
Time in Seconds Time in Seconds Time in Seconds
Persistent case
x 10
5 Frame loss Attempted moves Successful moves
500 500
Total number of lost frames
400 Bayes
3
300 300
2
200 200
Scribe
1 EMA 100 EMA 100
20 20
Bayes Bayes
0 0 0
0 1000 2000 3000 0 1000 2000 3000 0 1000 2000 3000
Time in Seconds Time in Seconds Time in Seconds
Conclusion
Both approaches reduce frame losses which improve
the quality of streaming
Communication cost of the receiver-driven strategy is
small
Limits
A large number of attempted moves have not taken
place due to the limitation of receiver-driven strategy
Only two kinds of user behavior have been
considered over which estimators are not consistent
Outline
1 Context
Introduction
Performance issues
Related work
2 Modeling
Non-contextual approach
Contextual approach
3 Comparison through experimentation
Optimization for improved quality
Experimental evaluation
4 General conclusion and perspectives
Overview of measurements
Metrics
Reference Type System Period Method
OD SD CP A/D D/U
[SGGS09] Feb. to Nov. 2008 X X X
[VGLN07] Apr. to Dec. 2006 Crawler X X
[WLX08] PPLive Nov. 2006 (about 28 hours) X X
[HLL+ 07] 2006 − 07 Passive/ X X X X
Crawler
[SFB+ 09] P2P Jun. 2006 Passive X X
[JLC07] PPStream unknown Crawler X X X
[SMC+ 09] Zattoo Mar. 2008 (2 weaks) X X
[ZLL05] Mar. 2005 (4 days) X X X
Cool-
[XKL07] Oct. 2006 (1 day) X X X
Streaming
[LXK+ 07] Sep. 2006 (1 day) X X X X
[Aga07] unknown 2006 (11 hours) X X
[TSZ+ 07] GridMedia Jan. 2006 (4.5 hours) X
[LWLZ09] UUSee May to Jun. 2008 (5 days) Logs X X X
[TSLZ06] Feb. 2005/Jan. 2006 X
CCTV
[TSLZ06] C/S Oct. to Jan. 2004 − 05 X
[SMZ04] CDN Akamai Oct. to Jan. 2003 − 04 X X X
[VAM+ 06] C/S unknown 2002 (90 days) X X X
[QGL+ 09a] Apr. 2008 (6 days) X X X X
Telco-
[QGL+ 09b] IPTV
Managed Jun. 2008 (1 month) X
[CRC+ 08] May to Oct. 2007 X X X
OD: Online Duration; SD: Session Duration; CP: Channel Popularity; A/D: Arrival/Departure rates; D/U:
Download/Upload traffic
Characterization
Popularity Session duration
0
10 1
0.9
Users’ requests distribution
0.6
−2
10 0.5
0.4
0.3
−3
10 Silverstone et al.
Qiu et al. 0.2 Vu et al.
Sripanidkulchai et al. Tang et al.
0.1
Qiu et al. Veloso et al.
−4
10 0
0 1 2 0 1 2 3 4
10 10 10 10 10 10 10 10
Rank (from higher to lower) Session durations in minutes
Measurements’ synthesis
Network performance
parameters: Variables Partners discovery Streaming Quality Delay
Information domain
Environment
estimations Network
Bayesian networks
Bayesian networks are graphical models that encode
probabilistic relationships among variables of interest
[Hec95]
Simplify the joint distribution through conditional
independence
Y
n
p(x) = p(xi |pai ) (4)
i=1
Naturally model the relationships of cause and effect
Allow multiway inference
Support mixed variables
Graphically represent the real world problem domain
Ihsan Ullah User-aware P2P live streaming systems 26/50
Context
Modeling Non-contextual approach
Comparison through experimentation Contextual approach
General conclusion and perspectives
User
simulations)
Simulation scenarios
GlobalBN
Global scenario:
One network for the whole
community Peer Peer
Local scenario:
A dedicated network for each Peer
LocalBN
Peer
LocalBN
peer
Trained over individual traces
Local estimations LocalBN
Peer Peer
LocalBN
Ihsan Ullah User-aware P2P live streaming systems 29/50
Context
Modeling Non-contextual approach
Comparison through experimentation Contextual approach
General conclusion and perspectives
Simulation parameters
45
35
15 30
25
10 20
15
5 10
0 0
5 10 15 20 25 30 35 40 0 20 40 60 80 100
Number of days Actual session durations
40 J
E 60
35
S
30 A 50
P
25 L 40
20
30
15
20
10
10
5
0 0
20 40 60 80 100 120 140 160 180 0 10 20 30 40 50 60
Time in days Actual session durations
Better performance
Consistent over different behaviors
Shows good accuracy
A classifier of users DS 1 , DS 2 , . . ., DS k
according to their
behaviors Training classifier Training BNs
estimations User
User classifier
classifier
Based on the viewing
durations of users
Session
User Class
Includes all the related Duration
variables
Estimation of the user
class variable gives the Streaming
Content Type
Quality
required class
Classification error
4
x 10
15
Incorrect
Correct
Number of classifications
10
0
J E S A P L
User classes
10
Percent error
40
8
30
6
20
4
2 10
0 0
0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9
Threshold Threshold
1
10
Percent error
0
10
−1
10
−2
10
1 5 10 15 20 25
History size
Conclusion
Outline
1 Context
Introduction
Performance issues
Related work
2 Modeling
Non-contextual approach
Contextual approach
3 Comparison through experimentation
Optimization for improved quality
Experimental evaluation
4 General conclusion and perspectives
New strategy
Instead of moving the receiver, the sender is moved
Pushes the unstable peers towards the outskirts of
the tree
Works in a decentralized way
Swap
Start
A A
Join/Schedule
swap
Continue
B C E
B
When the scheduled time is up
D E C
D
inform other
children (list)
Yes
Yes
Add parent
Random join
End
Experimental environment
70
60
50
40
30
WS
20 BN
EMA
10 20
BR
0
0 20 40 60 80 100 120
Time in minutes
Frame losses
5
x 10
70 12
WS WS
BN BN
EMA 10 EMA
20 20
BR BR
50
8
40
6
30
4
20
10 2
0 0
0 20 40 60 80 100 120 0 20 40 60 80 100 120
Time in minutes Time in minutes
Communication cost
350 2000
BN BN
EMA 1800 EMA
300 BR BR
1600
250 1400
1200
200
1000
150
800
100 600
400
50
200
0 0
0 20 40 60 80 100 120 0 20 40 60 80 100 120
Time in minutes Time in minutes
Outline
1 Context
Introduction
Performance issues
Related work
2 Modeling
Non-contextual approach
Contextual approach
3 Comparison through experimentation
Optimization for improved quality
Experimental evaluation
4 General conclusion and perspectives
Limits
No support for dynamic behaviors
No consideration of malicious behavior
Ihsan Ullah User-aware P2P live streaming systems 48/50
Context
Modeling Closing remarks
Comparison through experimentation Perspectives
General conclusion and perspectives
Future directions
Short term future work
Inclusion of other metrics with stability
Modification to predict next channel
Feedback mechanism for dynamic behaviors
Extension of the semi-Markovian model
Thesis publications
International Journals
I. Ullah, G. Doyen, G. Bonnet and D. Gaïti, “A Survey and Synthesis of User Behavior Measurements in
Video Streaming Systems”, IEEE Communications Surveys & Tutorials, 2011.
I. Ullah, G. Doyen, G. Bonnet and D. Gaïti, “A Bayesian approach for user aware peer-to-peer video
streaming systems”, Elsevier Journal of Signal Processing: Image Communication (to appear), 2011.
International Conferences
I. Ullah, G. Doyen, G. Bonnet and D. Gaïti, “User behavior anticipation in P2P live video streaming systems
through a Bayesian network”, in: 12th IFIP/IEEE International Symposium on Integrated Network
Management (IM). IEEE, 2011, pp. 337-344.
G. Bonnet, I. Ullah, G. Doyen, L. Fillatre, D. Gaïti and I. Nikiforov, “A Semi-Markovian individual model of
users for P2P video streaming applications”, in: 4th IFIP International Conference on New Technologies,
Mobility and Security (NTMS). IEEE, 2011, pp. 1-5.
I. Ullah, G. Doyen, G. Bonnet and D. Gaïti, “Modeling User Behavior in P2P Live Video Streaming Systems
through a Bayesian Network”, in: 4th IFIP International Conference on Autonomous Infrastructure,
Management and Security, (AIMS), Springer, 2-13, 2010.
I. Ullah, G. Doyen, G. Bonnet and D. Gaïti, “Improving Performance of ALM Systems with Bayesian
Estimation of Peers Dynamics”, in: 12th IFIP/IEEE International Conference on Management of Multimedia
and Mobile Networks and Services, (MMNS). Springer, 2009, pp. 157-169.
Sachin Agarwal.
A case study of large scale P2P video multicast.
In International Conference on IP Multimedia Subsystem Architecture and Applications (IMSAA), pages 1–5.
IEEE, 2007.
Grégory Bonnet, Ihsan Ullah, Guillaume Doyen, Lionel Fillatre, Dominique Gaïti, and Igor Nikiforov.
A Semi-Markovian individual model of users for P2P video streaming applications.
In 4th IFIP International Conference on New Technologies, Mobility and Security (NTMS), pages 1–5. IEEE,
2011.
Meeyoung Cha, Pablo Rodriguez, Jon Crowcroft, Sue Moon, and Xavier Amatriain.
Watching television over an IP network.
In Internet Measurement Conference (IMC), pages 71–84. ACM, 2008.
David Heckerman.
A tutorial on learning with Bayesian networks.
Technical report, Learning in Graphical Models, 1995.
Xiaojun Hei, Chao Liang, Jian Liang, Yong Liu, and Keith W. Ross.
A measurement study of a large-scale P2P IPTV system.
IEEE Transactions on Multimedia, 9(8):1672–1687, 2007.
Bo Li, Susu Xie, Gabriel Yik Keung, Jiangchuan Liu, Ion Stoica, Hui Zhang, and Xinyan Zhang.
An empirical study of the Coolstreaming+ system.
IEEE Journal on Selected Areas in Communications, 25(9):1627–1639, 2007.
Tongqing Qiu, Zihui Ge, Seungjoon Lee, Jia Wang, Jun Xu, and Qi Zhao.
Modeling user activities in a large IPTV system.
In Internet Measurement Conference (IMC), pages 430–441. ACM, 2009.
Tongqing Qiu, Zihui Ge, Seungjoon Lee, Jia Wang, Qi Zhao, and Jun Xu.
Modeling channel popularity dynamics in a large IPTV system.
In 11th international joint conference on Measurement and Modeling of Computer Systems (SIGMETRICS),
pages 275–286, 2009.
Thomas Silverston, Olivier Fourmaux, Alessio Botta, Alberto Dainotti, Antonio Pescapè, Giorgio Ventre, and
Kavé Salamatian.
Traffic analysis of Peer-to-Peer IPTV communities.
Computer Networks, 53(4):470–484, 2009.
Khaldoon Shami, Damien Magoni, Hyunseok Chang, Wenjie Wang, and Sugih Jamin.
Impacts of peer characteristics on P2PTV networks scalability.
In IEEE INFOCOM, pages 2736–2740, 2009.
Yun Tang, Lifeng Sun, Kaiyun Zhang, Shi-Qiang Yang, and Yuzhuo Zhong.
Longer, better: On extending user online duration to improve quality of streaming service in P2P networks.
In IEEE International Conference on Multimedia and Expo (ICME), pages 2158–2161, 2007.
Eveline Veloso, Virgílio Almeida, Wagner Jr. Meira, Azer Bestavros, and Shudong Jin.
A hierarchical characterization of a live streaming media workload.