Content uploaded by Stefan Fischer
Author content
All content in this area was uploaded by Stefan Fischer on Apr 27, 2013
Content may be subject to copyright.
resources
r1
waiting audio
active
audio
waiting video
r2
videos
active
compl.
succ.
4
4
p4
p5 p6
p7 p9p8
4
t1
aborted
i1 i2
p1 p2 p3
t2
t3 t4
t5
t6
reconfig.
resource
audio
compl.
succ.
admit audio
release
resources
severe QoS violation
audio abort
successful
audio completion
admit video
resource
reconfiguration
aborted video
successful
video completion
severe QoS violation
video abort
Firing probs.: 1
M000010 M000000 M010000 M020000
M100000 M110000
M200000
M000001
M001000M000100
M011000
M101000
Vanishing State
Markov State
Reconfiguration Edge
Transition
1
1
1
1
tau2
tau4 2*tau4
25*tau6*gamma
tau5
4*tau3*gamma
tau1
2*tau1
9*tau3*gamma
9*tau3*gamma
tau1
tau4
Region III
0
50
100
150
200
250
300
350
450
1e-05 0.0001 0.001 0.01
Time
gamma
audio reward = 1; video reward = 12
M000000->M000020
M100001->M100001
M010010->M010010
400
Region I
Region II
0
5
10
15
20
25
30
35
1e-06 1e-05 0.0001 0.001 0.01
Time
gamma
audio reward = 1; video reward = 14
M000000->M000020
M100001->M100001
M010010->M010010
0
5
10
15
20
25
30
35
40
45
1e-05 0.0001 0.001 0.01
Time
gamma
continuous audio reward = 0.1; video reward = 12
M000000->M020010
M000000->M000020
190
191
192
193
194
195
196
197
198
199
200
1e-05 0.0001 0.001 0.01
Reward
gamma
Performance for audio = 1; video = 12
M000000