Ben-600 - Delivery metrics - 10s fragments ============================================ Commands --------- Get log lines for latest test Origin: tail -n $((`wc -l /var/log/nginx/access.log | cut -d\ -f1` - `grep '"GET /ENDTEST' -n /var/log/nginx/access.log | cut -d: -f1 | tail -n2 | head -n1`)) /var/log/nginx/access.log | grep streamingtest Midtier: tail -n $((`wc -l /var/log/nginx/access.log | cut -d\ -f1` - `grep '"GET /ENDTEST' -n /var/log/nginx/access.log | cut -d: -f1 | tail -n2 | head -n1`)) /var/log/nginx/access.log | grep cix7cricsvweeu6k Edge: tail -n $((`wc -l /var/log/nginx/access.log | cut -d\ -f1` - `grep '"GET /ENDTEST' -n /var/log/nginx/access.log | cut -d: -f1 | tail -n2 | head -n1`)) /var/log/nginx/access.log | grep f5jayrbaz7nmtyyr Calculate duration stats cat test3.log | grep ".ts" | grep "jwplayer.flash.swf" | awk -F '\t' 'BEGIN{tot=0; count=0; min=9999; max=0;}{tot=+$13;count+=1; if ($13 > max) max=$13 endif; if ($13 < min) min=$13 endif;}END{avg=tot/count; printf "%.8f,%.8f,%.8f,%d\n",avg,max,min,count}' Disposition counts grep ".ts" test3.log | awk -F'\t' '{print $12}' | sort | uniq -c Extracting requested bitrates grep ".ts" test5.log | grep -o -P "Big_Buck_Bunny_([0-9]+)_" | cut -d_ -f4 | uniq -c Notes ------ Test ends are marked in the logs by running ben@milleniumfalcon:~$ GET -Ssed http://f5jayrbaz7nmtyyr.onion/ENDTEST Tests ------ Test 17 (Direct to Origin) Delivery Durations Origin: 0.01272727,4.64600000,0.84000000,66 Bitrates Origin: 3 1024 63 2048 Test 18 (Direct to midtier, coldcache) Delivery Durations Origin: 0.00157143,1.42200000,0.11000000,70 Midtier: 0.00245714,9.85700000,0.17200000,70 Cache Disposition Midtier: 70 CACHE_MISS Bitrates Midtier (and origin): 5 1024 3 2048 5 1024 34 2048 6 1024 13 2048 4 1024 Test 19 (Direct to midtier, warmcache) Delivery Durations Origin: 0.01225000,0.63500000,0.14700000,12 Midtier: 0.00347692,9.99700000,0.22600000,65 Cache Disposition Midtier: 53 CACHE_HIT 12 CACHE_MISS Bitrates: Origin: 12 2048 Midtier: 3 1024 62 2048 Test 20 (Cold edge, warm midtier) Delivery Durations Origin: 0.00246774,1.10100000,0.11200000,62 Midtier: 0.00336923,9.23400000,0.19000000,65 Edge 1: 0.04440000,9.82300000,1.44900000,65 Cache Disposition Midtier: 3 CACHE_HIT 62 CACHE_MISS Edge 1: 65 CACHE_MISS Bitrates Origin: 62 512 Midtier: 3 1024 62 512 Edge1: 3 1024 62 512 Test 21 (Warm edge, Warm midtier) Delivery Durations Origin: 0.02118182,0.65800000,0.13700000,11 Midtier: 0.00433333,9.90400000,0.06500000,15 Edge 1: 0.00000000,9.64600000,0.00000000,87 Cache Disposition Midtier: 4 CACHE_HIT 11 CACHE_MISS Edge 1: 72 CACHE_HIT 15 CACHE_MISS Bitrates Origin: 2 512 9 1024 Midtier: 2 512 13 1024 Edge 1: 1 1024 5 512 1 1024 7 512 1 1024 2 512 1 1024 6 512 1 1024 7 512 1 1024 1 512 1 1024 5 512 1 1024 1 512 1 1024 6 512 1 1024 5 512 1 1024 1 512 1 1024 6 512 1 1024 6 512 1 1024 15 512 Notes: Significant delivery issues towards the end of the stream. Also, the awk command being used for durations doesn't seem to be working correctly, the log shows x-durations of > 30 seconds which don't seem to be represented above. Will need to regenerate those stats for all tests when pulling stats from the logs later, but will continue to use it for consistency for the time being. Test 22 (Cold edge, cold midtier) Delivery Durations Origin: 0.00137333,0.93600000,0.10300000,75 Midtier: 0.00224000,9.65800000,0.16800000,75 Edge 1: 0.04362667,9.65800000,10.00300000,75 Dispositions: Midtier: 75 CACHE_MISS Edge 1: 75 CACHE_MISS Bitrates Origin: 1 1024 7 512 4 1024 6 512 6 1024 6 512 4 1024 9 512 20 1024 8 512 4 1024 Midtier: 1 512 1 1024 6 512 4 1024 6 512 6 1024 6 512 4 1024 9 512 20 1024 8 512 4 1024 Edge 1: 1 512 1 1024 6 512 4 1024 6 512 6 1024 6 512 4 1024 9 512 20 1024 8 512 4 1024 Delivery times were significantly better (though not great) on that test, so next test is basically a re-run of test 21 Test 23 (warm edge, warm midtier) Delivery Durations Origin: 0.00289655,0.67700000,0.08400000,29 Midtier: 0.00541379,8.63400000,0.15700000,29 Edge 1: 0.03597222,9.94400000,0.79500000,72 Dispositions Midtier: 29 CACHE_MISS Edge 1: 43 CACHE_HIT 29 CACHE_MISS Bitrates: Midtier: 4 1024 1 512 15 1024 2 2048 4 1024 3 512 Edge 1: 4 1024 1 512 1 1024 3 512 48 1024 1 2048 1 1024 1 2048 1 1024 2 512 1 1024 1 512 1 1024 1 512 1 1024 4 512 Test 24 (Artificially warmed Edge 1) Delivery Durations Origin: N/A Midtier: N/A Edge 1: 0.00579710,9.66700000,0.40000000,69 Dispositions Edge 1: 69 CACHE_HIT Bitrates Edge 1: 7 1024 5 512 43 1024 2 512 10 1024 2 2048 Test 25 - Two players, cold edge Delivery Durations Origin: 0.00000000,0.00000000,0.00000000,122 Midtier: 0.00416923,9.45800000,0.04000000,130 Edge 1: 0.00002685,9.94800000,0.00000000,149 Dispositions Midtier: 8 CACHE_HIT 122 CACHE_REVALIDATED Edge 1: 19 CACHE_HIT 130 CACHE_MISS Bitrates Origin: 4 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 5 512 2 1024 1 512 1 1024 1 2048 1 512 1 2048 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 2 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 4 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 2 512 1 1024 1 512 5 1024 1 2048 1 1024 2 2048 3 512 1 1024 2 512 1 1024 2 512 1 1024 1 512 7 1024 1 2048 1 1024 3 512 1 1024 1 2048 2 512 1 2048 2 512 1 2048 1 512 1 2048 1 512 2 1024 2 512 3 1024 1 2048 1 1024 1 2048 1 1024 1 512 2 2048 Midtier: 6 1024 1 512 1 1024 1 512 1 1024 2 512 2 1024 6 512 2 1024 1 512 1 1024 1 512 1 2048 1 512 1 2048 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 2 512 2 1024 2 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 7 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 2 512 1 1024 1 512 1 1024 1 512 6 1024 1 2048 1 1024 1 2048 1 512 1 2048 1 512 1 2048 1 512 1 1024 3 512 1 1024 2 512 9 1024 1 2048 3 512 1 1024 1 512 1 2048 1 512 1 2048 2 512 1 2048 2 512 1 1024 1 2048 4 1024 2 2048 2 1024 2 2048 Edge 1: 8 1024 1 512 1 1024 1 512 1 1024 2 512 1 1024 1 512 1 1024 8 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 2048 1 512 1 2048 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 2 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 1 512 7 1024 1 512 1 1024 1 512 1 1024 1 512 1 1024 2 512 1 1024 2 512 10 1024 1 2048 1 1024 1 2048 1 512 2 2048 1 512 1 1024 1 512 1 1024 3 512 1 1024 2 512 12 1024 1 2048 1 512 2 1024 1 512 1 1024 1 512 1 1024 1 512 1 2048 2 512 1 2048 1 512 1 2048 2 512 1 1024 1 2048 4 1024 2 2048 3 1024 4 2048 Test 26 - Two players, warm edge Delivery Durations Origin: 0.00000000,0.21400000,0.00000000,29 Midtier: 0.35025806,9.79800000,0.10900000,31 Edge 1: 0.00527439,9.80700000,0.00000000,164 Dispositions Midtier: 2 CACHE_HIT 1 CACHE_MISS 28 CACHE_REVALIDATED Edge 1: 133 CACHE_HIT 31 CACHE_MISS Bitrates Origin: 6 2048 2 1024 3 2048 1 512 8 2048 3 512 1 2048 2 1024 3 2048 Midtier: 5 2048 1 1024 1 2048 1 1024 3 2048 1 512 10 2048 3 512 1 2048 2 1024 3 2048 Edge 1: 10 1024 1 2048 1 1024 1 512 1 2048 1 512 1 2048 1 512 1 2048 2 512 1 2048 2 512 1 1024 1 512 1 1024 1 2048 1 512 27 1024 1 2048 2 1024 1 2048 13 1024 1 512 1 1024 1 2048 3 512 1 2048 1 512 1 1024 1 2048 2 1024 1 2048 2 1024 2 2048 1 1024 1 2048 6 1024 2 2048 1 1024 1 2048 1 1024 2 2048 1 1024 1 2048 1 1024 1 2048 2 1024 1 2048 11 1024 2 2048 1 512 2 2048 1 1024 1 512 1 1024 1 512 1 1024 1 512 4 1024 1 2048 1 1024 1 2048 1 1024 1 2048 1 1024 1 2048 2 1024 2 2048 3 1024 1 2048 1 1024 1 2048 1 1024 2 2048 1 1024 1 2048 2 1024 3 2048