Performance and load tests
Quizzy runs real games end to end on its staging site every two weeks: 5, 50, a 50-player knockout, 200 and 1,000 players, with simulated phones plus real Android, iPhone and desktop browsers and a paired TV.
Known limitations
Recent test runs
“Test incomplete” means our test harness couldn’t finish judging that game. It isn’t a failure of the game itself.
Times are shown in UTC.
5 players
Passed- TV scoreboard in sync
50 players
Passed- 294 of 294 answers confirmed
- 95% of results reached phones within 16 ms
- TV scoreboard in sync
50 players · knockout
Passed- 144 of 144 answers confirmed
- 95% of results reached phones within 17 ms
- TV scoreboard in sync
200 players
Passed- 1,343 of 1,343 answers confirmed
- 95% of results reached phones within 25 ms
- TV scoreboard in sync
1,000 players
Passed- 6,965 of 6,965 answers confirmed
- 95% of results reached phones within 120 ms
- TV scoreboard in sync
5 players
Passed- TV scoreboard in sync
50 players
Passed- 294 of 294 answers confirmed
- 95% of results reached phones within 29 ms
- TV scoreboard in sync
50 players · knockout
Passed- 84 of 84 answers confirmed
- 95% of results reached phones within 36 ms
- TV scoreboard in sync
200 players
Passed- 1,344 of 1,344 answers confirmed
- 95% of results reached phones within 123 ms
- TV scoreboard in sync
1,000 players
Test incomplete- 4,379 of 4,389 answers confirmed
- 95% of results reached phones within 64.1 sec
- TV scoreboard in sync
5 players
Passed- TV scoreboard in sync
50 players
Passed- 294 of 294 answers confirmed
- 95% of results reached phones within 45 ms
- TV scoreboard in sync
50 players · knockout
Passed- 138 of 138 answers confirmed
- 95% of results reached phones within 20 ms
- TV scoreboard in sync
200 players
Passed- 1,344 of 1,344 answers confirmed
- 95% of results reached phones within 91 ms
- TV scoreboard in sync
1,000 players
Test incomplete- 6,957 of 6,957 answers confirmed
- 95% of results reached phones within 228 ms
- TV out of sync
5 players
Passed- TV scoreboard in sync
50 players
Passed- 294 of 294 answers confirmed
- 95% of results reached phones within 26 ms
- TV scoreboard in sync
50 players · knockout
Passed- 126 of 126 answers confirmed
- 95% of results reached phones within 23 ms
- TV scoreboard in sync
200 players
Passed- 1,344 of 1,344 answers confirmed
- 95% of results reached phones within 37 ms
- TV scoreboard in sync
1,000 players
Test incomplete- 6,303 of 6,304 answers confirmed
- 95% of results reached phones within 8.5 sec
- TV out of sync
5 players
Passed- TV scoreboard in sync
50 players
Passed- 294 of 294 answers confirmed
- 95% of results reached phones within 12 ms
- TV scoreboard in sync
50 players · knockout
Passed- 101 of 101 answers confirmed
- 95% of results reached phones within 16 ms
- TV scoreboard in sync
200 players
Passed- 1,343 of 1,343 answers confirmed
- 95% of results reached phones within 29 ms
- TV scoreboard in sync
1,000 players
Test incomplete- 5,765 of 5,768 answers confirmed
- 95% of results reached phones within 26.2 sec
- TV scoreboard in sync
5 players
Passed- TV scoreboard in sync
50 players
Test incomplete50 players · knockout
Passed- 110 of 110 answers confirmed
- 95% of results reached phones within 26 ms
- TV scoreboard in sync
200 players
Test incomplete1,000 players
Test incomplete- 6,941 of 6,941 answers confirmed
- 95% of results reached phones within 2.7 sec
- TV scoreboard in sync
5 players
Passed- TV scoreboard in sync
50 players
Passed- 294 of 294 answers confirmed
- 95% of results reached phones within 20 ms
- TV scoreboard in sync
50 players · knockout
Passed- 46 of 46 answers confirmed
- 95% of results reached phones within 30 ms
- TV scoreboard in sync
200 players
Passed- 1,344 of 1,344 answers confirmed
- 95% of results reached phones within 35 ms
- TV scoreboard in sync
1,000 players
Test incomplete- 6,926 of 6,926 answers confirmed
- 95% of results reached phones within 177 ms
- TV out of sync
Fixed
A paired TV could stop updating its scoreboard in very large games.
Reloading the host screen mid-question no longer ends the question early.
Reloading the host screen mid-game no longer loses the game.