The purpose of this stress test is to insure server stability for our final assessment phase of VCAEST. During the VCAEST assessment we will potentially have 25 - 50 participants interacting with the VCAEST interface at a single time. 6 different "instances" will be established prior to the final assessment. Each instance allows 6 users to interact with the interface at a time. We will not need to stress test the virtual world component of the VCAEST interface. We will, however, need to stress test AutoTutor Lite. AutoTutor Lite is the web-based intelligent tutoring system that has been integrated inside the VCAEST virtual world.
The more the merrier -- ideally we'll have 10+ people interacting with a single SKO (Sharable Knowledge Object) or an individual AutoTutor Lite module.
Before the official stress test begins, a few things need to be recorded. - Have one user run through the SKOs that will be tested and note the time it takes to complete the information delivery portion.
- Have one user run through the self-reflection portion of a module and note the average time it takes to receive feedback from the Tutor. About 3-6 seconds is the current average. This changes depending on the size of the Tutor utterance.
For the stress-testing: Information Delivery & Self-Reflection - Note the time before beginning.
- Have all users open up this SKO: http://www.x-in-y.com/sko2013/VCAEST/ATL.html?guid=18e38ca4-f95c-4384-b22a-f50c79f39752&skoserver=http://skodev2012.appspot.com&DSSPP=http://dsspp2011.appspot.com. It took me 8 min and 35 sec to get through all of the information delivery.
- Have each user note the time when they reached slide 35/36. The Tutor will ask the users to click on the right arrow to advance to the Self-Reflection assessment.
- Have all of the users interact in the self-reflection at the same time.
- Have the users note the delay between input and feedback. It should be about 3 - 6 seconds.
For the stress-testing: Tutoring Assessment - Note the time before beginning.
- Have all users open up this SKO: http://www.x-in-y.com/SKO2013/VCAEST/ATL.html?guid=8e69f0bc-91df-4ca1-805e-acc11d3f0046&skoserver=http://skodev2012.appspot.com&DSSPP=http://dsspp2011.appspot.com
- Here are the following answers/input the users should type in:
Expectation 1: National Response Framework is a national system that describes how to utilize key response principles and lays groundwork for a united national response. Unique situations in which Federal Government takes on a larger role to provide states with support.
Expectation 2: Incident Command System (ICS) is a function of NRF, at lowest level. Used on site at beginning of incident. Builds upon itself with layers. As it grows it looks different, but is still a part of NRF.
Expectation 3: Key principles are basis for how entities should operate in response to an incident. Emphasize communication, chains of action, adaptability, unity, and preparedness.
Expectation 4: Stafford Act brings Federal resources and funding to support states during major disaster situations in an orderly and systematic way. Requires governors request assistance before president can send aid.
- The users are free to type in their own input (I don't know. Please help me., etc), but the above input should guarantee Tutor feedback.
- Note the time delay from the input and feedback. The delay here will be a little bit longer than the delay for the Self-Reflection feedback.
|