The tests were executed on Friday around 5 p.m. in a well-lit room in the TEL building. Our application was displayed on a 30" large display. Since our application is designed for large public displays, we preferred using a large display over notebook monitors for more accurate results.
We tested our application on two users. We asked the subjects to say their thoughts out aloud and took notes.
The subjects were asked to try and interact with the application, without prior knowledge of its contents. This task included understanding the purpose of each page of the application, understanding the icons, the buttons and the actions required to trigger these buttons, since one of our main goals is that our application is self-explanatory. We were also very interested in knowing how challenging the game is to the average user.
Carla, 23 years old, studies biology, has experience with gaming using the EyeToy on the Playstion 2, no experience with the Kinect.
Paul, 28 years old, studies chemistry, has gaming experience with both the Kinect and the EyeToy.
The subjects criticized the following features of our application:
• During the game, things happen too fast, so that the user has not enough time to decide for a proper action and react in time.
• The game concept is not identifiable
• The red paddle moves too slow
• On the border of the game, the behavior of the red paddle and dot are irritating
• The ball moves too fast
• The scoring system is not comprehensible
• There is no delete button on the keyboard in the high score page
• Having the red paddle and dot painted simultaneously on the user's hand is irritating
• The color scheme used throughout the game is not appealing
• The natural colored image is preferred over the depth image
Aside from the user feedback, the user test gave us also the benefit of reviewing our program once more. We noticed the following bugs in our application:
• when having more than 3 digits for scores, some of the digits are not properly displayed in the page and are misplaced
• after changing from the score page to the menu page, all of the displayed text is misplaced and shifted to the left.
For eliminating the detected bugs and a higher user satisfaction, we have planned the following modifications to our application:
• Using the normal color image instead of the depth image from the Kinect.
• Remove the dots that are drawn on the hands completely, or to replace them with the user ID
• Make the paddles bigger
• Make the ball slower
• Add delete button to the keyboard