Untitled Document

Java Applets (contents of Smart Desk):
Concentration Card game: It is a computer version of memory game. For the cognitive purposes, color of cards and back grounds can be selected. Also the number of cards and contents of cards (shapes, colors, images, or words) are selectable. User behavior during playing the game is recorded and shown as graphs after the session. Number of clicks on each cards, time taken between each mouse click, and mouse trajectory are examples of such graphs.
Sequences: A sequence of shapes are listed at the top of screen. Then a user is required to choose the same shape in the same sequence one by one. A pool of shapes are provided at the same screen, of course. Right and wrong answers are tracked with time information and mouse information(I think).
Drawing applets:one is to draw figures and the other one is to ask a user to fill a shape. Percentage of "in-the-shape-fill" and "fill-out-of-the-shape" is calculated.
Objects(Math-geometry):3-D objects of rectangle, triangle, and line in two levels. Basic user tracking exists.
Sound-Card: These applets are working with special hardware. At a screen, scanned cards images are displayed[figure 2]. Those are words-images cards. For example, the word allegator and a cartoon image of an allegator are drawn on each side of a card. The applet itself is working by getting keyboard events, but at the siggraph, slots and real cards were used. A user choose a card of allegator and if she puts into the right slot (there were 3 and 3 cards at the screen too), this applet will make some sound of UFO and flip the card.(well. reinforcement!) The other applet is about shapes again. There are cylinder, triangular-prism, and a square pillar as real wooden objects. And there is a station with holes of triangle, square, and circle. Only when a user chooses a right object for the hole, the object will click the switch at the bottom of the hole and make a signal back to the applet through TNG3 interface.

<Figure 2>
Learning Signs:Road signs and other safety signs (for social functions) are scanned and by clicking each of thumbnail, a user sees a bigger image. Its functionality is simple and needs to be improved if needed.
Choosing the same Object:An object is at the left-hand side and there are 4 objects including the object at the right-hand side of the screen. Right and wrong answers are recorded.
Basically above applets have user tracking methods. It was fairly straightfoward because Java applet itself is event-driven, and once I wrote classes for that, I just needed to re-use them. Problem is with non-java applications and the problem is solved by using Neattool process as a back ground process. Or perhaps writing a little stand-alone program only to measure user events at local machine will be a possible and light-weight solution.