Welcome Guest, you are in: <root>Elements • Login

Page History: Ink Canvas Element

Compare Page Revisions

14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 Current 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0

« Older Revision - Back to Page History - Newer Revision »

Page Revision: 2013/09/02 04:54

The Ink canvas element defines a screen area that receives and displays drawing and writing strokes made by a participant. The strokes can be done with a pen tablet, touchscreen or mouse. The element records explicit statistics of the drawing process, including stroke timing and coordinates/pressure of each dot. (See the demo video below) The element can also recognize handwritten text at request.

Table of Contents [Hide/Show] Demo video Snapshots Practical Use     Creating the Ink Canvas element     Saving the drawing results at runtime     Using the Ink Canvas element to recognize handwritten text Notes Synchronized Internal Actions Properties     Generic Properties

Demo video ¶

Snapshots ¶

Experiment Run	After experiment Picture Stays in InkCanvas
Cat Recognized correctly	Recorgnized that user wrote wrong word

Practical Use ¶

Creating the Ink Canvas element ¶

1. Add a new Ink Canvas element to the chosen event.
2. Adjust the canvas area either in the event surface editor or via element's Position and Size properties.
3. Adjust other properties of the Ink Canvas canvas element. For example, you can define the canvas background, stroke color and different drawing modes.
4. Double-click on the canvas area in the event surface editor and try to draw several strokes for testing. Make a double-click again to exit the test mode.
5. Write code that resets the canvas, requests text recognition and records drawing results in accordance with a logic of your experiment. To control the element at runtime, create proxy variable for the element's properties.
6. Start the experiment. After the onset of the parent event the element becomes functional.
   

Saving the drawing results at runtime ¶

1. Add a new Ink Canvas element to the chosen event and prepare it as described above.
2. Create proxy variables for the following properties: 'Save Ink File Now' and 'Clear Canvas Now'.
3. Add the following code in a snippet that is called after participant completes drawing:
   

   
   
   SaveInkFileNow="C:\\Data\\Participant_"+ParticipantCode+"_"+DrawingNumber+".csv";
   
   ClearCanvasNow=true;
   
   

   
   This code saves the collected stroke statistics and resets the made drawing. Note that you need to declare and adjust global variables ParticipantCode and DrawingNumber to form an unique file name (you can use other ID variables).
   

Using the Ink Canvas element to recognize handwritten text ¶

1. Add a new Ink Canvas element to the chosen event and prepare it as described above.
2. Create proxy variables for the following properties: 'Recognize Text Now', 'Recognized Text' and 'Recognition Confidence'.
3. Add the following code in a snippet that is called after participant completes writing:
   

   
   
   RecognizeTextNow=true;
   
   

4. Add the following code in a subsequent snippet that is called after (importantly!) the 'RecognizeTextNow' snippet:
   

   
   
   string S=RecognizedText; // string S now contains a text recognized by the Ink Canvas;
   
   string C=RecognitionConfidence; // string C now contains one of the confidence ranks, e.g. 'week', 'average', 'strong'  
   
   

   
   if you try to read the RecognizedText or RecognitionConfidence variables before or simultaneously with the 'RecognizeTextNow=true' command, the results wont be yet updated.
   

Notes ¶

• When the Ink Canvas element is used in the preview or debug modes, you may see flickering artefacts while doing drawing. Do not worry, these artefacts wont appear, when an experiment is run in he full screen mode.
• When the Ink Canvas element recognizes handwritten text, it considers all strokes made on the canvas from the left-top to the bottom-right. Thus, the recognition result may contain a text sentence, if multiple words are written on the canvas.
  

Synchronized Internal Actions ¶

Experiment Start	Parent Event Onset	Status change between Onset/Offset	Parent Event Offset	Experiment End
	Shows the canvas area and starts to record drawing movements, as a pen or mouse is pressed within the canvas area.		Hides the canvas area and stops recording drawing movements.

Properties ¶

Generic Properties ¶

Name	Description	Constraints	Value Type	Upon Runtime Change
Settings
Reset On Onset	Defines whether the old canvas strokes and text recognition results are reset on the onset of the parent event.	Boolean	Causes redrawing of the element on the event surface ~6ms.
Normal Tip Mode	Specifies the mode of the pointing device as it interacts with the canvas
Inverted Tip Mode	Specifies the mode of the inverted pointing device as it interacts with the canvas (e.g. with the inverted tip of a stylus)
Drawing Attributes
Behold Pressure	Defines whether the thickness of a rendered stroke changes according the amount of pressure applied (if an input device can report a pressure)	Boolean
Is Highlighter	Defines whether the rendered stroke looks like a highlighter (semi-transparent).	Boolean
Pen Size	Defines a size of the drawing pen.	EventIDE.ClassLibrary.clSize
Pen Colour	Defines a color of the drawing pen.	stColor
Drawn Color	Defines a color that highlights the currently drawing stroke. When a stroke is finished, it turns back to the pen color. No highlighting is applied, when the transparent color (0,255,255,255) is selected.	stColor
Smoothing	Defines whether Bezier smoothing is used to render strokes.	Boolean
Pen Shape	Defines a shape of the drawing pen. Assign 0 for rectangle and 1 for ellipse.	enPenShape
Canvas Background	Defines the background of the ink canvas.	stColor
Actions
Clear Canvas Now	Set to true to clear canvas and erase all collected strokes.	Boolean
Save Ink File Now	Assign a fully specified filename to save the current strokes to a file at runtime	clDesignAction
Open Ink File Now	Assign a fully specified filename to load strokes from a file at runtime. Only the Ink Serialized Format (.isf) files are supported.	clDesignAction
Recognize Text Now	Assign true to initiate text recognition on the canvas. The result is returned via Recognized Text property.	clDesignAction
Runtime Status
Stroke Number	Returns a number of drawn strokes	Status..	Int32
Recognized Text	Return a recognized text in a result of the Recognize Text action	Status..	String
Recognition Confidence	Return a confidence rank in results of the Recognize Text action	Status..	String

+=== Properties inherited from clVisualElement ===

Name	Description	Constraints	Value Type	Upon Runtime Change
VISUAL APPEARANCE
Alpha Masking	Defines whether the visual content rendered by this element will be used as an opacity mask which is applied onto the given event surface. The active opacity mask allows one to expose pixels of the parent event surface through a solid background of the given event. If the value is true, the darker pixels of the content will make more transparent holes on the entire event surface.	Design Time..	Boolean
AntiAliasing	If true, the rendered content will be anti-aliased for smoother visual appearance. If false, rendering will be authentic to its source, e.g. a bitmap.		Boolean	Visual Update..
Position	Defines the position of the element viewport on the screen. The position can be set in any of three coordinate systems: a) pixels, b) polar, c) central.		clPoint	Visual Update..
Size	Defines the size of the element viewport on the screen. The size can be set in any of three coordinate systems: a) pixels, b) visual degrees, c) 'relative-to-screen' size.		clSize	Visual Update..
Z Order	Indicates the current depth order of the element viewport on the surface of the parent event. The greatest number corresponds to the top position. The order can be changed by moving the element up and down in the element list.	Status..	Int32
Pivot Point	Defines the pivot point (coordinate and the rotation centers) within the element viewport.		stAlignment or Int32	Visual Update..
Visible	Defines whether the element is currently visible on the event surface. The property is convenient for switching visual content on and off.		Boolean	Visual Update..
Rotation	Defines the rotation angle (in degrees) of element viewport relative to the its pivot point.		Double in the range 0..360	Visual Update..
EFFECTS
Transparent Color	The color of the original pixels of rendered content that will be set as transparent.		stColor	Visual Update..
Transparency Tolerance	Tolerance ratio for choosing colors that become transparent. Zero means that effect is not applied, 1 denotes that all colors will become trasparent.		Int32, range (0..100)	Visual Update..
Color Mask	Produces a multiplicative combination of the original pixels and the selected mask color (except the alpha channel). The effect emulates a look through a colored glass. White or transparent mask color doesn't change the original pixels.		stColor	Visual Update..
Opacity	Opacity of the rendered content.		Int32, range (0..100)	Visual Update..
Contrast	Contrast of the rendered content.		Int32, range (-100..100)	Visual Update..
Brightness	Defines the brighness of the rendered content.		Int32, range (-100..100)	Visual Update..
Saturation	Saturation of the rendered content.		Double	Visual Update..
Pixelation	Defines the pixel scale of the rendering.		Int32, range (0..100)	Visual Update..
Blurring	The radius used in the gaussian blur of rendered content, as a pixel-based factor. The default is 0 which means no blurring.		Int32	Visual Update..
POSITIONAL JITTER
Reset Jitter	Set to true at runtime to reset the current positional jitter.	Runtime Command..	Boolean, set true for action	Visual Update..
Current Jitter	Jitter range, in pixels (non inclusive).	.	clSize	Visual Update..
Jitter Range	Jitter range, centered at the original position of the element.	.	clSize	Visual Update..

+=== Properties inherited from clElement === Inherited properties of clElement

Name	Description	Constraints	Value Type	Upon Change
Control
Is Enabled	If set to false the element is completely omitted when the experiment is run.	Design Time..	Boolean
Title	Title of the element.	Design Time..	String