EstimationLine Instructions

How to use and customize the app.

The EstimationLine instructions contain information on how to access the collected data as well as configure the app.

This page is is documentation for old version 1 (for reference)×

EstimationLine User Guide

The EstimationLine app is a proven estimation test for children to show where a target number should fall on a number line. In this iPad app, children touch the line with their finger to position their estimate. It is based on an experimental method originally introduced by Robert Siegler & John Opfer (2003) to examine numerical estimation. Many subsequent studies have used the method to understand the estimation capabilities of children as they develop their numerical skills. A computerized version of the number line estimation test designed by the same team was used in the Canadian Count Me In longitudinal study. This iPad app was tested in the field in an experiment with pre-kindergarten children in 2011.

In the EstimationLine app, the line is shown with a 0 above the left end of the line and a configurable endpoint (usually 10, 100 or 1000) above the right end, with the stimulus or target number for each trial displayed above the line. The participant (usually a child) is asked to mark the location on the number line where they think that target number belongs. In this iPad app version, the child touches the number line with their finger to mark their estimate of the target location. A red vertical mark is displayed to show their estimate. A small 'Retry' button is shown with each trial, since small children occasionally make accidental touches.

EstimationLine spares the experimenter the considerable work of converting pencil marks on paper into usable output data files. The output data for each trial is written into a trial by trial file in CSV format. The files can be retrieved via iTunes. Each trial output includes the participant's identifying information and the endpoint, the stimuli that was displayed and the participant's estimate. The estimate is computed based on the endpoint and the location they touched. The estimate is shown with up to two decimal points. For example, on a trial with a stimuli target of 9, above a line with an endpoint of 10, the touched estimate was written out to the datafile as 8.56.

The app shows four configurable sets of target stimuli. Each set has two configurable aspects: a single endpoint for the entire set, and the group of target or stimuli numbers that will be shown as trials in the set. After each set of trials for a particular endpoint,, an option to continue to the next set is displayed for the experimenter, so that the number of sets can be adjusted for each child, based on either a predetermined design or on the child's performance.The endpoints can be modified for each set and like the stimuli, can also be pre-configured via iTunes.

The stimuli sets provided as app defaults increase in endpoint size, complexity and number of trials. These four sets of default target stimuli were created to cover the full range of development: from the pre-kindergarten children (endpoints of 10) to older grades five and six students (endpoints of 100 and 1000). Each set of stimuli can be modified to meet the experimenter's needs. The app randomly shuffles the target stimuli at the start of each set to randomize the display order of the trials. The end-points of the number lines for each set have default values of 10, 20, 100 and 100. End points can also be modified for each participant session.

ReferenceLinks:

Run an EstimationLine Estimation Participant

Enter Participant Information

This is the first screen displayed when the app is started. There are 3 fields for the experimenter to fill which will identify the participant's trials in the output file:

  1. ID CODE Enter the participant's ID code.
    • This code can be any mix of numbers, letters or characters (except commas). It is assumed that you have assigned the code elsewhere and that you will keep track of the code and match it with the participant name in a separate confidential file. There is no control over these ID codes in the app - if you use the same code as has been used previously, both sets of data for the same code, with the time and date of the session, will appear in the data output file.
  2. GENDER Touch either the Male or Female button for the participant's gender. The selected button will be highlighted.
  3. BIRTH DATE Spin the month, day and year to view and select the participant's birthdate (the birthdate should end up in the center highlighted panel). This is a useful back-up to the participant ID code.

Once you have entered and made your selection, press the "Go" button on the keyboard.

Select Number Line Endpoints

There are four sets available for each participant, although all of the sets do not have to be administered. This screen allows the experimenter to modify the endpoint numbers (shown below the right-most end of the number line) for each set.

  • Default endpoints are provided for each set of 10, 20, 100 and 100 (the endpoints are configurable via the config.txt file).
  • To use these endpoints, touch the Next button to continue.
  • To modify an endpoint for a particular set, touch the text box containing the default value for the set.
  • The number keyboard will be displayed - use the backspace key to delete the exisitng number and enter a new number.
  • When you are finished editing a box, touch the next box you wish to edit, or touch the Next button when you are finished.

Provide Participant Instructions

This screen displays the default set of instructions. Have the participant read it or read it aloud to them. Press the Continue button once the instructions have been understood.

Conduct Experimental Trials

The experiment opens with the number line visible on the screen with start and endpoint values. For each trial, the participant or experimenter touches the Go button (in green in the bottom control panel) to start the trial and display the target stimuli at the top of the screen. At this point, any touch near the line will drop the red vertical estimate bar to show the estimate for that trial. The red Done button is then clicked to confirm the completion of the trial. The trial process then repeats until the end of the set.

A small 'Retry' button is provided in the bottom control panel during a trial. This feature was added for the experimenter following pilot testing with very young childen, who occasionally accidentally touched the line, and wished to clear the estimate bar and try again.

At the end of a set of trials, the number line is cleared from the screen. The default question 'Continue to next set?' is displayed with NO and YES buttons. Touching the Yes button launches the next set of trials. Touching the 'No' button leads to the 'Done' screen, as described below.

View Scores - Start Next Participant

Once the NO button has been selected to avoid continuing to further sets, or all four sets have been completed, the number line and control panel are removed and the word 'Done' is displayed. At this point, the iPad should be retrieved from the participant.

You can then press the View Scores button to see the results that have been saved into the data_v2.csv file. The results for the participant are displayed for each trial in each set they performed.

At this point, you can start a new participant via the button at the bottom of the screen or use another app by clicking the Home button on the iPad. Don't worry about 'closing' the EstimationLine app. Apps are normally left running - the concept of 'opening' and 'closing' is not applicable to apps.

EstimationLine Method: Trial Sequences

The EstimationLine app was field-tested in a study of young children in daycare settings conducted by Jo-Anne LeFevre of Carleton University in October-November 2011. Experimenters in the study reported that the children enjoyed using the iPad and had no trouble touching the line. Some children in the study were already familiar with the iPad from home use. As expected, many of the young children performed only a single set, and even those trials often did not appear to reflect much knowledge of the number line.

Default Stimuli Sequences

The stimuli file 'stimuli-production.txt' contains 4 lines of target stimuli - one for each set. Set 1 of the default stimuli is deliberately short and simple - it could be used as a demonstration set, or as a test set to determine whether the child should proceed to the next set. Each set is 'shuffled' before it is displayed, so that the targets appear in a random order for each participant.

The stimuli sets are designed to provide balanced coverage of the number line and progress in difficulty to accomodate testing with very young children. However, your stimuli design will depend on the age-groups you are studying and the goals of the study. See below for instructions on how to customize stimuli files to set up different target stimuli for the sets.

  • The stimuli are formatted as percentages -the app adjusts them according to the endpoints provided for that set before they are displayed.
    • For example: target stimuli 20 would be displayed as 2 for an endpoint of 10, 4 for an endpoint of 20, or 200 for an endpoint of 1000.
Set 1: 10,20,30,40,50,60,70,80,90
Set 2: 5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95
Set 3: 5,11,18,25,33,40,46,52,58,65,71,78,85,93,99
Set 4: 2,8,15,22,30,37,43,49,55,62,68,75,82,90,96

Endpoints for set are configured separately from the set stimuli, because the endpoints can also be changed for each participant. The default endpoints built into the app for the four sets are shown below. They are presented in the order in which they are shown in the config.txt file - there is no randomization applied to the order of the sets. See instructions on how to customize stimuli files below to change the endpoints in the config.txt file.

defaultEnds:10, 20, 100, 100

Retrieve and Analyse Output Data

Retrieving Collected Data

To access the data file:
  1. Open iTunes on your computer.
  2. Connect the EstimationLine iPad to the computer.
  3. Select the iPad in the "Devices" list.
  4. Go to the "Apps" tab using the tab bar at the top.
  5. Scroll down to the "File Sharing" section.
  6. Select the EstimationLine app from the list.
  7. Select the data_v2.csv file in the file list.
  8. Now:
    • To download the data file from the iPad:
      Press the "save to..." button and select a location to save the file.
    • To clear existing data and start a new data file:
      With the data file selected, press the delete key on your keyboard.
      Press the delete button in the dialog that appears.

The File Sharing screen in iTunes:



Screenshot of iTunes.

Data File Format

The session data is stored the file named data_v2.csv. EstimationLine uses CSV format, with column headers on the first line, to allow for easy interoperation with programs like Excel and SPSS. Each row in the output file stores the data for one trial.

Information contained in the columns:

ColumnContains
idthe participant id
gendergender, either m or f
birthyearyear of birth
birthmonthbirth month
birthdaybirth day
trialtimeThe time that the session ended. In the format "dd-mm-yyyy hh:mm"
endpointThe endpoint used for the trial. I.E 10
selected The number location on the line that the user touched to two decimal places of precision. On a scale from 0 to the endpoint.
stimuli The stimuli number that the child was asked to show where it was.

Example Output File:

id gender birthyear birthmonth birthday trialtime endpoint selected stimuli
Tom m 1990 1 1 12/10/11 19:01 10 7.56 7
Tom m 1990 1 1 12/10/11 19:01 10 8.96 9
Tom m 1990 1 1 12/10/11 19:01 10 4.94 5
Tom m 1990 1 1 12/10/11 19:01 10 5.85 6
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 10 4.58 5
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 10 2.21 4
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 10 1.24 2
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 10 2 3
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 10 8.01 9
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 10 6.29 6
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 8.07 7
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 10.15 10
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 8.65 9
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 4.33 5
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 15.72 16
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 12.1 6
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 12.53 13
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 14.82 19
SomeParticipant-JulyStudy m 2001 3 13 13-10-2011 19:58 20 16.7 4
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 10 4.34 4
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 10 5.81 6
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 10 5.74 2
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 10 6.75 9
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 10 6.88 7
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 10 7.35 3
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 20 16.05 6
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 20 16.1 18
6yoBostonArea-2365 m 2005 10 27 27-10-2011 17:42 20 15.95 16

Customization Options for the EstimationLine App

EstimationLine uses csv-format files for both input and output of the data. Once the app has been run at least once, the default configuration files become available in the iTunes file sharing section. Via iTunes, the default files can be saved to a computer, modified and then put back on the iPad, as described below.

Configurable Options in EstimationLine:

  • Default Endpoints
  • Instruction Text
  • Stimuli
  • Button Text

Steps to modify a configuration file:

Getting Configuration Files On and Off the iPad

Note: Due to a quirk in the iTunes process, you must have run the EstimationLine app at least once before the files become available via this method.

  1. Open iTunes.
  2. Connect the EstimationLine iPad.
  3. Select the iPad in the "Devices" list.
  4. Go to the "Apps" tab using the tab bar at the top.
  5. Scroll down to the "File Sharing" section.
  6. Select the EstimationLine app from the list.
  7. Now:
    • To retrieve a default configuration file from the iPad so you can modify it:
      1. Select the configuration file you want to retrieve
      2. Press the "save to..." button and select a location to save the file.
    • To replace a default configuration file with one on your computer:
      1. Press the "Add..." button.
      2. Select the configuration file on your computer that you want to put on the iPad.
      3. Click "Replace" in the dialog that appears
    • To replace a modified configuration file on the iPad with the default:
      1. With the configuration file selected, press the delete key on your keyboard.
      2. Press the delete button in the dialog that appears.

Main Config File Format

The config.txt file is a list of keys and values separated by colons. In the following format:

option1:value1
option2:value2
				

The keys have the following default settings:

OptionDefault ValueDescription
instructionsinstructions.txt The name of the text file with the instructions to the participant. These are shown to the participant before they start.
stimuliFilestimuli-production.txt The name of the text file with the stimuli. See the Changing the Stimuli section of this document.
defaultEnds10,20,100,100 The default endpoints to use for the four sets, separated by commas.
doneButtonTitleDone The text displayed on the done button.
playButtonTitleGo The text displayed on the play button.
okTextIs this good? The text displayed to ask the child if the location they think they touched the right place.
playTextPress the "Go" button to see the number. The text displayed on the bottom bar to ask if the child is ready.
whereIsTextWhere Is The text displayed next to the stimuli number asking where it should go on the line.
nextTrialQuestionContinue to the next set? The text displayed on a screen asking if the experimenter wants to continue to the next set.

Changing the Stimuli.

The stimuli file is the file that describes the numbers that the child is shown for each trial. The file contains 4 lines, one line for each of the four sets. Each line is a comma-separated list of percentages along the line. Percentages are used so that the same stimuli can be used while allowing the endpoints to be changed at the start of every trial.

Note: percentages may be decimal/real numbers if necessary. For example, 43.23487 is a valid stimuli. However, the precision is limited by the iPad's hardware so arbitrary precision is not possible.

Percentages are converted to integer stimuli before running the trial based on the endpoint being used. For example: target stimuli percentage 20 would be displayed as 2 for an endpoint of 10, 4 for an endpoint of 20, or 200 for an endpoint of 1000. Since the result of the transformation is rounded, extra precision can be added to the stimuli for larger endpoints but it will be rounded for smaller endpoints. For example: the stimuli percentage 67.94 would be displayed as 7 for an endpoint of 10, 68 for an endpoint of 100 and 6794 for an endpoint of 10,000.

The default configuration file is named stimuli-production.txt and looks like this:

10,20,30,40,50,60,70,80,90
5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95
5,11,18,25,33,40,46,52,58,65,71,78,85,93,99
2,8,15,22,30,37,43,49,55,62,68,75,82,90,96
				

To use a completely new set of sequences:

  1. Create a new stimuli file text file. For example, stimuli-easy.txt
  2. Move it onto the iPad via iTunes it as described in"Getting Configuration Files On and Off the iPad"
  3. Change the file name of the stimuliFile key in the config.txt file to the new name
  4. Move the new config.txt file onto the iPad like you did with the stimuli file.

Example: Customizing the Instructions

Customizing the instructions shown at the beginning of the task can be done simply by uploading a text file containing your instructions.

  1. Create a file named instructions.txt

    • Note: You may wish to download the original default instructions first so that you have a copy available.

  2. Navigate to the file sharing screen as detailed in the "Getting Configuration Files On and Off the iPad" section.
  3. Press the "Add" button
  4. Select the instructions.txt file to upload it and replace the existing instructions file.

Contact us at apasoehps@hume.ca if you still have questions that weren't answered by this page.

© Tristan Hume 2012.