EXAMSOFT PRODUCT SPECIFICATIONS

ExamSoft Core Platform

Overview

The ExamSoft Core Platform provides Users access to the ExamSoft Portal for the purposes of item banking, assessment authoring, scheduling, and scoring & reporting, along with access to the downloadable Examplify™ application for the purpose of assessment delivery.

Exhibit A Product/Service Name

This Specification covers the Product/Service names (“Product Names”) identified in the table below.

From time to time, ExamSoft may assign new Product names or create new Products with different capabilities within the ExamSoft Core Platform. The table below defines the capabilities included with each Product. Specific functionality for each Product Name is designated blow with an “X”. Please refer to a Product Name to review the specified capabilities for each Product.

Product Name ExamSoft Portal Examplify (Win & Mac) Examplify (iPad) PrintX      FlexSite Express
Ai: Assessment Intelligence
(Examplify for iPad)
X   X X *
Ai: Assessment Intelligence
(SofTest-M iPad only) + Rubrics
X   X X *
Ai: Assessment Intelligence (Win + Mac only) X X   X *
Ai: Assessment Intelligence BiModal (Win + Mac + Examplify for iPad) X X X X *
Ai: Assessment Intelligence BiModal (Win + Mac + SofTest-M (iPad)) X X X X *
Ai: Assessment Intelligence BiModal (Win + Mac + SofTest-M (iPad)) + Rubrics X X X X *
Ei: Exam Intelligence (Examplify for iPad only) X   X X *
Ei: Exam Intelligence (Examplify for iPad only) Initial Setup X   X X *
Ei: Exam Intelligence
(K-12 Enterprise,
Examplify for iPad only)
X   X X *
Ei: Exam Intelligence
(K-12 Enterprise,
Win + Mac only)
X X   X *
Ei: Exam Intelligence
(per Answer File)
X X   X *
Ei: Exam Intelligence (SofTest-M iPad only) X   X X *
Ei: Exam Intelligence
(Win + Mac)
X X   X *
Ei: Exam Intelligence
(Win + Mac) Initial Setup
X X   X *
Ei: Exam Intelligence
(Win + Mac only)
X X   X *
Ei: Exam Intelligence
(Win + Mac only)
Initial Setup
X X   X *
Ei: Exam Intelligence
(Win + Mac only + Examplify for iPad)
X X X X *
Ei: Exam Intelligence Base License Package (iPad only) X   X X *
Ei: Exam Intelligence
Base License Package
(Win + Mac only)
X X   X *
Ei: Exam Intelligence BiModal (Win + Mac +Examplify for iPad) X X X X *
Ei: Exam Intelligence BiModal (Win + Mac +Examplify for iPad)
(initial setup)
X X X X *
Ei: Exam Intelligence
Full Suite Upgrade
X X   X X
Examplify for iPad   X
Examplify for iPad
(initial setup)
  X
Examplify for iPad
(per ET)
  X
Examplify for iPad Basic (Examplify for iPad Basic only)   X
Examplify for iPad Beta   X
Examplify for iPad Initial Setup (per ET)   X
Mid-Year Startup – Ai: Assessment Intelligence (Win + Mac only)
+ Rubrics
X X   X *
Mid-Year Startup – Ai: Assessment Intelligence BiModal (Win + Mac + Examplify for iPad) X X X X *
Mid-Year Startup –
Ai: Exam Intelligence
(Win + Mac only) + Rubrics
X X   X *
Mid-Year Startup – Ei: Exam Intelligence
(Examplify for iPad only)
X   X X *
Mid-Year Startup – Ei: Exam Intelligence
(Win + Mac only)
X X   X *
Mid-Year Startup – Ei: Exam Intelligence BiModal
(Win + Mac + Examplify for iPad)
X X X X *
Pilot – Ai: Assessment Intelligence
(Win + Mac only) + Rubrics
X X   X *
Pilot – Ei: Exam Intelligence (Examplify for iPad only) X   X X *
Pilot – Ei: Exam Intelligence (Win + Mac only) X X   X *
EiS: ExamSoft Intelligence Streamlined
(Scantron only)
X
EiS Basic: ExamSoft Intelligence Streamlined (Scantron Basic only) X
Scantron X
Scantron (Initial Setup) X
EiX: Exam Intelligence Express X X
FSX: FlexSite Express X X
Pilot – FSX: FlexSite Express X X

* Functionality only available for Law School & Bar Jurisdiction clients.

Detailed Specifications

ExamSoft Portal

Users will have access to the ExamSoft Portal in order to manage users, questions, and assessments, as well as to review reporting.

User Management

ExamSoft will create a “Key Administrator” (“KA”) account within the ExamSoft Portal. The KA will have the ability to manage end user access rights to Portal features

  • Create, Edit, and Disable Staff & Student accounts

Question Management

Create and manage a bank of questions to be used in assessments

  • Add questions using text editing tools within the portal interface, or via bulk import
  • Attach files to individual questions
  • Edit existing questions with version history
  • Examples of supported Question Types include:
    • Multiple Choice
    • True / False
    • Fill-in-the-Blank
    • Essay
    • Hot Spot
  • Tag questions for reporting purposes
    • Define categories to be used in measuring Question and Exam Taker performance
    • Tag individual questions to one or more categories

Assessment Management

Create, manage, and post assessments

  • Assign questions to new or existing Assessments
  • Define assessment settings, including Name, scheduled date and time, and security requirements
  • Track student exam downloads and answer uploads

Scantron Upload

Manually upload assessment results for scoring in the ExamSoft portal

  • Input assessment results into .csv template and upload via the ExamSoft portal
  • Results are scored automatically and included in reporting & analytics

Scoring

Evaluate Exam Taker answers to calculate assessment scores

  • Automatically score exam results for questions where one or more “Correct” choices are defined (i.e., Multiple Choice)
  • Manually score of exam results for Essay questions, where no single “Correct” answer choice is defined in assessment creation
  • Manual adjustment of scoring criteria for individual questions post-assessment (e.g., accept additional answer choices)

Reporting & Analytics

A variety of reports are available based on assessment results

  • Item Analysis: detailed question-level analytics
    • Examples include: Question Difficulty, Upper/Lower 27% performance, Discrimination Index, Point Biserial, Average Time on Question
  • Assessment Analysis: detailed assessment-level analytics
    • Examples include: KR-20, Standard Deviation, Mean / Median / Min / Max Exam Taker performance
  • Exam Taker Performance
    • Examples include: % score, raw score, and details by Category and/or question
    • Faculty may define what detail is included in Exam Taker reporting, including text of questions and answers
    • Individual Exam Taker results may be released to Exam Takers within the ExamSoft Portal, or printed or exported for manual distribution
  • Category & Longitudinal Reporting
    • View Exam Taker performance by Category, across one or more Assessments

Examplify (Win & Mac)

ExamSoft administers offline assessments via the installed Examplify application. This enables Exam Takers to utilize their own devices, or utilize Client-provided testing lab devices, when completing assessments, provided that the device meets the defined Minimum System Requirements (“MSRs”).

The Exam Taker experience within Examplify is subject to the settings defined by assessment administrators within the ExamSoft Portal.

Assessment Access

Exam Taker access to assessment data is controlled by User and Assessment authentication

  • Exam Takers download Exam files prior to their scheduled exam
  • Exam files are encrypted on the Exam Taker’s device to prevent access
  • The ability to download Exam files is subject to the settings defined by the assessment administrator in the ExamSoft Portal

Device Security

For assessments flagged as “secure”, Examplify will take measures to prevent access to files or applications outside of Examplify for the duration of the assessment.

  • In the event that a student reboots their device due to a mid-exam interruption, they will be automatically returned to the exam in a secure environment.
  • Normal device settings and functionality are restored after assessment completion.

Assessment Experience

  • Exam Taker inputs are automatically saved throughout the assessment
  • Students may ‘flag’ questions for later return if backward navigation is enabled for the assessments
  • Where included in a Question or Assessment, Exam Takers may review attached assets, including images, documents, audio, and video files.
  • If enabled for the assessment, Exam Takers may also utilize optional features such as Calculator, Timer, etc.

Examplify (iPad®)

ExamSoft administers offline assessments via the installed Examplify iOS application. This enables Exam Takers to utilize their own iPad device, or utilize Client-provided testing lab devices, when completing assessments, provided that the device meets the defined Minimum System Requirements (“MSRs”).

The Exam Taker experience within Examplify for iPad is subject to the settings defined by assessment administrators within the ExamSoft Portal.

Assessment Access

Exam Taker access to assessment data is controlled by User and Assessment authentication

  • Exam Takers download Exam files prior to their scheduled exam
  • Exam files are encrypted on the Exam Taker’s device to prevent access
  • The ability to download Exam files is subject to the settings defined by the assessment administrator in the ExamSoft Portal

Device Security

For assessments flagged as “secure” Examplify will take measures to prevent access to files or applications outside of Examplify, including any network access, for the duration of the assessment.

  • In the event that a student reboots their device due to a mid-exam interruption, they will be automatically returned to the exam in a secure environment.
  • Normal device settings and functionality are restored after assessment completion.

Assessment Experience

  • Exam Taker inputs are automatically saved throughout the assessment
  • Students may ‘flag’ questions for later return if backward navigation is enabled for the assessments
  • Where included in a Question or Assessment, Exam Takers may review attached assets, including images, documents, audio, and video files.
  • If enabled for the assessment, Exam Takers may also utilize optional features such as Calculator, Timer, etc.

FlexSite Express

Law School clients may utilize a simplified ExamSoft portal that supports Essay and Multiple-Choice questions.

Assessment Management
Users may upload assessment details via a .csv file. Questions uploaded are “blank” – with no question stem or answer choices listed – for use when exam content is delivered via paper.

  • Define assessment details, such as posting date and security settings
  • Define the number of blank essay questions to be included.
  • Define the number of blank multiple choice questions to be included, including the answer key for each question.

Scoring

Evaluate Exam Taker answers to calculate assessment scores

  • Automatically score exam results for questions where one or more “Correct” choices are defined (i.e., Multiple Choice)
  • Integration with PrintX to facilitate printing or exporting Essay responses for manual grading (see below)

PrintX

Clients may print or export Essay question responses for grading purposes.

PrintX

Users may utilize an installed application to print Essay responses captured via Examplify so that they can be distributed physically for grading.

  • Define data settings and formatting options
  • Print essay answers for selected assessments and Exam Takers
  • View reports of completed printings

PX Online

Users may utilize a web-based tool to export Essay responses captured via Examplify as .pdf files, so that they can be distributed electronically for grading.

  • Define data settings and formatting options
  • Export essay answers to .pdf files for selected assessments and Exam Takers
  • View reports of completed printings

Prerequisites

Product Access is contingent on the following prerequisites:

  • Device compliance with published MSRs

Add-On Options

The following add-on Products and services are available with the Core Platform:

Third-Party Integrations – to support the integration of data between ExamSoft and third-party systems and tools

  • Blackboard Integration
  • Canvas Integration
  • D2L Integration
  • Integration Maintenance
  • Integration Maintenance (initial setup)
  • LDAP Integration
  • Moodle Integration
  • SAML Integration
  • Shibboleth Integration

Database Fees – to support the maintenance of multiple institutional programs within a single client database

  • Database
  • Database (Initial Setup)

Bar Services – additional services provided to jurisdictions to support the administration of the Bar Exam

  • Site Engineers – On-site personnel hired by ExamSoft on behalf of Bar Client to provide computer-based testing technical support to Exam Takers on each Bar Exam Day in which Exam Takers use ExamSoft’s Examplify Software. (Refer to ordering documents for pricing)
  • Printing and Shipping –  ExamSoft provides printing services of  Exam Taker Bar Exam essay answers and ships the essay answers to its Bar Clients. (Refer to ordering documents for pricing)