- Assessment API
- Higher Education
- Personnel Testing
- Contact/Demo
Transforming Assessment With AI-Powered Essay Scoring
IntelliMetric ® delivers accurate, consistent, and reliable scores for writing prompts for K-12 school districts, for higher education, for personnel testing, and as an API for software.
IntelliMetric ® Is The Gold Standard In AI Scoring Of Written Prompts
Trusted by educational institutions for surpassing human expert scoring, IntelliMetric ® is the go-to essay scoring platform for colleges and universities. IntelliMetric ® also aids in hiring by identifying candidates with excellent communication skills. As an assessment API, it enhances software products and increases product value. Unlock its potential today.
Proven Capabilities Across Markets
Whether you’re a hiring manager, school district administrator, or higher education administrator, IntelliMetric® can help you meet your organization’s goals. Click below to learn how it works for your industry.
Powerful Features
IntelliMetric ® delivers relevant scores and expert feedback tailored to writers’ capabilities. IntelliMetric ® scores prompts of varying lengths, providing invaluable insights for both testing and writing improvement. Don't settle for less; unleash the power of IntelliMetric ® for scoring excellence.
IntelliMetric ® scores writing instantly to help organizations save time and money evaluating writing with the same level of accuracy and consistency as expert human scorers.
IntelliMetric ® can be used to either test writing skills or improve instruction by providing detailed and accurate feedback according to a rubric.
IntelliMetric ® gives teachers and business professionals the bandwidth to focus on other more impactful job duties by scoring writing prompts that would otherwise take countless hours each day.
Using Legitimacy detection, IntelliMetric ® ensures all writing is original without any plagiarism - and doesn’t contain any messages that diverge from the assigned writing prompt.
Case Studies and Testimonials
Below are use cases and testimonials from customers who used IntelliMetric ® to reach their goals by automating the process of analyzing and grading written responses. These users found IntelliMetric ® to be a vital tool in providing instant feedback and scoring written responses.
Santa Ana School Disctrict Through the use of IntelliMetric ® , the Santa Ana school district was able to evaluate student writing and their students were able to use the instantaneous feedback to drastically improve their writing. The majority of teachers found IntelliMetric to benefit their classrooms as an instructional tool and found that students were more motivated to write.
Santa Ana School District
I have worked with Vantage Learning’s MY Access Automated Essay Scoring product both as a teacher and as a secondary ELA Curriculum specialist for grades 6-12. As a teacher, I immediately saw the benefits of the program. My students were more motivated to write because they knew that they would receive immediate feedback upon completion and submission of their essays. I also taught my students how to use the “My Tutor” and “My Editor” feedback in order to revise their essays. In the past, I felt like Sisyphus pushing a boulder up the hill, but with MY Access that heavy weight was lifted and my students were revising using specific feedback from My Access and consequently their writing drastically improved. When it comes to giving instantaneous feedback, MY Access performed more efficiently than myself.
More than 350 research studies conducted both in-house and by third-party experts have determined that IntelliMetric® has levels of consistency, accuracy and reliability that meet, and more often exceed, those of human expert scorers. After performing the practice DWA within SAUSD, I surveyed our English teachers and asked them about their recent experience with MY Access. Of the 85 teachers that responded to the survey, 82% of the teachers felt that their students’ experience with MY Access was either fair, good or very good. Similarly, 75% of the teachers thought the accuracy of the scoring was fair, good, or very good. Lastly, 77% of the teachers surveyed said that they would like to use MY Access in their classrooms as an instructional tool.
Many of the teachers’ responses to the MY Access survey included a call for a plagiarism detector. At the time, we had not opted for the addition of Cite Smart, the onboard plagiarism detector for MY Access This year, however, we will be using it and teachers across the district are excited to have this much needed tool available.
As a teacher and as an ELA curriculum specialist, I know of no other writing tool available to teachers that is more helpful than MY Access. When I tell teachers that we will be using MY Access for instruction and not just benchmarking this year, the most common reply I receive is “Oh great! That means that I can teach a lot more writing!” Think about it - if a secondary teacher has 175 students (35 students in 5 periods) and the teacher takes 10 minutes to provide feedback on each student’s paper, then it would take the teacher 29 hours (1,750 minutes) to give effective feedback to his/her students. MY Access is a writing teacher’s best friend!
Jason Crabbe
Secondary Language Arts Curriculum Specialist
Santa Ana Unified School District
Arkansas State University “In 2018, our students performed poorly in style and mechanics. Other forms of intervention have not proven successful. We piloted IntelliWriter and IntelliMetric and produced great results. The University leadership has since implemented a full-scale rollout across all campuses” - Dr. Melodie Philhours, Arkansas State University
The United Nations The United Nations utilizes IntelliMetric® via the Adaptera Platform for real-time evaluation of personnel writing assessments, offering a cost-effective solution to ensure communication skills in the workforce.
The United Nations, Department of Homeland Security and the world's largest online retail store all access IntelliMetric ® for immediate scoring of personnel writing assessments scored by IntelliMetric ® using the Adaptera Platform. In a world where clear concise communication is essential in the workforce using IntelliMetric ® to score writing assessments provides immediate, cost-effective evaluation of your employee skills.
IntelliMetric ® Offers Multilingual Scoring & Support
Score written responses in your native language with IntelliMetric! The automated scoring platform offers instant feedback and scoring in several languages to provide more accuracy and consistency than human scoring wherever you’re located. Accessible any time or place for educational or professional needs, IntelliMetric® is the perfect solution to your scoring requirements.
Intelliwriter
IntelliMetric-powered Solutions
Automated Essay Scoring using AI.
Online Writing Instruction and Assessment.
Adaptive Learning and Assessment Platform.
District Level Capture and Assessment of Student Writing.
AI-Powered Assessment and Instruction APIs.
Advanced AI-Driven Writing Mastery Tool.
- Read The Blog
SmartMarq: Human and AI Essay marking
Easily manage the essay marking process, then use modern machine learning models to serve as a second or third rater, reducing costs and timelines.
Define Rubrics
Create your scoring rubrics and performance descriptors
Manage Raters
Assign essays to be scored, then view results
Gather Ratings
Raters can easily move through and leave scores and comments
Auto-Scoring
Implement automated essay scoring to flag unusual scores
SmartMarq will streamline your essay marking process
SmartMarq makes it easy to implement large-scale, professional essay scoring.
- Reduce timelines for marking
- Increase convenience by managing fully online
- Implement business rules to ensure quality
- Once raters are done, run the results through our AI to train a custom machine learning model for your data, obtaining a second “rater.”
Note that our powerful AI scoring is customized, specific to each one of your prompts and rubrics – not developed with a shotgun approach based on general heuristics.
Fully integrated into our FastTest ecosystem
We pride ourselves on providing a single ecosystem with configurable modules that covers the entire test development and delivery cycle. SmartMarq is available both standalone, and as part of our online delivery platform. If you have open-response items, especially extended constructed response (ECR) items, our platforms will improve the process needed to mark these items. Leverage our user-friendly, highly scalable online marking module to manage hundreds (or just a few) raters, with single or multi-marking situations.
“FastTest reduced the workhours needed to mark our student essays by approximately 60%, cutting it from a multi-day district-wide project to a single day!”
A K-12 FastTest Client
Manage Users
Upload users and manage assignments to groups of students
Create Rubrics
Create your rubrics, including point values and descriptor
Tag Rubrics to Items
When authoring items, simply assign the rubrics you want to use
Set Marking Rules
Require multiple markers, adjudication of disagreements, and visibility limitations? Users can be specified to see only THEIR students, or have the entire population anonymized and randomized. Configure as you need.
Deliver tests online
Students write their essays or other ECR responses
Users mark responses
Users (e.g., teachers) log in and mark student responses on your specified rubrics, as well as flag responses or leave comments. Admins can adjudicate any disagreements.
Score examinees
Examinees will be automatically scored. For example, if your test has 40 multiple choice items and an essay with two 5-point rubrics, the total score is 50. We also support the generalized partial credit model from item response theory, or exporting results to analyze in other software like FACETS.
Sign up for a SmartMarq account
Simply upload your student essays and human marking results, and our AI essay scoring system will provide an additional set of marks.
Need a complete platform to manage the entire assessment cycle, from item banking to online delivery to scoring? FastTest provides the ideal solution. It includes an integrated version of SmartMarq with advanced options like scoring rubrics with the Generalized Partial Credit Model .
Chat with the experts
Ready to make your assessments more effective?
Online Assessment
Psychometrics.
e-rater ® Scoring Engine
Evaluates students’ writing proficiency with automatic scoring and feedback
Selection an option below to learn more.
About the e-rater Scoring Engine
The e-rater automated scoring engine uses AI technology and Natural Language Processing (NLP) to evaluate the writing proficiency of student essays by providing automatic scoring and feedback. The engine provides descriptive feedback on the writer’s grammar, mechanics, word use and complexity, style, organization and more.
Who uses the e-rater engine and why?
Companies and institutions use this patented technology to power their custom applications.
The e-rater engine is used within the Criterion ® Online Writing Evaluation Service . Students use the e-rater engine's feedback to evaluate their essay-writing skills and to identify areas that need improvement. Teachers use the Criterion service to help their students develop their writing skills independently and receive automated, constructive feedback. The e-rater engine is also used in other low-stakes practice tests include TOEFL ® Practice Online and GRE ® ScoreItNow!™.
In high-stakes settings, the engine is used in conjunction with human ratings for both the Issue and Argument prompts of the GRE test's Analytical Writing section and the TOEFL iBT ® test's Independent and Integrated Writing prompts. ETS research has shown that combining automated and human essay scoring demonstrates assessment score reliability and measurement benefits.
For more information about the use of the e-rater engine, read E-rater as a Quality Control on Human Scores (PDF) .
How does the e-rater engine grade essays?
The e-rater engine provides a holistic score for an essay that has been entered into the computer electronically. It also provides real-time diagnostic feedback about grammar, usage, mechanics, style and organization, and development. This feedback is based on NLP research specifically tailored to the analysis of student responses and is detailed in ETS's research publications (PDF) .
How does the e-rater engine compare to human raters?
The e-rater engine uses NLP to identify features relevant to writing proficiency in training essays and their relationship with human scores. The resulting scoring model, which assigns weights to each observed feature, is stored offline in a database that can then be used to score new essays according to the same formula.
The e-rater engine doesn’t have the ability to read so it can’t evaluate essays the same way that human raters do. However, the features used in e-rater scoring have been developed to be as substantively meaningful as they can be, given the state of the art in NLP. They also have been developed to demonstrate strong reliability — often greater reliability than human raters themselves.
Learn more about how it works .
About Natural Language Processing
The e-rater engine is an artificial intelligence engine that uses Natural Language Processing (NLP), a field of computer science and linguistics that uses computational methods to analyze characteristics of a text. NLP methods support such burgeoning application areas as machine translation, speech recognition and information retrieval.
Ready to begin? Contact us to learn how the e-rater service can enhance your existing program.
