Matches in SemOpenAlex for { <https://semopenalex.org/work/W2105204564> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W2105204564 startingPage "561" @default.
- W2105204564 abstract "When it comes to reading essays and rating them, computers have not played much of a role to date. But that may change, according to Mr. Page and Ms. Petersen, because - for the first time ever - a blind test has demonstrated that a computer can simulate the judgment of a group of human judges on a brand-new set of essays. It is now obvious that computers can do a raft of things once reserved for humans. But when it comes to reading essays and rating them, computers have not played much of a role. Of course, we've all grown accustomed to spell-checkers and grammar-checkers. And we've even learned to live with their limitations. But we all know that, for evaluations of real live student papers, only a literate human reader can give an essay a proper grade. Or do we? Research on computer rating of essays has continued since an article on the topic appeared in the Kappan almost 30 years ago.(1) At that time everyone was surprised to learn that a computer could do as well as a single human judge. That early work led to much research and federal support, but the world was plainly not ready for practical applications.(2) Computers were terribly expensive and rare, and software was poor and scarce. And in those early years, nothing had been achieved like today's success in essay reading. In the past three years, however, there has once again been much activity in this area, and some successes have even seemed to promise practical applications.(3) In 1994 the Educational Testing Service (ETS) collaborated to arrange a blind test of the latest work of Project Essay Grade (PEG). The Experiment In mid-1994 we and our colleagues undertook a unique test of computer essay grading. It had previously been shown that Project Essay Grade could succeed in a research setting - but, until there was some blind test of the system, no one could be sure how it would work in practice. The test we worked out used 1,314 essays supplied by ETS that had been composed on computers. These essays were written by college students taking the computer-based writing assessment that is part of the Praxis Series: Professional Assessments for Beginning Teachers, a program that is used as part of the teacher licensing process in 33 states. This constituted the largest set of essays yet analyzed by PEG. ETS divided the essays randomly into two groups: 1,014 research essays and 300 test essays. Along with the research essays, ETS sent two human ratings that had already been collected in the operational scoring of the Praxis Series. These we used formatively to fine-tune the computer program. (ETS also sent some rich data about those students' objective test scores and other nonpersonal information.) Although ETS had two ratings for the test essays, no human ratings, objective test scores, or other data about the test essays were sent to the research team. Thus, when our experiment began, two human scores existed for each of 1,314 essays. But even two human judges do not give a very accurate rating of essays, so ETS collected four more ratings for the 300 test essays and for 300 essays randomly chosen from among the 1,014 research essays. Thus 600 essays now had a total of six human ratings, and none of the judges knew whether the essays they read would be research or test essays. Here, then, is our unprecedented test. From the 300 test essays alone, without human ratings or background information, PEG would try to predict the average scores of the six human judges. All of us could then evaluate the performance of PEG. If the predicted ratings surpassed what two human judges could do in the way of predicting the scores of other judges, then the quality of PEG's performance would be reassuring. Otherwise, it would be back to the drawing board. The bottom line is that the computer program did predict human judgments well - perhaps even better than three human judges. In practical terms, these findings are very encouraging for large-scale testing programs. …" @default.
- W2105204564 created "2016-06-24" @default.
- W2105204564 creator A5066447167 @default.
- W2105204564 creator A5083476464 @default.
- W2105204564 date "1995-03-01" @default.
- W2105204564 modified "2023-10-03" @default.
- W2105204564 title "The Computer Moves into Essay Grading: Updating the Ancient Test." @default.
- W2105204564 hasPublicationYear "1995" @default.
- W2105204564 type Work @default.
- W2105204564 sameAs 2105204564 @default.
- W2105204564 citedByCount "63" @default.
- W2105204564 countsByYear W21052045642012 @default.
- W2105204564 countsByYear W21052045642013 @default.
- W2105204564 countsByYear W21052045642014 @default.
- W2105204564 countsByYear W21052045642015 @default.
- W2105204564 countsByYear W21052045642016 @default.
- W2105204564 countsByYear W21052045642019 @default.
- W2105204564 countsByYear W21052045642020 @default.
- W2105204564 crossrefType "journal-article" @default.
- W2105204564 hasAuthorship W2105204564A5066447167 @default.
- W2105204564 hasAuthorship W2105204564A5083476464 @default.
- W2105204564 hasConcept C111472728 @default.
- W2105204564 hasConcept C127413603 @default.
- W2105204564 hasConcept C136815107 @default.
- W2105204564 hasConcept C138885662 @default.
- W2105204564 hasConcept C144024400 @default.
- W2105204564 hasConcept C145420912 @default.
- W2105204564 hasConcept C147176958 @default.
- W2105204564 hasConcept C151730666 @default.
- W2105204564 hasConcept C15744967 @default.
- W2105204564 hasConcept C17744445 @default.
- W2105204564 hasConcept C19165224 @default.
- W2105204564 hasConcept C199539241 @default.
- W2105204564 hasConcept C26022165 @default.
- W2105204564 hasConcept C2777267654 @default.
- W2105204564 hasConcept C2777286243 @default.
- W2105204564 hasConcept C2780957641 @default.
- W2105204564 hasConcept C41008148 @default.
- W2105204564 hasConcept C41895202 @default.
- W2105204564 hasConcept C554936623 @default.
- W2105204564 hasConcept C86803240 @default.
- W2105204564 hasConceptScore W2105204564C111472728 @default.
- W2105204564 hasConceptScore W2105204564C127413603 @default.
- W2105204564 hasConceptScore W2105204564C136815107 @default.
- W2105204564 hasConceptScore W2105204564C138885662 @default.
- W2105204564 hasConceptScore W2105204564C144024400 @default.
- W2105204564 hasConceptScore W2105204564C145420912 @default.
- W2105204564 hasConceptScore W2105204564C147176958 @default.
- W2105204564 hasConceptScore W2105204564C151730666 @default.
- W2105204564 hasConceptScore W2105204564C15744967 @default.
- W2105204564 hasConceptScore W2105204564C17744445 @default.
- W2105204564 hasConceptScore W2105204564C19165224 @default.
- W2105204564 hasConceptScore W2105204564C199539241 @default.
- W2105204564 hasConceptScore W2105204564C26022165 @default.
- W2105204564 hasConceptScore W2105204564C2777267654 @default.
- W2105204564 hasConceptScore W2105204564C2777286243 @default.
- W2105204564 hasConceptScore W2105204564C2780957641 @default.
- W2105204564 hasConceptScore W2105204564C41008148 @default.
- W2105204564 hasConceptScore W2105204564C41895202 @default.
- W2105204564 hasConceptScore W2105204564C554936623 @default.
- W2105204564 hasConceptScore W2105204564C86803240 @default.
- W2105204564 hasIssue "7" @default.
- W2105204564 hasLocation W21052045641 @default.
- W2105204564 hasOpenAccess W2105204564 @default.
- W2105204564 hasPrimaryLocation W21052045641 @default.
- W2105204564 hasRelatedWork W1590881479 @default.
- W2105204564 hasRelatedWork W1954968711 @default.
- W2105204564 hasRelatedWork W1983578042 @default.
- W2105204564 hasRelatedWork W2001402876 @default.
- W2105204564 hasRelatedWork W2001440096 @default.
- W2105204564 hasRelatedWork W2018072436 @default.
- W2105204564 hasRelatedWork W2027533841 @default.
- W2105204564 hasRelatedWork W2029173090 @default.
- W2105204564 hasRelatedWork W2059677116 @default.
- W2105204564 hasRelatedWork W2062914707 @default.
- W2105204564 hasRelatedWork W2089150068 @default.
- W2105204564 hasRelatedWork W2094401778 @default.
- W2105204564 hasRelatedWork W2107484888 @default.
- W2105204564 hasRelatedWork W2147152072 @default.
- W2105204564 hasRelatedWork W2155652017 @default.
- W2105204564 hasRelatedWork W2158240052 @default.
- W2105204564 hasRelatedWork W2158997610 @default.
- W2105204564 hasRelatedWork W2166708896 @default.
- W2105204564 hasRelatedWork W3034730645 @default.
- W2105204564 hasRelatedWork W3118967241 @default.
- W2105204564 hasVolume "76" @default.
- W2105204564 isParatext "false" @default.
- W2105204564 isRetracted "false" @default.
- W2105204564 magId "2105204564" @default.
- W2105204564 workType "article" @default.