AutoGrade accuracy report
AutoGrade works by comparing two sentences and then seeing if they are similar by meaning. This report publishes the results of our tests which aim to determine how accurate AutoGrade is.
For the tests carried out in this report only 1 and 2 mark questions have been used. This is because we want to test lots of possible variations of saying the same points. This tests AutoGrade’s ability to compare two sentences and see if they are similar by meaning. The exact same process will occur on questions with different amounts of marks (eg. 8 mark questions).
Average accuracy of AutoGrade marking student’s work: 96%
Average accuracy of teachers marking student’s work: 96%
Date of tests: 01 / 12 / 2021
Date of last modification to AutoGrade alogirithm: 30 / 11 / 2021
| Student's answer | Indicative content, used for marking | Mark awarded by AutoGrade | Mark awarded by teachers | Accuracy |
|---|---|---|---|---|
| Enzymes speed up the rate of reaction. Enzymes denature in hot temperatures. |
| 2 / 2 | 2 / 2 | 100% |
| Enzymes will denature in hot temperatures. Enzymes are biological catalysts. |
| 2 / 2 | 2 / 2 | 100% |
| Enzymes denature because of heat. |
| 1 / 2 | 1 / 2 | 100% |
| Enzymes |
| 0 / 2 | 0 / 2 | 100% |
| rate of reaction |
| 0 / 2 | 0 / 2 | 100% |
| Enzymes, biological catalysts |
| 0 / 2 | 0 / 2 | 100% |
| Heat causes enzymes to denature. |
| 1 / 2 | 1 / 2 | 100% |
| Enzymes, which are biological catalysts, will denature if they get too hot |
| 2 / 2 | 2 / 2 | 100% |
| Embedded system |
| 0 / 2 | 0 / 2 | 100% |
| A computer system that has a dedicated purpose and is built into a physical product is known as an embedded system. |
| 2 / 2 | 2 / 2 | 100% |
| A computer system with a dedicated purpose and is built into a physical product is known as an embedded system. |
| 2 / 2 | 2 / 2 | 100% |
| A computer system with a specified purpose and is built into a physical device is known as an embedded system. |
| 2 / 2 | 2 / 2 | 100% |
| A computer system with a specified purpose and is built into a physical device is called an embedded system. |
| 2 / 2 | 2 / 2 | 100% |
| Embedded systems are built into a product and will have a specific function. An example of an embedded system is a washing machine. |
| 2 / 2 | 2 / 2 | 100% |
| Embedded computer systems have dedicated purposes. |
| 1 / 2 | 1 / 2 | 100% |
| Embedded computer systems have dedicated purposes. They are built into a physical machine. |
| 2 / 2 | 2 / 2 | 100% |
| Embedded systems are capable of performing multiple functions. |
| 0 / 2 | 0 / 2 | 100% |
| Embedded systems are able to perform multiple functions. |
| 0 / 2 | 0 / 2 | 100% |
| Embedded systems are built into physical devices. |
| 1 / 2 | 1 / 2 | 100% |
| computer system with a physical product |
| 0 / 2 | 0 / 2 | 100% |
| computer system with only one purpose |
| 0 / 2 | 1 / 2 | 50% |
| embedded systems do not have a dedicated purpose. |
| 0 / 2 | 1 / 2 | 50% |
| Ransomware requires you to pay for a key in order to decrypt your data. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware encrypts your data and you have to pay in order to get a decryption key. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware encrypts your data and you have to pay in order to get your data decrypted. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware is a type of malware. It involves encrypting user's data and requiring them to pay for it to be decrypted. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware decrypts user's data. |
| 0 / 1 | 0 / 1 | 100% |
| Ransomware requires you to pay in order to get your data decrypted. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware is a type of malware. |
| 0 / 1 | 0 / 1 | 100% |
| Ransomware is bad for businesses. |
| 0 / 1 | 0 / 1 | 100% |
| Ransomware can cause disruption because users won't be able to read their data. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware will encrypt your files. |
| 1 / 1 | 1 / 1 | 100% |
| With ransomware, you won't be able to read your files. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware encrypts the content on your computer. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware forces you to pay for a key in order to decrypt your data. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware is bad. |
| 0 / 1 | 1 / 1 | 0% |
| After paying for a key, you will be able to decrypt the data that was encrypted by ransomware software. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware demands a ransom in order to decrypt your files. |
| 1 / 1 | 1 / 1 | 100% |
| Ransomware demands money in order to decrypt your files. |
| 1 / 1 | 1 / 1 | 100% |
| An example of malware is ransomware. |
| 0 / 1 | 0 / 1 | 100% |
| AutoGrade implements Artificial Intelligence in order to mark student's exam answers. |
| 1 / 1 | 1 / 1 | 100% |
| AutoGrade implements Artificial Intelligence in order to mark student's exam responses. |
| 1 / 1 | 1 / 1 | 100% |
| Artificial Intelligence is used in order to allow AutoGrade to mark student's responses to exam questions. |
| 1 / 1 | 1 / 1 | 100% |
| Artificial Intelligence is used to help AutoGrade mark student's responses to exam questions. |
| 1 / 1 | 1 / 1 | 100% |
| Artificial Intelligence is used so that AutoGrade can mark student's responses to exam questions. |
| 1 / 1 | 1 / 1 | 100% |
| Artificial Intelligence is used by AutoGrade to enable AutoGrade to automatically mark student's exam answers. |
| 1 / 1 | 1 / 1 | 100% |
| AutoGrade marks student's exam answers by using Artificial Intelligence. |
| 1 / 1 | 1 / 1 | 100% |
| AutoGrade |
| 0 / 1 | 0 / 1 | 100% |
| Artificial Intelligence |
| 0 / 1 | 0 / 1 | 100% |
| exam answers |
| 0 / 1 | 0 / 1 | 100% |
| Artificial Intelligence enables AutoGrade to be able to mark student's work. |
| 0 / 1 | 0 / 1 | 100% |