The purpose of the project was to find out whether humans can tell the difference between human-generated text and artificial intelligence (AI) chatbots-generated text and to identify how Al-generated text differs from human-generated text. The dependent variable was the results given by the participants (whether the paragraphs were Al-generated texts or human-generated text). The Independent variable was the participants in the experiment and the controlled variable was the type of paragraphs (both the Al-generated texts and human-generated texts) and time used to test each participant. The hypothesis for this experiment was that the participants were not going to be able to differentiate between AI-generated text and human-generated text.
In this descriptive and mixed-method study, participants were presented with questionnaires. Each participant needed to state whether they thought each paragraph was human-generated or AI-generated. At the end of the questionnaire, the participants were asked to briefly explain what assisted them in differentiating between the two. They were given 60 seconds to decide. A stopwatch was used to time them. A sample of 456 participants took part in this project. They were not told how many AI-generated passages and human-generated passages there were in the selection. They only knew the total number of passages.
Over Ninety-nine percent of the participants could not correctly differentiate between AI-generated text and human-generated text in all passages. Only four participants were able to get 100% of the questions correct. All four learners attend schools located in urban areas.
After I did my analysis, I discovered that my hypothesis was incorrect. Four of the participants were able to get 100% of the questions correct this indicates that not all the participants were not able to tell the difference between Al-generated text and human-generated text. This rejects my hypothesis. However, the chances of humans differentiating between the two are very low. All four learners attend schools located in urban areas; this indicates that it is easier for learners attending urban area schools to recognise AI-generated texts than learners attending schools located in rural areas.