{"id":115467,"date":"2025-02-28T15:34:49","date_gmt":"2025-02-28T15:34:49","guid":{"rendered":"https:\/\/peraltafinancing.com\/business\/legal\/the-end-of-the-student-essay-reasoning-ais-are-starting-to-cross-into-pass-territory-technollama\/"},"modified":"2025-02-28T15:34:49","modified_gmt":"2025-02-28T15:34:49","slug":"the-end-of-the-student-essay-reasoning-ais-are-starting-to-cross-into-pass-territory-technollama","status":"publish","type":"post","link":"https:\/\/fivemor.com\/?p=115467","title":{"rendered":"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama"},"content":{"rendered":"


\n<\/p>\n

\n

\"\"<\/a><\/p>\n

One of the most challenging aspects of generative AI for legal education has been its potential use in assessment. There have been some polls conducted<\/a>, and large numbers of students admit to using AI in their assessments. Anecdotally I\u2019ve heard as much from my own students, and while few would admit to using it to write their essays, many are open about using it to research, to help with their structure, for bouncing-off ideas, and to get inspiration.<\/p>\n

The current status of AI use in education in general varies from one institution to another. In most UK institutions, AI use in assessment is forbidden because it is considered personation, in other words, the student didn\u2019t write the assessment. There have been different attempts to reach standards on how to handle this, and how to communicate it to students, but for the most part if you are caught using AI you will be failed, and may face disciplinary sanctions. Students that rely heavily on AI may also face the fact that it often hallucinates and gets stuff wrong, which could translate on a low mark or even a fail due to errors in the assessment, even if it\u2019s not caught.<\/p>\n

The problem of course is detection.<\/p>\n

So far, it has been relatively easy to detect bad AI use in essays, particularly as earlier LLMs such as ChatGPT used to rely heavily on some specific words such as \u201cdelve<\/a>\u201c. LLMs also have a certain tone, a very boring voice that experienced markers have learned to identify. AIs also tend to hallucinate references, so often reading a paper which cites articles, cases, and books that don\u2019t exist, can be a certain sign of LLM use. But more sophisticated use of AI may be more difficult to find, AI detectors are unreliable, and some students may use it for some things, and not for others.<\/p>\n

I won\u2019t get to the more philosophical and important questions that arise from the use (and prohibition) of AI in legal education. What legal professionals are we even trying to train? Won\u2019t they be using LLMs anyway in their everyday practice? Should we even be policing this when we have no resources, and academics are famously underpaid and overworked? UK higher education institutions are already suffering greatly from a funding crisis due to visa restrictions<\/a>, so you\u2019re often placing a lot of stress on already stressed professionals. Sorry, I have no answers to many of those important questions, I\u2019m just a nerdy academic who likes technology.<\/p>\n

Whatever side of the debate you fall on, one thing is clear. AI is getting better. All the time. My blog post on AI detection was written 11 months ago, and the models have already moved on so much that what I wrote back then is unrecognisable. The current models, particularly reasoning and research models, are able to provide text that is better written and better structured, and even the most raw content from a research model can provide a very decent output that is getting dangerously close to getting a pass mark. So I ran an experiment with OpenAI\u2019s new agent mode called \u201cDeep Research<\/a>\u201c. This is a search agent that runs on an early version of the o3 reasoning model, and it is designed to conduct web searches and find authoritative sources and use them to answer a research question. I chose this because I think that a models such as this is the most likely to produce an essay, and because it searches for authoritative online sources, it is less likely to hallucinate results.<\/p>\n

So I gave the model three copyright-related questions that I could ask in my class to see how it fared, and I was pretty impressed by some of the results, but I\u2019m not sure if I would have passed them based on on general marking standards<\/a> for a 3rd year undergraduate (knowledge and understanding, research, creative and critical thinking, presentation and communication). While the answers excel in knowledge and understanding, they would be marked down for being less critical and analytical in some cases (too descriptive), and marked down considerably for sources (too many online sources), and the bullet-point presentation, but would do excellent on communication.<\/p>\n

At the very least, they are right on the edge of pass for an undergraduate essay, making a couple of assumptions. Firstly, I would assume that each of the links is a footnote, and that a student would use the proper referencing standard. Secondly, I\u2019m ignoring the obvious tell-tale sign of an AI output, and that is the over-use of bullet points and numbered lists. These would probably fail as clearly AI just because of the formatting. I am assuming that a competent student would convert all of these into paragraphs.<\/p>\n

So again, I am forgetting the actual presentation, and going just for what is written, and I think the models are getting there. Here they are:<\/p>\n

    \n
  1. \u201cWrite an analysis of voice copyright in the UK and Europe, paying special attention to performer\u2019s rights.\u201d Here\u2019s the output<\/a>. I would probably give this a 48 (with the caveats above). Good knowledge, too descriptive and pretty basic sources.\n<\/li>\n
  2. \n

    \u201cWrite an analysis of the current UK government consultation on copyright and AI? What are the options on the table, and what is likely to be the end result? . Here\u2019s the output<\/a>. This is the best of the bunch, and probably would mark at 52 (with caveats). Properly formatted and with better sources, this could even go higher The policy recommendation section at the end is another tell-tale sign of AI use.<\/p>\n<\/li>\n

  3. \n

    \u201cCritically analyse whether artificial intelligence can generate works capable of copyright protection. Use UK and US law in your comparative analysis.\u201d Here is the output<\/a>. This is the poorest of the three from an analysis perspective, but the best with primary and secondary sources. I\u2019d give it a 42. Still a pass, but just about.<\/p>\n<\/li>\n<\/ol>\n

    Concluding<\/strong><\/p>\n

    I know I\u2019m opening myself to criticism with my marking standards. Am I being too harsh? Too lenient? Without the two concessions, these would have been clearly fails, but I think that it\u2019s not too difficult to assume that most students would be able to turn the above text into more than passable essays, and that is what I am trying to get at. We\u2019re probably at the point at which the written essay is no longer a viable manner of assessment. What next? Vivas? Written exams?<\/p>\n

    Last year we had a lot of submissions that were clearly written by AI. This year? Not so much. It could be that students aren\u2019t using the technology, or it could be that we\u2019ve finally crossed the \u201cpass\u201d boundary. So I\u2019ll leave you with this meme.<\/p>\n

    \"\"<\/a><\/p>\n

    \n

    Like this:<\/h3>\n

    Like<\/span><\/span> Loading…<\/span><\/p>\n

    <\/div>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"

    One of the most challenging aspects of generative AI for legal education has been its potential use in assessment. There have been some polls conducted, and large numbers of students admit to using AI in their assessments. Anecdotally I\u2019ve heard as much from my own students, and while few would admit to using it to […]<\/p>\n","protected":false},"author":1,"featured_media":115471,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[97],"tags":[18630,1770,19705,510,20867,5559,6763,18518,14656],"dealstore":[],"offerexpiration":[],"class_list":["post-115467","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-legal","tag-ais","tag-cross","tag-essay","tag-pass","tag-reasoning","tag-starting","tag-student","tag-technollama","tag-territory"],"yoast_head":"\nThe end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama - Som2ny Network<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/fivemor.com\/?p=115467\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama - Som2ny Network\" \/>\n<meta property=\"og:description\" content=\"One of the most challenging aspects of generative AI for legal education has been its potential use in assessment. There have been some polls conducted, and large numbers of students admit to using AI in their assessments. Anecdotally I\u2019ve heard as much from my own students, and while few would admit to using it to […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/fivemor.com\/?p=115467\" \/>\n<meta property=\"og:site_name\" content=\"Som2ny Network\" \/>\n<meta property=\"article:published_time\" content=\"2025-02-28T15:34:49+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"904\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/fivemor.com\/?p=115467#article\",\"isPartOf\":{\"@id\":\"https:\/\/fivemor.com\/?p=115467\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371\"},\"headline\":\"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama\",\"datePublished\":\"2025-02-28T15:34:49+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/fivemor.com\/?p=115467\"},\"wordCount\":1156,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/fivemor.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/fivemor.com\/?p=115467#primaryimage\"},\"thumbnailUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg\",\"keywords\":[\"AIs\",\"Cross\",\"Essay\",\"Pass\",\"Reasoning\",\"Starting\",\"Student\",\"TechnoLlama\",\"Territory\"],\"articleSection\":[\"Legal\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/fivemor.com\/?p=115467#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/fivemor.com\/?p=115467\",\"url\":\"https:\/\/fivemor.com\/?p=115467\",\"name\":\"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama - Som2ny Network\",\"isPartOf\":{\"@id\":\"https:\/\/fivemor.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/fivemor.com\/?p=115467#primaryimage\"},\"image\":{\"@id\":\"https:\/\/fivemor.com\/?p=115467#primaryimage\"},\"thumbnailUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg\",\"datePublished\":\"2025-02-28T15:34:49+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/fivemor.com\/?p=115467#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/fivemor.com\/?p=115467\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/fivemor.com\/?p=115467#primaryimage\",\"url\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg\",\"contentUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg\",\"width\":1200,\"height\":904},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/fivemor.com\/?p=115467#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/fivemor.com\/?bp_activities=1\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/fivemor.com\/#website\",\"url\":\"https:\/\/fivemor.com\/\",\"name\":\"Som2ny Network\",\"description\":\"Daily Deals\",\"publisher\":{\"@id\":\"https:\/\/fivemor.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/fivemor.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/fivemor.com\/#organization\",\"name\":\"Som2ny Network\",\"url\":\"https:\/\/fivemor.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png\",\"contentUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png\",\"width\":300,\"height\":86,\"caption\":\"Som2ny Network\"},\"image\":{\"@id\":\"https:\/\/fivemor.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/fivemor.com\"],\"url\":\"https:\/\/fivemor.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama - Som2ny Network","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/fivemor.com\/?p=115467","og_locale":"en_US","og_type":"article","og_title":"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama - Som2ny Network","og_description":"One of the most challenging aspects of generative AI for legal education has been its potential use in assessment. There have been some polls conducted, and large numbers of students admit to using AI in their assessments. Anecdotally I\u2019ve heard as much from my own students, and while few would admit to using it to […]","og_url":"https:\/\/fivemor.com\/?p=115467","og_site_name":"Som2ny Network","article_published_time":"2025-02-28T15:34:49+00:00","og_image":[{"width":1200,"height":904,"url":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/fivemor.com\/?p=115467#article","isPartOf":{"@id":"https:\/\/fivemor.com\/?p=115467"},"author":{"name":"admin","@id":"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371"},"headline":"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama","datePublished":"2025-02-28T15:34:49+00:00","mainEntityOfPage":{"@id":"https:\/\/fivemor.com\/?p=115467"},"wordCount":1156,"commentCount":0,"publisher":{"@id":"https:\/\/fivemor.com\/#organization"},"image":{"@id":"https:\/\/fivemor.com\/?p=115467#primaryimage"},"thumbnailUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg","keywords":["AIs","Cross","Essay","Pass","Reasoning","Starting","Student","TechnoLlama","Territory"],"articleSection":["Legal"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/fivemor.com\/?p=115467#respond"]}]},{"@type":"WebPage","@id":"https:\/\/fivemor.com\/?p=115467","url":"https:\/\/fivemor.com\/?p=115467","name":"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama - Som2ny Network","isPartOf":{"@id":"https:\/\/fivemor.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/fivemor.com\/?p=115467#primaryimage"},"image":{"@id":"https:\/\/fivemor.com\/?p=115467#primaryimage"},"thumbnailUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg","datePublished":"2025-02-28T15:34:49+00:00","breadcrumb":{"@id":"https:\/\/fivemor.com\/?p=115467#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/fivemor.com\/?p=115467"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/fivemor.com\/?p=115467#primaryimage","url":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg","contentUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/02\/robot-writer.jpeg","width":1200,"height":904},{"@type":"BreadcrumbList","@id":"https:\/\/fivemor.com\/?p=115467#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/fivemor.com\/?bp_activities=1"},{"@type":"ListItem","position":2,"name":"The end of the student essay? Reasoning AIs are starting to cross into pass territory \u2013 TechnoLlama"}]},{"@type":"WebSite","@id":"https:\/\/fivemor.com\/#website","url":"https:\/\/fivemor.com\/","name":"Som2ny Network","description":"Daily Deals","publisher":{"@id":"https:\/\/fivemor.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/fivemor.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/fivemor.com\/#organization","name":"Som2ny Network","url":"https:\/\/fivemor.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/fivemor.com\/#\/schema\/logo\/image\/","url":"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png","contentUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png","width":300,"height":86,"caption":"Som2ny Network"},"image":{"@id":"https:\/\/fivemor.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/fivemor.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png","caption":"admin"},"sameAs":["https:\/\/fivemor.com"],"url":"https:\/\/fivemor.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/posts\/115467","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=115467"}],"version-history":[{"count":0,"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/posts\/115467\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/media\/115471"}],"wp:attachment":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=115467"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=115467"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=115467"},{"taxonomy":"dealstore","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fdealstore&post=115467"},{"taxonomy":"offerexpiration","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fofferexpiration&post=115467"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}