One-to-one tutoring has long been known to outperform group instruction, and the question has been how to provide it at scale 12. Recent randomized studies show that AI tutoring can help students learn more in less time, and that AI used without guardrails can harm learning 34. This note describes a live test of a further step: running a university course itself as an agentic organization. In the author's alpha courses in the fall of 2026, a course agent prepares each class with the professor, learning-assistant agents help the human learning assistants troubleshoot students' work without being able to change it, and student-built agents compete in tournaments run by a referee written in code 5, an approach the course's textbook teaches 6. The professor makes every decision about students. The test is early; we describe the design, what has been recorded, what would count against it, and the privacy rules that govern any research in a classroom 7.
Can a university course be run as an agentic organization, with a course agent and learning-assistant agents doing the legwork and the professor making every decision?
Bloom reported that students tutored one-to-one performed about two standard deviations better than students taught in a conventional class, and posed the problem of finding group methods as effective 1. A later review found that intelligent tutoring systems came close to human tutoring in many studies 2. Recent work with generative AI points both ways: in a randomized trial in an introductory physics course, "students learn significantly more in less time when using the AI tutor, compared with the in-class active learning," though the authors say they "do not presume that structured AI tutoring will always outperform in-class active learning in all contexts" 3; in a field experiment in high school mathematics, students given unrestricted access to a chatbot did better in practice but, "when access is subsequently taken away, students actually perform worse than those who never had access," while a version with safeguards largely avoided the harm 4.
Evaluating agents is itself a research field. Benchmarks such as τ-bench find that even strong agents "are quite inconsistent" across repeated trials 8; public arenas rank models from pairwise comparisons 9; and game-based arenas test models against each other in competitive settings 10. Building AI Agents uses an arena, with a referee acting as an independent proctor, as a teaching tool 6.
Most studies of AI in education put an AI next to the student. We have not found a published study of a whole course run as an organization of people and agents, with the professor in the middle; our search so far has been informal, and we would welcome pointers.
The setting. The author's alpha courses in the fall of 2026, among them the alpha course for the textbook Building AI Agents. Each GSSF Press textbook is meant to be taught first in an alpha course, where new chapters, exercises, and labs are tried with real students, before it is offered to other professors and schools.
The design under test. A course agent prepares each class with the professor and keeps the course materials consistent with one source of truth. One agent type serves every learning assistant, with a read-only view of every student's work in place of the owner's access 5. Student-built agents compete in tournaments run by a referee written in code, with exact rules and a frozen record of every move 5. Students build in hosted labs rather than on their own equipment, so that cost and hardware are less of a barrier; whether that holds is part of the test.
What is recorded. Changes to how the course runs, dated, with what was learned, in The Knowledge Core's appendix "Actions Taken" 5; what the tournaments show about how the referee and the agents failed, not students' individual results; and, for the next edition of each book, what worked and what did not. Student records stay in the university's systems and never enter this research.
How evidence is judged. By what the course record shows and by what the next edition of each book changes as a result. Because the professor is also the designer and author, findings are reported as a case. Before any study that goes beyond improving the course itself, such as publishing results about students, we will ask the university's office for research with human subjects, which decides what review and consent are needed.
The record so far is short; it is in the online appendix of The Knowledge Core, for its signed-in readers 5. In a class tournament in October 2026, fourteen student-built agents played cards against each other with no human in the loop; the referee, first built as a workflow (a fixed sequence of automated steps), had a typo in one field and then stalled under load. It was rebuilt as a program, with its rules for how players exchange moves fixed at version 1.0, and rehearsed with practice players before students returned. Two learning assistants needed to troubleshoot students' work the way the professor can, without being able to change it; they were given agents with a read-only view 5.
What is not yet known: whether the course agent saves the professor time without lowering quality, whether students learn more from building agents that compete, and how the design carries to other professors' courses.
What would count against the design. If courses prepared with a course agent need more correction than courses prepared by hand; if learning-assistant agents do not shorten the time to help a student; or if tournaments teach less about how agents fail than ordinary exercises, then the design is not doing what it claims.
The strongest objection. Putting agents between a professor and a class could distance the teacher from students, and agents could become a crutch, so that students do better while the agents help and worse without them, as the mathematics study found 4. The design keeps the professor making every decision about students and has students build agents rather than lean on them; whether that is enough is part of the test.
Open questions. What guardrails keep agents from becoming a crutch for students, as the mathematics study warns 4? Which parts of teaching, such as grading and judgments about a student, must stay with the professor? How should a course agent be shared between professors without sharing anyone's students?
Students are never named in this research. Their names and grades stay in the university's own systems; their work in the hosted labs and the tournament records are seen by the course staff to support the course, and are not used in this research. Federal law protects the privacy of students' education records 7. In the design, grades are decided only by the professor, and no agent grades students or contacts them on its own. Before any research beyond improving the course, we will ask the university's office for research with human subjects, which decides what review and consent are needed. Nothing in this note is legal advice.
Directly: the students in the alpha courses are the first to use each new chapter, exercise, and lab, and what they show us goes into the next edition of the book before it reaches other professors' classes.
For a professor or a leader of any organization that teaches: agents can do the preparation and the record-keeping, and the decisions about people stay with people. Which decisions about the people you teach or lead would you never hand to an agent?