The drop from 2018 to 2022 is as big as the one from 2022 to 2026, so it's not obvious whether AI had a role at all, although it's highly plausible.
I suspect the bigger culprit is the optimized monetization of human attention, because pre-algorithmic social media doesn't seem to be as destructive. The fact that science wasn't as affected as math and reading (both of which rely more on attention/practice than rote memorization) somewhat supports this.
Between 2018 and 2022, we saw the widespread adoption of social media and the rapid digitalization of education. Focusing on these key shifts, it seems clear to me that any kind of electronic learning has had a negative impact on education :p
You make it sounds like you're being sarcastic. But I would argue that ubiquitous digital interfaces demanding our attention is wreaking havoc on people's focus.
I saw extremely rapid computerisation of my kid's education around 2020. Properly thought out and edited text books were replaced with last minute rushed teachers notes on google docs and buggy apps.
When I was a freshman in college taking CS courses, they were just rolling out a new Java curriculum. And Java being fairly new, the textbooks that we were assigned were absolutely terrible. Just garbage books.
AI, screen time, short form text/video, normalization of recreational drugs, post-truth, there's no one cause but there's lots of things that are not helping
Especially the part where it states that part of the issue is in 2000 when Finland had higher test scores then everyone it was attributed to play based learning and less testing. Everyone immediately jumped on this, because if you can have more fun and learn more, of course that is the way to go. This opinion still permeates both teachers and parents. I was of this opinion for a long time, as I went to a rigorous school, and would have enjoyed "play based learning".
It turns out this may have been way off and difficult schools such as those in China and Singapore have the best results. In the Finland example they had only recently switched from more rigorous to more play based, so the rigorous schooling was still being shown in testing.
I think we were all a bit bamboozled by this. Maybe it seemed too good to be true and we should have been more critical of the findings. But the play based learning opinion is still strong and we as a society need to move back to more rigor will make stronger students.
Seems highly plausible AI/robotics will lead a significant decline in public schooling in the near future. Kids honestly might learn better doing a few hours a day one-on-one with 2026 frontier AI than sitting in a classroom of 30 with a teacher. 2027, 2028, 2029?
Modern public education itself is industrial revolution technology. Why would it be left as-is after the intelligence revolution?
Math or arithmetic ? Math isn’t arithmetic any more than juggling is theoretical physics.
Mastery of arithmetic involves memorizing lots of heuristic rules that aren’t particularly insightful about, or are outright conflicting with, the structure of math, and learning the structure of math first slows your ability to do arithmetic.
I don’t think any school hands first graders calculators and asks them to never learn arithmetic. But I see no need once you’re doing algebra to be focusing your time on long division or multiplication. These are irrelevant distractions from algebra, time spent and points lost on arithmetic details is a waste of cognition and doesn’t help. This becomes increasingly true through calculus, linear algebra, until you get to real math courses where a calculator is pointless because arithmetic doesn’t even show up.
There is a 99% probability this will not happen in your lifetime. Half the point of school is so someone has supervision over children for 6 hours and to be part of a small community.
If anything, if someone is looking for an AI proof job while not wanting to do something braindead, teaching might be one of the good jobs that may get more competitive.
A very long time ago, in the 90s, we really thought that computers would make people smarter. We thought computers would sharpen people's analytical skills with logic and math, would provide them better tools to write and design things, would provide them information to help them get better answers.
Back then, there was a famous snake-oil salesman that coined the expression "computers are bicycles for the mind". He proposed an analogy: when you compare the effort humans put into personal locomotion on foot with other animals you'll notice that they spend a lot of effort to yield very little movement. But then you put them in a bicycle and things change: humans can move a lot with very little effort. Computers would do the same: increase the mind's "productivity".
Fast forward for today and we live in a world where everybody has a computer in their pockets. Ironically this change was pioneered by that very same snake-oil seller.
And when I see the consequences of it, I say to myself: "boy, we were soooo wrong!".
Law of unintended consequences? Or it is the fact that everyone is lazy and do want to remain dumb?
It’s still possible. There’s this sort of guerilla education movement in software with apps like Mathacademy and Mentava to really focus on actual learning, in a scientific way. I can say for my part that my son has been using Mathacademy and the results have been incredible.
The reason most educational software is not like this, as far as I can tell, is that the incentive structures aren’t there. Maximizing learning just isn’t a priority for most schools.
For this new breed of software though, they’re selling to parents, at fairly high prices. Some parents really care about their kids actually learning, and so the incentives are much more direct and aligned.
There is a very high correlation between national IQ and PISA scores. We know that IQ is declining across the world, and it is declining because fertility and IQ are negatively associated. It's likely that declining IQ is a nontrivial factor for why PISA scores are declining. It is unfortunately still taboo to talk about this. Which is bad, because we can't hope to do anything about it if we don't face the truth.
While kids practice the skills of the 21st century, testing got stuck in the 19 hundreds.
I see kids train edge AI models, built things using coding assistants and discuss post-modern philosophy.
I see the same kids struggle to write structured interpretations of 1950s texts they have no emotional connection to.
Kids are worse in orthography, handwriting, and reading stuffy texts from front to end, but they are so much better in a plethora of skills that did not exist 20 years ago.
You read a text. Then, you are asked a series of questions to assess your reading comprehension. Rinse and repeat for a school year to get a solid idea of each student's proficiency.
This skill has been declining steadily since the 1970s, but the decline has accelerated since the mid 2010s.
None of the things named in your comment, on either side of the line, really matter.
Reading, writing, and critical thinking skills matter. You don't have to "write structured interpretations of 1950s texts [you] have no emotional connection to" or practice "handwriting, and reading stuffy texts from front to end" to develop those skills (very loaded language, nice job!), but you have to put a lot of time into doing something, ideally somethings, where you're the one doing the heavy intellectual lifting.
Or, we can just write these kids off as a generation incapable of thinking or building by themselves without AI tools that do the thinking and building for them. Honestly, it's probably already too late. The way we've allowed kids of all ages to be exposed to these tools is basically equivalent to handing out cartons of cigarettes in a preschool.
One of the weirdest things I noticed when people around me started having kids was how immediately they picked up on their parents obsession with their phones, and would instinctively try to interact with them.
It was odd, disheartening and almost universal (barring the parents who went full 'my kid doesn't use any of the products I build')
According to PISA they did change the tests to be more relevant to using computers. Reading tasks are mostly practical: websites, emails, forum posts, comparing multiple sources and judging whether a source is credible.
So this "old testing" framework is at least from 2010s rather than from 1950s.
Yes - the older I get, the more obvious it is that the mind of a child (and young adult) is better suited to learning, reacts faster, and is more creative than mine.
The attention-deficit that is so common among especially (but not only) young people today means that grabbing their interest is of paramount importance to their learning. Just repeating that kids are bad at reading stuffy texts. But if you can put them onto something that they find interesting, they can definitely excel. I've got tales of high school students who are terrible students, but give them a CAD and 3D printer and they will solve any problem you have.
So - in other news, education is broken. How do we fix it?
I teach college… you rent wrong on what they output, you are wrong on the inference drawn from it.
On a regular basis I have students bring me “machine learning” models they have trained, which sounds great. But they have no idea what problem they are solving, what data they have or should have, and no idea why that method, etc. There is no understanding. They use words and concepts from a broad variety of fields, with confidence, but with little deep understanding. The Internet and AI give access to knowledge which is necessary but not sufficient for wisdom.
While K-12 bears a lot of blame (as a system not “teachers”) I’ve come to believe the problem is more societal. What we value and what kids logically perceive will be them ahead in life. If all they ever see is that surface level performance of knowledge is enough…why bother with more?
This very much echoes the region of critical slowing down present in a dynamical system after its equilibrium states have disappeared due to a change in the system (a bifurcation).
A sentence isn't Orwellian just because you are unfamiliar with its terms. I though dynamical systems theory was quite common knowledge among engineers
The issue is that you're talking in abstraction and it isn't clear what the concrete thing is you're thinking of. Bluntly: you're being obscure rather than illuminating.
For instance, with respect to this article, which is about test scores, how does dynamical systems theory describe what's going on or predict consequences?
I wanted to relate the result to well known phenomena in Dynamical systems. The value of the comment is in that relationship. But I guess I can try.
After a saddle-node bifurcation (for example) a system is left with a region of critical slowing down. It can be thought of as the ghost of the fix point that used to exist in that region. Thus observing local phenomena in the system can make it look like the system is still stable while in reality it isn't.
I guess the most famous example of this is global warning. As our emissions of greenhouse gases increased during the industrial revolution, the environment still seemed stable. But in reality we had already deleted the stable point around with our planets temperature oscillated.
I can see there a compounding drift from the stable point that is not initially apparent because the compounding values have not yet grown sufficiently to be meaningful. It is still an increase in drift
Slowing down implies a decrease though, what does that represent then?
Society, education and white-collar work in this case. Not saying I believe this does mean the collapse of white-collar work of course. Moreso that if that was the case, the point of no return could have already been passed without us knowing.
For something as abstract as education, is there such a thing as a "point of no return"? It's not obvious to me that's something that degrades in the same way that climate or a physical system does, even if we can draw some parallels. I do think it's still a useful analogy, for example, it would imply that even though we're only starting to notice the ripples of that instability now, it has the implication that fixing it things would mean having to address much more than just what's apparent, we'd also have to fix everything that lead to this mess over the last few decades.
I think there is for a snapshot in time of education or work which is how we commonly think of work right? It isn't true of course. But we sort try to group work into periods of stability between revolutions, industrial, digital or whatever.
We have a chance to adapt, that's for sure. But white-collar work might not exist (or just resemble) as it does today.
But I agree, the category is almost too malleable to analyze.
A bifurcation is a non-continuous change to a system as a result of a continuous parameter changing.
For example the disappearance of a stable temperature of the earth due to a continuous increase in green house emissions.
In this case the change in test scores is continuous yet might still lead to the disappearance of a stable point in society like white-collar work. At the start the change might seems slow but the point of no return could have already been passed.
I'm not saying I necessarily believe that (or that I stated it with much clarity) but I thought it was interesting how it "rhymes" with dynamical system theory.
I suspect the bigger culprit is the optimized monetization of human attention, because pre-algorithmic social media doesn't seem to be as destructive. The fact that science wasn't as affected as math and reading (both of which rely more on attention/practice than rote memorization) somewhat supports this.
That would have contributed to to the decline.
-Everyone has screens.
-Education system broken.
-Covid disruptions
-Biological effects of Covid infections
Especially the part where it states that part of the issue is in 2000 when Finland had higher test scores then everyone it was attributed to play based learning and less testing. Everyone immediately jumped on this, because if you can have more fun and learn more, of course that is the way to go. This opinion still permeates both teachers and parents. I was of this opinion for a long time, as I went to a rigorous school, and would have enjoyed "play based learning".
It turns out this may have been way off and difficult schools such as those in China and Singapore have the best results. In the Finland example they had only recently switched from more rigorous to more play based, so the rigorous schooling was still being shown in testing. I think we were all a bit bamboozled by this. Maybe it seemed too good to be true and we should have been more critical of the findings. But the play based learning opinion is still strong and we as a society need to move back to more rigor will make stronger students.
Modern public education itself is industrial revolution technology. Why would it be left as-is after the intelligence revolution?
Mastery of arithmetic involves memorizing lots of heuristic rules that aren’t particularly insightful about, or are outright conflicting with, the structure of math, and learning the structure of math first slows your ability to do arithmetic.
I don’t think any school hands first graders calculators and asks them to never learn arithmetic. But I see no need once you’re doing algebra to be focusing your time on long division or multiplication. These are irrelevant distractions from algebra, time spent and points lost on arithmetic details is a waste of cognition and doesn’t help. This becomes increasingly true through calculus, linear algebra, until you get to real math courses where a calculator is pointless because arithmetic doesn’t even show up.
If anything, if someone is looking for an AI proof job while not wanting to do something braindead, teaching might be one of the good jobs that may get more competitive.
“What has made the University of California exceptional is its commitment to increase access without sacrificing excellence.”
Go woke...
Back then, there was a famous snake-oil salesman that coined the expression "computers are bicycles for the mind". He proposed an analogy: when you compare the effort humans put into personal locomotion on foot with other animals you'll notice that they spend a lot of effort to yield very little movement. But then you put them in a bicycle and things change: humans can move a lot with very little effort. Computers would do the same: increase the mind's "productivity".
Fast forward for today and we live in a world where everybody has a computer in their pockets. Ironically this change was pioneered by that very same snake-oil seller.
And when I see the consequences of it, I say to myself: "boy, we were soooo wrong!".
Law of unintended consequences? Or it is the fact that everyone is lazy and do want to remain dumb?
The reason most educational software is not like this, as far as I can tell, is that the incentive structures aren’t there. Maximizing learning just isn’t a priority for most schools.
For this new breed of software though, they’re selling to parents, at fairly high prices. Some parents really care about their kids actually learning, and so the incentives are much more direct and aligned.
I see kids train edge AI models, built things using coding assistants and discuss post-modern philosophy.
I see the same kids struggle to write structured interpretations of 1950s texts they have no emotional connection to.
Kids are worse in orthography, handwriting, and reading stuffy texts from front to end, but they are so much better in a plethora of skills that did not exist 20 years ago.
Kids are worse at reading, period. Not just stuffy texts from 50 years ago, current stuff too according to the research.
The "skills" you claim they are learning have such a low barrier to entry they aren't skills at all.
Instructing a machine "make me a Foo" requires no thought.
test taking is not a valuable skill. it's mostly pattern matching against the question
people need new skills in a new age. the education system hasn't even kept pace with the existence of the internet, let alone AI
Guess we'll live in an illiterate society soon...
Reading, writing, and critical thinking skills matter. You don't have to "write structured interpretations of 1950s texts [you] have no emotional connection to" or practice "handwriting, and reading stuffy texts from front to end" to develop those skills (very loaded language, nice job!), but you have to put a lot of time into doing something, ideally somethings, where you're the one doing the heavy intellectual lifting.
Or, we can just write these kids off as a generation incapable of thinking or building by themselves without AI tools that do the thinking and building for them. Honestly, it's probably already too late. The way we've allowed kids of all ages to be exposed to these tools is basically equivalent to handing out cartons of cigarettes in a preschool.
It was odd, disheartening and almost universal (barring the parents who went full 'my kid doesn't use any of the products I build')
The Hobbit was published in 1937 and The Lord of the Rings was published 1954-55.
If the kids can't develop an emotional connection to them, that says much more about their teachers than it does the children or modern times.
So this "old testing" framework is at least from 2010s rather than from 1950s.
Tell us more?
Such as?
The attention-deficit that is so common among especially (but not only) young people today means that grabbing their interest is of paramount importance to their learning. Just repeating that kids are bad at reading stuffy texts. But if you can put them onto something that they find interesting, they can definitely excel. I've got tales of high school students who are terrible students, but give them a CAD and 3D printer and they will solve any problem you have.
So - in other news, education is broken. How do we fix it?
On a regular basis I have students bring me “machine learning” models they have trained, which sounds great. But they have no idea what problem they are solving, what data they have or should have, and no idea why that method, etc. There is no understanding. They use words and concepts from a broad variety of fields, with confidence, but with little deep understanding. The Internet and AI give access to knowledge which is necessary but not sufficient for wisdom.
While K-12 bears a lot of blame (as a system not “teachers”) I’ve come to believe the problem is more societal. What we value and what kids logically perceive will be them ahead in life. If all they ever see is that surface level performance of knowledge is enough…why bother with more?
https://www.fadedpage.com/link.php?file=20180223.html
https://en.wikipedia.org/wiki/Politics_and_the_English_Langu...
1. Never use a metaphor, simile, or other figure of speech which you are used to seeing in print.
2. Never use a long word where a short one will do.
3. If it is possible to cut a word out, always cut it out.
4. Never use the passive where you can use the active.
5. Never use a foreign phrase, a scientific word, or a jargon word if you can think of an everyday English equivalent.
6. Break any of these rules sooner than say anything outright barbarous.
Now you tell me
For instance, with respect to this article, which is about test scores, how does dynamical systems theory describe what's going on or predict consequences?
After a saddle-node bifurcation (for example) a system is left with a region of critical slowing down. It can be thought of as the ghost of the fix point that used to exist in that region. Thus observing local phenomena in the system can make it look like the system is still stable while in reality it isn't.
I guess the most famous example of this is global warning. As our emissions of greenhouse gases increased during the industrial revolution, the environment still seemed stable. But in reality we had already deleted the stable point around with our planets temperature oscillated.
I can see there a compounding drift from the stable point that is not initially apparent because the compounding values have not yet grown sufficiently to be meaningful. It is still an increase in drift
Slowing down implies a decrease though, what does that represent then?
Or are you talking about another system like "society" or "civilization"? Or something else altogether?
We have a chance to adapt, that's for sure. But white-collar work might not exist (or just resemble) as it does today.
But I agree, the category is almost too malleable to analyze.
So really it is not saying much at all.
For example the disappearance of a stable temperature of the earth due to a continuous increase in green house emissions.
In this case the change in test scores is continuous yet might still lead to the disappearance of a stable point in society like white-collar work. At the start the change might seems slow but the point of no return could have already been passed.
I'm not saying I necessarily believe that (or that I stated it with much clarity) but I thought it was interesting how it "rhymes" with dynamical system theory.