‹ BackHN Continuity

Thread

Plunging test scores are a slow-moving catastrophe

207 points · 414 comments · vinni2

  1. dumberquestions · · focus · HN ↗
    The drop from 2018 to 2022 is as big as the one from 2022 to 2026, so it's not obvious whether AI had a role at all, although it's highly plausible.

    I suspect the bigger culprit is the optimized monetization of human attention, because pre-algorithmic social media doesn't seem to be as destructive. The fact that science wasn't as affected as math and reading (both of which rely more on attention/practice than rote memorization) somewhat supports this.

    1. asutekku · · focus · HN ↗
      Between 2018 and 2022, we saw the widespread adoption of social media and the rapid digitalization of education. Focusing on these key shifts, it seems clear to me that any kind of electronic learning has had a negative impact on education :p
      1. AlienRobot · · focus · HN ↗
        Another modern problem with education is that every student has a smartphone now, which they bring to the class, then they get distracted by it.
        1. Loquebantur · · focus · HN ↗
          "Modern" education isn't modern at all. It's a leftover from industrialization, aiming at producing easily controllable worker drones.

          "Elites" fearing the "plebs" to question them on things they have no good answers for is what constrains active development of actual modern scientific concepts of pedagogy taking hold. You only get to research what is being paid for.

          Look at the, pretty obvious, natural human child-mode of learning: playing games.

          Just not escapist nonsense games. Games that model relevant aspects of reality in an engaging way. Where you can fail without real-life consequences and learn from it while enjoying yourself.

          1. pixl97 · · focus · HN ↗
            Playing games as a biological creature optimized to live on plains is great, your body has a lot of the lessons already encoded in DNA.

            When it comes catching up to the last 10,000 years of human development everything tends to get a bit trickier. Play is a good way at learning, but as you get to higher concepts you have to learn but are hard to game it gets a lot trickier.

            Trying to easily wrap this up as the elites vs you is highly reductive. Before that age you' have spent most of your time and effort making food and clothes, not active research into the world.

            1. piloto_ciego · · focus · HN ↗
              They're not wrong though, like, it is a creation of the industrial era, and honestly, the "elites vs all of us" isn't exactly crazy. Mcgraw Hill is literally owned by Apollo Global Management, don't just take my word for it, look up the relationship the management there had with Epstein.

              It doesn't have to be a conspiracy even, it could just be that terrible incentives across the board result in terrible outcomes lol

              1. JumpCrisscross · · focus · HN ↗
                > It doesn't have to be a conspiracy

                “Versus” implies intent. Apollo owning McGraw Hill doesn’t explain falling scores across the entire OECD.

                1. piloto_ciego · · focus · HN ↗
                  You're right, but with the rhetoric I see espoused about "don't go to college" by most really rich people (who all went to the best schools themselves) the more I think "don't fall for it kids!"

                  And there may be some social-engineering intent there, or at least something approximating it? Like, I don't think the elites are all smoking cigars after their Bohemian grove owl orgy (or whatever Alex Jones coded nonsense) and saying "muah hahahaha, we can really make these kids dumber!" But I definitely think that "it sure would be nice if the workers didn't want raises" certainly comes up. No child left behind has certainly had an effect too... Then there's the shootings, the bullying (which appears much much better than when I was a kid at least), and the jingoism/patriotic nonsense.

                  My wife and I have actually been considering taking the kids out of "traditional school" and doing something more bespoke. Here in Alaska that's a lot more practical than in say, Washington? We have great home school programs here, and with our family members we have the education and qualifications to teach most of the core subjects (lots of retired teachers in our extended family). But, even with my kids in a fantastic school, it is a weird and almost carceral experience for the kids. They're constantly waiting around for stuff, constantly being tested with tests that don't seem to make a huge difference in what's taught, and they aren't really reading literature or doing much in math beyond simple rote work except for one of my sons who is 2 years ahead in math but is still bored.

                  I'm not saying it was all roses when I was in school 20-30 years ago, but, it feels qualitatively different? Also... even in the nice school they're in, the environment is just... I don't know, oppressive, crowded, and restrained. I'm sorry, it's messed up to make kids ask to go to the bathroom or get a drink of water. I'm sorry, it's weird how authoritarian most of the classes are - I understand why, shrinking budgets mean bigger classes, but at least personally, I feel that there's a lot of merit to the idea that this thing that used to be about learning has become daycare so the parents can stay grinding away while their kids are safely sequestered. We will see if we can do it, but we're thinking pretty hard about just travelling in the winter while they do home school online or take college classes.

                  What's better: to have my kids sit in a box for 7 hours a day (but really only work for like 2-3 hours) and respond to bells on command or to do online school for 3 hours a day, have mom, dad, and grandma lecture on our specialties and guide them through projects that really push them all from another country in the winter where they can learn a second language, see a different world, etc? I understand that this is a privileged position for us - like, I work from my laptop and my wife has a commutable job, but each day I pick up the kids from their school it feels a little more like picking up a parolee.

                  1. burnished · · focus · HN ↗
                    Worry not, school was pretty much as you described even twenty years ago!
                    1. piloto_ciego · · focus · HN ↗
                      I feel like that really depended on where you went? But I suppose my life was different, by the time I was a junior in HS, I was mostly taking shop classes and language classes, had my own car that I had bought with a part time job, and had a color printer that convincingly forged hall passes on demand, so I pretty much did whatever I wanted the last couple years? It worked out fine, I graduated near the top of my class? But the strictures and authoritarian sense seemed to be lower?

                      I legit had aircraft sheet metal snips and numerous exacto knives in my locker and a leatherman on my person most of the time and it wasn't a huge deal? Hell, I needed the leatherman to open the hood of my shitbox car. In contrast today, one of my kids brought a toy knife to school a few years ago (because he thought it was cool, great learning opportunity for a young kid about "the man" I suppose) and you'd have thought they caught Bin Laden or something?

                      Perhaps I was just lucky, but it feels way different now, though there seems to be a lot less bullying.

                  2. trimethylpurine · · focus · HN ↗
                    College just doesn't work. They don't know what jobs will be available and they are way too far behind the professional sector to teach about them anyway, with rare exceptions that aren't economically favored for, institutionally.

                    The system forces schools to increase enrollment by assigning a tuition price based on attaching a loan to it. It's basically for profit. Then, the loans can't be forgiven in bankruptcy when the outcome of the education platform fails to produce an income that supports repayment.

                    To get an education that doesn't completely screw you over, you need to be a minority with a scholarship or actually have rich parents and attend for fun. But in either case, your only benefit financially is the hope of connecting with other students whose parents are richer than yours.

                    Exceptions for subjects with artificial barriers of entry (medicine, law, etc., and each of those has its own set of problems, mainly the price of education).

                    (Speaking about the United States, but probably a lot of this applies to many places.)

                    I disagree with the sentiment that the rich are dissuading college enrollment. I'm not rich. I don't hire college grads. They are broke, entitled, and lack work ethic. After 5 in a row, I started giving opportunities to smart kids, from good families, who exhibit an appreciation for hard work and good moral character. Those people learn in a month what takes a college grad 6. They appreciate opportunity, instead of expecting it.

                    As I should have always known, a good person is far, far more valuable than a piece of paper certifying victimhood.

                    1. piloto_ciego · · focus · HN ↗
                      I really have found college valuable, but I also self-funded and have no debt. This is pretty much the arrangement I'm trying to set up for my kids too - when I had a blue-ish collar job (bush pilot is a blue collar job no?) I didn't think school had a lot of value, but then again, looking in hindsight, I'd unironically say that the most "valuable" (scare quotes intentional here) course I took was art history. Not because I learned anything that was economically useful, but it gave me a new way to view the world and literally changed some of the decisions I made with my life?

                      I agree with the idea of giving opportunities to smart kids from good families who work hard and are ethical. But I also think it's pretty damn hard to get good at certain things outside of a classroom? I don't know, I have mixed emotions.

                      Still, despite my misgivings with traditional education, I think there remains some good that comes from going to a place where your only job is to learn.

                      1. trimethylpurine · · focus · HN ↗
                        I'm teaching my kids how to build a business, and how to learn chemistry and deep science through self learning programs, like Aleks, and the like. Same curriculum as I got in college.

                        But none of the loans and none of the "go work for IBM" mentality that taught me how to be a loser for way too long.

                        A few years head start on actual business building is way more valuable than a 250 kid lecture hall with a teacher who never built anything in their life.

                        The future belongs to entrepreneurs, and that's even more true now with LLM built businesses.

                        Get them a face to face sales job for a bit. It does a lot for one's character to learn how to break the ice and be personable. And it teaches work ethic.

                    2. compiler-guy · · focus · HN ↗
                      Zhang, L., Liu, X., & Hu, Y. (2024). Degrees of return: Estimating internal rates of return for college majors using quantile regression. American Educational Research Journal. Prepublished March 12, 2024.

                      <a href="https:&#x2F;&#x2F;journals.sagepub.com&#x2F;stoken&#x2F;default+domain&#x2F;W9MBX7ZGK8FKK86JZ3Z9&#x2F;full" rel="nofollow">https:&#x2F;&#x2F;journals.sagepub.com&#x2F;stoken&#x2F;default+domain&#x2F;W9MBX7ZGK...

                      &quot;We estimate the internal rates of return (IRRs) for individuals with college degrees in 10 broad majors compared to high school graduates. Our analysis shows significant differences in the age-earnings trajectories and IRRs across college majors. Specifically, Computer Science and Engineering majors have the highest IRRs, exceeding 13%, whereas Humanities &amp; Arts and Education majors have the lowest IRRs, around 5% for male and 8–9% for female college graduates. Furthermore, the quantile regression analyses show that IRR is generally higher at the high end of the earnings distribution. Finally, we observed a slight decrease in IRR during the study period, which is consistent with the flattening and even decline in college wage premiums following the 2008 Great Recession.&quot;

                      1. trimethylpurine · · focus · HN ↗
                        This doesn&#x27;t say anything about causality.

                        The fact that attending colleges requires certain abilities and privileges that also correlate with financial success doesn&#x27;t say anything about the influence that college has on earnings.

                        For all we know, the fact that college direction is ingrained in a public education system that is required by law, hides the fact that college has a negative impact on one&#x27;s financial product when taken over a lifetime.

                        The same people that think college might pan out, also think loans for businesses, or other such behaviors that exhibit initiative, might pan out. We&#x27;d expect those same traits in leaders and entrepreneurs, and we&#x27;d expect them to be paid more.

                        Plainly, the claim is misguided and its dissemination, I suspect, is most likely driven by profits.

                        1. compiler-guy · · focus · HN ↗
                          The above study did indeed control for that differences in socioeconomic background and all the rest.

                          The data is very extensive on this point. You are handwaving away a bunch of science on this, and throwing shade on researchers without anything more than a &quot;yeah, they would say that.&quot; That&#x27;s very weak sauce.

                          If you want to make a case, at least cite some evidence

                          Not sure what your sources are. The roi for disadvantaged students is lower than it is for richer students, but still positive across the vast majority of outcomes.

                          1. trimethylpurine · · focus · HN ↗
                            I don&#x27;t need to cite evidence to point out a logical impossibility.

                            To make a good experiment you&#x27;d need to control for the presence of college in society. The fact that it exists and takes credit for the work of people who would already be doing what it purports to cause makes it impossible to conceive of such a study.

                            It&#x27;s just like a church claiming responsibility for human morality, where everyone starts with a church forced on them. Likewise the church will show studies on criminal behavior and drug addicts, and of course, we will find success in their work. God really does save then, right?

                            I&#x27;m not religious, I&#x27;m a scientist.

                            Sure enough lots of people are moral even without the church, and lots of people are incredibly successful, even without college.

                            And those examples lend themselves to reasoning deductively about the facts, a much higher logical bar when weighing what is or isn&#x27;t worth believing in.

                            That&#x27;s true as far as the latest arguments on the philosophy of science. So I&#x27;m perfectly comfortable waving away illogical arguments, and giving less weight to inductive ones, even if they include lots of marketing and other sound research.

                            It&#x27;s more worth believing in because it&#x27;s more logically sound. So no, the sauce is not weak when compared to your faith based argument.

                            The research you provided shows that we might expect some people to benefit from college. Sure. But to prescribe it for everyone, is clearly a mistake. It&#x27;s bad for many famous examples, and it&#x27;s bad for countless more of us who now lead companies in fields we didn&#x27;t study.

                            As a side note, for others out there pedaling this lie, it&#x27;s offensive and dismissive to act like repaying such a huge debt over 20 years is a win. I sweat and struggled, and ate trash for your lies.

                            Your lies did that to me. Take responsibility for that, and think carefully, before you go convincing other kids to follow in my footsteps.

                  3. JumpCrisscross · · focus · HN ↗
                    &gt; with the rhetoric I see espoused about &quot;don&#x27;t go to college&quot; by most really rich people

                    The two categories of people I know who say this are elite-college graduates and parents of kids who crashed out of their standardized tests.

                    &gt; or to do online school for 3 hours a day, have mom, dad, and grandma lecture on our specialties

                    We’ve tried this for decades. What are the data?

                    1. piloto_ciego · · focus · HN ↗
                      &gt; The two categories of people I know who say this are elite-college graduates and parents of kids who crashed out of their standardized tests.

                      I mostly see business people who are already successful people saying this to be honest.

                      &gt; We’ve tried this for decades. What are the data?

                      Well, the data is that if you can get a private tutor, that&#x27;s what you should do, it&#x27;s way more helpful than just going to school for 7 hours a day. That&#x27;s why were thinking about making a more alternative education style happen. I&#x27;m definitely qualified to teach some stuff, and so is my wife, and mother. We just will need to find a way to fill in the gaps of the places where we&#x27;re not qual&#x27;d. Regardless, I think personalized&#x2F;individualized education is almost always better by the numbers.

                      That said, it really depends on what you&#x27;re optimizing for.

                  4. graemep · · focus · HN ↗
                    &gt; We have great home school programs here, and with our family members we have the education and qualifications to teach most of the core subjects (lots of retired teachers in our extended family).

                    These days you can find online courses and tutors. Lots of one to one adult attention helps a lot but kids can teach themselves a lot too. One problem is qualifications. Here in the UK our kids can just do the same exams school kids do. I think its more complicated in the US?

                    I think a large part of the problem with schools (and this is why its a problem across many countries) is a greater focus on metrics.

                    Schools have never been efficient with kids time.

          2. koolba · · focus · HN ↗
            &gt; Look at the, pretty obvious, natural human child-mode of learning: playing games.

            &gt; Just not escapist nonsense games. Games that model relevant aspects of reality in an engaging way. Where you can fail without real-life consequences and learn from it while enjoying yourself.

            In a lot of ways, that’s math contests and games like Around The World.

            And that’s exactly the type of thing modern educational philosophies have eliminated.

            For some reason it’s perfectly fine to have little Johnny show that’s he can run a race faster than the next kid, but he can’t show that he can solve math problems faster.

          3. ThousndBeerMike · · focus · HN ↗
            I mean they are doing some things over at the Alpha School to work on gamification of education that is actually useful for the modern human, but they get a ton of hate for what they are doing, despite the test results speaking for themselves

            (they bribe kids, and the lessons are individualized through software).

          4. kyykky · · focus · HN ↗
            My kids are very much into games. However, soon as they got old enough to invite friends over, I have learned they are a minority. Most of their friends don’t give a shit.
        2. runarberg · · focus · HN ↗
          Maybe more and more teachers care less and less about training students to take tests, and care more about actually educating students in the subject matter. So maybe the plunging test scores are are simple as “students are worse at taking tests.”
          1. what · · focus · HN ↗
            Seems conflicting. If they’re “actually educating” the students, they should know the material and have no problem on a test?
            1. runarberg · · focus · HN ↗
              Not necessarily. Test taking is a skill in its own right. The PISA test is for example 4 hours long, and students might not have the endurance to stay focused reading text that doesn’t matter and answering questions they don‘t care about for 4 whole hours.
              1. what · · focus · HN ↗
                Not being able to focus for 4 hours seems like a bigger problem. But it’s also entirely orthogonal to your distinction of “teaching the test” vs “actually educating”. You can’t teach people to focus for 4 hours.
                1. runarberg · · focus · HN ↗
                  I know I would not be able to focus for 4 hours on a test that doesn’t matter, while reading text I don‘t care about, so that kids are failing that seems like a non-issue to me.

                  The rest if your point is simply wrong. Focusing is a physical activity that you can train for. Every good chess player that plays classical trains for that. And so do (or rather so did) students in the education system. Taking mock tests before the finals is a way to train your endurance such that you will be better able to keep your focus throughout the test.

                  1. what · · focus · HN ↗
                    Focusing is mental activity, not physical.
                    1. runarberg · · focus · HN ↗
                      Mental activity is a subset of physical activity.
                      1. what · · focus · HN ↗
                        This has to be the most retarded thing I’ve read all year. There is nothing physical about writing a test for 4 hours.
                        1. runarberg · · focus · HN ↗
                          &gt; When disagreeing, please reply to the argument instead of calling names. &quot;That is idiotic; 1 + 1 is 2, not 3&quot; can be shortened to &quot;1 + 1 is 2, not 3.&quot;

                          <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;newsguidelines.html">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;newsguidelines.html

                          1. what · · focus · HN ↗
                            There’s something wrong with you.
                            1. runarberg · · focus · HN ↗
                              I am a psychological monist, I do not believe there is any difference between our body and our mind, that our minds, just like our bodies, can be fully explained as a physical phenomena. I share this philosophy with lots of people, including prominent philosophers of mind.

                              There is nothing wrong with me.

          2. procaryote · · focus · HN ↗
            so your take on declining test scores is that it means people are learning more?
            1. runarberg · · focus · HN ↗
              No. My take is that test scores are a lousy measure of education. Maybe students are indeed learning less, and that would be worrying, but while we measure that using test score we simply cannot control for test taking ability.
              1. procaryote · · focus · HN ↗
                what would be a better repeatable measure of education?
                1. runarberg · · focus · HN ↗
                  I am not a teacher, nor even an expert in the pedagogical sciences, as a layperson I can point out what looks wrong, but I need not know what is better.

                  Maybe asking teachers is better. Maybe a robust metric across generations and across population simply does not exist, and cannot exist, and we just have to accept that we cannot compare the education of kids in America today with the education of kids in Guatemala a decade ago.

        3. procaryote · · focus · HN ↗
          This is highly optional. You can lock phones up at the start of the school day or at the start of class
          1. falserum · · focus · HN ↗
            How do you take the phone from a child refusing to give it up? (It Needs parent buy-in, which is not guaranteed)
            1. thinkybrewster · · focus · HN ↗
              My sons&#x27; school makes it a requirement of continued enrolment.
            2. nobody9999 · · focus · HN ↗
              &gt;How do you take the phone from a child refusing to give it up? (It Needs parent buy-in, which is not guaranteed)

              It&#x27;s not just a good idea. It&#x27;s the law[0].

              [0] <a href="https:&#x2F;&#x2F;www.governor.ny.gov&#x2F;eliminating-distractions-new-york-schools&#x2F;new-york-state-phone-free-schools-law" rel="nofollow">https:&#x2F;&#x2F;www.governor.ny.gov&#x2F;eliminating-distractions-new-yor...

          2. FranOntanaya · · focus · HN ↗
            But you may be still trying to teach kids that are going through a form of withdrawal for several hours because it&#x27;s not managed outside school.
            1. procaryote · · focus · HN ↗
              If it&#x27;s every lesson, every weekday, they&#x27;ll get used to it
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.