[Lex Computer & Tech Group/LCTG] Goodhart's Law in Education

[Robert Primak]

 Having detected a racial disparity statistically, rather than taking steps to help poor kids move up, they sought to correct the statistic by keeping affluent kids down.  

This is more and more common in public schools nationwide. There have also been complaints about "inclusion" of students with learning/behavior issues and disabilities in "mainstream" classrooms. Every class must now be held back until the slowest students finally do (or don't) learn the lessons. 
The decline in Big City reading, English and Math test scores (or the elimination of all testing) is one measure of this decline in public education in this country. "Teaching to the test" shows an example of the strong form of Goodhart's Law, as may have been noted previously in this conversation. 
I am all in favor of being as inclusive as possible, but there is a difference between "reasonable accommodation" vs. chasing the faster-learning students out of the public school system, or forever damaging their education and career opportunities.
This has nothing to do with de facto segregation, allegations of systemic bias or affirmative action. Those are different, though somewhat related, issues. 
-- Bob Primak
    On Saturday, July 15, 2023 at 08:11:56 AM EDT, JOHN M BROWN <mit69 at icloud.com> wrote:  
 
 This item, "Cambridge schools are divided over middle school algebra,” in the Globe may be an illustration of the strong form of Goodhart’s Law (… or, at any rate, of the law of unintended consequences) as applied to education -
"The district’s aim was to reduce disparities between low-income children of color, who weren’t often represented in such courses, and their more affluent peers. But some families and educators argue the decision has had the opposite effect, limiting advanced math to students whose parents can afford to pay for private lessons, like the popular after-school program Russian Math, or find other options for their kids, like Udengaard is doing." 
Regardless, the response to the measured problem was a cop out.  Having detected a racial disparity statistically, rather than taking steps to help poor kids move up, they sought to correct the statistic by keeping affluent kids down.  
   John B



On Jul 10, 2023, at 1:29 PM, Jon Dreyer <jon at jondreyer.org> wrote:
 
By the time I got through the first few paragraphs, I remembered that, over a decade ago, I saw the danger of what he calls "overfitting" in education and coined what I called "the implicit motto of education reform":
 

If you can't measure what you value, value what you can measure.
 

So I was not surprised to see education as the first on the list of examples of the the danger of overfitting in section 3.

I'd not read of Goodhart's Law, either the weak or strong forms, but I had discovered the idea. It seems increasingly important to keep in mind as technology makes it ever easier to measure things. A few examples I don't think I saw in the article are measuring executive performance by measuring quarterly financials or measuring software engineers by lines of code.
 

-- 
 

 Jon "Measure Twice, Gut Once" Dreyer
 Math Tutor/Computer Science Tutor
 Jon Dreyer Music 
 


On 7/10/23 8:40 AM, Harry Forsdick wrote:
  
  Interesting use of ML/AI:  
  
  Too much efficiency makes everything worse: overfitting and the strong version of Goodhart's law  
      
   - https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart.html
  -- Harry  
 
  
===============================================
::The Lexington Computer and Technology Group Mailing List::
Reply goes to sender only; Reply All to send to list.
Send to the list: LCTG at lists.toku.us      Message archives: http://lists.toku.us/pipermail/lctg-toku.us/
To subscribe: email lctg-subscribe at toku.us  To unsubscribe: email lctg-unsubscribe at toku.us
Future and Past meeting information: http://LCTG.toku.us
List information: http://lists.toku.us/listinfo.cgi/lctg-toku.us
This message was sent to bobprimak at yahoo.com.
Set your list options: http://lists.toku.us/options.cgi/lctg-toku.us/bobprimak@yahoo.com
  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.toku.us/pipermail/lctg-toku.us/attachments/20230715/d5e83027/attachment.htm>