[Lex Computer & Tech Group/LCTG] Too much efficiency makes everything worse

Jon Dreyer jon at jondreyer.org
Mon Jul 10 10:29:36 PDT 2023


By the time I got through the first few paragraphs, I remembered that, 
over a decade ago, I saw the danger of what he calls "overfitting" in 
education and coined what I called "the implicit motto of education reform":

    /If you can't measure what you value, value what you can measure./

So I was not surprised to see education as the first on the list of 
examples of the the danger of overfitting in section 3.

I'd not read of Goodhart's Law, either the weak or strong forms, but I 
had discovered the idea. It seems increasingly important to keep in mind 
as technology makes it ever easier to measure things. A few examples I 
don't think I saw in the article are measuring executive performance by 
measuring quarterly financials or measuring software engineers by lines 
of code.

-- 

Jon "Measure Twice, Gut Once" Dreyer
Math Tutor/Computer Science Tutor <http://www.passionatelycurious.com>
Jon Dreyer Music <http://music.jondreyer.com>

On 7/10/23 8:40 AM, Harry Forsdick wrote:
> Interesting use of ML/AI:
>
>     Too much efficiency makes everything worse: overfitting and the
>     strong version of Goodhart's law
>
>   * https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart.html
>
> -- Harry
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.toku.us/pipermail/lctg-toku.us/attachments/20230710/135003aa/attachment.htm>


More information about the LCTG mailing list