<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>By the time I got through the first few paragraphs, I remembered
that, over a decade ago, I saw the danger of what he calls
"overfitting" in education and coined what I called "the implicit
motto of education reform":</p>
<blockquote>
<p><i>If you can't measure what you value, value what you can
measure.</i></p>
</blockquote>
<p>So I was not surprised to see education as the first on the list
of examples of the the danger of overfitting in section 3.</p>
<p>I'd not read of Goodhart's Law, either the weak or strong forms,
but I had discovered the idea. It seems increasingly important to
keep in mind as technology makes it ever easier to measure things.
A few examples I don't think I saw in the article are measuring
executive performance by measuring quarterly financials or
measuring software engineers by lines of code.<br>
</p>
<p>-- <br>
</p>
<p style="font-family: Times, serif">
Jon "Measure Twice, Gut Once" Dreyer<br>
<a href="http://www.passionatelycurious.com">Math Tutor/Computer
Science Tutor</a><br>
<a href="http://music.jondreyer.com">Jon Dreyer Music</a>
</p>
<div class="moz-cite-prefix">On 7/10/23 8:40 AM, Harry Forsdick
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CABKvzKoTUFAH7o8tgTpCfJZ2=RXSC6tr5ZxBPTH6eHq5AC8ZQw@mail.gmail.com">
<div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;font-size:large;color:rgb(11,83,148)">Interesting
use of ML/AI:</div>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;font-size:large;color:rgb(11,83,148)"><br>
</div>
<blockquote style="margin:0 0 0 40px;border:none;padding:0px">
<div>
<div class="gmail_default" style=""><span
style="font-size:calc(var(--simplify-font-size) +
0.3125rem);color:rgb(11,83,148);font-family:verdana,sans-serif">Too
much efficiency makes everything worse: overfitting and
the strong version of Goodhart's law</span></div>
</div>
</blockquote>
<div>
<div class="gmail_default" style="">
<ul>
<li><span style="font-size:calc(var(--simplify-font-size) +
0.3125rem);color:rgb(11,83,148);font-family:verdana,sans-serif"><a
href="https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart.html"
moz-do-not-send="true" class="moz-txt-link-freetext">https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart.html</a></span></li>
</ul>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;font-size:large;color:rgb(11,83,148)">--
Harry</div>
</div>
</blockquote>
<div class="moz-signature"><br>
</div>
</body>
</html>