[Lex Computer & Tech Group/LCTG] AI Energy Requirements

[Larry Wittig]

In the past few weeks, Commonwealth Fusion Systems announced that it
will build its first "on-the-grid" fusion power plant in Chesterfield,
VA. It cited "The announcement comes as Virginia’s energy needs are
surging, driven by the rapid growth of data centers that power big
tech operations. These facilities consume enormous amounts of
electricity and water to process and cool computer systems." This is
fusion, not the "Small modular nuclear [fission] reactors" cited
above.

On Tue, Dec 31, 2024 at 4:18 PM Jerome Slate via LCTG
<lctg at lists.toku.us> wrote:
>
> Dear LTCG Group,
> No worries about the AI energy load ~ 40% increase in USA energy output by 2050.
> Small modular nuclear reactors are coming to the rescue.
> We will have a live speaker on this topic on Feb 12.
> George W Griffith PhD from the Idaho National Laboratory, part of the Dept of Energy, will present this topic.
> We are all saved.
>
> Jerry Slate
>
>
> On 12/31/2024 11:05 AM, Robert Primak via LCTG wrote:
>
> The problem is, New Scientist has a paywall. To read the article we would have to subscribe. (Which might not be a bad idea for some of us.)
>
> But anyone can listen to this audio-only breakdown of the same fundamental concepts.
>
> How Running AI Computations Backwards Can Save Energy
> https://www.youtube.com/watch?v=kKAwpyj98m0
> The Singularity Labs | 12:35 m:s
>
> Fascinating discussion, and makes the concepts much clearer.
>
> BTW, reverse-time computation has nothing to do with time as in space-time. It's a technique of doing some calculations back-to-front, as well as front-to-back. It can be much more efficient in terms of CPU and NPU loads, as well as making the computations happen faster.
>
> Pruning of irrelevant background details has an even greater effect on computational efficiency.
>
> Given the huge energy demands of AI, as well as AI's tendency to use up a lot of GPU and other hardware resources, this is an important area of concern.
>
> -- Bob Primak
>
> On Tuesday, December 31, 2024 at 10:10:16 AM EST, John Rudy via LCTG <lctg at lists.toku.us> wrote:
>
>
> I have been getting this very interesting magazine for a couple of months.  It is mostly short stories on a VERY wide swath of technical issues.  Seems to be UK based.  It is a weekly of about 40 pages, and  the 12/29 article had this article on the cost of AI computing and the way in which computers use so much money erasing data.  I only partially understand it but it appears to be well worth reading.  Then someone with more knowledge that I can explain it at a meeting.
>
>
>
> https://www.newscientist.com/article/mg26435231-300-how-to-fix-computings-ai-energy-problem-run-everything-backwards/
>
>
>
> John Rudy
>
>
>
> 781-861-0402
>
> 781-718-8334  cell
>
> 13 Hawthorne Lane
>
> Bedford MA
>
> jjrudy1 at comcast.net
>
>
>
> ===============================================
> ::The Lexington Computer and Technology Group Mailing List::
> Reply goes to sender only; Reply All to send to list.
> Send to the list: LCTG at lists.toku.us      Message archives: http://lists.toku.us/pipermail/lctg-toku.us/
> To subscribe: email lctg-subscribe at toku.us  To unsubscribe: email lctg-unsubscribe at toku.us
> Future and Past meeting information: http://LCTG.toku.us
> List information: http://lists.toku.us/listinfo.cgi/lctg-toku.us
> This message was sent to bobprimak at yahoo.com.
> Set your list options: http://lists.toku.us/options.cgi/lctg-toku.us/bobprimak@yahoo.com
>
> ===============================================
> ::The Lexington Computer and Technology Group Mailing List::
> Reply goes to sender only; Reply All to send to list.
> Send to the list: LCTG at lists.toku.us      Message archives: http://lists.toku.us/pipermail/lctg-toku.us/
> To subscribe: email lctg-subscribe at toku.us  To unsubscribe: email lctg-unsubscribe at toku.us
> Future and Past meeting information: http://LCTG.toku.us
> List information: http://lists.toku.us/listinfo.cgi/lctg-toku.us
> This message was sent to slatemd at comcast.net.
> Set your list options: http://lists.toku.us/options.cgi/lctg-toku.us/slatemd@comcast.net
>
>
> ===============================================
> ::The Lexington Computer and Technology Group Mailing List::
> Reply goes to sender only; Reply All to send to list.
> Send to the list: LCTG at lists.toku.us      Message archives: http://lists.toku.us/pipermail/lctg-toku.us/
> To subscribe: email lctg-subscribe at toku.us  To unsubscribe: email lctg-unsubscribe at toku.us
> Future and Past meeting information: http://LCTG.toku.us
> List information: http://lists.toku.us/listinfo.cgi/lctg-toku.us
> This message was sent to 9423lew at gmail.com.
> Set your list options: http://lists.toku.us/options.cgi/lctg-toku.us/9423lew@gmail.com