Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

A Mathematical Theory of Communication by Claude Shannon (https://people.math.harvard.edu/~ctm/home/text/others/shanno...)


This one is about compression, reliable communication. While interesting and well-written, I don't think it matches the original request for "papers on AI, ML, ...".


> "I don't think it matches the original request for "papers on AI, ML, ..."."

I feel like most who understand this paper and who also understand AI and ML will disagree.


I had a good quick skim. It has a language model (ok trigrams!) and the cross entropy formula and reasoning for it. On my reading list for sure! We did some information theory at uni but don’t recall all of this stuff, maybe I just forgot.


Research paper on AI doesn't necessarily mean a meme title and chasing a dubious "sota" status on some benchmark. I would say foundational work is more worth reading.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: