2026-02-25 17:29 UTC
@atoponce@fosstodon.org yes, LLM entropy is limited by the random generator used in the sampling process. Usually, it's some fast non-CSPRNG.
Replies (1)
-
@atoponce@fosstodon.org 2026-02-25 21:14
@dchest@mastodon.social Does the LLM have access to a proper RNG library, or is it just running through some linear algebra looking for a specific quality metric before returning? Admittedly, I'm ignorant to LLM and ML specifics.