They don't "know" anything. Every word they generate is statistically likely to ...

		bigfishrunning 4 months ago \| parent \| context \| favorite \| on: A small number of samples can poison LLMs of any s... They don't "know" anything. Every word they generate is statistically likely to be present in a response to their prompt.