• DarkenLM@kbin.social
    link
    fedilink
    arrow-up
    3
    ·
    1 year ago

    No need to be sorry, I am well aware I can be wrong, and I prefer to learn something new than being bashed for being wrong.

    Maybe I phrased it in a way different than I thought about it. I didn’t mean to claim that Shannon-Fano or Huffman are THE most efficient ways of doing it, but rather that comparing it to the massive overhead of running a LLM to compress a file, the current methods are way more resource efficient, even one as obsolete as Shannon-Fano codes.

    I should probably have mentioned an algorithm like LZMA, or gzip, like you did.