LiquidAI/LFM3-1.7B · Hugging Face
huggingface.co
Text Generation model with 2B parameters. Download, explore files and run it on Hugging Face.
  • [object Object]@lemmy.caEnglish
    2·
    11 days ago

    LFM3 1.7B and omni are surprisingly usable.

    The official q8 quants are super fast but much much lower quality, so if you can go with the native bf16 weights.

    I want to try fine tuning the q8 though for specific tasks, it seems like you cod get a really good balance