• Architeuthis
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 hours ago

    Local models are astoundingly slow compared to online ones and you can’t really run anything else while they are doing inference.