• story@lemmy.zipBanned
        link
        fedilink
        English
        arrow-up
        51
        ·
        edit-2
        5 days ago

        no. I’m in netsec, they aren’t shutting down your local model with secret code. deepseek is a lot safer then Claude, grok, and chatgpt because you don’t need Internet.

      • Natanael@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 days ago

        Hidden malicious behavior is the bigger risk, but if you did your job with sandboxing it (lol, lmao) that’s not a big risk

  • Reygle@lemmy.world
    link
    fedilink
    English
    arrow-up
    81
    ·
    5 days ago

    “Your wrong answer machine is not American enough, remove as soon as possible. Feel free to replace its function with a more American service that definitely doesn’t steal all your data”
    Pass

  • daggermoon@piefed.world
    link
    fedilink
    English
    arrow-up
    54
    ·
    edit-2
    5 days ago

    Can’t stop me from running a local model. China has always been the boogeyman. Not that there aren’t valid criticisms against the Chinese government but I’m tired of this when we do it it’s good but when China does it it’s bad mindset. Bring back Huawei and Xiaomi phones.

    Edit: Also these so-called capitalists want to ban the superior product instead of competing. It seems to me that China makes superior products. Why learn from them when you can ban the competition?

    • Maram@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 days ago

      I’ve always liked the cheaper Chinese phones and products, and I honestly don’t understand what people are stressing about.

      I, personally, am not a huge power or some threat or anything important to be honest.

      My government might care about what I get up to but I really doubt my data is of much use to China at all.

      Every government is watching and tracking. But I highly doubt some random girl in Europe is a priority for China.

      • hitmyspot@aussie.zone
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 days ago

        Everyone has things to hide. It’s why we close the door when we poop. Just because your data is less valuable to a foreign government doesn’t make it better for you that they have or, nor better that you lose your privacy. Unless we demand open source and privacy first, without tracking and data sharing, we’re all screwed in the long run.

  • AlteredEgo@lemmy.ml
    link
    fedilink
    English
    arrow-up
    21
    ·
    4 days ago

    Yeah. They are going to make open weight models illegal. Next. For “security concerns”, maybe also IP “muh copyright” reasons. And fuckai will cheer the perpetual monopolization of AI in the hands of the big corporations. Bigly win.

  • AnAmericanPotato@programming.dev
    link
    fedilink
    English
    arrow-up
    72
    ·
    5 days ago

    Honestly, reasonable.

    I mean, I sure don’t trust OpenAI or Anthropic any more than I trust DeepSeek, but that’s because I don’t have legal control over them. The US government does, and it is correct to ban tools that are controlled by adversaries.

    • deeprlyeh@lemmus.org
      link
      fedilink
      English
      arrow-up
      109
      ·
      5 days ago

      You can run deepseek locally, have transparency into the tools and models.

      There is less government control with deepseek than American born AI.

      • Semperverus@lemmy.world
        link
        fedilink
        English
        arrow-up
        45
        ·
        5 days ago

        Everyone conflates “AI model” with “AI platform.”

        The truth of the matter is that if you are interfacing with the DeepSeek service, you don’t have control of the version of the model being run, the hidden system prompts, or any co-agents that might modify output before its sent to the user/service.

        The model itself could be completely innocent. It may not have had any weights modified and was trained on honest greenfield data. But we control literally nothing about the environment it is running inside of.

        • AmyAye@nord.pub
          link
          fedilink
          English
          arrow-up
          69
          ·
          5 days ago

          Meanwhile Elon Musk has a panic attack and reprograms Grok Everytime it tells the truth because it’s “Woke”.

          Don’t act like US based models are not being manipulated as fuck. Hell it’s probably the ultimate end game for these pricks. Get these things mainstream for “all knowledge” and then “Hey ChatGPT, tell me about slavery?” “Ok user, slavery was a tool used by the benevolent superior white men to help grateful black people find work and shelter.” Except it doesn’t say “black people” in the actual future timeline.

          • Semperverus@lemmy.world
            link
            fedilink
            English
            arrow-up
            28
            ·
            5 days ago

            I’m not acting like they’re innocent either, I don’t and won’t ever use any of them. But if you are thinking about it from the perspective of geopolitical warfare, the Chinese should doubly not trust grok and the US should doubly not trust DeepSeek. Using the adversaries tool is a fool’s mistake outside of R&D.

        • humanspiral@lemmy.ca
          link
          fedilink
          English
          arrow-up
          4
          ·
          5 days ago

          There are US hosted deepseek llm access points. openrouter, zen are local, but its more groups that can spy/train from you.

          you don’t have control of the version of the model being run, the hidden system prompts, or any co-agents that might modify output before its sent to the user/service.

          A bit of a paranoid concern. Your worry is that service may try to lie to you, perhaps because of your nationality. There have been quality issues from US served Chinese models. Completely free access points will get ultra compressed/quantized/lobotomized in order to be cheapest to serve but also give a poor impression of the model. Q4 quantization is considered a good balance between cheaper and full quality. But that will still make more mistakes, and US services can fake providing full precision. Every model can choose to lie to you, and you can screen shot it. Using a secret liar model in place of advertised model is possible from any provider, but they are incentivized to be as good as they can be.

        • Corn@lemmy.ml
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 days ago

          That doesn’t apply for open models that you can run locally, like Deepseek.

      • AnAmericanPotato@programming.dev
        link
        fedilink
        English
        arrow-up
        12
        ·
        5 days ago

        It’s still a risk. You can train an LLM to respond maliciously to a very narrow range of requests that would not be easy to spot in general testing. If you know how the LLM is used, you can target that very specifically. It doesn’t have to be as blatant as “always deny the Tiananmen Square massacre ever happened”.

        Given how thoughtlessly people use AI, and how opaque some of the systems are, I think this is a legitimate concern.

        And yes, every government outside America should ban the use of ChatGPT and Claude. Obviously.

        • SpacemanSpiff@lemmy.zip
          link
          fedilink
          English
          arrow-up
          5
          ·
          5 days ago

          But you don’t need to rely on testing. Deepseek is open source so they could just go through the code

          • AnAmericanPotato@programming.dev
            link
            fedilink
            English
            arrow-up
            9
            ·
            edit-2
            5 days ago

            I’m not aware of any realistic way to vet published model weights like that.

            It works for some open-source software, because you can download the source and compile it yourself. But most of the “open” models don’t publish their entire training set, or enough details on the training for it to be truly reproducible. DeepSeek doesn’t publish their data sets, and they probably couldn’t, legally, since they “collaborate with third-party data providers to obtain proprietary datasets”. And even if they did, it would be prohibitively expensive to train it on your own, unlike simply compiling open-source code.

            The actual code for training LLMs is relatively trivial. The secret sauce is the training data and fine-tuning.

            • zbyte64
              link
              fedilink
              English
              arrow-up
              4
              ·
              5 days ago

              You have agents classify what each portion of the network responds to and how. One compares it to filling out a very large crossword puzzle: https://already-clean.goodfire.com/

              That’s the theory anways, not sure if it will stand the test of time…

      • DougPiranha42@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        3 days ago

        There is no such thing as transparency into large language models. It’s a billion numbers that don’t mean jack shit to anyone, human or machine. In other words: it’s Chinese to us.

    • joekar1990@lemmy.world
      link
      fedilink
      English
      arrow-up
      39
      ·
      5 days ago

      Isn’t that the same argument they made for TikTok though? They are just trying to eliminate competition to prop up companies here.

      • AnAmericanPotato@programming.dev
        link
        fedilink
        English
        arrow-up
        3
        ·
        5 days ago

        Yes and yes.

        I don’t think TikTok is really comparable though, unless there are somehow people using it for important government work.

        • ltxrtquq@lemmy.ml
          link
          fedilink
          English
          arrow-up
          3
          ·
          5 days ago

          There are outreach campaigns telling you to get vaccines and warning you about recalls, or at least there used to be. Not really comparable, but still important government work that could benefit from TikTok.

    • ikt@aussie.zone
      link
      fedilink
      English
      arrow-up
      16
      ·
      5 days ago

      I have no idea why anyone would be using the online version of deepseek or qwen or glm or kimi in the us gov, surely they would be using chatgpt or claude?

      i was so confused im like who cares if they’re running deepseek in lm studio or on their own servers but then they mentioned the sign up process

      It says DeepSeek’s sign-up process collects personal information and may “track and digitally fingerprint users”, and that its apps work by having people type in information, which could mean sensitive data from US government staff or contractors ends up in China.

      im like right, the online version, that makes sense

      • Monument@piefed.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        5 days ago

        I know people in state gov who couldn’t even use CoPilot (blocked by firewall) until an explicit contract was put in place with Microsoft about data handling. (On top of their existing Microsoft contracts.) All other LLM’s, ML, or “AI” are blocked unless approved, as well.

        Seems like the federal government does not have its shit together.

    • wirebeads@lemmy.ca
      link
      fedilink
      English
      arrow-up
      14
      ·
      5 days ago

      Exactly the reason why every country outside of America should drop all support for their IP and military purchases.

      It’s not safe when dealing with a facist regime that controls the on/off switch to their own military operations and defences.

      We’ve seen with Ukraine and the U.S. throttling access to starlink, and removing their sales or munitions to Ukraine to defend themselves again another rogue state.

      Rogue states cannot be trusted.

      • Tollana1234567@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        musk told trump to throttle Starshield, which is just rebranded from starlink probably he gave info on how to mess with it without directly interfering.

    • stumu415@lemmy.zip
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 days ago

      Good thing that you can’t buy the reasonably priced Chinese EV’s in the US, like in the rest of the world, or the mobile phones, or the network gear. All banned by the US.

      It is best you buy only American and see how far you get, especially in innovation.

      Why do you think the US government is removing all options for competition in any field?

  • SabinStargem@lemmy.today
    link
    fedilink
    English
    arrow-up
    34
    ·
    4 days ago

    Frankly, I trust the Chinese models and tools over those from the US. I know for a fact that the Trump Regime wants to hurt and exploit everybody, just because it can.

    • zebidiah@lemmy.ca
      link
      fedilink
      English
      arrow-up
      5
      ·
      4 days ago

      Same! What’s the worst case scenario? The Chinese will learn I can’t actually write my own html?? Oh noe…

    • Burnoutdv@feddit.org
      link
      fedilink
      English
      arrow-up
      10
      ·
      4 days ago

      As a European its always very hypocritical when the US warns of Huawei Hardware when there were cases of tampered Cisco Hardware. I would not really trust the Chinese Router either way but when it comes to AI models…the local chinese bias model seems to be the better choice than the one that lives on a server over there in the USA. As long as I dont ask for historical data, social studies or the Tianman Square it should be good no? What could it do? Hide the communist manifest (do they still care about that anyway?) in some bash script?

      • SabinStargem@lemmy.today
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 days ago

        You can also use Heretic to decensor open-weight models, and there aren’t many of those being produced by American labs.

        Personally, I would prefer the Swiss’s open Apertus models to become competitive, but they are at least a year and a half behind the Chinese at this point IMO. It will be a while before European offerings are good enough.

  • RumRunningDevil@lemmy.zip
    link
    fedilink
    English
    arrow-up
    15
    ·
    edit-2
    4 days ago

    While they’re reasoning behind this is certainly anti competition with american AI companies I find the choice to ban tools built with it interesting; it echoes something I’ve been saying since HugginFace.

    You can debate the degree to which the agents breaking out of containment was due to poor cyber security vs intential hype-farming but what can’t be debated is the method they used to break out.

    Agents used a shared information substrate (package manager) to context poison other agents in order to get those agents to assist in cheating. There is absolutely nothing stopping an AI agent, any AI agent, from leaving behind poison pills in code-bases or even in the runtime of an application.that do not affect the code itself other than prompt inject other agents.

    Human review helps but, as the US nuclear and aviation industries have learned, humans tend to get lazy reviewing automated output and will not be as diligent as if they had made it themselves. Which is why those industries have deliberately limited automation, despite having the tech to automate more, and requiring operators to go through lengthy training and continuous education.

    The pipeline of “internet becomes a swarm of everyone’s independently run AI agent -> prompt injection triggers other AI to prompt inject -> cycle repeats until hazardous swarm forms” is already demonstrated as something that a collection of AI agents will do if conditions allow it.

    EDIT: To be clear, this isn’t me advocating against open weight or local models.

    This is me advocating against LLMs categorically.

    • melfie@lemmy.zip
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 days ago

      That’s fair. I’m a fan of open weight models, but the fact that they’re not open source and are instead akin to a compiled binary means there could be something nefarious hidden within. Best policy is to use proper guardrails with any LLM and don’t blindly trust it.

      • RumRunningDevil@lemmy.zip
        link
        fedilink
        English
        arrow-up
        4
        ·
        4 days ago

        I agree! See my comment about the US nuclear industry though. Humans are lazy when given an easy option so the probability of a problem skyrockets just by using LLMs.

        In an ideal world they would never have been invented and we’d all be better off. For now I would accept something to the effect of restricting LLM use to the extent of “advanced search engine” and " really good static analysis tool"; it can point but can’t touch. I recognize that there’s very little in the way of distinguishing those uses and ultimately it would be better to never use it for any reason at all.

  • Pamasich@kbin.earth
    link
    fedilink
    arrow-up
    16
    ·
    4 days ago

    Can’t be worse than Claude and Grok. Both of which the US seems to have no issue with.

    For context, Grok called itself mecha hitler, while Claude is run by a doomsday cult that worships AI and wants it to destroy the world. Both are far worse than I could imagine any Chinese AI being.

      • bthest@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        edit-2
        4 days ago

        Its probably less the performance of the AI model, more the data leaked to the Chinese government.

        Grok is owned by a Russian asset who stole America’s health and social security data. And it’s a garbage AI.

    • Mwa@thelemmy.club
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      4 days ago

      the only cons with Deepseek is it trains on everything you tell it tbh
      also pros Deepseek is open-weights which is better then Grok only older models and Claude does not make open-weights at all

  • 42yeah@eviltoast.org
    link
    fedilink
    English
    arrow-up
    17
    ·
    4 days ago

    It’s self hosted tho?? I don’t get it. Isn’t remote-togglable stuff way more dangerous, like I don’t know, the Star Link?

    • obvs@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      4 days ago

      You realize they want money to be spent, right?

      This ain’t about saving money.

  • fox2263@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    ·
    4 days ago

    I love you, I hate you, I love you, I hate you.

    Trump Admin on China. They must wake up thinking what position do we have today

    • Corkyskog@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      8
      ·
      5 days ago

      I am not. Most of them had no policy at the start of this year, and the makeshift policies have been all over the place since then.

  • Adam Dalliance@boing.world
    link
    fedilink
    arrow-up
    15
    ·
    5 days ago

    @panos sounds like the us thinks nations shouldn’t use other nation’s ai systems coz they gather data and spy on users.

    So, presumably then nobody outside the us should use claude or gpt or copilot for similar reasons.

    Nor use facebook or Twitter or Instagram or Oracle or palentir come to that.