isn’t this a bit like saying “google drive is being used to easily pirate movies”?
Except it’s even a bit more ridiculous than that because they can technically just scan the files and the metadata as where these are entire models that are not developed or being deployed by hugging face, they’re just downloads hosted… I’m actually not sure what exactly they’re supposed to do about this besides not allow image models I guess? Which I frankly wouldn’t be against
i don’t think the distinction “image model” really holds anymore. most big language models can generate images on their own if you bully them enough. they’ve ingested enough binary data to know what a valid jpeg looks like and you can use that to get base64-encoded images out.
as for banning diffusion models rather than transformers… well we have text diffusion models now.
The image generator and llm are separate models
are you talking image diffusion models now? because CLIP isn’t really an llm in the normal sense. it’s just a classifier.
You think the model I use knows what a JPEG is? It just wants a picture of a gatdang hot dog
I hadn’t heard of that method.
can you show some examples of such images?
there are some in this paper: https://arxiv.org/html/2408.08459v2
No. One is about creating “content” and the other is about hosting “content.”
but… huggingface is a file hosting service.
It has specificity, it’s a niche. The niche is that of collaboration and aid in the pursuit of AI slop production, including the really horrible shit.
okay, but you see my point though, right?
Your point is that you’re trapped in semantics and you don’t comprehend what it means to deal with or combat networks of things.
no, my point is that attacking a file service for a problem caused by the ai giants is at best misguided and at worst an attempt to distract from what said giants are doing, namely creating the files in the first place.
It’s hard for me to figure out what HF as a platform can do here. What specific signal can be vetted to prevent this? Since models are non-deterministic I don’t know if keyword filters would even work.
To me this is different than Grok because Grok is a tool embedded in Xitter, that grabs the photos posted on the same platform to create the nasty images, so because the platform and tool are working in concert, X and Grok should be shut down over it if that function can’t be disabled.
it’s the in-band signalling problem again. how do you distinguish input and configuration when it all goes into the same pipe?
TL;DR
WhErE gUaRdRaIlS?!Guardrails bad, something something free market, something something rational actors, something something common sense.
Tf is hugging face now I don’t want to Google it
Hugging Face is the place where you go to download models you can host yourself.
Honestly… I have no idea how they expect hugging face to address this, once you’re hosting the model yourself, they can’t control your system prompt or scan what it’s outputting or anything of the sort. It’d also be pretty impractical to scan all of these models to prevent anything, some of these models are terabytes in size, and I think just about anything that can output an image can output a “sexualized” image to some degree.
Seems like a nothingburger headline, really, a bit like saying “VLC does nothing to prevent users from watching child porn”. It doesn’t, but I don’t know how you’d expect it to when it just serves a basic function that doesn’t really have anything to do with the illegal part.
It’s backdoor outrage that will be used to ban local models so only the billionaire class get to own them and charge for their use.
Definitely on my list of suspicions, with this article coming out so soon after Claude had to drop their prices for Fable dramatically, and with models like Kimi’s latest competing with it for much cheaper. Not to mention this coincides with the push to ban “Chinese models”, it feels like this could be part of a broader wave to block the competitive open source models from US markets by any means available.
I only know that they recently scraped all of GitHub for training data
Of course it is…
deleted by creator
If you do it in the checkout line, yeah
I always explain this “nudification” process as…
You know how if you put black bars over someone in a bikini or speedos, and suddenly they look naked? You haven’t seen the person naked, but you’ve got a good idea what they look like naked because your brain filled in the gap. It’s exactly what the diffusion model is doing.
I’m not sure it’s realistic to stop the models doing it entirely given how they work. If you want it to fill in the background when you cut your ex out of a photo, it’s going to fill in any other gaps.
