These companies should be criminally liable for training their models on child porn.

    • Allero@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      20 hours ago

      I think it’s relation to the content. Violent games are widespread and often played by individuals who don’t dream of bringing a rifle and shooting everybody.

      CSAM, however, is primarily watched by individuals who are already mentally inclined towards child abuse. They would want to have sexual/romantic interaction with children IRL, and they either already do it or are stopped by morality, legality and other factors while still having the urge.

      • Lumisal@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        19 hours ago

        Oh boy, do you show how young you are.

        Violent video games were definitely not widespread before, and there definitely were plenty of people saying this back then even in the 90s. I remember seeing a CSPAN coverage where American Republicans were specifically saying only the sick and twisted would want to play Mortal Kombat.

        Yes, the first one, which at the time looked like this:

        They weren’t calling for regulations or research, but a ban. And yes, there were “studies” of small sample sizes they presented too.

        It’s especially important to stay level headed and rational when it comes to what we may instinctively find disgust in, because you don’t fix societal issues with pure demonization. Currently the way most treat pedophilia is the same way I saw people treated those who had HIV.

        What we should be doing is figuring out why some people have these pedophilic tendencies, and trying to cure it. We still need to keep the legal punishments for committing actual rapes of course, but if you make the existence of a pedophile itself essentially illegal, then you won’t see them coming out to seek help before they potentially do something heinous, much like an addict does not necessarily start out as a thief to get their next fix. And that’ll make it harder to fix the roots of the issue.

        Instead, you’ll see it used as a cudgel by the corrupt who are above the law anyway used to oppress the general population and get rid of anyone they dislike, much like they’ve done in the past with drugs (crack cocaine), political ideology (communism’s red scare), and even homosexuality before that (see what happened to Turing).

        • Allero@lemmy.today
          link
          fedilink
          English
          arrow-up
          2
          ·
          19 hours ago

          Indeed, I agree with the last part. We should tread carefully with policy here, for two main reasons:

          1. We still have exceptionally little evidence one way or another, which is honestly insane given the topic’s importance
          2. “Protect the children” narrative is commonly abused for tyrannical laws that trample otherwise unrelated freedoms. I can easily see how this narrative can transform in broader AI oversight in a way that tramples democracy and fair access to information.

          I merely addressed the “why is this different” issue. You’re unlikely to even want to watch any form of CSAM unless you’re into this, i.e. unless you’re a pedophile. You don’t have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.

          CSAM attracts a very specific demographic, and we need to make sure we understand how AI-generated CSAM affects this demographic and whether it induces real life abusive behaviors, or maybe represses them. And yes, it is also important to understand how it affects children, how likely they are to find such materials, and how it affects their sexual development. But this part is exceptionally hard to study, because you can’t just take children and expose them to CSAM to see how it’s going.

          • Lumisal@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            9 hours ago

            You don’t have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.

            I mean, I personally don’t find those things appealing and wonder how you can enjoy those things, but it’s been shown to reduce aggression. Crime went down as violent video games went up too - I know, correlation isn’t causation - but I could see for example how a cousin of mine would have been more likely to join the local gang if he couldn’t instead be home playing GTA as a teen.

            You’re unlikely to even want to watch any form of CSAM unless you’re into this, i.e. unless you’re a pedophile.

            CSAM yes, but there’s an important distinction that’s been blurred in recent years and I think it’s no coincidence - the distinction between CSAM and pedophilic content. CSAM involves actual human children - it’s in the name. Pedophilic content however can include content that doesn’t include actual children, like drawings.

            When you have an unevenly enforced justice system, who does it benefit to square the two? If the ruling class is full of pedophiles who actually rape children, then putting CSAM in the same rank as a drawing benefits them. It would be the same as saying a snuff film is as bad as a movie with props. And that benefits them, because it makes CSAM seem less bad than it is, while giving them expanded powers against those they don’t like. Calling something AI-generated CSAM (assuming it’s from a model that wasn’t trained on any specifically) makes it seem that what people like Trump do is actually just as bad as a basement dweller geberating pedo content. The reality is one is FAR more horrific than the other.

            On everything else you said, I mostly agree. I just want to point out for point 1, I was alive during the right when there was little research or evidence about violent video games too. Yeah, movies and books like that existed, but that wasn’t as immersive because those mediums aren’t interactve, and that was the important distinction back then.

            • Allero@lemmy.today
              link
              fedilink
              English
              arrow-up
              2
              ·
              8 hours ago

              Violent games have been shown to reduce aggression

              Yes, but we don’t know if it translates the same way to CSAM. That’s why we desperately need more studies. Before then, any stance is just a wild guess.

              The distinction between CSAM and pedophilic content

              Indeed, I use CSAM as an accepted broad term, even though, if AI was not trained on real CSAM, sexual abuse was not involved. You raise an interesting political point on why we shouldn’t.

              Other than that, we need to know several things when considering legality of such options:

              • Is real CSAM involved in a given model training data
              • Does consumption of different forms of AI-generated content increase or decrease real world sexual abuse rates
              • Is there any distinction between hyperrealistic AI-generated content and drawing-like content in terms of real world behaviors and training data
              • How can we protect children from being exposed to such content online - and how incidents of it happening anyway affect sexual and mental development of children

              Powerful people may intentionally put equality between real-life CSA and AI-generated content

              That’s an interesting angle to look at. So, we also need to know how normalization or criminalization of AI-generated materials affect public perception of real world CSA. Makes sense.

    • MaggiWuerze@feddit.org
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 day ago

      I would argue, that in both cases it only (or at least only meaningfully) affects people who already have a leaning towards the specific issue.

    • Le_Mon2@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      11
      ·
      1 day ago

      Well it’s different because video games aren’t created by comsuming and averaging out every piece of footage of children being raped that grok can find on the internet. Hope this helps.

    • Snowclone@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      7
      ·
      1 day ago

      why would watching children be abused from real or stimulated sources be the same as playing a violent video game?

      • Lumisal@lemmy.world
        link
        fedilink
        English
        arrow-up
        17
        arrow-down
        1
        ·
        edit-2
        1 day ago

        You’re right. A video game is far more interactive. Heck these days you can even put on a headset and really simulate the action of murdering people. Grand Theft Auto is a whole detailed simulation on muder, theft, and more. Wayyy more immersive than just plain video.

        Clearly then, by your own logic and the study’s conclusion, watching simulated sources make people more likely to do the thing after all. I mean, what sick person fantasizes about murdering strangers?

        Obviously we must ban the existence of violent video games or crime in society will spiral out of control.

        Edit: for the younger lemmings, this is sarcasm. “Fake X causes more real X” is really old propaganda, and its usually used on something most of the population already finds morally objectable + is harmful to society to advance some ulterior motive.

        In this case, probably government spying and the erosion of privacy, as usual.

          • Lumisal@lemmy.world
            link
            fedilink
            English
            arrow-up
            14
            arrow-down
            1
            ·
            1 day ago

            And you’re too young to remember back when the same talking points were used against video games to try to ban them or against movies and books “promoting” drugs. This isn’t a new thing. “Fake X causes more of Real X to happen!” Has being going on for decades if not over a century and has always been used for an ulterior motives.

            Making up statistics to find yet another way for governments to justify eliminating privacy isn’t going to save children or stop pedophilia, much like banning video games wouldn’t reduce gun deaths and banning drugs doesn’t really reduce drug use. The root cause is elsewhere.

            But you go ahead thinking your virtue signaling makes things better. I’m sure your name calling tactic will totally make a difference.

            • Snowclone@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              2
              ·
              18 hours ago

              I think perhaps, child sexual abuse material can be treated differently than video games. certainly it’s not related to anything I was talking about. it’s pretty absurd to connect ‘hay these AI companies released software that’s creating csam, let’s stop this and hold them accounting’ to ‘let’s stop video games.’ these are very distinctly different things. I’m not suggesting thought crime laws or laws to prevent anyone from buying or consuming video games or anything related to that, that world is already rated and regulated. AI software creating scam is not. that’s the problem. not video games. why do you even think this is related, it’s absurd.

              • Lumisal@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                9 hours ago

                I think there’s some confusion on your part.

                I’m not against what the main topic is about - holding companies legally liable for training on CSAM material. They should be, because they have possession of CSAM.

                What I’m against is the illegalization of non-CSAM material until it’s proven detrimental to humans, because otherwise it will be used as an excuse to lock up political opponents and erode privacy. This is not hypothetical, this is already observable. And yes, that does mean material that depicts disgusting acts with characters that appear to be children, including those stupid “but she’s actually 1000 years old” the Japanese seem to be fond of using. Because that is not CSAM, since literally no children were sexually abused, much like shooting someone in a video game isn’t actually murdering someone. It’s definitely pedophilic content, but then again at least it doesn’t hurt someone directly. To me it’s the equivalent of Portugal’s drug program where opiod addicts can go to pharmacies to get clean needles and cheap pharmacy grade opiods. And I think it’s no coincidence that countries that ban that and restrict research into it are all part of spying exchange programs like 5-Eyes.

                Nor do I think it’s a coincidence that those countries leaders are pedophiles.

                Because when you ban things like this, you _don’t _ get rid of them, you just push them underground. And paradoxically, what is known is that when something is fully banned, use of if rises (the forbidden fruit effect). You can see it anywhere where drugs are legalized. You can see it in history with the temperence movement. You can even see it with violent video games, where the controversy around it made younger children play them more back then than they do now.

                Banning non-CSAM pedophilic material likely results in the same effect. And just like with drugs and other such things, it will result in people getting hurt. In this case, actual childen.

                If the material is actually proven harmful to society, then additional steps can be taken, such as curing or treating pedophilia, if that’s possible. But its researched way too little to know if that’s the case due to its taboo status.

                I’m not suggesting thought crime laws or laws to prevent anyone from buying or consuming video games or anything related to that, that world is already rated and regulated.

                Except the arguments you make are the exact ones made way back to do exactly that to video games, and it wasn’t always rated and regulated… I’m not sure how you don’t get that point.

                For the record, I personally don’t play video games that are too violent. I don’t find pleasure in the simulated killing of humans or grotesque deaths - especially if they are depicted as innocents like in GTA. Being alive (and younger) during that time period, I thought that maybe those senators had a point. But when science showed it decreased aggression overall and when regulations were implemented, that was that. So I have first hand experience with knee-jerk reactions to things I find disgust with. But I’ve come to learn better since then that the solution to social problems is rarely if ever than banning of something, as easy a solution that would be.

                • Snowclone@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  edit-2
                  23 minutes ago

                  there’s a lot of data and study on pedophilia and csam, and I’m not going to try and educate you on it, it’s not hard to find, csam is not a form of deterrent or harm reduction it’s shown to desensitize and increase abusive behavior or desire to abuse. refusing to accept any study or data is not the same and saying there isn’t any, and pedophila isn’t a part of typical human sexuality, it’s a paraphilia and studies show it’s highly treatable. and csam not only hinders treatment it can cause the paraphilia to develop particularly in minors, csam isn’t equivalent to any entrainment. it’s not comparable, that’s why people in law and study started calling it csam in the first place. it’s not the same category. please. look up what people who study and enforce laws about it have been saying for decades and by all means look at their published data. refusing information isn’t making you clever or logos, it’s making you argue in favor of a self enforcing problem for corporations that profit from it. it’s all harm and no one in actual study or law is calling hentai, video games or depictions of children in non pornography, or child like behavior in pornography as the same as child sexual abuse material.

                • Le_Mon2@lemmy.zip
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  2 hours ago

                  Ai generated CSAM is not fucking “non CSAM material” It literally is a remix machine for existing csam. Hence the possession part. You cannot say “no children were harmed in the making of this ai video”

                  Legalize and regulate drugs and alcohol. Yes

                  Legalized and regulate video games. Yes

                  Legalize “non csam” material like your drawing example. Sure. Gross yes, but legal.

                  You are being disingenuous with the comparison and you know it. Or you’re too old to understand the differences between ai training/generation and drawing a picture.

                  • Lumisal@lemmy.world
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    33 minutes ago

                    I work in tech.

                    That’s not exactly how generative AI works. Some does have CSAM in its training material, which I said they should be held accountable. Early Stable Diffusion had it, and so does Grok (and I doubt Musk ever removed it).

                    But generative AIs can create things not in its data set.

                    Like you said, its a remix machine of sorts, to put it simply. It doesn’t need actual CSAM to generate that, it just needs nude adults, clothed children, and sex images to extrapolate from to then generate pedophilic content. That’s why they can’t easily stop generators from generating such content even on the ones they’ve confirmed don’t have it on their data set, and have to rely instead on keyword blocking.

                    You could perhaps go through a data set and remove all images of children, but then it’s likely someone would still find a way to loophole it (using keywords like gnomes or cherubs perhaps), or you could remove all nudity but it could also break the gen AIs capability to depict humans at all (as was the case with one of the later Stable Diffusion models, 3.0 I think).

                    You can chill on the witch hunting. I get you are understandably passionate on the subject but accusing anyone trying to find solutions of doing the opposite or being disingenous won’t help either.

        • Snowclone@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          7
          ·
          edit-2
          1 day ago

          your doing A LOT here, friend. I’m not sure I can unpack this… I’m not suggesting playing Grand Theft Auto is going to make anyone more likely to commit violent crimes. I don’t see the connection with csam. I don’t think the effects of viewing csam is equivalent or similar to playing a video game. I’ve played GTA, it’s really not an instruction manual or stimulation of detailed murder or violence, honestly, it’s a bit silly and while modern versions of the game are more detailed than the early versions of the game that were graphically more similar to Frogger than anything else, it’s still not very detailed. if you needed a murder equivalent to csam I think gore and ‘faces of death’ type of videos would be more comparable, video games are marketed to be fun and are rated and regulated pretty heavily in most areas of the world, AI generated csam isn’t being caught up in that same process of regulation or review, multiple corporations have made software that is producing AI generated csam and no one is really holding them accountable like you or me would be if we personally increased the reported rates of csam by huge orders of magnitude. we’d be in prison. the software isn’t free from the corporations that made it. they made it, they should be held accountable.