t3_1fdpjth

Hi redditors,

We’re back, just as summer starts to recede into fall, with an update on our Q2 numbers and a few highlights from our safety and policy teams. Read on for a roundup of our work on banning content from “nudifying” apps, the upcoming US elections, and our latest Content Policy update. There’s also an FYI that we’ll be updating the name of this subreddit from r/redditsecurity to r/redditsafety going forward. Onto the numbers:

# Q2 By The Numbers

|Category|Volume (January - March 2024)|Volume (April - June 2024)|
|:-|:-|:-|
|Reports for content manipulation|533,455|440,694|
|Admin content removals for content manipulation|25,683,306|25,062,571|
|Admin-imposed account sanctions for content manipulation|2,682,007|4,908,636|
|Admin-imposed subreddit sanctions for content manipulation|309,480|194,079|
|Reports for abuse|3,037,701|2,797,958|
|Admin content removals for abuse|548,764|639,986|
|Admin-imposed account sanctions for abuse|365,914|445,919|
|Admin-imposed subreddit sanctions for abuse|2,827|2,498|
|Reports for ban evasion|15,215|15,167|
|Admin-imposed account sanctions for ban evasion|367,959|273,511|
|Protective account security actions|764,664|2,159,886|

# Preventing Nonconsensual Media from Nudifying Apps

Over the last year, a new generation of apps leveraging AI to generate nonconsensual nude images of real people have emerged across the Internet. [To be very clear](https://support.reddithelp.com/hc/en-us/articles/360043513411-Never-Post-Intimate-or-Sexually-Explicit-Media-of-Someone-Without-Their-Consent): sharing links to these apps or content generated by them is prohibited on Reddit. Our teams have been monitoring this trend and working to prevent images produced by these apps from appearing on Reddit.

Working across our threat intel and data science teams, we honed in on detection methods to find and ban such violative content. As of August 1, we’ve **enforced \~9,000 user bans** and over **\~40,000 content takedowns**. We have ongoing enforcement on content associated with a number of nudifying apps, and we’re continuously monitoring for new ones. If you see content posted by these apps, please report it as nonconsensual intimate media via the report flow. More broadly, we are also partnered with the nonprofit SWGfl to implement their StopNCII tool, which enables victims of nonconsensual intimate media to protect their images and videos online. You can access the tool [here](https://stopncii.org/).

# Harassment Policy Update

In August, we revised our [harassment policy language](https://www.reddit.com/r/redditsecurity/comments/1et3lal/update_on_enforcing_against_sexualized_harassment/) to make clear that sexualizing someone without their consent violates Reddit’s harassment policy. This update prohibits posts or comments that encourage or describe a sex act involving someone who didn’t consent to it, communities dedicated to sexualizing others without their consent, or sending an unsolicited sexualized message or chat.

We haven’t observed significant changes to reporting since this update, but we will be keeping an eye out.

# Platform Integrity During Elections 

With the US election on the horizon, our teams have been working to ensure that Reddit remains a place for diverse and authentic conversation. We highlighted this in a recent [post](https://www.reddit.com/r/redditsecurity/comments/1ehp7p1/supporting_our_platform_and_communities_during/):

“Always, but especially during elections, our top priority is ensuring user safety and the integrity of our platform. Our [Content Policy](https://www.redditinc.com/policies/content-policy) has long prohibited content manipulation and [impersonation](https://support.reddithelp.com/hc/en-us/articles/360043075032-Do-not-impersonate-an-individual-or-entity) – including inauthentic content, disinformation campaigns, and manipulated content presented to mislead (e.g. deepfakes or other manipulated media) – as well as[ hateful content](https://support.reddithelp.com/hc/en-us/articles/360045715951-Promoting-Hate-Based-on-Identity-or-Vulnerability) and [incitement of violence](https://support.reddithelp.com/hc/en-us/articles/360043513151-Do-not-post-violent-content).”

For a deeper dive into our efforts, read the full [post](https://www.reddit.com/r/redditsecurity/comments/1ehp7p1/supporting_our_platform_and_communities_during/) and be sure to check out the comments for great questions and responses.

# Same Subreddit, New Subreddit Name

What's in a name? We think a lot. Over the next few days, we’ll be updating this subreddit name from r/redditsecurity to r/redditsafety to better reflect what you can expect to find here.

While security is part of safety, as you may have noticed over the last few years, much of the content posted in this subreddit reflects the work done by our Safety, Policy, and Legal teams, so the name r/RedditSecurity doesn’t fully encompass the variety of topics we post here. Safety is also more inclusive of all the work we do, and we’d love to make it easier for redditors to find this sub and learn about our work.

Our commitment to transparency with the community remains the same. You can expect r/redditsafety to have our standard reporting from our Quarterly Safety & Security report (like this one!) our bi-annual Transparency Reports, as well as additional policy and safety updates.

Once the change is made, if you visit r/redditsecurity, it will direct you to r/redditsafety. If you’re currently a subscriber here, you’ll be subscribed there. And all of our previous r/redditsecurity posts will remain available in r/redditsafety.

  
*Edit: Column header typo*

<div class="md"><p>Hi redditors,</p>

<p>We’re back, just as summer starts to recede into fall, with an update on our Q2 numbers and a few highlights from our safety and policy teams. Read on for a roundup of our work on banning content from “nudifying” apps, the upcoming US elections, and our latest Content Policy update. There’s also an FYI that we’ll be updating the name of this subreddit from <a href="/r/redditsecurity">r/redditsecurity</a> to <a href="/r/redditsafety">r/redditsafety</a> going forward. Onto the numbers:</p>

<h1>Q2 By The Numbers</h1>

<table><thead>
<tr>
<th align="left">Category</th>
<th align="left">Volume (January - March 2024)</th>
<th align="left">Volume (April - June 2024)</th>
</tr>
</thead><tbody>
<tr>
<td align="left">Reports for content manipulation</td>
<td align="left">533,455</td>
<td align="left">440,694</td>
</tr>
<tr>
<td align="left">Admin content removals for content manipulation</td>
<td align="left">25,683,306</td>
<td align="left">25,062,571</td>
</tr>
<tr>
<td align="left">Admin-imposed account sanctions for content manipulation</td>
<td align="left">2,682,007</td>
<td align="left">4,908,636</td>
</tr>
<tr>
<td align="left">Admin-imposed subreddit sanctions for content manipulation</td>
<td align="left">309,480</td>
<td align="left">194,079</td>
</tr>
<tr>
<td align="left">Reports for abuse</td>
<td align="left">3,037,701</td>
<td align="left">2,797,958</td>
</tr>
<tr>
<td align="left">Admin content removals for abuse</td>
<td align="left">548,764</td>
<td align="left">639,986</td>
</tr>
<tr>
<td align="left">Admin-imposed account sanctions for abuse</td>
<td align="left">365,914</td>
<td align="left">445,919</td>
</tr>
<tr>
<td align="left">Admin-imposed subreddit sanctions for abuse</td>
<td align="left">2,827</td>
<td align="left">2,498</td>
</tr>
<tr>
<td align="left">Reports for ban evasion</td>
<td align="left">15,215</td>
<td align="left">15,167</td>
</tr>
<tr>
<td align="left">Admin-imposed account sanctions for ban evasion</td>
<td align="left">367,959</td>
<td align="left">273,511</td>
</tr>
<tr>
<td align="left">Protective account security actions</td>
<td align="left">764,664</td>
<td align="left">2,159,886</td>
</tr>
</tbody></table>

<h1>Preventing Nonconsensual Media from Nudifying Apps</h1>

<p>Over the last year, a new generation of apps leveraging AI to generate nonconsensual nude images of real people have emerged across the Internet. <a href="https://support.reddithelp.com/hc/en-us/articles/360043513411-Never-Post-Intimate-or-Sexually-Explicit-Media-of-Someone-Without-Their-Consent">To be very clear</a>: sharing links to these apps or content generated by them is prohibited on Reddit. Our teams have been monitoring this trend and working to prevent images produced by these apps from appearing on Reddit.</p>

<p>Working across our threat intel and data science teams, we honed in on detection methods to find and ban such violative content. As of August 1, we’ve <strong>enforced ~9,000 user bans</strong> and over <strong>~40,000 content takedowns</strong>. We have ongoing enforcement on content associated with a number of nudifying apps, and we’re continuously monitoring for new ones. If you see content posted by these apps, please report it as nonconsensual intimate media via the report flow. More broadly, we are also partnered with the nonprofit SWGfl to implement their StopNCII tool, which enables victims of nonconsensual intimate media to protect their images and videos online. You can access the tool <a href="https://stopncii.org/">here</a>.</p>

<h1>Harassment Policy Update</h1>

<p>In August, we revised our <a href="https://www.reddit.com/r/redditsecurity/comments/1et3lal/update_on_enforcing_against_sexualized_harassment/">harassment policy language</a> to make clear that sexualizing someone without their consent violates Reddit’s harassment policy. This update prohibits posts or comments that encourage or describe a sex act involving someone who didn’t consent to it, communities dedicated to sexualizing others without their consent, or sending an unsolicited sexualized message or chat.</p>

<p>We haven’t observed significant changes to reporting since this update, but we will be keeping an eye out.</p>

<h1>Platform Integrity During Elections </h1>

<p>With the US election on the horizon, our teams have been working to ensure that Reddit remains a place for diverse and authentic conversation. We highlighted this in a recent <a href="https://www.reddit.com/r/redditsecurity/comments/1ehp7p1/supporting_our_platform_and_communities_during/">post</a>:</p>

<p>“Always, but especially during elections, our top priority is ensuring user safety and the integrity of our platform. Our <a href="https://www.redditinc.com/policies/content-policy">Content Policy</a> has long prohibited content manipulation and <a href="https://support.reddithelp.com/hc/en-us/articles/360043075032-Do-not-impersonate-an-individual-or-entity">impersonation</a> – including inauthentic content, disinformation campaigns, and manipulated content presented to mislead (e.g. deepfakes or other manipulated media) – as well as<a href="https://support.reddithelp.com/hc/en-us/articles/360045715951-Promoting-Hate-Based-on-Identity-or-Vulnerability"> hateful content</a> and <a href="https://support.reddithelp.com/hc/en-us/articles/360043513151-Do-not-post-violent-content">incitement of violence</a>.”</p>

<p>For a deeper dive into our efforts, read the full <a href="https://www.reddit.com/r/redditsecurity/comments/1ehp7p1/supporting_our_platform_and_communities_during/">post</a> and be sure to check out the comments for great questions and responses.</p>

<h1>Same Subreddit, New Subreddit Name</h1>

<p>What&#39;s in a name? We think a lot. Over the next few days, we’ll be updating this subreddit name from <a href="/r/redditsecurity">r/redditsecurity</a> to <a href="/r/redditsafety">r/redditsafety</a> to better reflect what you can expect to find here.</p>

<p>While security is part of safety, as you may have noticed over the last few years, much of the content posted in this subreddit reflects the work done by our Safety, Policy, and Legal teams, so the name <a href="/r/RedditSecurity">r/RedditSecurity</a> doesn’t fully encompass the variety of topics we post here. Safety is also more inclusive of all the work we do, and we’d love to make it easier for redditors to find this sub and learn about our work.</p>

<p>Our commitment to transparency with the community remains the same. You can expect <a href="/r/redditsafety">r/redditsafety</a> to have our standard reporting from our Quarterly Safety &amp; Security report (like this one!) our bi-annual Transparency Reports, as well as additional policy and safety updates.</p>

<p>Once the change is made, if you visit <a href="/r/redditsecurity">r/redditsecurity</a>, it will direct you to <a href="/r/redditsafety">r/redditsafety</a>. If you’re currently a subscriber here, you’ll be subscribed there. And all of our previous <a href="/r/redditsecurity">r/redditsecurity</a> posts will remain available in <a href="/r/redditsafety">r/redditsafety</a>.</p>

<p><em>Edit: Column header typo</em></p>
</div>

Q2’24 Safety & Security Quarterly Report

t3_1fdqbwg

r/RedditSecurity has moved to r/RedditSafety

<div class="md"><p><a href="/r/RedditSecurity">r/RedditSecurity</a> has moved to <a href="/r/RedditSafety">r/RedditSafety</a></p>
</div>

251 Subscribers

r/RedditSecurity has moved to r/RedditSafety