I've been getting this error for the past couple days. I had access in the past. Is there anything I can do to fix the issue? Or is it happening to others.

This is after trying to authorize from https://api.pushshift.io/signup

{"detail":"User is not an authorized moderator."}

{"detail":"User is not an authorized moderator."}

Hi all,

I want to access the reddit data using pushshift API. I raised a request. Can anyone help me how can I get the access at the earliest?

Thanks1

Hi, I've been searching for a dataset containing Gab posts. I finally came across a link but there is a login page coming up. I signed up and logged in, but since there is another guardrail requiring approval of requests and requests can only be submitted by moderators. I am unable to get access.

Is there any way of getting access to the data through my researcher credentials.

Hi everyone :) I'm new to using big data dumps. I downloaded the r/Incels and r/MensRights data sets from u/Watchful1 and are now stuck with these big data sets. I need them for my Master Thesis including NLP. I just want to sample about 3k random posts from each Subreddit, but have absolutely no idea how to do it on data sets this big and still unzipped as a zst (which is too big to access). Has anyone a script or any ideas? I'm kinda lost

I'm not a programmer, but I know that Pushshift functions as an archive for Reddit. Many posts I've interacted with have been deleted, and sometimes I'd like to see what the original post said. How can I view it?

Additionally, sometimes the post itself isn't deleted, but the original poster's account is gone, and I want to remember who made the post.

Hello all,

Earlier this week, Pushshift faced a breach of security because of which the application configuration had to be updated. The updated application that authorizes you now goes by the name "ncri_ingest". All users will need to reauthorize for API access through https://api.pushshift.io/signup.

Users that have a long-running script using the refresh functionality will also need to replace the token with a new one after reauthorizing.

We apologize for any inconvenience caused and appreciate your patience during this period.

• On behalf of Team NCRI

When it goes to the reddit page, I get;

bad request (reddit.com)

you sent an invalid request

— invalid client id.

Requested nearly a week ago, I’ve heard nothing.

I've just starting using it again recently - what's the protocol? Does it go down often?

It's been down for me for a few days now.

https://academictorrents.com/details/20520c420c6c846f555523babc8c059e9daa8fc5

I've uploaded a new centralized torrent for all monthly dump files through the end of July 2024. This will replace my previous torrents.

If you previously seeded the other torrents, loading up this torrent should recheck all the files (took me about 6 hours) and then download only the new files. Please don't delete and redownload your old files.

Hi all,

I am a researcher and I used to collect Pushshift data using the API. Now I need to collect data again. The issue is I do not need a specific subreddit bu specific posts that cotain targeted expression and then I need to collect posts of that user who made these comments. Let's say in the last 5 years.
I was thinking to index the data in our lap (the last 5-6 years of pushshift comments and posts)
Did any one do that before or is there any guide or project for this so it saves the time experimenting with tools and structure?

Edit: What I mean exactly is if you have indexd Pushshift data youself what did you use, MongoDB / Elasticsearch?
Any one have docker file / code that get me started with this task faster?

Thanks,

Kind regards

Anyone know how we can get confirmation an account was removed after we submit the request? I can see the link to submit it but I don't see how we would get notified once it happened? Or maybe someone knows what website I could check?

I'm trying to use the PushshiftAPI() and it gives the following error: WARNING:pmaw.PushshiftAPIBase:Not all PushShift shards are active. Query results may be incomplete.

why it's not working? what can I do?

i accept the terms, i allow access, i get the search interface

but then when i try to search i get a pop up saying authentication is required and i am back to square one.

So first off id like to say appreciate you guys doing this. It's thankless work and really cool for people looking for long gone stuff so thank you 🙏

Now on to my problem . I won't rule out that what I'm about to ask is easy and I'm just not familiar enough with json files to know , so if it is , please be easy on my as I have tried frrsearching on my on and their post is a last ditch effort.

So there is a guide / tutorial that was posted a while back in an now deleted sub reddit. I have downloaded both the " posts " and " comments " dumps and tried searching through them using notepad++ and the search function. I have found numerous instances of the name of the guide , but have yet to find the full guide post itself.

Is there an easier way to try and find it? When I do get a hit , they all look to be 1 line long and that's it. Any tips trick or anything I need to do different to find the full guide I'm looking for?

Thanks in advance to anyone that can off anything. It's greatly appreciated 🙏

Hello all,

We observed downtimes in Pushshift and occasional failure to collect data for the last few days. On diagnosis, this was owing to an internal server and storage issue. The system was fixed this morning, and data is now being collected normally. We appreciate your patience and apologize for any inconvenience caused during this period.

-Pratik

On behalf of Team Pushshift

It looks like I can no longer grab the access cookie to allow access on mobile with chrome in desktop mode (android os).

It looks to be two issues:

• The "Sign in with Reddit" button does not allow a long press to open as a tab and therefore allow the cookie to go into my chrome app.

• Clicking the button opens the Reddit App and the built in browser. A recent update looks to have removed their option to "open in chrome" from that built in browser. This means I can no longer use that button to force the access page to go back into the chrome app.

Please can the devs either fix the button to allow opening in a tab on the chrome mobile app, or ask Reddit to add back in the "open in chrome" button for the official Reddit apps in-built website browser?

April dump files: https://academictorrents.com/details/9b29491dccf7d9d72e5538ce8b647cf8ed43fb34

Sorry for the delay a second month in a row, still working on my upload process.

Hello,

PushShift ingest seems to have stalled around
Mon May 20 2024 21:49:29 GMT+0200

The frontend is up & responding with hits older than that.

Is this just normal maintenance?

Regards

Long shot but does anyone have a script out there that maps posts to comments, and combines them in a new json object. from the dumps I've collected like 25k posts and 75k comments and since they are kinda random rn, I would like to map posts to comments to do some better analysis

I keep getting this message despite 1) being a moderator and 2) having received approval from pushshift.

does anyone know how to resolve this?

Postgrad student who's (academic) life is hanging on a thread if she failed to use PRAW or Pushift to scrape comments from subreddit 'r/gameofthrones'!!!!!!!!

https://preview.redd.it/5px05uzt620d1.png?width=1654&format=png&auto=webp&s=3fe52df48862188c4bd37b3d7bba54985be63583