/r/datasets

Photograph via //r/datasets

A place to share, find, and discuss Datasets.

Datasets for Data Mining, Analytics and Knowledge Discovery

Rules

  • Try to post original source whenever you can.
  • Low effort posts will be removed.
  • Self-promotion(of a website/domain you work for or own) without disclosure will be removed.
  • Any Paid Dataset or Resource must be marked as such in the title with [PAID].
  • Any Synthetic/Mock data must be marked as such in the title with [Synthetic].
  • All Survey posts are subject to approval. Message the mods before posting.

Unsure about your post?

Feel free to message the mods and discuss it before posting.

Related Subreddits

/r/datasets

200,749 Subscribers

1

Banking datasets? Data analyst asking

Where is the cheapest place to purchase data for bank analytics? I am a data analyst for a small bank and wanted to do some analytics to be impressive. Where can I get data that would be super helpful and relevant to the executives of the bank?

0 Comments
2025/02/04
20:10 UTC

2

US Census Trade by Industry and Product Statistics (TIPS)

Does anyone have a copy of the experimental data product that was previously hosted here: Trade by Industry and Product Statistics (TIPS)

The 4 excel files for 21/22 import and exports have not been restored to the site yet. Thank you!

0 Comments
2025/02/04
18:44 UTC

6

[Synthetic] Synthetic Emotions: AI-Generated Videos of Human Expressions

I am excited to share Synthetic Emotions, a dataset featuring AI-generated videos of individuals expressing different emotions, including happiness, anger, sadness, fear, surprise, disgust, love, confusion, and more.

This dataset was created using OpenAI Sora and consists of 100 short videos, each 5 seconds long, 480p resolution, 9:16 aspect ratio, and generated in one-shot to ensure consistency. The dataset covers a diverse range of ethnicities and demographics to provide a balanced representation of human emotions.

Key Details:

  • Video Duration: 5 seconds
  • Resolution: 480p
  • Aspect Ratio: 9:16
  • Generation Mode: One-shot using OpenAI Sora
  • Total Videos: 100
  • Emotion Categories (10 total): Happiness and Joy, Anger, Sadness, Fear, Surprise, Disgust, Love and Affection, Confusion, Neutral/Everyday, Mixed Emotions

Potential Applications:

  • Emotion Recognition Research
  • Affective Computing & AI-Human Interaction
  • Synthetic Video Data Exploration

If you are working in emotion recognition, AI-human interaction, or affective computing, or are simply interested in how AI-generated human emotions compare to real-world expressions, this dataset may be useful.

The dataset is available on Hugging Face:
🔗 https://huggingface.co/datasets/aadityaubhat/synthetic-emotions

0 Comments
2025/02/04
18:22 UTC

1

Global Inflation rate from 1960 to present Kaggle dataset

Hi all, I want to share this dataset that I had created, contains all countries inflation rate of 1960 to 2023, I wait that you can use it in your projects,

https://www.kaggle.com/datasets/fredericksalazar/global-inflation-rate-1960-present

0 Comments
2025/02/04
16:09 UTC

2

When to worry about data contamination in LLM experiments?

Hey, I am currently preparing my master thesis experiment and was looking for datasets. My experiment will use LLMs as baseline with different RAG variations. Data contamination is a big topic for LLMs, because if the LLM has already been trained on the data I want use, then the whole experiment is pointless. The dataset I found on zenodo.org is for vulnerability detection.

Public and readable datasets are problematic, but what's about downloadable datasets that do not have a preview on its side?

Should I be worried ?

1 Comment
2025/02/04
07:57 UTC

1

Support Requested - RavenPack & Competitor Dataset Information

Hi all,

I'm helping a client evaluate a list of various data providers, but can't quite seem to get a demo with some of these companies. It's likely because their qualification process vets me out.

Is anyone willing to share the pricing of RavenPack's products (like their sentiment analysis) the quality of their data?

If you have experience with other data providers, would love to learn about your experience with them as well.

Thanks in advance!

1 Comment
2025/02/04
05:26 UTC

3

URGENT: In need of Eco-home dataset for my thesis

Hi everyone,

I am in need of a dataset that shows data about eco-home owners**.**

Definition of eco-home: "An eco-home, or eco-house, is a home built to have a minimal impact on the environment. Eco-homes are designed to use less energy, reduce waste, and conserve water."

Does anyone know where I could potentially find something like this? I am at a dead end and have procrastinating badly due to being unable to find a data source for this niche.

Thanks so much.

*Edit: data around LEED-certified homes would work too

1 Comment
2025/02/04
00:42 UTC

2

Looking for a specific video dataset for smoke and fire detection.

I am looking for a video dataset containing CCTV recordings of smoke/fire in buildings. My project aims to detect smoke and fire in the office buildings, factories and etc. I've already searched every video on YouTube, Archive org, etc. Any help would be appreciated, thanks.

0 Comments
2025/02/03
16:16 UTC

8

Prepared list of data sources on diverse topics

I prepared "Datasets" repo which contains data sources of diverse topics, i.e., from Legal cases, health, sports, transport, finance, company filings etc., along with links to open data portals, data dumps. Feel free to contribute and share.

It will be useful for data collection. Repo here.

4 Comments
2025/02/03
07:32 UTC

2

Looking for genome data for a hobby project

So I am reading a lot about evolution and for a big part, that's about genes. I'm now a few books down, so I can kind of confidently talk about those subjects now, but the thing is that I have never ever worked with or even explored genetic data. Mind you, I am a data scientist. As a hobby project, I want to explore some genetic datasets. Does anyone know of any good a freely available resources, or could someone tell me a little about the different types of genetic data?

1 Comment
2025/02/03
08:05 UTC

0

Dataset of 180-degree stereoscopic VR videos for VR video upscaling and synthesis.

Hi! I've done quite a bit of research trying to find datasets that fit the description above. Essentially, I'm working on an AI that can upscale 180-degree VR videos, preferably they'd be SBS. As a bit of a side project, I'd also like to work on an AI that has only one eye's view as an input, and the other as an output. Essentially turning a 2D video into a 3D SBS video. Any help/leads would be appreciated. Thank you!

0 Comments
2025/02/03
02:06 UTC

3

Need secondary sources on independent contracting vs. employment data and advice on collecting primary source data

So, I'm trying to do research on whether one should be an independent contractor or an employee. This includes benefits, pay, work/life balance and a bunch of other stats. Do you know of any good secondary sources that can help me research this and do you have any advice on how to make my own survey (the survey doesn't have to be on reddit)?

Also, if you know a good sub to ask this in, go ahead and point that out.

0 Comments
2025/02/03
00:16 UTC

2

Missing airport data for a travel project

I’m working on building a comprehensive travel spreadsheet and I have a section that contains a lot of airport data. I’m currently trying to find a comprehensive list of annual passenger traffic and if the airport is a domestic, regional, international, etc. I Ideally want to be able to pull data from IATA directly, but I can’t seem to find a good way to do that. I’ve been searching through GitHub and I haven’t found a dataset that contains this information yet. I am open to adding more info to the spreadsheet, so if you have any other good data sources to check out regarding airports that would be great too!

2 Comments
2025/02/02
22:06 UTC

4

Looking for news API for at least the last 20 years

Hey all,

I hope this is the right forum, but I am kind of new to all of this.

  • I am looking for a news API (doesn't really matter which type of API) which goes back to at least 2000.
  • Can be from one big (NYT or so source), but the more sources it covers the better.
  • Must include financial news (but doesnt have to be limited to that)
  • Doesn't have to be free (sure, the less the better)

I found a couple, but none of them goes further than let's say the past 5 years.

Any help?

Cheers :)

Edit: with financial news I don't necessarily mean it very specific. Let's say the API just Covers different newspaper, which have a financial section, that would be enough

1 Comment
2025/02/02
15:54 UTC

1

Dataset Copyright from Webscraping Issues

If I webscraped data from a website that 'surveys' users to populate their database, then publicly displays it for users to see without any paywall or sign up required, can I freely post and use this data as I please? I would like to make it publicly available, but I don't want to infringe on anything while doing so.

My end goal would be to just post it on kaggle for public use as well as do some analysis viewable in some sort of website or dashboard

6 Comments
2025/02/02
05:34 UTC

2

YRBS dataset and BRFSS dataset backup

Hi, CDC took down the YRBS dataset and the BRFSS dataset. Does anyone backup those most updated 2023 dataset and being willing to share? Thanks!

1 Comment
2025/02/01
14:02 UTC

2

What stats for analysing healthcare large datasets for prison and mental health

Hi everyone,

Hope you’re all well, I’m in the early stages of designing a PhD project and hope to work with linked large datasets to evaluate mental healthcare in prison and forensic settings, and evaluate economic aspects and effectiveness of care. I’m hoping to base this work on linked datasets. So far I’ve been reading about the solutions for missing data, and been surprised at the number of theories. Really interesting stuff!

If anyone has any suggestions for how to approach this topic, or ideas for methods , resources, books, YouTube and general thoughts please these would all be really appreciated. I’m literally starting from scratch with the stats knowledge so grateful for any suggestions,

I see this as part of the background work rather than requesting anything unscrupulous!

Thank you in advance

2 Comments
2025/02/02
03:20 UTC

2

Looking for DFS data sets for baseball, showing daily pricing of the players. Is this available somewhere?

I’ve seen this for football a while back. Perhaps there’s something here?

2 Comments
2025/02/02
02:53 UTC

1

Prevalence of video gaming in the UK dataset?

Hi everyone,

Does anyone know of any panel datasets on video gaming (inc. mobile gaming) in the UK, or even just England and Wales? Looking to write a paper on video gaming habits.

I’ve seen reports on Statista, but you have to pay a hefty sum!

0 Comments
2025/02/01
14:39 UTC

7

PREVIOUS YEAR SALES DATASET FOR FRORECASTING

Where do I find previous years sales dataset for forecast

5 Comments
2025/02/01
11:39 UTC

1

Resume/CV Dataset for a Smart-Recruiter Project

I'm looking for a large resume/CV dataset for my Smart-Recruiter project. I'm unable to find a suitable one on neither of the popular platforms like Kaggle or Google Dataset Search or UCI Machine Learning Repo.

Requirements:

  1. Simple 1/2 pages of files.
  2. Preferred file type is PDF but anything will work right now.
  3. Trying to avoid dummy data.

P.S.: I found a dataset on Kaggle that has about 228 docx files but the problem with this dataset is it's too long, like each docx file contains at least 6 pages on average. And this is my understanding that any resume that is beyond 2 pages, don't make it to the interview process.

I'm open to suggestions.

0 Comments
2025/02/01
05:37 UTC

2

Looking for a recent Machine learning Dataset, to perform regression, classification.

Hello all, I've been tasked with finding a dataset for one of my courses. But can't find any recent decent dataset to perform machine learning tasks. There's also the constraint of having at least 50k samples and around 20 more or less features. I found some on kaggle but needed to delge more. Where can I look for more datasets where I can specify queries like these?

0 Comments
2025/02/01
05:09 UTC

2

ISO: US National employment projections by zip code (or similar region) - 2020 or newer

I'm looking for a dataset that provides projections about the labor market by zip code. Ideally it would be for year 2023, but something as old as 2020 could suffice. I know the BLS only separates by state and I'm not seeing anything newer than 2018 from the US Census (doesn't mean I'm not missing something).

Any help is appreciated!

1 Comment
2025/02/01
04:24 UTC

1

Where can i find sports datasets recently updated?

Hey there, im looking for volleyball and rugby dataset. Is there any website with updated matches?

0 Comments
2025/02/01
04:15 UTC

3

Facebook friends network analysis: How to gather data

Hello! I am a humanities masters student with no coding background. I am trying to create a social network analysis of an individual Facebook page. I’ve found instructions from 2019-2021 on how to gather friend data using Selenium, but these tools no longer work. I’m getting quite frustrated trying to find solutions. At this point is the Facebook API at all conducive to this data gathering? Thank you in advance.

2 Comments
2025/01/31
22:13 UTC

1

Requesting dataset for Drug-Drug Interaction Prediction

Hello ,
I’m currently working on a college research project on Drug-Drug Interaction Prediction using Knowledge Graph Embeddings and a Convolutional-LSTM Network. I came across the paper

- Drug-Drug Interaction Prediction Based on Knowledge Graph Embeddings and Convolutional-LSTM Network by *Md. Rezaul Karim, Michael Cochez, Joao Bosco Jares, Mamtaz Uddin, Oya Beyan, and Stefan Decker (Fraunhofer FIT, RWTH Aachen University, University of Dhaka).

If anyone has access to the dataset (or a similar one), or knows how I can obtain it, I’d really appreciate your help!

this would be really helpful .As i cant find the dataset from Kaggle also or from any source .

3 Comments
2025/01/31
14:05 UTC

0

Help creating a deepfake audio dataset?

Hey everyone,

I’m working on building a deepfake audio dataset and wanted to get some help on best practices. I want to ensure that the dataset is diverse and representative for training an effective detection model.

Some questions I have:

How many speakers should I aim for to get a balanced dataset?

Should I maintain an equal gender ratio, or does it make a difference ?

How long is enough from each source(mins, hours)

Any recommended sources or strategies for collecting high-quality real audio?

What sample rates (e.g., 16kHz, 44.1kHz, 48kHz) or a what mix?

Are certain codecs (e.g., MP3, AAC, Opus, WAV) more challenging for detection models?

Would love to hear from those who have experience

1 Comment
2025/01/31
12:39 UTC

2

Any leads on Walmart Product Reviews Datasets?

I am working on a data analysis project but I'm having a difficult time find any datasets for Walmart Product Reviews with maybe 2022 or 2023 data. Any ideas?

2 Comments
2025/01/31
10:57 UTC

Back To Top