/r/opendata
Playing with data from open APIs and datasets:
http://opendata.stackexchange.com/
Other related subreddits are: http://reddit.com/r/statistics http://reddit.com/r/datasets http://reddit.com/r/visualization http://reddit.com/r/machinelearning http://reddit.com/r/rstats http://reddit.com/r/econometrics http://reddit.com/r/semanticweb
/r/opendata
Just looking to see if this is an active govdata community or just opendata
Hi guys!
I spent quite a few hours today trying to get CKAN setup (both via Kubernetes clustering and via a "simple" Docker deployment).
I eventually got the AWS Marketplace image working but .. I found it such a cumbersome installation process (and the documentation suggests it's not much easier to run).
I'm sure a great and very powerful for governments wishing to share data but ... it seems too hard and "enterprise scale" for my objectives.
Here's what I'm doing:
I'm hoping to create an open access data portal specific to impact investment, a form of finance that tries to integrate sustainability objectives.
I'm thinking, in terms of functionalities:
- Aggregating various open access datasets into one place
- Sharing my edited versions of these source datasets (mostly CSV, JSON)
- It would also be nice to able to embed and share live data (and perhaps even host a sandbox for connecting to a read-only PostgreSQL DB) but ... those are "nice to haves" rather than essential features
Right now I'm updating a Github repository and I was sure that there was something like a CMS that could make the process of sharing datasets more attractive.
Related to my job but ultimately it's a not for profit venture that I'd be bootstrapping. So while I can spin up a VPS for hosting, I'm looking to keep costs reasonable, etc.
TIA for any recommendations!
Does anyone have any sources about the concentration of land in Israel?
Interested in things like what percent of land value or land area is under control of the largest or wealthiest landholders, maybe split by things like "desert" vs "non-desert", use (like agricultural vs residential vs other) or institution (like individual/business/government).
(I say "concentration of land" rather than "concentration of land ownership" since I think most Israeli land is leased from the government.)
Hello,
I am looking for a free data set that represents logical word pairs in the following form. Examples:
Background: I want to develop a logical game for children in primary school so that they think about the words and then create new words with meaning. I think that there might be such a database with logical connections. Could anyone give me a tip or hint, please?
Thank you very much in advance!
My thoughts so far are either
Do those make sense? Is there something better?
I know you can wade through the Unicode/Unihan database files and group the symbols by "unicode block", but are there any open collections of symbols/glyphs which group them by more fine-grained categories? Something like this, but way more.
For example, we might have these JSON files:
I searched around GitHub for a while but didn't find anything (surprisingly!). Have you seen anything like this? Doesn't need to be complete, but hoping not to have to roll my own solution. Thank you for your help.
Perhaps you know of some machine learning tool which has aggregated this stuff (I am imagining like tesseract somewhere). Or some sort of NLP dataset.
Not really sure what this is (https://github.com/unicode-org/cldr-json) but are you able to find it in there perhaps?
Hi! Meet Wobby.
You can find all kinds of statistical, open data on Wobby and analyze it immediately in a sort of ChatGPT environment. You can also upload your own data ;)
I'd like to improve our offer of open data sets and also try to better inform users in case of upcoming changes to datasets and platforms. How do you do this for users who are, by default, not required to sign in on anything?
I am doing a project that will be scraping and analyzing large numbers of web pages (>10^(7) pages at a time). One of the things I need to do is efficiently identify spam content, advertisements, banner ads, etc. to pre-filter it.
Are there any pre-existing libraries that accurately classify this sort of material? I'm looking both for text/HTML processing libraries, but also image classification for things like banner ads. If there are not pre-existing open-source libraries that do this, then I would be interested in training data sets that I could use to develop my own filters.
Thanks!
Hello community,I'm seeking, for a personal project, a huge opendata dataset which will have a bunch of attributes.
This dataset (or these datasets) will be used to feed a star/snowflake schema which will be used as datasource for an OLAP cube.
Thats why I'm searching for a lot of atttributes (which will become dimensions in the hypercube).
Ideally a sales dataset with product, customer, country, date of sales, unit price, quantity, discount... will be more than welcome.
Thanks in advance for your help !
Bob
Hi looking for online car parts database preferably includes russian. Didn’t want to parse other websites
I am particularly interested in the river Thames, or the English channel, for shipping
For aircraft, British airspace would be nice
But, in both cases, I will accept anything worldwide.
I would prefer a realtime feed, but could live with a delay of an hour, day or week. Maybe longer, just as long it is continuous and I can regularly pull fresh data every minute or so.
It is important to note that I do not have a feed to offer them in exchange, which many such sites require.
Hey! I am working on a project related to normative linguistic discrimination. Would appreciate any tips on where I might find relevant data, especially related to education and age. Thanks a lot! I know this is a little vague so please let me know if I can answer questions that might help with the search.
Hello, I've recently released an app for electric vehicle drivers, which ensures they can easily find great charge points. ⚡ ⚡ 🚙
It has coverage in the UK and US and uses the Open Charge Map and OpenStreetMaps databases. We will send user submitted data about chargers to the Open Charge Map database as well to share user contributions.
I was looking for feedback on the app and testers to find how to further improve it, especially the opendata aspects. 🙂
What is unique (I think!) about the app is that its focus is on making it easy to compare charge points by providing users with a ranked list based on travel time, connector numbers, crime rate or the types of amenities or brands users want to have present nearby. i.e. if you'd like a charger with a Starbucks nearby it can find it quite easily. ☕
I am also using crowd-sourced data and machine learning techniques to further power the charger recommender with charge point use forecasts.
The goal is to make the charging experience and environment which users encounter at chargers more predictable for drivers!
Easiest way to download is via electro-app.com.
Please reply below or DM me if you would like to know more!
I work in the open data office of a smallish city; we use R for almost everything. For those of you working in open data, what language do you use most?
My favourite era is Caesar's, but I will accept anything from the founding to the fall of the Western Empire.
Ideally, lat/long, plus a title. Any description would be a bonus, but a title is enough,and I will research for the description.
Primary interest is Caesar's Rome, secondary is military bases, third is anything notable in the Roman empire, including battle sites, occupied territories, roads, palaces, etc, etc, etc.
As much data as possible please, and I will create an open source project with whatever I get.
I am a programmer who is fascinated by maps. And ancient Rome. And I need a new hobby
I am excited to announce the release of my latest project, the NBA Stats API (version 0.1 Beta). This API provides access to NBA season and playoff player totals, advanced statistics, shot chart data, and more. As an NBA fan and data enthusiast myself, I've always had a passion for finding patterns and trends in sports statistics. This API is my contribution to the community, in hopes that it will fuel your own analysis, be it for fantasy leagues, sports journalism, predictive modeling, or simply out of curiosity.
I've put in many hours of work into this project, ensuring that the data is not only accurate but also easy to access and understand. The API is currently in its Beta version (0.1), and I'm excited to see how it will evolve with your valuable feedback and suggestions. Currently, the advanced statistics is in testing and will be made available very soon.
The complete API documentation is available as a POSTMAN collection at the following link: API Documentation.
I've also hosted all the code behind this project on GitHub under MIT license: NBA Stats GitHub Repository
I am continuously working on improving and expanding the API, and your feedback and suggestions are more than welcome. Feel free to ask any questions, provide suggestions, or even share what you've managed to achieve using the API. I'm looking forward to your creations!
I've created a small website to start visualizing this data. Check out my favorite chart displaying Total Points vs. Win Shares. All data on this site fetches from the API.
Hey Redditors,
I'm Amiya Sur, currently pursuing my dissertation at the University of Leeds. My research is focused on water governance, specifically investigating the impacts of environmental factors on groundwater levels with a view to develop a predictive model.
I'm facing some challenges with data collection and hoping some of you can point me in the right direction. If anyone has information or resources on datasets related to groundwater levels and environmental characteristics, especially from the African region (but I'm open to others too), it would be a great help.
Any insights or pointers would be much appreciated. Thank you!
Cheers,
Amiya Sur