Stack Exchange
log in sign up chat discuss faq users badges

Area 51 » Technology

definition commitment beta
275
followers
Share This

Open Data

Beta Q&A site for developers and researchers interested in open data.

12
votes
2
answers

Relationship of Open Science to Open Data?

feb 9 '15 at 1:20 Community♦ 1
2
votes
1
answer

What sort of license will be most suitable for my open data covering [domain]?

may 29 '13 at 22:33 Community♦ 1

discuss this proposal

This proposal is now in the Beta phase — example questions are locked!

61 Example Questions

active newest votes
up vote 26 down vote
Is there a list of all US Government agencies and sub agencies and is it available via API?
added by Dmitry Kachaev Feb 22 '13 at 17:51
link
<comments removed> @Gray B. Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:14
Remember that votes above 10 do not help a proposal to complete its definition phase, so many people consider every vote over 10 to be a wasted vote. It is far more useful to use your vote to approve of a question with fewer than 10 votes. Also, if a question you have already voted on now has more than 10 votes, remember that you can remove your up vote and put it on another suitable question, to help a proposal get through the definition phase more quickly. – Mark Booth Apr 5 '13 at 23:49
up vote 24 down vote
Is there API to get list of all publicly available datasets through data.gov and metadata for them based on keywords?
added by Dmitry Kachaev Feb 22 '13 at 17:30
link
<comments removed> Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:15
up vote 23 down vote
I’m liberating data for my city, what protocol/standard/API should I implement to make my data catalog automatically harvested into data.gov?
added by Dmitry Kachaev Feb 22 '13 at 18:06
link
<comments removed> @GovInTranches Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:15
up vote 15 down vote
Is there a complete list of all US federally registered nonprofits?
added by rjmajma Feb 22 '13 at 18:47
link
up vote 15 down vote
What is the best source for by-precinct elections data?
added by Jay Guarneri Feb 27 '13 at 16:25
link
up vote 15 down vote
Is there a list of all schools within the United States?
added by Marina Martin Mar 3 '13 at 2:37
link
<comments removed> Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:17
up vote 14 down vote
I’m building a tool to automatically discover and download tabular data from data.gov and load it into MySQL database. How I should approach it?
added by Dmitry Kachaev Feb 22 '13 at 17:35
link
up vote 13 down vote
What are the differences for the local crime reporting data standards for city data on Cities.data.gov?
added by rjmajma Feb 22 '13 at 18:36
link
up vote 13 down vote
Where can I find out what nonprofits lost their tax-exempt status?
added by rjmajma Feb 27 '13 at 15:14
link
<comments removed> @jfenton Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:17
up vote 13 down vote
What is a best-practice for publishing updated resources on Open Data portals like CKAN? Should I just add new resources, or overwrite past versions?
added by nicksuch Feb 27 '13 at 20:40
link
up vote 13 down vote
I have a lot of data in scanned PDF files. What procedures should I take to preserve accuracy when I convert them into more usable formats?
added by Andy Shu Xin Mar 20 '13 at 9:33
link
This may not be the best wording, but this is a really common and important question. Perhaps better: "How do I extract structured data from a PDF?" – Jonathan Stray Apr 3 '13 at 14:40
@Jonathan Stray Thank you for the suggestion. Your version is more succinct and general. – Andy Shu Xin Apr 5 '13 at 10:16
Or even, "How do I get data out of a PDF and make it structured?" – OmahaJoe Apr 8 '13 at 18:49
up vote 12 down vote
Is there a complete list of hospitals and clinics across the country?
added by Ryan Panchadsaram Feb 22 '13 at 17:38
link
Your question will be better if you specify which country – THelper Feb 27 '13 at 8:25
<comments removed> @Jason Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:16
up vote 12 down vote
How do I approach a federal agency when I have an idea for a data set that should be released?
added by user1839486 Mar 12 '13 at 16:23
link
up vote 12 down vote
What are you favorite examples of productivity gains that have resulted from an API produced by the US federal government?
added by Gray B. Mar 13 '13 at 21:17
link
NCBI count?.. GenBank, etc.? Or I dont understand anything here :-( ? – qPCR4vir Mar 20 '13 at 21:20
up vote 11 down vote
What agencies contribute/what products are covered in the Recalls API?
added by rjmajma Feb 22 '13 at 17:58
link
up vote 11 down vote
Where can I find tabular historical data on appropriations amounts in similar granularity to OMB's public budget database?
added by nihonjinrxs Feb 24 '13 at 5:40
link
up vote 11 down vote
Is there a portable data format (xml, csv, etc) that currently exists to display state code (or laws)?
added by chrisjlee Mar 14 '13 at 18:58
link
<comments removed> Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:18
up vote 11 down vote
How can we verify data provided by governments, especially when no one else has comparable resources to replicate the data collection process?
added by Andy Shu Xin Mar 17 '13 at 20:08
link
A reall excellent question. For an example of the often complicated answers, see uscc.gov/Research/… – Jonathan Stray Apr 9 '13 at 21:22
up vote 11 down vote
What's the fastest way to standardize names of people or organizations when cleaning data?
added by Jonathan Stray Apr 3 '13 at 14:41
link
up vote 10 down vote
What tools can I use to download spatial/geo data and plot it on a map? Is there any HOW-TOs with walkthrough for data.gov?
added by Dmitry Kachaev Feb 22 '13 at 18:02
link
3  
Wouldn't such questions be covered by GIS? – TildalWave Mar 5 '13 at 0:52
agreed there is some overlap with GIS, but I believe Open Data would be more the place to cover the MANY format conversion, cleanup, geocoding and other practical problems that arise when trying to use data from diverse sources of varying quality. – Jonathan Stray Apr 9 '13 at 21:18
up vote 10 down vote
Can I use weather data for a commercial disaster preparedness app?
added by rjmajma Feb 22 '13 at 18:04
link
2  
Are you asking about feasibility or legality? Either way you should be more specific about which weather data you're referring to. – dvogel Mar 15 '13 at 17:36
up vote 10 down vote
Is OBD-II data available on all U.S. cars and trucks?
added by Ian Kalin Feb 22 '13 at 22:52
link
up vote 10 down vote
Do Green Button downloads include just kWh or does it include pricing and gas consumption?
added by Ian Kalin Feb 24 '13 at 15:49
link
up vote 10 down vote
Is there an easy way to transform raw data into a structured format that can be queried online without loading it into a database?
added by FlatMerge Feb 27 '13 at 23:04
link
1  
Can you be a bit more specific? Do you mean, turning a spreadsheet into an API without having to download database software? Or is it something more like Socrata? – Konklone Mar 13 '13 at 14:39
Agreed not a precise question, but IMHO this is exactly the sort of problem that this forum should help solve. – Jonathan Stray Apr 9 '13 at 21:23
up vote 10 down vote
Why does the US Department of Education's school universe data only list one LEA for Hawaii?
added by Marina Martin Mar 3 '13 at 2:36
link
up vote 10 down vote
Has anyone found a way to produce and maintain a restful API entirely through GitHub?
added by Gray B. Mar 4 '13 at 22:57
link
1  
This question could be moved to the GitHub Q&A site: area51.stackexchange.com/proposals/43637/github – hadinbe Mar 8 '13 at 17:53
up vote 10 down vote
What are examples of companies that are using open health data to help individuals manage their health?
added by user1839486 Mar 12 '13 at 15:31
link
The list could be long, and there is no right answer. I would rather ask "how" companies can use open health data to help individuals manage their health. That's more open-ended, and answers will describe the processes, tools, and policies that these company do or could use or implement. – Nicolas Apr 9 '13 at 22:19
up vote 10 down vote
What government APIs would best support job creation in the United States?
added by Gray B. Mar 13 '13 at 21:12
link
up vote 10 down vote
Are there free services available to geocode address location data?
added by Jason Hoekstra Mar 14 '13 at 15:41
link
This should be about open data. Services often hide the full dataset. I think the question should be "What data is available for getting the location of an address?" – Nicolas Apr 9 '13 at 22:22
up vote 10 down vote
How can I obtain a listing of prior Freedom of Information Act (FOIA) requests made to a US federal agency?
added by Jason Hoekstra Mar 14 '13 at 15:50
link
<comments removed> Please do not use comments to answer these questions. This proposal is not part of a Q&A site, and the task at hand is to help define what is on and off topic for a site. Comments are here to help improve the questions; not to answer them. See What is the rationale for deleting answers? Thank you. – Robert Cartaino Apr 1 '13 at 19:19
up vote 10 down vote
Where can I find a listing of proposed legislation from US Congress?
added by Jason Hoekstra Mar 14 '13 at 15:54
link
up vote 10 down vote
Is U.S. Government data the only type of data that qualifies as "open data"?
added by Tom Morris Mar 14 '13 at 18:23
link
Non-US questions are entirely welcome. – Konklone Mar 14 '13 at 21:04
Most people we reached out to are US based, so that's why questions are skewed towards US .gov data. Everyone else are welcome to join since it definitely will make a stronger open data community. – Dmitry Kachaev Mar 15 '13 at 5:31
I upvoted this for the idea behind...I think the question per se is not very answerable. Perhaps instead one could ask "In what way can US Government data assist research in [some international/non-US field of study] (or vice versa) ?". – Andy Shu Xin Apr 5 '13 at 19:14
Agreed this should be a forum for international questions about Open Data. – Jonathan Stray Apr 6 '13 at 16:46
up vote 10 down vote
Where can I open geographical data about [France]?
added by Alexis Dufrenoy Mar 15 '13 at 14:09
link
1  
As almost every question here seem to be about the US, I think it's necessary to make sure other countries are not out of the scope. – Alexis Dufrenoy Mar 15 '13 at 14:10
It's pretty clear from the questions and comments that this is entirely U.S. centric. – Tom Morris Apr 6 '13 at 4:31
I don't think so. It's actually the opposite, since each question about the U.S. is clearly stated that way. It's never implicit. – Alexis Dufrenoy Apr 6 '13 at 9:32
1  
I believe this form should be about open data questions internationally. It's a got topic in almost every country. – Jonathan Stray Apr 6 '13 at 16:47
up vote 10 down vote
Are data from organizations like the UN or World Bank more credible than those from governments?
added by Andy Shu Xin Mar 20 '13 at 9:28
link
up vote 10 down vote
Aside from the concept of data being available in open/accessible formats, any best practices for Documentation to go along with the data?
added by Mary Maher Mar 21 '13 at 20:50
link
A lot of these questions come up under discussions of 'data re-use' aka 'data repurposing' (although that suggests documenting well enough for it to be used for purposes other than why it was collected), peer-reviewing of data (discussed as 'data publication'), data citation (sufficient documentation to give attribution), data provenance (covers a really broad field), data curation (adding value to data, in part by documenting), etc. The problem is, it varies by the type of data; I've tried for solar data in FITS & event catalogs ( see bottom of docs.virtualsolar.org/wiki/Citation ) – Joe Mar 29 '13 at 14:37
up vote 10 down vote
as a local public health official, what data are available to help me understand my community's biggest problems?
added by LAB Mar 21 '13 at 22:51
link
up vote 10 down vote
I want to look at new businesses est in a given geo area. Does anyone know if there is a standard across states for this info and/or best sources?
added by batpigandme Mar 25 '13 at 18:57
link
up vote 10 down vote
Where can I find a free data set matching zip codes to congressional districts for the 113th congress?
added by Yahel Apr 3 '13 at 13:56
link
up vote 10 down vote
What individual income or tax return data is available in the U.S.?
added by Jonathan Stray Apr 3 '13 at 14:29
link
up vote 10 down vote
What are the most effective ways to guide novice data users to form statistically sound data questions to avoid misleading results, junk charts, etc.?
added by tekhne Apr 6 '13 at 17:58
link
1 2 next

This site is in

Public Beta

Anyone can participate!

Sites remain in beta for at least 90 days to build up a critical mass of users, questions, and participation.

proposed by

Dmitry Kachaev
5,174●1●17●43

8 years ago

edited by

Robert Cartaino ♦ 3
227k●68●638●1445

8 years ago

viewed

19,495 times

latest activity

7 years ago

followers

users also following

5.8% Freelancing
4.4% Earth Science
4.4% Puzzling
4.0% Reverse Engineering
46.2% only this proposal

followers active in

48.0% Stack Overflow
14.9% Open Data
13.8% Super User
12.4% Meta Stack Exchange
11.3% English Language...
10.9% Software Engineering

recent followers

added May 21 '13 at 14:57
cyroxx
3,653●3●17●36
added May 21 '13 at 8:42
windyjonas
2,984●18●31
added May 21 '13 at 6:54
FDSg
2,257●2●25●34
added May 20 '13 at 19:54
Clever Idea Widgetry
1,344●1●9●34
added May 20 '13 at 19:26
Bani
2,384●5●19●41
added May 19 '13 at 20:08
Kevin Ford
3,427●6●23●76
added May 19 '13 at 2:14
Jeromy Anglim ♦ 1
136k●81●501●954
added May 19 '13 at 0:09
user87470
51●1
added May 18 '13 at 21:31
Johan B
1,033●3●24●37
added May 17 '13 at 14:36
Rebecca Williams
51●2
added May 17 '13 at 13:08
Tomislav Muic
4,046●2●39●78
added May 16 '13 at 12:43
Imran Ghory
51●1
added May 16 '13 at 8:14
SF.
177k●87●695●1577
added May 15 '13 at 18:12
asif.m
2,520●7●30●59
added May 15 '13 at 13:50
user87283
51●1
added May 15 '13 at 9:04
user87250
51●1
added May 14 '13 at 20:48
Greg Elin
1,381●9●7
added May 13 '13 at 15:15
Phantom
51●1
added May 13 '13 at 12:53
Douglas S. Stones
40.2k●17●174●362
added May 12 '13 at 12:16
Popopo
6,372●4●45●155
added May 12 '13 at 9:51
mkrnr
903●6●19
added May 11 '13 at 21:11
slowdown
161●4
added May 11 '13 at 17:36
Sazzadur Rahaman
6,501●1●26●48
added May 11 '13 at 13:13
Macbre
51●1
added May 11 '13 at 11:16
Shaun McDonald
6,460●2●23●31
added May 11 '13 at 0:30
user86549
51●1
added May 10 '13 at 22:42
user86547
51●1
added May 10 '13 at 22:08
user86546
51●1
added May 10 '13 at 20:16
user86543
51●1
added May 10 '13 at 20:00
Sam Lee
51●1
added May 10 '13 at 15:59
yibe
5,299●6●35●39
added May 10 '13 at 13:03
RobinGower
949●5●11
added May 10 '13 at 10:42
Haaakon
17.4k●18●105●245
added May 10 '13 at 6:48
Bogdanovist
18.8k●10●109●214
added May 10 '13 at 6:09
NullPoiиteя
64.2k●27●154●257
added May 9 '13 at 20:14
user86489
51●1
added May 9 '13 at 18:25
user86483
51●1
added May 9 '13 at 18:21
tekhne
101●3
added May 9 '13 at 16:25
user86480
51●1
added May 9 '13 at 15:25
user86478
51●1
feed icon proposal feed
faq | blog | legal | privacy policy | contact us | feedback always welcome
site design / logo © 2021 Stack Exchange Inc; user contributions licensed under cc by-sa; see the licensing help page for more information.
rev 2021.3.15.578