Guided Tour of the Data-gov Wiki

From Data-gov Wiki

Contents 1 Overview 2 Linked Government Data 2.1 data.gov datasets 2.2 non-data.gov data 3 Simple Demos (for beginners) 3.1 Demo: State Library Agency Survey: Fiscal Year 2006 3.2 Demo: Agencies' Dataset Contribution on Data.gov 3.3 Demo: U.S. Residential Energy Consumption by Appliance Type, 2005 3.4 Demo: World Eathquake Map (Interactive Browser) 3.5 Demo: World Eathquake Map (Yahoo Pipes) 4 Linked Data Demos (for linked data) 4.1 Demo: Agency Budget Summary 4.2 Demo: Clean Air Status and Trends Network (CASTNET) 4.3 Demo: Linking USPS Money and News 4.4 Demo: Agency Budget and New York Times News 4.5 Demo: Tracking Changes of data.gov Catalog via RSS

Overview

The Data-gov Wiki is a project where we investigate the role of semantic web technologies, esp. linked data, in producing, processing and utilizing government data found in data.gov. Below are some objectives of this project:

• to enrich the value of government data by converting them into linked data
• to show web users the value of linked government data through applications and visualizations
• to educate web developers building applications using low-hanging semantic technologies and web technologies

Linked Government Data

We collect government datasets from the data.gov and some other sources. The goal is to get them linked and thus lead to better value.

data.gov datasets

Data.gov hosts 4164 Datasets contributed by 41 US government agencies, including 3298 Raw Data Catalog and 866 Tool Catalog

• There are currently 357 translated RDF datasets
  • contributing 5717531665 triples.
  • contributing 20430 properties.
  • contributing 398282190 instances

non-data.gov data

Beyond the datasets published at data.gov, we also found and converted 36 more government related datasets. See Dataset Catalog.

There are also 23 data sources, some of which provide SPARQL query endpoints. see Data Source Catalog

	Foaf:name	Dgtwc:sparql endpoint
UK government data	UK government data	http://services.data.gov.uk/transport/sparql http://services.data.gov.uk/education/sparql http://services.data.gov.uk/sparql
Uscencus2000	Uscencus2000	http://www.rdfabout.com/sparql

Simple Demos (for beginners)

notes

• All source code are included and replicable. see http://code.google.com/p/data-gov-wiki/source/browse/#svn/trunk/www/demo
• All services used in the demos are publicly accessible.
• Most demos, expect one, are using online file as SPARQL dataset and specifying FROM clause in SPARQL query
• There are many more demos using different types of charts from Google Visualization API

Demo: State Library Agency Survey: Fiscal Year 2006
	Description: This demo displays the number of library books per capita by state. Live Demo(s): [1] Dataset(s): Dataset 353 Technology Used: RDF,SPARQL,SparqlProxy,Google Visualization API Creator(s):

• It also shows how to use SparqlProxy execute SPARQL query on the converted government data and convert the results in appropriate format.
• It also shows how to use Google Visualization API (intensity map) to draw a map view of the SPARQL results.

Demo: Agencies' Dataset Contribution on Data.gov
	Description: This demo shows the number of Data.gov datasets contributed by each government agency Live Demo(s): [2] Dataset(s): Dataset 92 Technology Used: RDF,SPARQL,SparqlProxy,Google Visualization Table,Google Visualization Bar Chart,Google Visualization Column Chart,Google Visualization Line Chart,Google Visualization Pie Chart,Tech: RDF-Google Visualization Creator(s):

• this demo minimizes the coding efforts with configurable visualization web service ( its configuration file is in JSON). The service supports users to browse the same data, a list of pairs (name, integer value), using different views from Google Visualization API, such as table, bar chart, column chart, line chart, and pie chart.

Demo: U.S. Residential Energy Consumption by Appliance Type, 2005
	Description: Bar graph of electric energy consumption by appliance, USA 2005 Live Demo(s): [3] Dataset(s): Dataset 59 Technology Used: RDF,SPARQL,SparqlProxy,Google Visualization API,TDB Triple Store Creator(s):

• this demo uses a sparql endpoint (TDB Triple Store) as SPARQL dataset, the FROM clause is skipped in SPARQL query

Demo: World Eathquake Map (Interactive Browser)

Description: This demo displays a world map listing recent earthquakes (in the past week) with a magnitude of 3.0 or greater on the Richter scale and a depth 50 kilometers or less. Clicking on a location shows additional earthquake details. Clicking on a property facet to show only relevant earthquakes. Live Demo(s): [4] Dataset(s): Dataset 34 Technology Used: RDF,SPARQL,SparqlProxy,Simile Exhibit Creator(s):

• this demo uses MIT Exhibit for visualization, and it can take either raw data (in RDF) or SPARQL query results (in Exhibit JSON) as input data

Demo: World Eathquake Map (Yahoo Pipes)
	Description: This demo shows a map of the world depicting the locations of all earthquakes of magnitude greater than 3.0, dph of less than 50 miles, over the previous seven days. Clicking on a location shows additional details. Live Demo(s): [5] Dataset(s): Dataset 34 Technology Used: Yahoo! Pipes,SparqlProxy Creator(s):

• this demo uses Yahoo! Pipes for visualization, and it takes SPARQL query results (in CSV) as input data

Linked Data Demos (for linked data)

Demo: Agency Budget Summary
	Description: Timeline for an agency's aggregated budget from 1976 to 2014. At most three sources will be plotted, and the data.gov catalog was linked to get the title of sources. Live Demo(s): [6] Dataset(s): Dataset 401,Dataset 402,Dataset 403,Dataset 92 Technology Used: RDF,SPARQL,SparqlProxy,Google Visualization API Creator(s):

• We linked Dataset 401, Dataset 402 and Dataset 403 by reusing property namespace (e.g. http://data-gov.tw.rpi.edu/vocab/p/401/bureau_name)
• we linked Budget datasets (Dataset 401, Dataset 402 and Dataset 403) and data.gov catalog (Dataset 92) by sharing the same identifier (i.e. URL of the raw CSV data).

Demo: Clean Air Status and Trends Network (CASTNET)
[[|link=Demo: Clean Air Status and Trends Network (CASTNET)|150px|150px]]	Description: Live Demo(s): Dataset(s): Technology Used: Creator(s):

• we linked Dataset 8 and Dataset 9 by reusing property namespace (e.g. http://data-gov.tw.rpi.edu/vocab/p/8/num1976)
• we linked datasets from Data.gov (Dataset 8 and Dataset 9) and dataset from epa.gov (Dataset 10001) by sharing the same identifier (i.e. site id).
• Its data visualization uses both MIT Exhibit (faceted browsing for map of sensors) and Google Visualization API (annotated timeline for sensor readings)

Demo: Linking USPS Money and News

Description: This demo shows the US Postal Service's financial history by: (i) plotting net income (income - expenses), budget authority (money allocated by Congress) and outlays (actual expenses) on a timeline (ranging from 1976 to 2008), and (ii) annotating the timeline with historical events, dynamically loaded from an RSS feed of articles on this wiki. Live Demo(s): [7] Dataset(s): Dataset 401,Dataset 402,Dataset 10006,Dataset 10024 Technology Used: RDF,SPARQL,SparqlProxy,Google Visualization API,JavaScript,RSS,Semantic MediaWiki Creator(s):

• We linked Dataset 401 and Dataset 402 by reusing property namespace (e.g. http://data-gov.tw.rpi.edu/vocab/p/401/bureau_name)
• We linked data.gov data (Dataset 401 and Dataset 402) with USPS.com income/spending data (Dataset 10006) as well as USPS news data (Dataset 10024, RSS feed) by time (fiscal year)
• The USPS News (RSS feed) is writable by Wiki users. A user can add news items and the changes will be immediately reflected in the annotated timeline after refresh. The source of user contributed News are also preserved and visible in the demo.

Demo: Agency Budget and New York Times News
	Description: Annotated timeline of agency's budget and New York Time news related to it, 1976-2008 Live Demo(s): [8] Dataset(s): Dataset 401,New York Times News API Technology Used: RDF,SPARQL,SparqlProxy,Google Visualization API,New York Times News API,Google Visualization Annotated Timeline Creator(s):

• We linked government dataset Dataset 401 (Public Budget Database - Budget Authority and offsetting receipts 1976-Current, Executive Office of the President) with New York Times News (by querying New York Times News API).

Demo: Tracking Changes of data.gov Catalog via RSS
	Description: RSS feeds for recently updated datasets on data.gov Live Demo(s): [9] Dataset(s): Dataset 92 Technology Used: RDF,SPARQL,SparqlProxy,SW4J diff Creator(s):

• We linked different versions of Dataset 92 (Executive Office of the President), which changes one weekly base, and publishes changes via RSS and Twitter.