Here are a few selected starting points for data analysis..
National Center for Education Statistics (NCES) http://nces.ed.gov/
National Center for Health Statistics http://www.cdc.gov/nchs/
Open Data Inventory (ODIN) http://odin.opendatawatch.com/
Open Data Network http://www.opendatanetwork.com/
Orange - Open Source Data Visualization and Analysis for Novice and Experts http://orange.biolab.si/
Statisphere http://www.statisphere.govt.nz/
Truthy - Information Diffusion Research http://truthy.indiana.edu/
United Kingdom National Accounts, The Blue Book, 2014 Edition http://www.ons.gov.uk/ons/rel/naa1-rd/united-kingdom-national-accounts/the-blue-book-2014-edition/index.html
The DBpedia Data Set (3.9) http://wiki.dbpedia.org/Datasets
United States Census Bureau http://www.census.gov/
Statisphere http://www.statisphere.govt.nz/
Statistics Canada http://www.statcan.gc.ca/start-debut-eng.html
USA.gov - Data and Statistics http://www.usa.gov/Topics/Reference-Shelf/Data.shtml
WisStat - Applied Population Laboratory http://www.getfacts.wisc.edu/
World dataBank - World Development Indicators (WDI) and Global Development Finance (GDF) http://databank.worldbank.org/data/
The World Bank - Data http://data.worldbank.org/
Techniques
Weka 3: Data Mining Software in Java http://www.cs.waikato.ac.nz/~ml/weka/
Random.org - True Random Number Service http://random.org/
credit: http://www.zillman.us/subject-tracers/statistics-resources-and-big-data/
