Add files via upload

Adding notebook to census branch.

Add files via upload
Adding notebook to census branch.
f4d78549 · wiltand1 · Colbry, Dirk · 486b16c3 · f4d78549
Commit f4d78549 authored 3 years ago by wiltand1 Committed by Colbry, Dirk 2 years ago
--- a/censusdata tutorail.ipynb
+++ b/censusdata tutorail.ipynb
+{
+ "cells": [
+  {
+   "cell_type": "markdown",
+   "id": "78ccb82d",
+   "metadata": {},
+   "source": [
+    "# Censusdata tutorial\n",
+    "\n",
+    "Useful link:\n",
+    "\n",
+    "https://jtleider.github.io/censusdata/example1.html\n",
+    "\n",
+    "https://jtleider.github.io/censusdata/api.html\n",
+    "\n",
+    "https://jtleider.github.io/censusdata/example3.html"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "dc5fcca9",
+   "metadata": {},
+   "source": [
+    "### Install censusdata library"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "54211a3c",
+   "metadata": {
+    "scrolled": true
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Collecting censusdata\n",
+      "  Downloading CensusData-1.15.tar.gz (26.6 MB)\n",
+      "\u001b[K     |████████████████████████████████| 26.6 MB 5.5 MB/s eta 0:00:01\n",
+      "\u001b[?25hRequirement already satisfied: pandas in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from censusdata) (1.3.4)\n",
+      "Requirement already satisfied: requests in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from censusdata) (2.27.1)\n",
+      "Requirement already satisfied: python-dateutil>=2.7.3 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from pandas->censusdata) (2.8.2)\n",
+      "Requirement already satisfied: pytz>=2017.3 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from pandas->censusdata) (2021.3)\n",
+      "Requirement already satisfied: numpy>=1.17.3 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from pandas->censusdata) (1.20.3)\n",
+      "Requirement already satisfied: six>=1.5 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from python-dateutil>=2.7.3->pandas->censusdata) (1.16.0)\n",
+      "Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (1.26.7)\n",
+      "Requirement already satisfied: idna<4,>=2.5 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (3.2)\n",
+      "Requirement already satisfied: charset-normalizer~=2.0.0 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (2.0.4)\n",
+      "Requirement already satisfied: certifi>=2017.4.17 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (2021.10.8)\n",
+      "Building wheels for collected packages: censusdata\n",
+      "  Building wheel for censusdata (setup.py) ... \u001b[?25ldone\n",
+      "\u001b[?25h  Created wheel for censusdata: filename=CensusData-1.15-py3-none-any.whl size=28205534 sha256=67f5d3391f90bc0e7dba31614e537f4acd16155c871442aeb1cd9a322a4f3f14\n",
+      "  Stored in directory: /Users/liruohong/Library/Caches/pip/wheels/f7/28/2d/3308dceb3ca282b1479585690170f0a00821d9b36cbf835159\n",
+      "Successfully built censusdata\n",
+      "Installing collected packages: censusdata\n",
+      "Successfully installed censusdata-1.15\n",
+      "Note: you may need to restart the kernel to use updated packages.\n"
+     ]
+    }
+   ],
+   "source": [
+    "pip install censusdata"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "e7581483",
+   "metadata": {},
+   "source": [
+    "### Import libararys\n",
+    "Import censusdata libararys\n",
+    "\n",
+    "Import pandas libarary for data processing"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 2,
+   "id": "dbda6a76",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "import pandas as pd\n",
+    "import censusdata"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "569bec68",
+   "metadata": {},
+   "source": [
+    "### Method of censusdata library\n",
+    "censusdata.search(src, year,field, criterion,tabletype): search for given text patterns\n",
+    "\n",
+    "censusdata.censustable():identified table of interest\n",
+    "\n",
+    "censusdata.printtable():show all variables included in the identified table of interest\n",
+    "\n",
+    "censusdata.geographies():\n",
+    "\n",
+    "censusdata.download():download the selected data"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 6,
+   "id": "5b7a5a3e",
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/plain": [
+       "[('B23024_023E',\n",
+       "  'POVERTY STATUS IN THE PAST 12 MONTHS BY DISABILITY STATUS BY EMPLOYMENT STATUS FOR THE POPULATION 20 TO 64 YEARS',\n",
+       "  'Estimate!!Total!!Income in the past 12 months at or above poverty level!!With a disability!!In labor force!!Civilian!!Unemployed'),\n",
+       " ('B23024_030E',\n",
+       "  'POVERTY STATUS IN THE PAST 12 MONTHS BY DISABILITY STATUS BY EMPLOYMENT STATUS FOR THE POPULATION 20 TO 64 YEARS',\n",
+       "  'Estimate!!Total!!Income in the past 12 months at or above poverty level!!No disability!!In labor force!!Civilian!!Unemployed'),\n",
+       " ('B23025_005E',\n",
+       "  'EMPLOYMENT STATUS FOR THE POPULATION 16 YEARS AND OVER',\n",
+       "  'Estimate!!Total!!In labor force!!Civilian labor force!!Unemployed'),\n",
+       " ('B27011_014E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed'),\n",
+       " ('B27011_015E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years'),\n",
+       " ('B27011_016E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!With health insurance coverage'),\n",
+       " ('B27011_017E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!With health insurance coverage!!With private health insurance'),\n",
+       " ('B27011_018E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!With health insurance coverage!!With public coverage'),\n",
+       " ('B27011_019E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!No health insurance coverage'),\n",
+       " ('B27011_020E',\n",
+       "  'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',\n",
+       "  'Estimate!!Total!!In labor force!!Unemployed!!65 years and over')]"
+      ]
+     },
+     "execution_count": 6,
+     "metadata": {},
+     "output_type": "execute_result"
+    }
+   ],
+   "source": [
+    "censusdata.search('acs5', 2015, 'label', 'unemploy')[80:90]"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 4,
+   "id": "40cbfb96",
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Variable     | Table                          | Label                                                    | Type \n",
+      "-------------------------------------------------------------------------------------------------------------------\n",
+      "B23025_001E  | EMPLOYMENT STATUS FOR THE POPU | !! Estimate Total                                        | int  \n",
+      "B23025_002E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total In labor force                      | int  \n",
+      "B23025_003E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Civilian labor fo | int  \n",
+      "B23025_004E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int  \n",
+      "B23025_005E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int  \n",
+      "B23025_006E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Armed Forces      | int  \n",
+      "B23025_007E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total Not in labor force                  | int  \n",
+      "-------------------------------------------------------------------------------------------------------------------\n"
+     ]
+    }
+   ],
+   "source": [
+    "censusdata.printtable(censusdata.censustable('acs5', 2015, 'B23025'))"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 5,
+   "id": "2bf2bc44",
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Variable     | Table                          | Label                                                    | Type \n",
+      "-------------------------------------------------------------------------------------------------------------------\n",
+      "B23025_001E  | EMPLOYMENT STATUS FOR THE POPU | !! Estimate Total                                        | int  \n",
+      "B23025_002E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total In labor force                      | int  \n",
+      "B23025_003E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Civilian labor fo | int  \n",
+      "B23025_004E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int  \n",
+      "B23025_005E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int  \n",
+      "B23025_006E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Armed Forces      | int  \n",
+      "B23025_007E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total Not in labor force                  | int  \n",
+      "-------------------------------------------------------------------------------------------------------------------\n"
+     ]
+    }
+   ],
+   "source": [
+    "censusdata.printtable(censusdata.censustable('acs5', 2015, 'B23025'))"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "1a3e0003",
+   "metadata": {},
+   "source": [
+    "### Class for representing Census geographies: censusdata.censusgeo(geo,name)\n",
+    "\n",
+    "censusdata.censusgeo.hierarchy():Geography hierarchy for the geographic level of this object\n",
+    "\n",
+    "censusdata.censusgeo.params():Geographic parameters of this object.\n",
+    "\n",
+    "censusdata.censusgeo.request():Generate geographic parameters for Census API request.\n",
+    "\n",
+    "censusdata.censusgeo.sumlevel():Summary level code for the geographic level of this object."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 14,
+   "id": "4572b9e7",
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Summary level: 050, state:17> county:031\n",
+      "(('state', '17'), ('county', '031'))\n",
+      "{'for': 'county:031', 'in': 'state:17'}\n",
+      "050\n"
+     ]
+    }
+   ],
+   "source": [
+    "geo = censusdata.censusgeo([('state', '17'), ('county', '031')])\n",
+    "print(geo)\n",
+    "print(geo.params())\n",
+    "print(geo.request())\n",
+    "print(geo.sumlevel())"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "e8d800b3",
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "ec541cba",
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "Python 3 (ipykernel)",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.9.7"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}
+%% Cell type:markdown id:78ccb82d tags:
+
+# Censusdata tutorial
+
+Useful link:
+
+https://jtleider.github.io/censusdata/example1.html
+
+https://jtleider.github.io/censusdata/api.html
+
+https://jtleider.github.io/censusdata/example3.html
+
+%% Cell type:markdown id:dc5fcca9 tags:
+
+### Install censusdata library
+
+%% Cell type:code id:54211a3c tags:
+
+``` python
+pip install censusdata
+```
+
+%% Output
+
+    Collecting censusdata
+      Downloading CensusData-1.15.tar.gz (26.6 MB)
+    [K     |████████████████████████████████| 26.6 MB 5.5 MB/s eta 0:00:01
+    [?25hRequirement already satisfied: pandas in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from censusdata) (1.3.4)
+    Requirement already satisfied: requests in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from censusdata) (2.27.1)
+    Requirement already satisfied: python-dateutil>=2.7.3 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from pandas->censusdata) (2.8.2)
+    Requirement already satisfied: pytz>=2017.3 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from pandas->censusdata) (2021.3)
+    Requirement already satisfied: numpy>=1.17.3 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from pandas->censusdata) (1.20.3)
+    Requirement already satisfied: six>=1.5 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from python-dateutil>=2.7.3->pandas->censusdata) (1.16.0)
+    Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (1.26.7)
+    Requirement already satisfied: idna<4,>=2.5 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (3.2)
+    Requirement already satisfied: charset-normalizer~=2.0.0 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (2.0.4)
+    Requirement already satisfied: certifi>=2017.4.17 in /Users/liruohong/opt/anaconda3/lib/python3.9/site-packages (from requests->censusdata) (2021.10.8)
+    Building wheels for collected packages: censusdata
+      Building wheel for censusdata (setup.py) ... [?25ldone
+    [?25h  Created wheel for censusdata: filename=CensusData-1.15-py3-none-any.whl size=28205534 sha256=67f5d3391f90bc0e7dba31614e537f4acd16155c871442aeb1cd9a322a4f3f14
+      Stored in directory: /Users/liruohong/Library/Caches/pip/wheels/f7/28/2d/3308dceb3ca282b1479585690170f0a00821d9b36cbf835159
+    Successfully built censusdata
+    Installing collected packages: censusdata
+    Successfully installed censusdata-1.15
+    Note: you may need to restart the kernel to use updated packages.
+
+%% Cell type:markdown id:e7581483 tags:
+
+### Import libararys
+Import censusdata libararys
+
+Import pandas libarary for data processing
+
+%% Cell type:code id:dbda6a76 tags:
+
+``` python
+import pandas as pd
+import censusdata
+```
+
+%% Cell type:markdown id:569bec68 tags:
+
+### Method of censusdata library
+censusdata.search(src, year,field, criterion,tabletype): search for given text patterns
+
+censusdata.censustable():identified table of interest
+
+censusdata.printtable():show all variables included in the identified table of interest
+
+censusdata.geographies():
+
+censusdata.download():download the selected data
+
+%% Cell type:code id:5b7a5a3e tags:
+
+``` python
+censusdata.search('acs5', 2015, 'label', 'unemploy')[80:90]
+```
+
+%% Output
+
+    [('B23024_023E',
+      'POVERTY STATUS IN THE PAST 12 MONTHS BY DISABILITY STATUS BY EMPLOYMENT STATUS FOR THE POPULATION 20 TO 64 YEARS',
+      'Estimate!!Total!!Income in the past 12 months at or above poverty level!!With a disability!!In labor force!!Civilian!!Unemployed'),
+     ('B23024_030E',
+      'POVERTY STATUS IN THE PAST 12 MONTHS BY DISABILITY STATUS BY EMPLOYMENT STATUS FOR THE POPULATION 20 TO 64 YEARS',
+      'Estimate!!Total!!Income in the past 12 months at or above poverty level!!No disability!!In labor force!!Civilian!!Unemployed'),
+     ('B23025_005E',
+      'EMPLOYMENT STATUS FOR THE POPULATION 16 YEARS AND OVER',
+      'Estimate!!Total!!In labor force!!Civilian labor force!!Unemployed'),
+     ('B27011_014E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed'),
+     ('B27011_015E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years'),
+     ('B27011_016E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!With health insurance coverage'),
+     ('B27011_017E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!With health insurance coverage!!With private health insurance'),
+     ('B27011_018E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!With health insurance coverage!!With public coverage'),
+     ('B27011_019E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed!!18 to 64 years!!No health insurance coverage'),
+     ('B27011_020E',
+      'HEALTH INSURANCE COVERAGE STATUS AND TYPE BY EMPLOYMENT STATUS BY AGE',
+      'Estimate!!Total!!In labor force!!Unemployed!!65 years and over')]
+
+%% Cell type:code id:40cbfb96 tags:
+
+``` python
+censusdata.printtable(censusdata.censustable('acs5', 2015, 'B23025'))
+```
+
+%% Output
+
+    Variable     | Table                          | Label                                                    | Type
+    -------------------------------------------------------------------------------------------------------------------
+    B23025_001E  | EMPLOYMENT STATUS FOR THE POPU | !! Estimate Total                                        | int
+    B23025_002E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total In labor force                      | int
+    B23025_003E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Civilian labor fo | int
+    B23025_004E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int
+    B23025_005E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int
+    B23025_006E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Armed Forces      | int
+    B23025_007E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total Not in labor force                  | int
+    -------------------------------------------------------------------------------------------------------------------
+
+%% Cell type:code id:2bf2bc44 tags:
+
+``` python
+censusdata.printtable(censusdata.censustable('acs5', 2015, 'B23025'))
+```
+
+%% Output
+
+    Variable     | Table                          | Label                                                    | Type
+    -------------------------------------------------------------------------------------------------------------------
+    B23025_001E  | EMPLOYMENT STATUS FOR THE POPU | !! Estimate Total                                        | int
+    B23025_002E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total In labor force                      | int
+    B23025_003E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Civilian labor fo | int
+    B23025_004E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int
+    B23025_005E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! !! Estimate Total In labor force Civilian labor | int
+    B23025_006E  | EMPLOYMENT STATUS FOR THE POPU | !! !! !! Estimate Total In labor force Armed Forces      | int
+    B23025_007E  | EMPLOYMENT STATUS FOR THE POPU | !! !! Estimate Total Not in labor force                  | int
+    -------------------------------------------------------------------------------------------------------------------
+
+%% Cell type:markdown id:1a3e0003 tags:
+
+### Class for representing Census geographies: censusdata.censusgeo(geo,name)
+
+censusdata.censusgeo.hierarchy():Geography hierarchy for the geographic level of this object
+
+censusdata.censusgeo.params():Geographic parameters of this object.
+
+censusdata.censusgeo.request():Generate geographic parameters for Census API request.
+
+censusdata.censusgeo.sumlevel():Summary level code for the geographic level of this object.
+
+%% Cell type:code id:4572b9e7 tags:
+
+``` python
+geo = censusdata.censusgeo([('state', '17'), ('county', '031')])
+print(geo)
+print(geo.params())
+print(geo.request())
+print(geo.sumlevel())
+```
+
+%% Output
+
+    Summary level: 050, state:17> county:031
+    (('state', '17'), ('county', '031'))
+    {'for': 'county:031', 'in': 'state:17'}
+    050
+
+%% Cell type:code id:e8d800b3 tags:
+
+``` python
+```
+
+%% Cell type:code id:ec541cba tags:
+
+``` python
+```