Merge branch 'ande2472-main-patch-29109' into 'main'

Pandas See merge request CMSE/data_science_bridge_curriculum!2

Merge branch 'ande2472-main-patch-29109' into 'main'
Pandas See merge request CMSE/data_science_bridge_curriculum!2
bd55c587 · Colbry, Dirk · 8b95fb0b · edf45fe2 · bd55c587
Commit bd55c587 authored 2 years ago by Colbry, Dirk
--- a/Pandas.ipynb
+++ b/Pandas.ipynb
+{
+ "cells": [
+  {
+   "cell_type": "code",
+   "execution_count": 32,
+   "id": "fc73d74c",
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/plain": [
+       "('answercheck.py', <http.client.HTTPMessage at 0x7fc9a8612220>)"
+      ]
+     },
+     "execution_count": 32,
+     "metadata": {},
+     "output_type": "execute_result"
+    }
+   ],
+   "source": [
+    "##ANSWER##\n",
+    "#Install answercheck in current director\n",
+    "from urllib.request import urlretrieve\n",
+    "urlretrieve('https://raw.githubusercontent.com/colbrydi/jupytercheck/master/answercheck.py', filename='answercheck.py')\n",
+    "##ANSWER##"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "3c2a4f39",
+   "metadata": {},
+   "source": [
+    "# Pandas\n",
+    "Pandas is a python library used to analyze data."
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "2b78245b",
+   "metadata": {},
+   "source": [
+    "![Giant Panda Bear Eating Apples - Image found on Flickr](https://live.staticflickr.com/3296/2679911705_33e5b2db7d_b.jpg)\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "71e867d9",
+   "metadata": {},
+   "source": [
+    "## Description\n",
+    "Pandas take tabular data and store them in objects known as ‘databases’. They are useful for exploring, cleaning, and processing data\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "58ec20e8",
+   "metadata": {},
+   "source": [
+    "## Self Assessment\n",
+    "\n",
+    "Questions that test for the learning goals and allows students to evaluate if they truly understand the topics."
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "5d237ca9",
+   "metadata": {},
+   "source": [
+    "## Training Materials\n",
+    "\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "21f9b14e",
+   "metadata": {},
+   "source": [
+    "For a general understanding of how to use pandas, along with practice exercises, check out the following website: https://www.w3schools.com/python/pandas/default.asp\n",
+    "\n",
+    "For a complete directory of everything you can do with pandas:\n",
+    "\n",
+    "https://pandas.pydata.org/docs/index.html\n",
+    "\n",
+    "Pandas Cheat Sheet:\n",
+    "\n",
+    "Data Analysis:\n",
+    "\thttps://drive.google.com/file/d/1UHK8wtWbADvHKXFC937IS6MTnlSZC_zB/view \n",
+    "\n",
+    "Wrangling Data:\n",
+    "https://pandas.pydata.org/Pandas_Cheat_Sheet.pdf\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "1b047470",
+   "metadata": {},
+   "source": [
+    "Go to https://people.sc.fsu.edu/~jburkardt/data/csv/csv.html and download the “grades.cvs” file. We will use it to solve the following problems:\n",
+    "\n",
+    "&#9989; **<span style=\"color:red\">Question:</span>**  Create a dataframe variable to store the grades.cvs table.\n",
+    "\n",
+    "\t\n",
+    "\n",
+    "If you need help: https://www.w3schools.com/python/pandas/pandas_csv.asp\n"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "ee42a54e",
+   "metadata": {},
+   "outputs": [
+    {
+     "ename": "NameError",
+     "evalue": "name 'pd' is not defined",
+     "output_type": "error",
+     "traceback": [
+      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
+      "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
+      "Input \u001b[0;32mIn [1]\u001b[0m, in \u001b[0;36m<cell line: 2>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      1\u001b[0m \u001b[38;5;66;03m##ANSWER##\u001b[39;00m\n\u001b[0;32m----> 2\u001b[0m df \u001b[38;5;241m=\u001b[39m \u001b[43mpd\u001b[49m\u001b[38;5;241m.\u001b[39mread_csv(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mgrades.csv\u001b[39m\u001b[38;5;124m'\u001b[39m)\n\u001b[1;32m      3\u001b[0m df\n",
+      "\u001b[0;31mNameError\u001b[0m: name 'pd' is not defined"
+     ]
+    }
+   ],
+   "source": [
+    "##ANSWER##\n",
+    "df = pd.read_csv('grades.csv')\n",
+    "df\n",
+    "##ANSWER##"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "1e046af0",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>**  Remove the 9th row (Andrew Airpump’s data) from the dataframe.\n",
+    "\n",
+    "If you need help, refer to the Wrangling Data cheatsheet: https://pandas.pydata.org/Pandas_Cheat_Sheet.pdf\n"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "180aff55",
+   "metadata": {},
+   "outputs": [
+    {
+     "ename": "NameError",
+     "evalue": "name 'pd' is not defined",
+     "output_type": "error",
+     "traceback": [
+      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
+      "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
+      "Input \u001b[0;32mIn [1]\u001b[0m, in \u001b[0;36m<cell line: 2>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      1\u001b[0m \u001b[38;5;66;03m##ANSWER##\u001b[39;00m\n\u001b[0;32m----> 2\u001b[0m df \u001b[38;5;241m=\u001b[39m \u001b[43mpd\u001b[49m\u001b[38;5;241m.\u001b[39mread_csv(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mgrades.csv\u001b[39m\u001b[38;5;124m'\u001b[39m)\n\u001b[1;32m      3\u001b[0m df\n",
+      "\u001b[0;31mNameError\u001b[0m: name 'pd' is not defined"
+     ]
+    }
+   ],
+   "source": [
+    "##ANSWER##\n",
+    "df_1 = df.drop([8])\n",
+    "df_1\n",
+    "\n",
+    "##ANSWER##"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "43219d26",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>**  Clean up column headers to remove unnecessary quotation marks.\n",
+    "\n",
+    "\n",
+    "If you need help: https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.rename.html\n"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "4c9f8f12",
+   "metadata": {},
+   "outputs": [
+    {
+     "ename": "NameError",
+     "evalue": "name 'pd' is not defined",
+     "output_type": "error",
+     "traceback": [
+      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
+      "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
+      "Input \u001b[0;32mIn [1]\u001b[0m, in \u001b[0;36m<cell line: 2>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      1\u001b[0m \u001b[38;5;66;03m##ANSWER##\u001b[39;00m\n\u001b[0;32m----> 2\u001b[0m df \u001b[38;5;241m=\u001b[39m \u001b[43mpd\u001b[49m\u001b[38;5;241m.\u001b[39mread_csv(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mgrades.csv\u001b[39m\u001b[38;5;124m'\u001b[39m)\n\u001b[1;32m      3\u001b[0m df\n",
+      "\u001b[0;31mNameError\u001b[0m: name 'pd' is not defined"
+     ]
+    }
+   ],
+   "source": [
+    "##ANSWER##\n",
+    "df_2 = df_1.rename(columns=[{'\\\"First name\\\"': 'First name'}])\n",
+    "\tdf_2\n",
+    "\n",
+    "\n",
+    "##ANSWER##"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "f4e4a841",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>** Sort the data by student’s SSN. Store this data in a new dataframe called df_3.\n",
+    "\n",
+    "\n",
+    "If you need help: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.sort_values.html?highlight=sort_values#pandas.DataFrame.sort_values\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "b8c5166c",
+   "metadata": {},
+   "outputs": [
+    {
+     "ename": "NameError",
+     "evalue": "name 'pd' is not defined",
+     "output_type": "error",
+     "traceback": [
+      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
+      "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
+      "Input \u001b[0;32mIn [1]\u001b[0m, in \u001b[0;36m<cell line: 2>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      1\u001b[0m \u001b[38;5;66;03m##ANSWER##\u001b[39;00m\n\u001b[0;32m----> 2\u001b[0m df \u001b[38;5;241m=\u001b[39m \u001b[43mpd\u001b[49m\u001b[38;5;241m.\u001b[39mread_csv(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mgrades.csv\u001b[39m\u001b[38;5;124m'\u001b[39m)\n\u001b[1;32m      3\u001b[0m df\n",
+      "\u001b[0;31mNameError\u001b[0m: name 'pd' is not defined"
+     ]
+    }
+   ],
+   "source": [
+    "##ANSWER##\n",
+    "df_3 = df_2.sortvalues(by='Final')\n",
+    "\tdf_3 \n",
+    "\n",
+    "\n",
+    "\n",
+    "##ANSWER##"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "11a12621",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>** Sort the data by the overall letter grade they received in the class and the grade they received on the final.\n",
+    "\n",
+    "\n",
+    "If you need help: Same as above\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "333f476e",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>**  Create a line graph plotting Test 1 scores against Test 2 scores.\n",
+    "\n",
+    "\n",
+    "\n",
+    "If you need help: https://pandas.pydata.org/docs/user_guide/visualization.html\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "f66f2294",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>**  Perform a correlation test comparing Test 3 and Test 4 scores.\n",
+    "\n",
+    "\n",
+    "If you need help: https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.corr.html\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "dd9c7fa5",
+   "metadata": {},
+   "source": [
+    "&#9989; **<span style=\"color:red\">Question:</span>**  Example answercheck question: What is $x = 2+2$?\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 28,
+   "id": "64684dfd",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "#Put your answer here"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 29,
+   "id": "619a2259",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "##ANSWER##\n",
+    "x = 4\n",
+    "##ANSWER##"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 30,
+   "id": "9cc2b34a",
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "\n",
+      "CheckWarning: passed variable is <class 'int'> and not a numpy.matrix.\n",
+      "    Trying to convert to a array matrix using ```A = np.matrix(A)```.\n",
+      "\n",
+      "\n",
+      "CheckWarning: passed matrix is int64 and not <class 'numpy.float64'>...\n",
+      "    Trying to convert to float using ```A = A.astype(float)```.\n",
+      "\n",
+      "Testing [[4.]]\n",
+      "Answer seems to be correct\n",
+      "\n"
+     ]
+    }
+   ],
+   "source": [
+    "from answercheck import checkanswer\n",
+    "checkanswer.vector(x,'2cab95d1b144d663bad1ce5c51020ae0')"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "44b461a0",
+   "metadata": {},
+   "source": [
+    "---\n",
+    "\n",
+    "Written by <<YOUR NAME HERE>>, Michigan State University  \n",
+    "As part of the Data Science Bridge Project \n",
+    "    \n",
+    "<a rel=\"license\" href=\"http://creativecommons.org/licenses/by-nc/4.0/\"><img alt=\"Creative Commons License\" style=\"border-width:0\" src=\"https://i.creativecommons.org/l/by-nc/4.0/88x31.png\" /></a><br />This work is licensed under a <a rel=\"license\" href=\"http://creativecommons.org/licenses/by-nc/4.0/\">Creative Commons Attribution-NonCommercial 4.0 International License</a>."
+   ]
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "Python 3 (ipykernel)",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.9.12"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}
+%% Cell type:code id:fc73d74c tags:
+
+``` python
+##ANSWER##
+#Install answercheck in current director
+from urllib.request import urlretrieve
+urlretrieve('https://raw.githubusercontent.com/colbrydi/jupytercheck/master/answercheck.py', filename='answercheck.py')
+##ANSWER##
+```
+
+%% Output
+
+    ('answercheck.py', <http.client.HTTPMessage at 0x7fc9a8612220>)
+
+%% Cell type:markdown id:3c2a4f39 tags:
+
+# Pandas
+Pandas is a python library used to analyze data.
+
+%% Cell type:markdown id:2b78245b tags:
+
+![Giant Panda Bear Eating Apples - Image found on Flickr](https://live.staticflickr.com/3296/2679911705_33e5b2db7d_b.jpg)
+
+
+%% Cell type:markdown id:71e867d9 tags:
+
+## Description
+Pandas take tabular data and store them in objects known as ‘databases’. They are useful for exploring, cleaning, and processing data
+
+%% Cell type:markdown id:58ec20e8 tags:
+
+## Self Assessment
+
+Questions that test for the learning goals and allows students to evaluate if they truly understand the topics.
+
+%% Cell type:markdown id:5d237ca9 tags:
+
+## Training Materials
+
+
+
+%% Cell type:markdown id:21f9b14e tags:
+
+For a general understanding of how to use pandas, along with practice exercises, check out the following website: https://www.w3schools.com/python/pandas/default.asp
+
+For a complete directory of everything you can do with pandas:
+
+https://pandas.pydata.org/docs/index.html
+
+Pandas Cheat Sheet:
+
+Data Analysis:
+	https://drive.google.com/file/d/1UHK8wtWbADvHKXFC937IS6MTnlSZC_zB/view
+
+Wrangling Data:
+https://pandas.pydata.org/Pandas_Cheat_Sheet.pdf
+
+
+%% Cell type:markdown id:1b047470 tags:
+
+Go to https://people.sc.fsu.edu/~jburkardt/data/csv/csv.html and download the “grades.cvs” file. We will use it to solve the following problems:
+
+&#9989; **<span style="color:red">Question:</span>**  Create a dataframe variable to store the grades.cvs table.
+
+
+
+If you need help: https://www.w3schools.com/python/pandas/pandas_csv.asp
+
+%% Cell type:code id:ee42a54e tags:
+
+``` python
+##ANSWER##
+df = pd.read_csv('grades.csv')
+df
+##ANSWER##
+```
+
+%% Output
+
+    ---------------------------------------------------------------------------
+    NameError                                 Traceback (most recent call last)
+Input     In [1], in <cell line: 2>()
+          1 ##ANSWER##
+    ----> 2 df = pd.read_csv('grades.csv')
+          3 df
+    NameError: name 'pd' is not defined
+
+%% Cell type:markdown id:1e046af0 tags:
+
+&#9989; **<span style="color:red">Question:</span>**  Remove the 9th row (Andrew Airpump’s data) from the dataframe.
+
+If you need help, refer to the Wrangling Data cheatsheet: https://pandas.pydata.org/Pandas_Cheat_Sheet.pdf
+
+%% Cell type:code id:180aff55 tags:
+
+``` python
+##ANSWER##
+df_1 = df.drop([8])
+df_1
+
+##ANSWER##
+```
+
+%% Output
+
+    ---------------------------------------------------------------------------
+    NameError                                 Traceback (most recent call last)
+Input     In [1], in <cell line: 2>()
+          1 ##ANSWER##
+    ----> 2 df = pd.read_csv('grades.csv')
+          3 df
+    NameError: name 'pd' is not defined
+
+%% Cell type:markdown id:43219d26 tags:
+
+&#9989; **<span style="color:red">Question:</span>**  Clean up column headers to remove unnecessary quotation marks.
+
+
+If you need help: https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.rename.html
+
+%% Cell type:code id:4c9f8f12 tags:
+
+``` python
+##ANSWER##
+df_2 = df_1.rename(columns=[{'\"First name\"': 'First name'}])
+	df_2
+
+
+##ANSWER##
+```
+
+%% Output
+
+    ---------------------------------------------------------------------------
+    NameError                                 Traceback (most recent call last)
+Input     In [1], in <cell line: 2>()
+          1 ##ANSWER##
+    ----> 2 df = pd.read_csv('grades.csv')
+          3 df
+    NameError: name 'pd' is not defined
+
+%% Cell type:markdown id:f4e4a841 tags:
+
+&#9989; **<span style="color:red">Question:</span>** Sort the data by student’s SSN. Store this data in a new dataframe called df_3.
+
+
+If you need help: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.sort_values.html?highlight=sort_values#pandas.DataFrame.sort_values
+
+
+%% Cell type:code id:b8c5166c tags:
+
+``` python
+##ANSWER##
+df_3 = df_2.sortvalues(by='Final')
+	df_3
+
+
+
+##ANSWER##
+```
+
+%% Output
+
+    ---------------------------------------------------------------------------
+    NameError                                 Traceback (most recent call last)
+Input     In [1], in <cell line: 2>()
+          1 ##ANSWER##
+    ----> 2 df = pd.read_csv('grades.csv')
+          3 df
+    NameError: name 'pd' is not defined
+
+%% Cell type:markdown id:11a12621 tags:
+
+&#9989; **<span style="color:red">Question:</span>** Sort the data by the overall letter grade they received in the class and the grade they received on the final.
+
+
+If you need help: Same as above
+
+
+%% Cell type:markdown id:333f476e tags:
+
+&#9989; **<span style="color:red">Question:</span>**  Create a line graph plotting Test 1 scores against Test 2 scores.
+
+
+
+If you need help: https://pandas.pydata.org/docs/user_guide/visualization.html
+
+
+%% Cell type:markdown id:f66f2294 tags:
+
+&#9989; **<span style="color:red">Question:</span>**  Perform a correlation test comparing Test 3 and Test 4 scores.
+
+
+If you need help: https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.corr.html
+
+
+%% Cell type:markdown id:dd9c7fa5 tags:
+
+&#9989; **<span style="color:red">Question:</span>**  Example answercheck question: What is $x = 2+2$?
+
+
+%% Cell type:code id:64684dfd tags:
+
+``` python
+#Put your answer here
+```
+
+%% Cell type:code id:619a2259 tags:
+
+``` python
+##ANSWER##
+x = 4
+##ANSWER##
+```
+
+%% Cell type:code id:9cc2b34a tags:
+
+``` python
+from answercheck import checkanswer
+checkanswer.vector(x,'2cab95d1b144d663bad1ce5c51020ae0')
+```
+
+%% Output
+
+    
+    CheckWarning: passed variable is <class 'int'> and not a numpy.matrix.
+        Trying to convert to a array matrix using ```A = np.matrix(A)```.
+    
+    
+    CheckWarning: passed matrix is int64 and not <class 'numpy.float64'>...
+        Trying to convert to float using ```A = A.astype(float)```.
+    
+    Testing [[4.]]
+    Answer seems to be correct
+    
+
+%% Cell type:markdown id:44b461a0 tags:
+
+---
+
+Written by <<YOUR NAME HERE>>, Michigan State University
+As part of the Data Science Bridge Project
+
+<a rel="license" href="http://creativecommons.org/licenses/by-nc/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-nc/4.0/88x31.png" /></a><br />This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-nc/4.0/">Creative Commons Attribution-NonCommercial 4.0 International License</a>.