Register for Exploratory and download/install Exploratory: https://exploratory.io/download
Download and install R: https://mirror.its.sfu.ca/mirror/CRAN
Download and install RStudio: https://www.rstudio.com/products/rstudio/download/
Download and install QGIS: https://qgis.org/
The purpose of this group project is to learn how to create a basic data science report. You will need to wrangle messy data that come in a variety of format. You will also need to merge different datasets and conduct an analysis to test your hypotheses or make recommendations based on your findings. We will go through the initial three parts of your group project in class, but your group will need to work together to complete the final report.
In part 1, you will be first given a snapshot of crime data for 2016, and you will be diving into data wrangling procedures.
In part 2, you will be working on merging the crime data with other datasets from the open data platform.
In part 3, you will be conducting an exploratory data analysis (EDA) and will be applying some statistical learning techniques to extract useful information out of the dataset you created.
[IMPORTANT] Please move the downloaded file to a specified project folder.
Once you downloaded the crime data for each, download the census data and the corresponding GeoJSON file.
Group 1 - Boston: Boston crime 2016, Boston Census, Boston GeoJSON
Group 2 - Los Angeles: LA crime 2016, LA Census, LA GeoJSON
Group 3 - Los Angeles: LA crime 2016, LA Census, LA GeoJSON
Group 4 - San Francisco: SF crime 2016, SF Census, SF GeoJSON
Group 5 - Washington DC: Washington DC crime 2016, Washington DC Census, Washington DC GeoJSON
Group 6 - New York City: NYC crime 2016, NYC census, NYC GeoJSON
Group 7 - New York City: NYC crime 2016, NYC census, NYC GeoJSON
Group 8 - Philadelphia: Philadelphia crime 2016, Philadelphia Census, Philadelphia GeoJSON
Group 9 - Detroit: Detroit crime 2016, Detroit Census, Detroit GeoJSON
Group 10 - Detroit: Detroit crime 2016, Detroit Census, Detroit GeoJSON
Follow the steps in group session from the lecture 5 to replicate the same procedures using your city’s crime data. In brief, first, use the coordinate information of your crime data to create heapmaps. Second, join the census data to explore relationships among variables. Third, add the GeoJSON data to map the data by census tract.
Issue at hand: What are the issues? What’s troubling the most?
Supporting data: For this project, you are given the crime data. Your job is to merge the the crime data with some other useful data to complete your story.
Relationship: What is the relationship between X and Y? Does the relationship go up or down or stay the same?
Interprtation: Why do you think the relationship between X and Y exists? Do some research. Read newspaper, and use your common sense and judgment to try to understand the observed relationship.
Summary and conclusions: Summarize what you’ve learned and draw a conclusion.
Continuing the group activity yesterday, choose one person to report your initial exploration that includes issue, cause and effect (hypothesis), supporting data, and maps and graphs. You don’t need to do any interpretation as of yet.
VSP BigData [lecture number] - [group number] - [presenter name] VSP BigData Lecture 6 - Group 1 - Bill Gates