This class will involve a good deal of coding, for which you will need some basic tools. Please make sure to set up the following tools after the first day of class.
An interactive bash shell
This will give you the ability to interact with your filesystem via the command line instead of a GUI such as Windows Explorer or Mac Finder. We will also use bash to automate acquiring and cleaning data sets.
If you use Windows, you can try the builtin bash/Ubuntu shell on Windows 10 or you can install Cygwin which includes bash and a terminal application by default. Mac OS X includes a bash shell by default, and a terminal application in
/Applications/Utilities. Linux also includes a working shell and terminal.
Verify that your environment is properly configured by typing the following commands indicated after the
# symbol. You should see something similar (although not necessarily identical) to the following:
# echo $SHELL /bin/bash # grep --version grep (BSD grep) 2.5.1-FreeBSD # cut usage: cut -b list [-n] [file ...] cut -c list [file ...] cut -f list [-s] [-d delim] [file ...]
O’Reilly’s Classic Shell Scripting book is a more complete reference.
A Git client
Git is a version control system that allows you to track modifications to files and code over time. It also facilitates collaborations so that multiple people can share and edit the same code base.
If you are on Windows you can install Github for Windows which provides both the command line tool for git and a graphical user interface. Alternatively, you can install git as an optional package under Cygwin. We recommend the Github application, as it will be easier to interface with Github using it. Likewise, modern versions of Mac OS X have a command line git client installed by default, but the Github for Mac tool is a recommended addition. Linux users can install git with the appropriate package manager (e.g.,
yum install git on RedHat or
apt-get install git), and there are a number of different git GUIs for Linux.
Complete this relatively brief interactive tour of git. See this one page guide for explanations of the usual git workflow and most common commands, or here for a more verbose guide. Github also has an introductory video, some training courses, and a handy cheatsheet.
A Github account
Github is a platform that facilitates collaboration on projects that use git. You can use it to host projects, publish them to the web, and share them with other people. Create a free account if you don’t already have one.
Once you have an account, clone the course repository using your local git client. This is most easily done on the command line as follows:
# git clone https://github.com/jhofman/msd2017.git Cloning into 'msd2017'... remote: Counting objects: 145, done. remote: Compressing objects: 100% (98/98), done. remote: Total 145 (delta 40), reused 137 (delta 37) Receiving objects: 100% (145/145), 454.90 KiB | 594.00 KiB/s, done. Resolving deltas: 100% (40/40), done. Checking connectivity... done.
When this is complete, verify that you have a local directory called
msd2017 containing a
R and RStudio
R is a useful programming language for exploratory data analysis, data visualization, and statistical modeling. RStudio is a popular integrated development environment (IDE) for working in R.
We will discuss all of these tools in more detail in class.