The last chapter of the book , Let's look at some real-world datasets . For each data set , We will use the method introduced before , Extract meaningful content from raw data . The method presented is applicable to other data sets , Including yours . This chapter contains a variety of case datasets , It can be used to practice .
Case datasets can be found in Github Warehouse found , See Chapter one .
#14.1 come from Bitly Of USA.gov data
2011 year ,URL Shorten service Bitly With the US government website USA.gov cooperation , Provides a copy of the generated from .gov or .mil Anonymous data collected from users with short links . stay 2011 year , In addition to real-time data , You can also download hourly snapshots in the form of text files . When writing this book （2017 year ）, The service has been shut down , But we keep a copy of the data for the case of this book .
Take the hourly snapshot as an example , The format of each line in the file is JSON（ namely JavaScript Object Notation, This is a common Web data format ）. for example , If we only read the first line in a file , Then the result should be as follows ：
In [5]: path = 'datasets/bitly_usagov/example.txt'
In [6
