Click this button to return to main.

SG BAIK’S ONLINE REPOSITORY

This work is a snippet reconstructed from an academic coursework 95-885 Data Science and Big Data at Carnegie Mellon University.

Used Pandas. Exported from Jupyter Notebook.

Making a dataset that conforms to H. Wickham’s definition of ‘tidy’ data.

This work is a snippet reconstructed from an academic coursework from 95-885 Data Science and Big Data at Carnegie Mellon University.

In [1]:

import pandas as pd
import datetime

In [2]:

# read csv file and confirm it's the correct file
# make dataframe
df = pd.read_csv('billboard.csv', sep = ',')

display(df.head())
display(df.tail())

5 rows × 83 columns

5 rows × 83 columns

In [3]:

# melt dataframe for weeks
df2 = pd.melt(df, id_vars = ['year', 'artist', 'track', 'time', 'genre', 'date.entered',
       'date.peaked'], value_vars = ['x1st.week', 'x2nd.week', 'x3rd.week', 'x4th.week',
       'x5th.week', 'x6th.week', 'x7th.week', 'x8th.week', 'x9th.week',
       'x10th.week', 'x11th.week', 'x12th.week', 'x13th.week', 'x14th.week',
       'x15th.week', 'x16th.week', 'x17th.week', 'x18th.week', 'x19th.week',
       'x20th.week', 'x21st.week', 'x22nd.week', 'x23rd.week', 'x24th.week',
       'x25th.week', 'x26th.week', 'x27th.week', 'x28th.week', 'x29th.week',
       'x30th.week', 'x31st.week', 'x32nd.week', 'x33rd.week', 'x34th.week',
       'x35th.week', 'x36th.week', 'x37th.week', 'x38th.week', 'x39th.week',
       'x40th.week', 'x41st.week', 'x42nd.week', 'x43rd.week', 'x44th.week',
       'x45th.week', 'x46th.week', 'x47th.week', 'x48th.week', 'x49th.week',
       'x50th.week', 'x51st.week', 'x52nd.week', 'x53rd.week', 'x54th.week',
       'x55th.week', 'x56th.week', 'x57th.week', 'x58th.week', 'x59th.week',
       'x60th.week', 'x61st.week', 'x62nd.week', 'x63rd.week', 'x64th.week',
       'x65th.week', 'x66th.week', 'x67th.week', 'x68th.week', 'x69th.week',
       'x70th.week', 'x71st.week', 'x72nd.week', 'x73rd.week', 'x74th.week',
       'x75th.week', 'x76th.week'], var_name = 'week', value_name = 'rank')

display(df2)