UIDAI (Adhar) public dataset download and Merge with iPython and Pandas

Adhar(UIDAI) dataset is a wonderful data provided by Indian government.

Things I like about this dataset:

  • It fits into relation schemas pretty well
  • Great way for beginners like me to explore Data Science basics using latest tools like ipython, Pandas, Anaconda etc.
  • This dataset is being used by UDACITY courses (Introduction to data science)  see references for videos
  • It is a real-time data, it updates every other day
  • You can use REST api calls to get the data for a particular day, particular month OR just the latest data.
  • Its probably going to be a huge data thinking of India’s population.
  • This data can be mixed with some other interesting datasets provided by http://data.gov.in/
  • Its size is around 30 GB when summed up, but you can download in bits and pieces and play with whatever size you want.

You can see this notebook in following ways.

1. If you don’t  have iPython but want to quickly see this, Follow these steps:

2. If you have iPython installed and want to run this notebook quickly to get the dataset, follow these steps

3.  If you don’t want to do anything, give me your address i will personally come and run it on your machine (HaHA) Just kidding ….both above mentioned ways should work.

References:

  1. Udacity lecture1: https://www.youtube.com/watch?v=PxS2Z7g2Xdc
  2. Udacity lecture2: https://www.youtube.com/watch?v=c5sxdOU7Xuo
  3. To Understand dataset: https://data.uidai.gov.in/uiddatacatalog/dataCatalogHome.do
  4. To install iPython: https://blog.safaribooksonline.com/2013/12/12/start-ipython-notebook

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s