Top Skills for a Data Scientist – 2019

Synopsis

We look at the top key skills required for a data scientist updated for 2019. We do so by gathering 2000 job posts and using text mining to retrieve information. We also use algorithms to find out how each skill is related to another. Finally, we look at implications of identifying the in-demand skills that will effect the workforce and economy. Read More “Top Skills for a Data Scientist – 2019”

Top Skills for a Data Scientist – 2018

Synopsis

We look at the top key skills required for a data scientist. We do so by gathering 1000 job posts and using text mining to retrieve information. We also use algorithms to find out how each skill is related to another. Finally, we look at implications of identifying the in-demand skills that will effect the workforce and economy.

Read More “Top Skills for a Data Scientist – 2018”

Open Data Day: Code and the City

I was a participant in a hackathon called Code and the City. The event was held in celebration of Open Data Day. Along with industry sponsors like Soti, Amazon, Microsoft and Cisco, the event sponsors included the City of Mississauga and Sheridan College.

codeandthecity

The idea was to answer a problem set that would benefit the City of Mississauga with a population of almost 800,000 using open data:

How can Mississauga gain greater awareness and engagement with the community in a digital environment?

Read More “Open Data Day: Code and the City”

Predictive Text Application – Milestones

Synopsis

We are developing an application that can predict a word based on previous ones. Text mining and natural language processing (NLP) are used. This is similar to the software available on mobile platforms such as SwiftKey. The end product will be a web application that takes an incomplete phrase from the user and predicts the next word. In order to build the application, we require an appropriate data collection. Here we use the English language sets from HC Corpora. This milestone report details our initial exploratory analysis of the data and our future goals in a concise and understandable manner.

Read More “Predictive Text Application – Milestones”