Start your first project
Time to start your project! Be mindful that your project helps meet the criteria in the
section above and reflects your passions, expertise, and capabilities.
Understanding the Data Science Workflow. Before we start, it's
essential to understand the data science workflow. It's like a roadmap guiding us
through the project. The workflow includes several stages:
- Data Collection: This is where we gather our raw materials, the data. It could be from various sources like databases, APIs, web scraping, or online repositories. For example, if you're interested in social media analysis, you might collect data from Twitter using its API.
- Feature Extraction and Exploratory Data Analysis (EDA): Here, we transform raw data into a format that can be analyzed (feature extraction) and then explore it to understand its characteristics (EDA). For instance, if you're working with text data, feature extraction might involve converting the text into numerical vectors. EDA could involve finding the most common words or the sentiment of the text.
- Model Selection and Validation: In this stage, we choose a suitable machine learning model and validate its performance using techniques like cross-validation. For example, if you're working on a classification problem, you might choose a logistic regression model and validate it using k-fold cross-validation.
- Model Deployment, Continuous Monitoring, and Improvement: Once we're satisfied with our model, we deploy it. But our job doesn't end there. We continuously monitor the model's performance and make improvements as needed. For instance, if your model is a recommendation system for a website, you would monitor how users interact with the recommendations and update the model based on this feedback.
Dataquest simplifies this learning process with its unique teaching approach, making it
easy for beginners to understand and follow the data science workflow. Its outcome-based
learning platform simulates the real-world challenges that data professionals face every
day, thereby providing contextual learning. The platform's 'Backwards Curriculum Design'
ensures that each course is created with the end in mind. By working with industry
professionals, Dataquest determines real-world scenarios and builds learning objectives
based on these scenarios. This way, learners are equipped with the skills required to
complete projects successfully, proving their ability to apply these skills in a job
setting.
Choose a Project or Pick a Topic
Pick projects that resonate with you. Remember, data science is broad and it's impossible
to be an expert in everything. The projects you select should allow you to delve into
different facets of data science and progressively grow your skillset. Beginners can
start with projects such as House Prices Regression or Titanic Classification. It's
advisable to complete multiple projects, each focusing on different aspects of data
science like data collection, data cleaning, data exploration, data visualization,
regression, statistics, and machine learning. Opt for projects that mimic real-world
situations. For example, web scraping reviews from a food delivery website or scraping an
online course website can provide invaluable hands-on experience. These kinds of projects
not only help you understand how to collect and clean data but also expose you to the
practical applications of data science.
Here are our top four beginner-friendly projects you can start with:
Or you can choose from hundreds of guided projects on the
Dataquest learning platform.
Or pick a topic that you're interested in and motivated to explore. It's very obvious when
people are making projects just to make them, and when people are making projects because
they're genuinely interested in exploring the data. It's worth spending extra time on this
step, so ensure that you find something you're actually interested in. A good way to find
a topic is to browse different datasets and seeing what looks interesting. Here are some
good sites to start with:
- • Data.gov — contains government data.
- • /r/datasets — a subreddit that has hundreds of interesting datasets.
- • Awesome datasets — a list of datasets, hosted on GitHub.
- • 17 places to find datasets — a blog post with 17 data sources, and example datasets from each.
In real-world data science, you often won't find a nice single dataset that you can
browse. You might have to aggregate disparate data sources, or do a good amount of data
cleaning. If a topic is very interesting to you, it's worth doing the same here, so you
can show off your skills better.
Find a Dataset
Now that you've chosen a project, you need a dataset. There are many resources available
online where you can find datasets. Some of our favorites are Kaggle, UCI Machine Learning
Repository, and Google Dataset Search. Choose a dataset that aligns with your project
goals. Ensure the data comes from reliable sources to maintain the credibility of your
project. If you need a little help finding free datasets,
here's
a good place to start.
Clean the Data
Once you've found your dataset, it's time to roll up your sleeves and clean it. This step
involves removing any errors or inconsistencies in the data. It might seem tedious, but
remember, a clean dataset is crucial to the success of your project. For instance, you
might need to handle missing values, remove duplicates, or correct inconsistent entries.
Explore the Data
Now comes the fun part — exploring the data! This involves looking at the data from
different angles, visualizing it, and trying to find patterns or insights. It's like
being a detective, where your clues are hidden in the data. For example, for a house
price prediction project, you might plot the distribution of prices, investigate the
relationship between the number of rooms and price, or identify neighborhoods with the
highest average prices.
The important thing is to stick to a single angle. Trying to focus on too many things at
once will make it hard to make an effective project. It's also important to pick an
angle that has sufficient nuance. Here are examples of angles without much nuance:
- Figuring out which banks sold loans to Fannie Mae that were foreclosed on the most.
- Figuring out trends in borrower credit scores.
- Exploring which types of homes are foreclosed on most often.
- Exploring the relationship between loan amounts and foreclosure sale prices
All of the above angles are interesting and would be great if we were focused on
storytelling, but aren't great fits for an operational project.
Communicate Your Results
Once you've built your model and made some predictions, it's time to share your
findings. This could involve creating a report or presentation, or even writing a blog
post about your project. Remember, communication is a key skill in data science. It's
not enough to build a great model; you also need to explain it to others.
Let's consider a beginner data science project, such as analyzing a dataset of Titanic
passengers to predict survival. After you've built your model and made some predictions,
you might create a presentation to share your findings.
In your presentation, you could start by explaining the problem you were trying to solve
and the data you used. Then, you could discuss the exploratory data analysis you
performed, the insights you gained, and the model you chose.
Next, you could present the results of your model. This could include the accuracy of
your model, the most important features for predicting survival, and any interesting
patterns or trends you discovered. For example, you might find that passenger class and
gender were important factors in survival, which could lead to a discussion about the
social dynamics of the time.
Finally, don't forget to discuss any challenges you faced during the project and how you
overcame them, as well as any future improvements you would like to make to your model.
This shows that you can reflect on your work and are always looking to improve, which
are important qualities in a data scientist.
Remember, the goal is not just to present your results, but to tell a story with your
data that engages your audience and demonstrates your understanding of the project.
Get Feedback
After you've communicated your results, don't forget to get feedback. This can help you
improve your skills and make your future projects even better. Don't be afraid of
criticism. Instead, view it as a learning opportunity. You could ask your peers or mentors
to review your project and provide feedback.
Upload Your Work on GitHub
Finally, showcase your hard work on GitHub. It's a great platform to host your code,
data files, models, and notebooks. This allows potential employers to see your code
quality, organization skills, and style of documentation. For the house price prediction
project, you might create a GitHub repository containing your code, the cleaned dataset,
any visualizations you created, and a readme file explaining your project.
Link your GitHub repositories to your LinkedIn profile, resume, or personal website,
which can help attract the attention of recruiters.
Here's
a more detailed tutorial on how to upload and present your projects on GitHub.