Meetup

How to Become a Better Data Scientist: The Definitive Guide

Alexey Grigorev, OLX GroupEpisode 24 · 1:00:42 · Jul 2020 · 950 viewsHosted by Demetrios Brinkmann
Thumbnail for How to Become a Better Data Scientist: The Definitive Guide Watch on YouTube
TL;DR
  1. 1

    A full-stack data scientist can own a machine learning project from defining the problem through deployment without being an expert in every part of the process.

  2. 2

    Data scientists become more useful when they understand product work, communicate clearly, and learn enough infrastructure to work independently in a safe environment.

  3. 3

    The best way to learn tools and theory is to start with a real problem, use the available abstractions, and go deeper only when the problem requires it.

Summary

Alexey Grigorev describes a full-stack data scientist as someone who can own a machine learning project from requirements gathering to deployment. This does not mean becoming an expert data engineer, DevOps engineer, and machine learning researcher at once. It means knowing what each stage involves, doing the basics, and asking for help when necessary. He recommends using staging environments or separate clusters for infrastructure experiments, then earning access to production through repeated, trusted work. Grigorev also argues that data science roles are splitting between analytics-focused work and engineering-focused machine learning work. As tools make model training easier, connecting systems and making models useful in products will still require software engineering. He advises learners to focus on problems instead of trying to master every model or tool first. Communication, documentation, product thinking, and practical projects matter as much as technical skills.

Key ideas
07:58

A full-stack data scientist owns the whole machine learning cycle

Alexey Grigorev defines a full-stack data scientist as someone who can own a machine learning project end to end. That starts with collecting requirements, talking to people, and deciding whether machine learning is needed at all. The work then includes preparing data, training and evaluating a model, deploying it, and checking how real users interact with it. He contrasts this with focusing only on modelling. The goal is not to perform every task at an expert level. It is to understand the whole process well enough to move a project forward and identify where specialist help is needed.

09:59

Breadth is realistic when it means basic working knowledge

Grigorev rejects the idea that a full-stack data scientist must be a superhero who can do every job alone. Each stage of a machine learning project can require several specialists. A data scientist can still work across the stages by learning the core activity at each one. For requirements, that means talking to people and prioritising needs. For data preparation, it may mean learning where the data is and how to extract it. For deployment, it can mean creating a simple Kubernetes service that scales, without managing the Kubernetes cluster. Asking for help is part of the role, especially after making a genuine attempt.

13:33

Small infrastructure skills can remove long waits

Grigorev learned infrastructure because waiting for busy engineers could block his work for months. His advice is to ask an infrastructure or DevOps engineer to teach the smallest useful set of skills. In his example, an engineer suggested installing Minikube and following a tutorial covering pods, services, and deployments. They did one deployment together, after which Grigorev could repeat the work independently. He says this made him less dependent on other teams and helped him iterate faster. The point is not to replace infrastructure specialists. It is to avoid making them perform every small task needed to test a data science idea.

16:48

Use staging as a safe place to learn deployment

Grigorev separates experimentation from production access. In many projects, he did not have permission to touch production, but he could work in staging. A staging environment or separate cluster gives a data scientist room to experiment without risking live systems. Once a deployment is stable and tested, infrastructure engineers can move it to production with less work. Repeated, careful deployments also help build trust. He recommends asking for help when needed and showing that the service works before requesting a production change. This approach lets a data scientist learn infrastructure while keeping operational risk contained.

21:42

Data science roles are splitting toward analytics and engineering

Grigorev sees the data scientist title dividing into different types of work. In some United States companies, data scientists focus on SQL, business insights, and experiments such as A/B tests. In Europe, he more often sees roles that combine SQL, Python, pandas, machine learning frameworks, Flask, and Docker. He expects some of these engineering-oriented roles to be called machine learning engineer. As automated machine learning tools make model creation easier, he expects more attention to connecting tools, understanding the business domain, and building software that can use the model. The role may change names while the underlying work continues.

28:52

Tool choice should follow the problem

Grigorev advises learners not to study every algorithm, framework, and infrastructure tool before solving a real problem. Someone predicting churn can begin with a library, set up cross-validation, and treat the model as a black box. They can learn the mathematics later when the work requires it. For MLOps, he recommends looking at the tools already available in the organisation and using them to solve a specific deployment problem. If no suitable tool exists, build a small prototype, inspect what it does, and decide whether it is useful. This keeps attention on delivering a working solution instead of collecting disconnected knowledge.

37:31

Kaggle teaches modelling, while production adds problem definition

Grigorev is clear that Kaggle competitions are different from a data science job. Kaggle develops skills in feature creation, model tuning, and cross-validation, and it exposes learners to machine learning problems and evaluation metrics that others have already defined. Real work also requires formulating the problem, collecting and preparing data, and deciding what success means. Competition participants may spend substantial effort improving a score by a small amount, while most products do not need that degree of precision. He still recommends following several competitions, even passively, because seeing different problems and winning approaches broadens a learner's understanding.

41:35

Communication and product partnership affect technical impact

For Grigorev, communication is a core part of data science work. Before solving a problem, the data scientist needs to understand what the problem is, who it affects, and why the organisation is solving it. Afterward, they should demonstrate the result, explain complex ideas in simple words, write useful documentation, and communicate with stakeholders. When proposing a new framework or tool, he recommends first convincing the product manager. The product manager can help explain the value to the wider organisation and can give feedback on the data scientist's presentation, writing, and communication. Technical work has limited value when nobody understands the problem it addresses.

51:15

Pet projects can create infrastructure experience

When a data scientist has no infrastructure opportunities at work, Grigorev recommends building a pet project. The project does not need to serve a huge number of users. It should take an idea from an initial concept to a prototype and then deploy it to AWS or another cloud. That process provides practice with deployment and gives the learner something concrete to put on GitHub or describe in an article. The project may also help create an opportunity inside the current company, because the data scientist can show colleagues what they learned and ask to apply those skills to a work problem.

"A full-stack data scientist is somebody who can do the whole cycle, who can own the ML project end-to-end."Alexey Grigorev08:25
Who should watch
  • You are a data scientist who wants to work beyond notebooks and understand deployment without becoming a full-time infrastructure engineer.
  • You are learning data science from a software engineering background and want a project-led route into machine learning.
  • You work on simple models and reports but need a practical way to gain infrastructure experience and demonstrate it to your employer.