What AI is doing to Data Science jobs

Analysing demand for skills and the impact of AI across six data-related occupations

The roles I am best qualified for are the ones AI is most likely to erode. The roles growing fastest are the ones I am least prepared for. I only learned this by pointing the tools of my own trade at my own field.

For the past five years I have built data pipelines and produced analytics across several fields — workforce data, healthcare pathology, and financial-services research. Here I use them to measure, rather than guess, how generative AI is changing what employers ask data professionals to do — across six occupations, and for my own career.

A companion methods post documents the pipeline, the taxonomy, and the statistics in full. This post stays with the findings.

The data

The 2026 figures come from LinkedIn job ads posted in July–August 2026; the 2021 figures from LinkedIn ads posted in September 2021. A language model reads each ad and extracts the skills it requires, and a second step maps every raw phrase (Python, Py3) onto one of about 11,300 canonical concepts — the unit of analysis here. The 2026 sample is roughly 500 ads per role (Analytics Engineer 341); the three roles with 2021 data have 100–150 ads each. Only Data Analyst, Data Engineer, and Data Scientist had enough 2021 ads to compare over time, so every over-time result is limited to those three.

How the six Data Science roles differ in skill demand

“Data Science” is one label for six different jobs. The clearest way to see the difference is each role’s skill-demand profile — how often its ads ask for each family of skills. In the charts below, each axis is a skill category, and the distance along it is the share of the role’s 2026 ads asking for any skill in it. The dashed grey shape is the median across all six roles, so each role is shown against the typical role. There are 27 categories in all; the radar shows the eight that most distinguish the roles, and the drop-downs below give the numbers and examples.

Each role's skill-demand profile (2026)The 8 most role-distinguishing categories. Each axis is the % of the role's ads mentioning any skill in it (0–100%).median across the six rolesAI EngineerFound. modelsData vizAgenticDeep learningStat. inferenceModel deployData transf.OrchestrationAnalytics EngineerFound. modelsData vizAgenticDeep learningStat. inferenceModel deployData transf.OrchestrationData AnalystFound. modelsData vizAgenticDeep learningStat. inferenceModel deployData transf.OrchestrationData EngineerFound. modelsData vizAgenticDeep learningStat. inferenceModel deployData transf.OrchestrationData ScientistFound. modelsData vizAgenticDeep learningStat. inferenceModel deployData transf.OrchestrationMachine Learning EngineerFound. modelsData vizAgenticDeep learningStat. inferenceModel deployData transf.Orchestration

Each role’s 2026 skill-demand profile across eight categories, measured against the median role (dashed).

Show the numbers (all twelve categories, % of each role’s ads)

Skill category (% of ads)

AI Engineer

Analytics Engineer

Data Analyst

Data Engineer

Data Scientist

Machine Learning Engineer

foundation models

88

21

7

16

33

66

data visualisation

11

76

78

32

48

8

agentic systems design

71

8

3

6

16

34

deep learning

27

2

1

3

29

66

statistical inference

7

20

38

6

70

19

model deployment

58

16

6

28

31

69

data transformation

31

94

93

93

83

35

pipeline orchestration

38

51

19

81

24

36

machine learning

45

27

30

24

84

84

data architecture

54

77

45

91

42

33

cloud platforms

68

53

28

82

44

54

distributed processing

25

16

9

61

30

39

What the categories mean (the most-demanded skills in each)

Category

Most-demanded skills in it

foundation models

large language models, retrieval-augmented generation, prompt engineering, LangChain, generative AI

data visualisation

Power BI, tableau, data visualization, Looker, dashboards

agentic systems design

LangGraph, agentic workflows, ai agents, agentic ai, tool calling

deep learning

PyTorch, TensorFlow, deep learning, jax, Transformers

statistical inference

statistical analysis, statistical modeling, A/B testing, causal inference, statistical methods

model deployment

MLOps, Kubernetes, Docker, mlflow, observability

data transformation

SQL, data modeling, dbt, excel, analytics engineering

pipeline orchestration

data pipelines, airflow, azure data factory, AWS Glue, ETL/ELT pipelines

machine learning

machine learning, predictive modeling, scikit-learn, feature engineering, predictive analytics

data architecture

snowflake, vector databases, BigQuery, data warehousing, Redshift

cloud platforms

aws, Databricks, Azure, google cloud platform, Terraform

distributed processing

Spark, Apache Kafka, PySpark, distributed systems, Hadoop

Two groups stand out. AI Engineer and Machine Learning Engineer stretch toward machine learning, foundation models, model deployment, and cloud platforms. Data Analyst and Analytics Engineer stretch toward data transformation and visualisation, and barely register on the modelling axes. Data Engineer and Data Scientist overlap with both groups — which is why the single label hides so much.

To explore this landscape rather than only summarise it, I also built an interactive knowledge graph of the full skill set. It is a supplementary tool: its value is visual and exploratory. Every skill is a node, sized by demand; an edge joins two skills that often appear in the same ad. You can pick a role and see which skills cluster together — something a static chart cannot show.

→ Explore the interactive skill-demand graph

The knowledge-graph explorer (opens in a new tab).

How demand changed, 2021 to 2026

For the three roles I can track over time, the skill mix has moved sharply. All three show the same broad pattern — legacy tools out, modern and AI tools in — but the specifics reveal how differently AI is arriving in each.

Skills each role stopped and started asking for (2021→2026)Significant changes only. Grey bar = 2021, colour = 2026 (scaled to 60% max).Data EngineerFallingjava34→12%Hadoop26→7%Spark43→28%ETL41→27%hive16→4%r13→2%Risingdata governance8→35%ci/cd8→28%dbt2→21%data quality17→35%data engineering19→35%Databricks13→28%Data ScientistFallingr63→37%Hadoop22→6%Scala17→4%data mining20→8%Keras12→2%java17→7%Risinglarge language models0→18%Databricks1→16%generative AI0→15%snowflake1→13%data pipelines3→12%Data AnalystFallingstatistics21→7%r33→22%data mining18→8%data cleaning12→6%data management11→6%RisingPower BI32→42%data validation3→11%

Skills that changed significantly in each role’s ads, 2021 to 2026. Grey bar is 2021, colour is 2026.

Data Engineer shows the clearest structural change — a move from the old big-data stack to what the industry calls the modern data stack. Java fell from 34% of ads to 12%, and Hadoop from 26% to 7%. In their place, dbt rose from under 2% to 21%, data governance more than quadrupled to 35%, and CI/CD went from 8% to 28%. This matches a well-documented migration: on-premise Hadoop clusters proved costly to maintain, and cloud warehouses plus SQL transformation tools replaced them — a shift Databricks flagged as early as 2021. The surge in data governance and data quality is not incidental: dbt Labs’ 2026 State of Analytics Engineering report argues that AI now produces analytics faster than the governance and trust mechanisms meant to check it, which pushes quality and governance to the centre of the role.

Data Scientist shows generative AI arriving directly. R fell from 63% of ads to 37%, and older infrastructure — Hadoop, Scala, Keras — declined, while large language models rose from 0% to 18% and generative AI from 0% to 15%. This is the industry-wide move from an R-centred toolkit to a Python-and-cloud one: Python is now used by around 58% of developers against under 5% for R in the Stack Overflow Developer Survey. (Note the falling skill here is R and legacy infrastructure, not statistics itself — classical statistics falls in the Data Analyst ads, not the Data Scientist ones.)

Data Analyst changed least, but in a revealing direction: classical statistics (21% to 7%), R (33% to 22%), and data mining all fell, while Power BI rose (32% to 42%). The role is consolidating around business-intelligence tooling and moving away from hand-written statistical work — the kind of routine task automated tools now handle.

How much AI has entered each role

The central question is how far AI skills have actually entered these jobs. They concentrate heavily in the two AI-native roles, as the numbers make plain.

AI skill (% of ads)

AI Engineer

Analytics Engineer

Data Analyst

Data Engineer

Data Scientist

Machine Learning Engineer

machine learning

29

12

10

14

62

58

natural language processing

12

1

1

2

16

18

generative AI

25

5

2

3

15

22

large language models

43

6

1

4

18

36

retrieval-augmented generation

34

2

0

3

6

17

prompt engineering

31

2

1

2

7

10

MLOps

14

1

0

3

9

22

vector databases

22

1

0

1

3

8

AI-skill demand by role, 2026 (% of the role’s ads mentioning each skill). AI Engineer and Machine Learning Engineer carry almost all of it.

One clarification matters. When an ad lists “large language models” or “generative AI” as a required skill, it is almost never asking for academic familiarity. In context these ads describe applied work. Three real examples from the 2026 dataset:

“Hands-on production experience with LLMs: prompt engineering, agent development, evals, RAG, and deployment at scale”

“Experience building and deploying generative AI solutions using large language models (LLMs) into Production”

“Experience building applications with LLMs, including areas such as RAG, prompt engineering, agentic workflows, evaluation, or fine-tuning”

So “AI skill” in this data means the ability to build with AI, not merely to understand it.

The clearest signal is in the Data Scientist role. Of the 2,802 skills that appear in Data Scientist ads, machine learning ranks 3rd, large language models rank 12th, and generative AI 20th — ahead of many long-standing techniques. Neither LLMs nor generative AI appeared in a single 2021 Data Scientist ad; in 2026 they are in about one in six.

That demand is not limited to technology companies. Of the 500 Data Scientist ads, 25% require at least one AI skill, and the employers asking include mainstream enterprises — Ford, Walmart, Capital One, BMO, Amazon, Intuit — alongside AI-first firms such as Tempus AI. In other words, AI-skill demand in Data Science has already spread beyond the technology sector. (This is a small, single-source sample and company name is only a rough proxy for sector, so I read it as indicative, not definitive.)

To see how these AI skills connect to the rest of each role’s skill set — which skills they appear alongside, and how demand ranks — explore the interactive skill-demand graph.

What this means for my own career

Here the analysis turns on me. I scored my own level on the top skills for each role — 0 (aware), 1 (developing), 2 (advanced) — using my resume and my work-history and portfolio projects as evidence, then compared that against real 2026 demand.

This is not a ranking of one “best” job. A single score would hide what I want to do and how exposed each role is to AI. So I look at two things: how well my current skills match each role, and how well each role fits where I want to go.

How much of each role's in-demand skills I already holdDemand-weighted share of the role's top-20 skills for 2026.skills I already have…and use at an advanced levelData Analyst80%Data Engineer68%Analytics Engineer67%Data Scientist60%AI Engineer44%Machine Learning Engineer41%

How much of each role’s top-20 in-demand skills I already have. The light bar weights every skill by its 2026 demand and gives half credit for a developing skill; the dark segment is the part I use at an advanced level.

To make that concrete: for Data Analyst, the most-demanded 2026 skills are ones I have used for years — SQL, Python, Power BI, data visualisation — alongside a few I am still developing and a few I barely know (Tableau, R, Snowflake). Weighted by how often the role’s ads demand each one, that comes to the roughly 80% shown.

The uncomfortable pattern is that I match best exactly the roles most exposed to AI, and worst the AI-native roles that are growing fastest. My strongest current fit (Data Analyst, Analytics Engineer, Data Engineer) and the direction the field is heading (the AI-native roles) point opposite ways.

That is worth taking seriously. The research points in two directions at once, and both bear on the traditional-versus-AI-role split above:

Put plainly: being hard to replace is less about which of the six job titles I pick, and more about how I work and how fast I keep learning. Work alongside AI. Keep a base of skills that do not decay quickly — analytical thinking, judgement, and communication, which the World Economic Forum’s Future of Jobs 2025 report names among the most valued and fastest-rising human skills (it expects about 39% of core skills to change by 2030). One honest caveat: my own ad data cannot confirm that claim — job ads rarely spell out human skills (communication appears in only 10–15% of ads, analytical thinking in almost none), which is a real limit of ad-based analysis. So for that point I rely on external research, not my data.

My learning plan

Three directions, each tied to what the data above shows.

  1. Build with AI, and learn the methods rather than the tools. The AI-native roles are where I match worst, and their ads (quoted above) ask for RAG, evaluation, and orchestration repeatedly. Those are methods that outlast the specific frameworks — and the skill-decay research is the reason to learn the method and treat this year’s library as replaceable. My anchor is extending the project behind this post into an AI-served feature.
  2. Build things people use. This is my strongest cluster already (the ~68% match on Data and Analytics Engineer), and the rising skills there are learnable and durable: dbt (up from 2% to 21% of Data Engineer ads), a cloud warehouse (Snowflake and Databricks both rising), and shipping one real analytics or education application of my own.
  3. Invest in the durable human skills. Job ads barely name them, and my data cannot measure them — but that is rather the point: knowing where value lies, communicating it, and deep domain knowledge are hard to automate precisely because they are hard to specify. It is the least certain of the three bets, and the one I would stake the most on.

How this was built

The pipeline and the method are fully reproducible: raw job ads are turned into typed, categorised, and facetted skill concepts, then demand, change over time, and skill co-occurrence are computed and served from a small BigQuery warehouse. The exact figures depend on the specific job-ad sample, which I do not republish, so the numbers here are not meant to be re-derived by a reader — but the taxonomy, the statistics, and the design decisions are all documented in the methods post.

Thanks for reading. The interactive graph is here; questions and corrections are welcome.

← All articles