Data Engineer / Bangalore, India

Making datamove withpurpose.

I design production data pipelines, migration systems, and dependable delivery paths for enterprise teams.

4 years building with Azure, Databricks, Python, SQL, and Spark.
Explore my work View resume Get in touch
Yadukrishnan J
Data Engineer / Builder / Problem Solver

01 / The short version

Reliable data is a team sport.

I'm Yadukrishnan, a Data Engineer who turns complex migration and analytics work into stable systems that people can rely on. My focus is Azure-native data engineering, clean delivery practices, and the operational details that make a solution last.

Speciality

Enterprise data migrations and pipeline orchestration.

Approach

Practical architecture, rigorous validation, clear stakeholder communication.

Education

B.E. Information Science, Ramaiah Institute of Technology. CGPA 9.28.

02 / Impact in numbers

The work behind the work.

A portfolio is more useful when it shows the operating scale, not just the tools.

50+ TB

document data migrated

4M+

files and metadata records moved

$1.5M

potential annual licensing savings

200+

production incidents resolved within SLA

03 / Experience

Working where the data matters.

My work sits at the intersection of data platforms, delivery, and the people relying on both. I bring the same care to data models, production support, and business acceptance testing.

NOV 2025 - PRESENT

IM Engineer - Data

Shell

Leading a five-member delivery team while building production data and migration systems for global business teams.

  • Designed an Azure migration solution that moved 50+ TB and 4M+ documents with Python, SQL, ADF, Databricks, and REST/Graph APIs.
  • Implemented GitHub Actions CI/CD with SonarQube and Apiiro quality gates before production releases.
  • Defined data-management standards adopted across assets for governance, validation, and delivery consistency.

AUG 2022 - NOV 2025

Associate Data Engineer

Shell

Built the data products, models, and operational foundations behind analytics used across business assets.

  • Designed star-schema models for BI dashboards used by 50+ stakeholders across assets.
  • Reduced average dashboard load time by 35% through SQL and warehouse-compute optimisation.
  • Resolved 200+ production incidents through structured triage, root-cause analysis, and durable fixes.

JAN 2022 - JUL 2022

Machine Learning Engineer Intern

ABB

Applied an engineering mindset to a material-strength prediction workflow on Azure.

  • Built preprocessing ETL pipelines and performed exploratory analysis on material-property data.
  • Trained and tuned multiple machine-learning models with GridSearch.
  • Deployed the final model through an Azure pipeline with automated ingestion and retraining.

04 / Selected work

Selected work.

A closer look at the systems behind the outcomes: migration workloads that continue safely at scale, and AI support that keeps operational knowledge useful.

01

50% faster migration throughput

Azure / Python / Microsoft Graph

Data migration tool

An end-to-end migration system for moving documents and metadata at enterprise scale without treating reliability as an afterthought.

  • Used Python workers and Microsoft Graph APIs to move files and metadata concurrently, with work split into independently retriable batches.
  • Persisted item state, checkpoints, and errors in Azure SQL Database so interrupted runs could resume safely without duplicating work.
  • Added live progress monitoring, validation checks, and operational reporting so delivery teams could see throughput, exceptions, and completion status.
AzurePythonMicrosoft GraphAzure SQL DatabaseMultithreading

02

Faster issue resolution and configuration support

Azure OpenAI / Azure AI Foundry

AI support assistant

A subject-matter assistant that gives internal teams grounded help with incidents and product configuration using their approved operational knowledge.

  • Built a retrieval workflow over product manuals, user guides, standard operating procedures, and historical incident records to keep answers tied to internal evidence.
  • Used Azure OpenAI and Azure AI Foundry to orchestrate intent-aware responses, cited knowledge retrieval, and follow-up actions for common support journeys.
  • Designed an Azure-based ingestion path to refresh the knowledge base as documents and incident history change, with telemetry for quality and adoption monitoring.
Azure OpenAIAzure AI FoundryAzure AI SearchAzure Blob StorageApplication Insights

05 / Toolkit

Tools, with intent.

A focused toolkit for moving data securely, modelling it well, and releasing it with confidence.

01

Data platform

Azure DatabricksAzure Data FactoryAzure Data Lake StorageAzure Blob StorageAzure SQL DatabaseAzure AI Search

02

Engineering

PythonSQLPySparkApache SparkMicrosoft Graph APIsMultithreading

03

Delivery & AI

Azure OpenAIAzure AI FoundryGrounded retrievalApplication InsightsGitHub ActionsAzure DevOpsCI/CDSonarQubeApiiro

06 / Credentials

Certified for the work.

01Databricks Certified Associate Data Engineer
02AZ-900 Azure Data Fundamentals
03AI-900 Azure AI Fundamentals
04PL-300 Power BI Data Analyst Associate

07 / Contact

Let's build the reliable version.

For data-engineering work, migration challenges, or a good technical conversation, I'm one message away.

krishnanyadu60@gmail.com
LinkedIn GitHub Bangalore, India