Description

Lead Data Engineer with 9+ years of experience building reliable and scalable data platforms across AWS and modern big data stacks.

I help companies design and implement production-grade data pipelines, real-time streaming systems, and analytics-ready data warehouses using technologies like Spark, Databricks, Python, SQL, and Airflow.

I’ve led data engineering teams and delivered large-scale data solutions for global companies including EPAM Systems and Intuit, working with high-volume datasets and complex data ecosystems.

My expertise includes ETL architecture, data platform design, pipeline performance optimization, and cloud-native data engineering on AWS and Azure.

Currently exploring LLM-driven data workflows, RAG architectures, and AI-augmented data platforms.

Available for remote freelance projects, consulting, and short-term engagements across Europe with European startups and data teams.

Languages

English
Native or bilingual
Hindi
Native or bilingual

Workplace preferences

Remote only

Primarily works remotely

EPAM Systems
Lead Data Engineer
DIGITAL AND IT
February 2024 - Today (2 years and 4 months)
Sofia, SF, Bulgaria
I lead a team managing marketing data pipelines, bringing data from various sources into AWS, and constructing data marts to enhance data analysis capabilities. I played a crucial role in architecting the overall data strategy for the marketing data platform, utilizing Databricks, Spark, Python, SQL, Airflow, AWS EMR, Lambda, S3. Learning & creating POCs on LLM.
Databricks Python SQL Microsoft Azure DevOps
Intuit
Senior Software Engineer
September 2021 - February 2024 (2 years and 5 months)
Bengaluru, Karnataka, India
I led a team of engineers in architecting and building robust Spark ETL data pipelines on AWS for loyalty and audit data preparation. My role involves designing and developing scalable data architecture, ensuring efficient data processing using technologies like Databricks, Spark, Python, SQL, Airflow, AWS EMR, Lambda, and S3.
Apache Spark Apache Kafka SQL Python Amazon Web Services
Reliance Jio
Deputy Manager
TELECOMMUNICATIONS
August 2020 - September 2021 (1 year and 1 month)
Kolkata, West Bengal, India
developed Spark streaming pipelines to process application logs, enabling real-time monitoring of application health. I primarily worked with Scala, Python, and SQL to deliver effective data processing solutions.
Scala SQL Python Apache Kafka Elasticsearch