Harshitha Shetty

• • Led the design, development, and optimization of end-to-end Azure data engineering solutions for large-scale insurance datasets. Used Azure Data Factory for orchestration, Azure Databricks with PySpark for processing, and ADLS Gen2 for storage—handling ingestion, transformation, and data curation across multiple domains.

• • Built scalable data pipelines on Azure Databricks to process Delta Lake

• • I designed and built database solutions that help the trading desk and the company track P&L.

• • I set up data engineering pipelines for big data ingestion with Azure Databricks. On top of that, I handled data modeling and built a data warehouse using Azure Synapse, plus managed a data lake on Azure Blob Storage.

• • I managed CI/CD pipelines with Azure DevOps and ran orchestrations with Airflow.

• • I also worked on different POCs with Snowflake and DBT. When it came to P&L reporting, I built and managed the data, and I pitched in on projects to improve processes, boost efficiency, and drive innovation across the team.

• • Design and build a custom Customer Data Platform (CDP) using Matillion for orchestration and ETL, Python to develop the core logic, and Snowflake as the data warehouse.

• • Created and implemented solutions on AEP to achieve more accurate and efficient results.

• • Lead the team to build deployment modules for AEP schema, field groups, datasets, and identities.

• • Orchestrate journey to run campaigns, then extract reports through CJA. Used the UI to build schemas, field groups, datasets, segments, and profiles.

• • Worked directly with business owners and employees to gather information and truly understand how things operate on a day-to-day basis.