Summary
Overview
Work History
Education
Skills
Timeline
Generic

Shaily Shah

Philadelphia

Summary

Dedicated to using cutting-edge technology to build secure, reliable, and scalable data management systems. Skilled in Data Science, Data Modeling, and Data Engineering to tell compelling data stories.

Overview

7
7
years of professional experience

Work History

Senior Data Engineer

IDEXX
11.2023 - Current
  • Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
  • Built and optimized scalable data pipelines using tools like GitHub Actions for CI/CD, AWS Lambda, Snowflake Integrations and Amazon SNS, improving pipeline reliability and enabling real-time error notifications and automated remediation processes.
  • Developed and maintained performant, business-aligned data models in Snowflake, tuning SQL queries and warehouse usage to reduce compute costs, improve query latency, and support efficient analytics and reporting across teams.
  • Automated and standardized data workflows, including dynamic query generation, centralized error handling, and rigorous testing frameworks, resulting in a 40% reduction in manual engineering effort and enhanced pipeline consistency.
  • Led the company-wide implementation of a data catalog, becoming the first team to standardize metadata and improve data discoverability, while leveraging Snowflake procedures to enforce data quality and governance at scale.
  • Designed and deployed machine learning algorithms to analyze consumer product trends, delivering actionable insights that influenced product strategy, and collaborated cross-functionally to align data solutions with evolving business needs.

Data Engineer

Accenture
02.2022 - 11.2023
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • .Designed and built scalable ETL pipelines using AWS Redshift, Glue, and Lambda, enabling seamless extraction, transformation, and loading of diverse data sources into a centralized warehouse.
  • Developed AWS Glue jobs with PySpark and SQL, implementing advanced transformations (joins, aggregations, filters) and managing SQL scripts to define structured data models within the ETL framework.
  • Automated large-scale data workflows by scheduling and managing Glue jobs via the AWS console, significantly improving the scalability and efficiency of data transformation and loading processes.
  • Utilized Oracle SQL to model complex relational schemas, write advanced queries for data analysis, and ensure data quality and consistency across integrated datasets.
  • Collaborated with cross-functional teams to define data requirements, resolve data issues through root cause analysis, and deliver reliable, tailored data solutions that support critical business decisions.

Data Analyst Consultant

IQVIA
07.2018 - 08.2020
  • Supported a $450M Commercial Agile Program as part of the PMO team, assisting project managers in developing client deliverables, maintaining project plans, and ensuring alignment with program goals and timelines.
  • Managed multiple Operational Support teams, ensuring the stability of client systems and software, resolving data-related issues efficiently, and coordinating with technical teams to implement Commercial Data Warehouse solutions.
  • Acted as the primary liaison between clients and technical teams across various ETL and Business Intelligence projects, translating business needs into actionable technical requirements and ensuring successful project execution.

Education

Master of Science - Business Intelligence & Data Analytics

Carnegie Mellon University
Pittsburgh, PA
12-2021

Bachelor of Science - Applied Mathematics

Pennsylvania State University
University Park, PA
05-2018

Skills

  • Python, SQL, Java
  • ETL development
  • Big data processing
  • Machine Learning
  • AWS Redshift, Glue, Lambda, S3
  • GitHub
  • Tableau
  • Docker
  • Data Science, Data Management, Data Modeling, and Data Engineering

Timeline

Senior Data Engineer

IDEXX
11.2023 - Current

Data Engineer

Accenture
02.2022 - 11.2023

Data Analyst Consultant

IQVIA
07.2018 - 08.2020

Master of Science - Business Intelligence & Data Analytics

Carnegie Mellon University

Bachelor of Science - Applied Mathematics

Pennsylvania State University

Similar Profiles

CREATE PROFILE
Shaily Shah