// Available for senior roles

AtifImam

Lead / Senior Data Engineer · 8+ Years

Architecting and leading large-scale data platforms across healthcare, hospitality, and e-commerce. I own end-to-end platform decisions , from infrastructure design to engineering standards and deliver measurable outcomes at scale.

INGEST / SOURCES ORCHESTRATION COMPUTE / TRANSFORM DATA WAREHOUSE DATA SERVING / BI GOVERNANCE & QUALITY MySQL Postgres Fresh works AWS S3 Parquet · EKS · EFS Apps Flyer Clever Tap Apache Airflow 50+ DAGs · Retry Logic · Alerting · EKS Deploy PySpark 10× Parquet opt. dbt Transform Modelling Dagster DQ Pipelines Snowflake −30% cost · RBAC Redshift AWS · Matillion BigQuery GCP · −35% latency Analytics Campaign · Revenue Dashboards Business Intelligence Competitive Intel · Pricing PII Masking · RBAC Schema Enforcement Zero-Defect DQ
8+ Years of Experience
50+ Production DAGs Owned
10× Pipeline Performance Gain
Performance Awards

Technical Skills

Languages
Programming & Scripting
Python SQL PySpark Bash / Shell
Data Warehousing
Warehouse Platforms
Snowflake BigQuery Redshift
Orchestration & Transform
Pipeline Tooling
Airflow dbt Dagster Meltano
Compute Engines
Distributed Processing
Apache Spark Parquet PySpark
Cloud & DevOps
Infrastructure & CI/CD
AWS EKS S3 CloudFormation Secrets Manager Lambda Docker Kubernetes GitLab CI/CD
Leadership
People & Architecture
Technical Mentorship Architecture Ownership Eng Standards Stakeholder Mgmt Data Governance

Experience

Dec 2024 – Present
DataBerry Tech
▸ Diaceutics
Healthcare Analytics · Remote
Sr. Data Engineer — Tech Lead
  • Platform tech lead owning end-to-end ELT architecture using Airflow, dbt, Snowflake, and AWS; drove modular data modelling adoption across the engineering team.
  • Reduced monthly Snowflake compute costs by 30% through warehouse sizing optimisation, query profiling, and workload management while cutting dashboard query latency.
  • Designed and enforced a data governance framework covering RBAC policies, tag-based & dynamic masking, and PII protection for sensitive healthcare data.
  • Built a zero-defect data quality framework incorporating schema enforcement and reconciliation logic, setting the quality benchmark for all downstream business deliverables.
Dec 2023 – Dec 2024
Forary Soft
▸ Wayfair
E-Commerce · Remote
Senior Data Engineer
  • Led architectural refactoring of GCP data pipelines, reducing processing time by 35% and significantly improving system reliability for high-volume customer data workflows.
  • Designed and delivered analytical models measuring email/SMS campaign effectiveness, enabling the marketing team to reduce customer fatigue and optimise communication frequency.
  • Engineered fault-tolerant Airflow DAGs with automated alerting and retry logic, achieving near-zero unplanned downtime for 20+ business-critical pipelines.
Aug 2021 – Aug 2023
RedDoorz
▸ Hospitality Tech
Noida · On-site
Sr. Associate Lead / Sr. Data Engineer
  • Led the data platform team as most senior engineer; owned architecture decisions, defined engineering standards, and mentored 3 junior engineers on best practices, version control, unit testing, and automated data validation.
  • Deployed and owned production Airflow on AWS EKS with Secrets Manager and EFS Drivers, creating a secure, scalable orchestration environment serving 50+ DAGs organisation-wide.
  • Architected end-to-end ELT/ETL pipelines in Python and PySpark to ingest large-scale datasets from 6+ sources (MySQL, Postgres, Freshworks, AppsFlyer, Zendesk, CleverTap) into S3, Redshift, and Snowflake.
  • Built a competitive intelligence framework via web scraping (Agoda, tiket.com, Traveloka) to surface real-time market pricing insights, a first-of-its-kind initiative at the company.
  • Provisioned cloud infrastructure via AWS CloudFormation and built GitLab CI/CD pipelines, driving the team's first adoption of infrastructure-as-code practices.
  • 🏆 Employee of the Quarter (2023)
Feb 2020 – Aug 2021
Axtria India
▸ Healthcare Analytics
Noida · On-site
Data Engineer / Associate
  • Achieved a 10× reduction in Parquet file ingestion runtime by redesigning partition strategies and optimising Spark configurations.
  • Core contributor to flagship product DataMax — built complex business logic in PySpark, Redshift, and Matillion that formed the foundation of client-facing analytics.
  • Developed a custom Data Quality Check pipeline in Dagster, setting a new internal standard for data accuracy across all deliverables.
  • 🏆 Bravo Award (2020) for outstanding contribution to product development.
Jan 2018 – Jan 2020
Cognizant
▸ Technology Solutions
Bengaluru · On-site
Programmer Analyst
  • Automated high-volume manual data tasks using PySpark and Python, significantly boosting team productivity.
  • Modernised legacy Hive queries into optimised PySpark scripts, reducing runtime and infrastructure resource consumption.
  • Built pricing and sales data models from SAP systems and contributed to a reusable data loading framework.
  • 🏆 Hats-Off Award (2019) for exceptional performance.

Key Achievements

30%
Snowflake cost reduction via warehouse sizing optimisation, query profiling, and workload management on a healthcare data platform.
Diaceutics · Cost Optimisation
10×
Ingestion performance improvement by redesigning partition strategies and Spark configurations for large-scale Parquet pipelines.
Axtria · Spark Optimisation
35%
GCP pipeline acceleration through end-to-end architectural refactoring of high-volume customer data workflows.
Wayfair · Pipeline Architecture
50+
Business-critical pipelines maintained with zero unplanned downtime via fault-tolerant Airflow DAG design with automated alerting and retry logic.
RedDoorz · Reliability Engineering
🏆
Employee of the Quarter
RedDoorz · 2023
🥇
Bravo Award
Axtria · 2020
Hats-Off Award
Cognizant · 2019

Education

🎓
B.Tech in Computer Science
NIIT University, Neemrana
2013 – 2017
05 / Contact

Let's Build
Something
Together.

Open to senior data engineering roles, platform architecture opportunities, and interesting data infrastructure challenges.