Job Title: Senior Data Engineer (AWS or Azure) Job Type: Full-Time / Contract (W2) Work Location: Sunnyvale, CA (Onsite/Hybrid as per client requirement) Domain: E-commerce or Retail Experience: 8+ Years Responsibilities • Architect and maintain enterprise data pipelines supporting Retail’s e-commerce operations. • Ensure data quality, governance, and scalability across multi-petabyte datasets. • Collaborate with data scientists, analysts, and product teams to deliver data solutions. • Optimize pipelines for near real-time analytics and machine learning. Job Duties • Build ETL/ELT pipelines using Spark, PySpark, Airflow, Databricks. • Develop data lake/warehouse solutions with Snowflake, Redshift, BigQuery, Delta Lake. • Integrate structured/unstructured data from e-commerce, payment, and inventory systems. • Deploy pipelines on AWS (Glue, EMR, S3, Lambda), Azure Synapse, GCP BigQuery. • Implement data quality frameworks and governance (Great Expectations, dbt). • Enable real-time streaming pipelines with Kafka, Kinesis, Pub/Sub. • Collaborate on MLOps workflows for predictive analytics and personalization. Required Skills • 8+ years in Data Engineering. • Expertise in SQL, Python, Spark, Airflow. • Strong knowledge of Snowflake, Redshift, or Databricks. • Hands-on experience with AWS/Azure/GCP cloud data services. Desired Skills • Familiarity with ML model pipelines. • Knowledge of e-commerce transaction and clickstream data processing.