I

IAD / SAD / LAD GCP Data Engineer

Chennai India

7 days ago


Years of Experience

4 - 23 years

Workplace Type

On-site

Seniority Type

Associate

Industry

Logistics and Supply Chain


Analyse your salary

Want to know how much a IAD / SAD / LAD GCP Data Engineer make in Chennai India?

Get Salary insights for IAD / SAD / LAD GCP Data Engineer in Chennai India. Know how your salary compares to the industry average. Our AI analyzer uses other candidates' stated pay expectations to identify market trends.


Skills

GcpBig QueryDatabricksJavaKubernetesData EngineeringPythonApache Airflow

Contact our TA to know more about the job

Rashi Modi

Talent Advocate at WhiteCrow


Description

About our client

Our client is an American multinational shipping & receiving and supply chain management company founded in 1907. Operating in more than 220 countries and territories, they are committed to moving the world forward by delivering what matters. Beginning as a small messenger service and a $100 loan, they now have more than 500,000 users around the globe. They are a transportation and logistics leader, offering innovative solutions to customers, big and small. They understand and appreciate their responsibility to help build safer, stronger and more resilient communities founded on justice and economic opportunity for all, supported by a healthy, sustainable global environment.


Job description

Responsibilities:


Architecture & Design: 


  • Design end-to-end data architectures that integrate real-time streaming (Kafka, GCP Pub/sub) and batch processing (Big Query OR Databricks).


Pipeline Development: 


  • Build and maintain robust ETL/ELT pipelines flowing into BigQuery/Databricks, ensuring data is clean, modeled, and ready for consumption.


Custom Integration: 


  • Develop custom APIs and microservices using Java/Python/C# to facilitate data movement between niche systems and the data lakehouse.


Infrastructure Management: 


  • Deploy and manage data workloads on Google Kubernetes Engine (GKE), ensuring high availability and cost-efficiency.


Technical Leadership: 


  • Mentor junior engineers, conduct code reviews, and establish DataOps best practices (CI/CD, automated testing, and monitoring).


Data Reliability: 


  • Implement data quality frameworks to ensure accuracy and lineage across the hybrid environment.


Requirements:


  • Experience with Terraform & Azure Dev Ops (ADO).
  • Knowledge of workflow orchestrators like Apache Airflow (Cloud Composer).
  • Experience implementing Data Governance (metadata management, data cataloging).
  • Data Processing & Storage
  • BigQuery: Expert-level SQL and experience with partition/cluster optimization.
  • Databricks: Deep knowledge of the Lakehouse architecture, Delta Lake, and Spark (PySpark/Scala) Software Engineering & APIs
  • Languages: Proficiency in Java/Python/C# for backend development and custom data connectors.
  • API Design: Proven ability to build and consume RESTful APIs for data ingestion Streaming & Infrastructure
  • Kafka/GCP Pub-Sub: Experience building event-driven architectures and managing producers/consumers.
  • GKE: Proficiency in containerization (Docker) and orchestrating data workloads on Kubernetes.

Sign up to create profile

Fill in your details to create profile on WhiteCrow

Why get hired via WhiteCrow?

We take your privacy seriously

We take your privacy seriously

By default, your profile stays hidden from past & current employers. We only showcase your anonymous profile to employers and seek your permission before revealing your full profile.

Know more

Personal & Dedicated Talent Advocate

Personal & Dedicated Talent Advocate

Our Talent Advocates are here to help: from providing insider knowledge to guiding you through interviews to negotiations.

Know more

Exclusive Jobs from Top Companies

Exclusive Jobs from Top Companies

Gain access to mid to senior level executive job opportunities at more than 90 of the Fortune 500 companies globally on WhiteCrow.

Know more

Why get hired via WhiteCrow?

With our unique combination of AI matching technology and human expertise, WhiteCrow will help you get discovered for your unicorn role.

Know more

Contact our TA to know more about the job

Rashi Modi

Talent Advocate at WhiteCrow


People also viewed

Principal HANA Database Administrator

Bengaluru, India

2 days ago


Mechatronics Engineer

Pune, India

2 days ago


Tax Supervisor

Mumbai, India

7 days ago


Maintenance Engineer

Istanbul, Turkey

10 days ago


Finance Analyst

Mumbai, India

10 days ago


Customer Service Specialist

Penang, Malaysia

11 days ago


View more jobs

Sign up to create profile

Fill in your details to create profile on WhiteCrow