Senior Data Engineer

Consulting Principal AWS Cloud Engineer

Responsibilities: <ul><li>Develop and implement accurate forecasting models to predict product demand using historical data.</li><li>Leverage time series analysis techniques to generate business insights and drive data-driven decisions.</li><li>Continuously optimize forecasting models to adapt to changing business needs and improve forecast accuracy.</li><li>Apply advanced ML algorithms (e.g., XGBoost, Random Forest, Deep Learning) to solve complex business problems.</li><li>Conduct exploratory data analysis (EDA) to uncover trends, anomalies, and actionable insights.</li><li>Develop and validate machine learning models to support various analytical use cases.</li><li>Design scalable and maintainable data pipelines and architectures to support analytical workflows.</li><li>Ensure high data quality and consistency across multiple data sources.</li><li>Collaborate with engineering teams to implement best practices in data storage, processing, and governance.</li><li>Build and deploy data solutions on Databricks, leveraging its ML and Spark capabilities.</li><li>Utilize AWS services (e.g., S3, EC2, Lambda, SageMaker) for scalable cloud-based model training and deployment.</li><li>Ensure cost-effective and optimized use of cloud resources in project implementations.</li><li>Design end-to-end analytics and ML solutions tailored to client needs.</li><li>Lead technical discussions and contribute to solution architecture.</li><li>Translate business requirements into technical specifications and deliver actionable results.</li><li>Understand key metrics and pain points within manufacturing and supply chain operations.</li><li>Use domain knowledge to frame problems accurately and drive impactful analytical outcomes.</li><li>Collaborate with stakeholders to ensure alignment between analytics and business goals.</li><li>Understand SAP modules related to supply chain and manufacturing (e.g., MM, PP, SD) Use SAP knowledge to enhance data modeling and business context understanding.</li></ul> Requirement: <ul><li>Skills Required: o Strong proficiency in Python o Expertise in Time Series Forecasting and Demand Forecasting o Familiarity with Advanced ML Algorithms and Data Analysis o Must have experience in Data Architecture – practical exposure required o Hands-on experience with Databricks and AWS (should be visible in past projects) o Design and solutioning experience highly valued</li><li>Strong background in data architecture, solution design, and end-to-end ML model lifecycle</li><li>Experience as Data Architect, Solution Architect, or in equivalent architectural roles</li><li>Should come from a product-based or data engineering-focused startup background</li></ul>

Responsibilities: <ul><li>Demonstrated ability to drive cultural change and advocate for cloud transformation Key Responsibilities Cloud Strategy &amp; Leadership&nbsp;</li><li>Develop and implement a comprehensive AWS cloud strategy, ensuring alignment with business and technology goals.&nbsp;</li><li>Provide technical leadership and advocacy, championing cloud-native best practices and innovation.&nbsp;</li><li>Lead and drive architectural decisions, ensuring scalability, security, and operational efficiency.</li><li>Cloud Architecture &amp; Design&nbsp;</li><li>Architect secure, scalable, and highly available AWS cloud environments.&nbsp;</li><li>Develop and maintain enterprise-wide cloud blueprints, patterns, and frameworks to drive consistency.&nbsp;</li><li>Research and integrate emerging cloud technologies to foster continuous innovation. Infrastructure as Code &amp; Automation&nbsp;</li><li>Lead adoption and implementation of Infrastructure as Code (IaC) using Terraform, AWS CloudFormation, and Helm.&nbsp;</li><li>Design and optimize CI/CD pipelines to streamline cloud deployments and operations.&nbsp;</li><li>Implement self-healing and automated failover mechanisms to enhance resilience and reliability.</li><li>Kubernetes &amp; Cloud-Native Technologies&nbsp;</li><li>Manage and optimize Kubernetes clusters (EKS, Helm, IAM) for scalability and security.&nbsp;</li><li>Define and enforce best practices for containerized applications and orchestration.&nbsp;</li><li>Improve Kubernetes networking, ingress, and observability solutions to enhance performance. Security &amp; Compliance&nbsp;</li><li>Establish and enforce security best practices for AWS environments, including IAM, WAF, Secret Manager, and encryption.&nbsp;</li><li>Implement zero-trust security models and secure multi-account AWS environments.&nbsp;</li><li>Conduct security audits, incident response, and ensure compliance with industry standards. Monitoring, Logging &amp; Reliability Engineering.</li><li>Deploy and manage monitoring tools (DataDog, Splunk, CloudWatch, Coralogix) to ensure visibility and observability.&nbsp;</li><li>Implement SRE principles to enhance system uptime, reliability, and efficiency.&nbsp;</li><li>Conduct post-mortem analysis and drive continuous improvements in cloud performance. Collaboration &amp; Thought Leadership&nbsp;</li><li>Work closely with software developers, system engineers, and security teams to design and implement cloud solutions.&nbsp;</li><li>Provide mentorship, training, and technical leadership to engineering teams.&nbsp;</li></ul> Requirements: <ul><li>10+ years of experience in IT, with at least 5+ years in AWS cloud engineering and architecture.</li><li>Deep understanding of AWS services, including EC2, EKS, RDS, S3, Lambda, VPC, IAM, Transit Gateway, and CloudFormation.&nbsp;</li><li>Expertise in Kubernetes (EKS, Helm, Daemon Sets, StatefulSets, Karpenter, external-dns, aws-cni).&nbsp;</li><li>Strong experience with Terraform, CloudFormation, and automation scripting (Bash, Python, PowerShell).&nbsp;</li><li>Hands-on experience managing CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps).&nbsp;</li><li>Proficiency in monitoring and logging tools (DataDog, Splunk, Coralogix, CloudWatch).&nbsp;</li><li>Strong networking and security knowledge (DNS, VPC, NAT, Security Groups, IAM).&nbsp;</li><li>Experience designing and developing scalable, production-grade software tools and automation scripts using Python. Preferred Certifications&nbsp;</li><li>AWS Certified Solutions Architect – Professional (or equivalent).&nbsp;</li><li>Additional certifications in Kubernetes (CKA), AWS Security, or DevOps are a plus. Leadership &amp; Soft Skills&nbsp;</li><li>Proven experience leading cloud architecture and strategy initiatives.&nbsp;</li><li>Ability to mentor and guide technical teams in a fast-paced, agile environment.&nbsp;</li><li>Strong problem-solving and troubleshooting skills in complex cloud environments.</li><li>Excellent communication skills with the ability to translate technical concepts for engineering, business, and executive stakeholders.&nbsp;</li></ul>

Skills

Industry

Location

Jobtitle

2 lambda Jobs found

Senior Data Engineer

Consulting Principal AWS Cloud Engineer

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

2 lambda Jobs found

Senior Data Engineer

Consulting Principal AWS Cloud Engineer

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.