Intermediate / Senior Data Engineer

Senior AI Engineer

Data Engineer

IAD / SAD / LAD GCP Data Engineer

Senior - Data Engineer

Senior Proactive Engineer

Responsibilities: <ul><li>Designing, implementing, and optimising scalable data pipelines using Python, PySpark, and Databricks.</li><li>Driving the delivery of customer-facing data products through APIs, Databricks-based sharing, and event-driven mechanisms (e.g., Kafka or similar).</li><li>Taking ownership of end-to-end features — from scoping and development to deployment and monitoring.</li><li>Leading and participating in technical design discussions, contributing to architectural improvements and long-term data strategy.</li><li>Mentoring and coaching junior engineers actively while supporting their technical and professional development.</li><li>Collaborating with cross-functional teams to understand business requirements and translate them into technical solutions.</li><li>Conducting peer code reviews, upholding code quality standards, and championing continuous improvement practices.</li><li>Contributing to the team’s agile delivery process and provide input during planning and retrospectives.</li></ul> Requirements: <ul><li>Have extensive experience in data engineering or backend software engineering with a data focus.</li><li>Be proficient in Python, PySpark, and working within Databricks environments.</li><li>Have hands-on experience designing and delivering data products via REST APIs, event-driven systems, or data sharing platforms like Databricks Delta Sharing.</li><li>Have a solid understanding of distributed data processing, ETL/ELT workflows, and data lake/lakehouse architectures.</li><li>Have experience with cloud platforms (e.g., AWS, Azure, GCP) and modern data tooling.</li><li>Have a proven track record of mentoring or coaching other engineers.</li><li>Have effective communication and collaboration skills, including the ability to explain complex concepts to non-technical stakeholders.</li><li>Be familiar with agile development practices</li></ul>

Role Description: <ul><li>We are building a new data engineering team to support a strategic move from legacy data estates to a modern data platform built on Databricks.</li><li>This role plays a key part in re-engineering existing systems, improving scalability, and enabling future innovation.</li></ul> Responsibilities: <ul><li>Transition legacy data systems to Databricks.</li><li>Build and maintain robust, scalable data pipelines.</li><li>Work closely with subject matter experts, product teams, and stakeholders to understand business logic.</li><li>Apply best practices in data engineering and programming.</li><li>Mentor junior engineers and contribute to knowledge sharing.</li><li>Participate in code reviews and technical discussions.</li></ul> Requirements: <ul><li>Hands-on experience in software or data engineering roles.</li><li>Strong proficiency in Python and working knowledge of PySpark.</li><li>Experience or strong interest in Databricks.</li><li>Solid understanding of SQL and structured data.</li><li>Experience with cloud platforms (AWS preferred; Azure/GCP acceptable).</li><li>Familiarity with REST APIs and event-driven architectures.</li><li>Experience using Git or similar version control systems.</li><li>Strong problem-solving skills and collaborative mindset.</li></ul> Preferred Experience <ul><li>Experience working on data platform modernization or migration projects.</li><li>Ability to refactor and improve legacy codebases.</li><li>Exposure to AI/ML data pipelines is an advantage.</li></ul> Why Join Us <ul><li>Opportunity to work on a strategic, high-impact data platform transformation.</li><li>Exposure to cutting-edge technologies including Databricks and cloud platforms.</li><li>Collaborative, inclusive team culture with strong mentorship.</li><li>Clear opportunities for career growth and skill development.</li></ul>

Role Overview: <ul><li>We are building a new data engineering team to support a strategic move from legacy data estates to a modern data platform built on Databricks.&nbsp;</li><li>This role plays a key part in re-engineering existing systems, improving scalability, and enabling future innovation.</li></ul> Responsibilities: <ul><li>Lead the transition of legacy data systems to Databricks, ensuring reliability and performance.</li><li>Design, build, and maintain robust, scalable data pipelines to support analytical and operational use cases.</li><li>Collaborate closely with subject matter experts, product teams, and business stakeholders to understand and implement business logic accurately.</li><li>Apply data engineering and programming best practices to ensure high-quality, maintainable, and secure solutions.</li><li>Mentor junior engineers, fostering technical growth and promoting knowledge sharing across the team.</li><li>Participate in code reviews, architectural discussions, and technical decision-making to uphold engineering standards.</li></ul> Requirements:&nbsp; Required Skills &amp; Experience: <ul><li>Hands-on experience in software or data engineering roles.</li><li>Strong proficiency in Python and working knowledge of PySpark.</li><li>Experience or strong interest in Databricks.</li><li>Solid understanding of SQL and structured data.</li><li>Experience with cloud platforms (AWS preferred; Azure/GCP acceptable).</li><li>Familiarity with REST APIs and event-driven architectures.</li><li>Experience using Git or similar version control systems.</li><li>Strong problem-solving skills and collaborative mindset.</li></ul> Preferred Experience: <ul><li>Experience working on data platform modernization or migration projects.</li><li>Ability to refactor and improve legacy codebases.</li><li>Exposure to AI/ML data pipelines is an advantage.</li></ul>

Responsibilities: Architecture &amp; Design:&nbsp; <ul><li>Design end-to-end data architectures that integrate real-time streaming (Kafka, GCP Pub/sub) and batch processing (Big Query OR Databricks).</li></ul> Pipeline Development:&nbsp; <ul><li>Build and maintain robust ETL/ELT pipelines flowing into BigQuery/Databricks, ensuring data is clean, modeled, and ready for consumption.</li></ul> Custom Integration:&nbsp; <ul><li>Develop custom APIs and microservices using Java/Python/C# to facilitate data movement between niche systems and the data lakehouse.</li></ul> Infrastructure Management:&nbsp; <ul><li>Deploy and manage data workloads on Google Kubernetes Engine (GKE), ensuring high availability and cost-efficiency.</li></ul> Technical Leadership:&nbsp; <ul><li>Mentor junior engineers, conduct code reviews, and establish DataOps best practices (CI/CD, automated testing, and monitoring).</li></ul> Data Reliability:&nbsp; <ul><li>Implement data quality frameworks to ensure accuracy and lineage across the hybrid environment.</li></ul> Requirements: <ul><li>Experience with Terraform &amp; Azure Dev Ops (ADO).</li><li>Knowledge of workflow orchestrators like Apache Airflow (Cloud Composer).</li><li>Experience implementing Data Governance (metadata management, data cataloging).</li><li>Data Processing &amp; Storage</li><li>BigQuery: Expert-level SQL and experience with partition/cluster optimization.</li><li>Databricks: Deep knowledge of the Lakehouse architecture, Delta Lake, and Spark (PySpark/Scala) Software Engineering &amp; APIs</li><li>Languages: Proficiency in Java/Python/C# for backend development and custom data connectors.</li><li>API Design: Proven ability to build and consume RESTful APIs for data ingestion Streaming &amp; Infrastructure</li><li>Kafka/GCP Pub-Sub: Experience building event-driven architectures and managing producers/consumers.</li><li>GKE: Proficiency in containerization (Docker) and orchestrating data workloads on Kubernetes.</li></ul>

Responsibilities: <ul><li>Uses a set of tasks and techniques to work as a liaison among and elicit the needs of stakeholders to define and validate solutions that meet business needs, goals, or objectives.</li><li>Analyzes and synthesize information elicited from stakeholders, defines, and manages the plan to deliver requirements and documents, and manages requirements throughout the project life cycle.</li><li>Develop ETL (Extract, transform, load) process to help extract and manipulate data from multiple sources.</li><li>Reformulating or automating the existing data workflows to maximize their functioning and greater scalability.</li><li>Critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details, and produce actionable business insights out of it.</li><li>Need to conduct complex data analysis and improve data quality and efficiency.</li><li>Develop models to create reporting infrastructure/dashboards for business process management and data mining.</li><li>Design Summary, Detail, and Dashboard reports and management summaries which present data findings in a professional, concise, and readable format appropriate for content and audience.</li><li>Solve ad-hoc requirements of Management related to data for critical decision making</li><li>Troubleshoot data inaccuracies, identify root causes, and take corrective action</li><li>Effectively communicate and translate quantity findings (Storytelling with data) inclusive of key insights and actionable recommendations to optimize performance</li><li>Optimize reports to ensure a responsive solution when visualizing vast amounts of data.</li></ul> Requirements: <ul><li>5+ years of data engineering experience in ETL design, development, optimization &amp; testing using, Alteryx, Data Bricks, Cloud AWS Services, Python, SQL scripts,</li><li>5+ years of hands-on experience in business intelligence and in configuring, designing, and building visualizations and dashboards using Tableau and other BI tools (Tableau Prep, Tableau Dashboard, Tableau Server, Business Objects, Power BI, etc.)</li><li>Excellent problem-solving, communication, and organizational skills.&nbsp;</li><li>Experience in performance tuning and optimization of ETL processes to enhance efficiency and minimize data processing time</li><li>Detail-oriented with excellent time management and organizational skills to meet a critical deadline</li><li>Self-motivated, ability to prioritize work and multi-task across many assignments in a fast-paced work environment</li><li>Collaborated with cross-functional teams to gather requirements, design data models, and implement scalable data architectures to support business analytics and reporting needs</li><li>Proven ability to work independently and with a team.</li><li>Ability to interpret technical or dashboard structure</li><li>Experience in business domains – supply chain, pricing, sales &amp; marketing, sales, finances</li></ul>

Responsibilities: <ul><li>Analyze DEX tool data to identify trends, predict issues, and propose proactive interventions to enhance employee digital experience.</li><li>Develop, test, and maintain scripts and tools using PowerShell and Python to automate repetitive tasks and improve system performance.</li><li>Work with data warehouses like Redshift and analytics platforms such as Databricks. Use SQL or another programming language to work with databases and create dashboards to extract insights and develop actionable recommendations.</li><li>Develop dashboards and reporting tools using SysTrack and Microsoft Power BI to provide visibility into key performance metrics.</li><li>Collaborate with IT Service Desk and Desktop Support Teams to identify opportunities for automation and efficiency improvements.</li><li>Proactively engage with stakeholders to understand business requirements and translate them into technical solutions.</li><li>Design and implement innovative ideas to enhance customer service and reduce the mean time to resolution (MTTR).</li><li>Act as a consultant to various teams, providing technical expertise in the use of DEX tools and scripting languages.</li><li>Lead initiatives to integrate new technologies or methodologies that improve the IT environment and employee satisfaction.</li><li>Conduct Root Cause Analysis (RCA) on recurring issues and propose permanent solutions.</li><li>Engage with vendor support resources to resolve complex technical challenges and evaluate new technologies.</li><li>Work with APIs to integrate and enhance system capabilities, ensuring seamless interaction between tools and platforms.</li></ul> Requirements: <ul><li>Proficiency in DEX tools like SysTrack, Nexthink, or similar platforms.</li><li>Strong coding skills in PowerShell and Python.</li><li>Hands-on experience with data analytics platforms, such as Databricks, and data warehouses like Redshift. Proficiency in SQL as a programming language for working with databases and creating dashboards.</li><li>Expertise in Microsoft Power Apps and Power BI for data visualization and automation.</li><li>Experience in working with APIs for system integration and enhancements.</li><li>Deep understanding of IT environments, including endpoint devices, software, and cloud-based tools.</li><li>Ability to interpret data and provide actionable insights to improve digital employee experience.</li><li>Strong problem-solving skills, with experience conducting RCA and developing innovative solutions.</li><li>Demonstrated ability to identify and act on trends and opportunities in emerging technologies.</li><li>Knowledge of IT Service Management frameworks (e.g., ITIL) and their practical application.</li></ul>

Skills

Industry

Location

Jobtitle

6 databricks Jobs found

Intermediate / Senior Data Engineer

Senior AI Engineer

Data Engineer

IAD / SAD / LAD GCP Data Engineer

Senior - Data Engineer

Senior Proactive Engineer

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

6 databricks Jobs found

Intermediate / Senior Data Engineer

Senior AI Engineer

Data Engineer

IAD / SAD / LAD GCP Data Engineer

Senior - Data Engineer

Senior Proactive Engineer

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.