IAD / SAD / LAD GCP Data Engineer

Java Backend Engineer

Staff Software Engineer - Backend

Responsibilities: Architecture &amp; Design:&nbsp; <ul><li>Design end-to-end data architectures that integrate real-time streaming (Kafka, GCP Pub/sub) and batch processing (Big Query OR Databricks).</li></ul> Pipeline Development:&nbsp; <ul><li>Build and maintain robust ETL/ELT pipelines flowing into BigQuery/Databricks, ensuring data is clean, modeled, and ready for consumption.</li></ul> Custom Integration:&nbsp; <ul><li>Develop custom APIs and microservices using Java/Python/C# to facilitate data movement between niche systems and the data lakehouse.</li></ul> Infrastructure Management:&nbsp; <ul><li>Deploy and manage data workloads on Google Kubernetes Engine (GKE), ensuring high availability and cost-efficiency.</li></ul> Technical Leadership:&nbsp; <ul><li>Mentor junior engineers, conduct code reviews, and establish DataOps best practices (CI/CD, automated testing, and monitoring).</li></ul> Data Reliability:&nbsp; <ul><li>Implement data quality frameworks to ensure accuracy and lineage across the hybrid environment.</li></ul> Requirements: <ul><li>Experience with Terraform &amp; Azure Dev Ops (ADO).</li><li>Knowledge of workflow orchestrators like Apache Airflow (Cloud Composer).</li><li>Experience implementing Data Governance (metadata management, data cataloging).</li><li>Data Processing &amp; Storage</li><li>BigQuery: Expert-level SQL and experience with partition/cluster optimization.</li><li>Databricks: Deep knowledge of the Lakehouse architecture, Delta Lake, and Spark (PySpark/Scala) Software Engineering &amp; APIs</li><li>Languages: Proficiency in Java/Python/C# for backend development and custom data connectors.</li><li>API Design: Proven ability to build and consume RESTful APIs for data ingestion Streaming &amp; Infrastructure</li><li>Kafka/GCP Pub-Sub: Experience building event-driven architectures and managing producers/consumers.</li><li>GKE: Proficiency in containerization (Docker) and orchestrating data workloads on Kubernetes.</li></ul>

Responsibilities: <ul><li>Collaborate with team, high availability, concurrent and fault tolerant software systems.</li><li>Significantly contribute to development of Aladdin’s global, multi-asset trading platform.</li><li>Work with product management and business users to define the roadmap for the product.</li><li>Design and develop innovative solutions to complex problems, identifying issues and roadblocks.</li><li>Apply validated quality software engineering practices through all phases of development.</li><li>Ensure resilience and stability through quality code reviews, unit, regression and user acceptance testing, dev ops and level two production support.</li><li>Be a leader with vision and a partner in brainstorming solutions for team productivity, efficiency, guiding and motivating others.</li><li>Drive a strong culture by bringing principles of inclusion and diversity to the team and setting the tone through specific recruiting, management actions and employee engagement.</li><li>For VP Level: In addition to above, a VP level candidate should be able to lead individual projects priorities, deadlines and deliverables using AGILE methodologies.</li></ul> Requirements: Qualifications: <ul><li>B.S. / M.S. degree in Computer Science, Engineering, or a related subject area</li><li>For VP Level: 8+ years of proven experience</li><li>For Associate Level: 4+ years of experience</li></ul> Skills and Experience: <ul><li>A proven foundation in core Java and related technologies, with OO skills and design patterns</li><li>Track record building high quality software with design-focused and test-driven approaches</li><li>Good hands-on object-oriented programming knowledge in Java, Spring, TypeScript, JavaScript, Microservices, Angular (2.0+), React.</li><li>Strong knowledge of Open-Source technology stack (Spring, Hibernate, Maven, JUnit, etc.).</li><li>Experience with relational database and/or NoSQL Database (e.g., Apache Cassandra)</li><li>Great analytical, problem-solving and communication skills</li><li>Some experience or a real interest in finance, investment processes, and/or an ability to translate business problems into technical solutions.</li><li>For VP Level: In addition to the above, a VP level candidate should have experience leading development teams, projects or being responsible for the design and technical quality of a significant application, system, or component. Ability to form positive relationships with partnering teams, sponsors, and user groups.</li></ul> Nice to have and opportunities to learn: <ul><li>Exposure to building microservices and APIs ideally with REST, Kafka or gRPC.</li><li>Experience working in an agile development team or on open-source development projects.</li><li>Experience with optimization, algorithms or related quantitative processes.</li><li>Exposure to high scale distributed technology like Kafka, Mongo, Ignite, Redis</li><li>Experience with Cloud platforms like Microsoft Azure, AWS, Google Cloud</li><li>Experience with DevOps and tools like Azure DevOps</li><li>Experience with AI-related projects/products or experience working in an AI research environment.</li><li>A degree, certifications or opensource track record that shows you have a mastery of software engineering principles.</li></ul>

Responsibilities: Lead your team’s engineering efforts and demonstrate ownership of features, projects, modules, and services that you and your team deliver. Lead design and development efforts of existing and new payment experiences using a wide variety of technologies. Play a key role in the broader architectural decision-making processes. Act as a strong advocate for clean and scalable principles and practices in all areas, including coding, documentation, automation etc. Participate in formal and informal code and design reviews to hold quality high. Be a champion of high-performing, secure, and reliable software services. Identify critical non-functional requirements for the work your team is prioritizing (Availability, Security, Performance, Scalability, etc.) Provide technical leadership to your team across all phases of the software development lifecycle. Collaborate and communicate effectively with all technical and non-technical partners and stakeholders (Architecture, Developer Experience, Product, Design, Analytics, Legal, Marketing, etc.) Work with your Agile team to achieve shared understanding around the new products and features under consideration. Continuously learn by staying on top of the latest technology trends and share your knowledge and experience with your peers, adjacent teams, and across the organization. Collaborate frequently with other developers and teams to design and implement the cutting-edge reliable solutions. Understand and apply our technical architecture to ensure consistent, reliable, and secure deployments. Enhance and maintain existing product capabilities as required. Actively contribute to the test suites to enable speedy and reliable continuous integration. Guide continuous improvements to our build, deploy, and go to market processes. Bring fresh ideas for how to continuously improve our software, and your team. Advocate for ways to avoid and remediate technical debt on an ongoing basis. Actively participate in program planning, influencing the product and technology roadmap, and driving outcomes.  Requirements: You have a Bachelor’s or Master’s degree in Computer Science, or a related field of study. You have 8+ years of professional experience in the software industry. You are proficient and have strong skills in Java, object oriented, and functional programming, and are familiar with all related and latest topics and technologies. You care about writing high-quality code, and you've written your fair share of automated tests to back up your code. You're passionate about high-scale, high-throughput, low-latency systems, and about creating compelling experiences and integrations.  You're a problem solver, and you enjoy working both independently and collaboratively to identify the root cause of any issue and solve it with a can-do mindset.  You have experience mentoring less seasoned team members. You are open to and enjoy collaborating with teammates in non-technical roles as well.  Experience in developing software for distributed systems with high performance, scalability, and availability. Familiar and comfortable with the technologies, the tradeoffs, and the design patterns emerging in application development. Experience in developing high performance, scalable and available web services using J2EE and frameworks such as RestEasy, Spring, Apache CXF and Jersey.. Good understanding of web services and SOA related standards like REST/OAuth/JSON and SOAP/WSDL. Experience in payments processing or e-commerce domains. Experience working in a global-scale SaaS environment. Thrive in a fast-paced, dynamic environment. You have a bias towards action and results. 

Skills

Industry

Location

Jobtitle

3 apache Jobs found

IAD / SAD / LAD GCP Data Engineer

Java Backend Engineer

Staff Software Engineer - Backend

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

3 apache Jobs found

IAD / SAD / LAD GCP Data Engineer

Java Backend Engineer

Staff Software Engineer - Backend

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.