Senior Data Scientist II

Senior Data Engineer

Data Engineer / Senior / Supervisor

About the Role : <ul><li>As a data scientist on our team, you will work on new product development in a small team environment writing production code in both run-time and build-time environments.&nbsp;</li><li>You will help propose and build data-driven solutions for high-value customer problems by discovering, extracting, and modeling knowledge from large-scale natural language datasets including matter and contract repository, invoice/legal spend data and work management.&nbsp;</li><li>You will prototype new ideas, collaborating with other data scientists as well as product designers, data engineers, front-end developers, and a team of expert legal data annotators.</li><li>You will get the experience of working in a start-up culture with the large datasets and many other resources of an established company.</li><li>We are committed to advancing gender diversity within the technology sector and supporting greater representation of women in tech. To further this commitment,</li></ul> Responsibilities: <ul><li>Develop and implement LLM-based applications tailored for legal use-cases&nbsp;</li><li>Evaluate and help maintain our data assets and training/evaluation data sets&nbsp;</li><li>Design and build pipelines for preprocessing, annotating, and managing legal document datasets&nbsp;</li><li>Collaborate with legal experts to understand requirements and ensure ML-applications meet domain-specific needs&nbsp;</li><li>Conduct experiments and evaluate model performance to drive continuous improvements&nbsp;</li><li>Fine-tune and deploy large language models to enhance their performance on legal text processing tasks&nbsp;</li><li>Interface with other technical personnel or team members to finalize requirements.&nbsp;</li><li>Work closely with other development team members to understand complex product requirements and translate them into software designs.&nbsp;</li><li>Successfully implement development processes, coding best practices, and code reviews for production environments.</li></ul> Requirements:&nbsp; <ul><li>Able to work in person 2 days per week&nbsp;</li><li>Bilingual English and Spanish&nbsp;</li><li>Practical experience with large language models, prompt engineering, fine-tuning RAG-based applications and benchmarking, using frameworks such as LangChain&nbsp;</li><li>MS in Data Science, Computer Science, Statistics, Machine Learning, or relevant work experience&nbsp;</li><li>Practical experience in Natural Language Processing methods and libraries such as spaCy, word2vec, Flair, BERT (ways to vectorize text data)&nbsp;</li><li>Formal training in machine learning: dimensionality reduction, clustering, embeddings, and sequence classification algorithms&nbsp;</li><li>Strong Python background&nbsp;</li><li>Knowledge of AWS, GCP, Azure, or other cloud platform&nbsp;</li><li>Understanding of data modeling principles and complex data models.&nbsp;</li><li>Proficiency with relational and NoSQL databases as well as vector stores (e.g., MySQL, Postgres, Solr, Elasticsearch/OpenSearch)</li><li>Knowledge of Spark-Scala, Ray or other distributed computing systems highly preferred&nbsp;</li><li>Knowledge of API development, containerization, and machine learning deployment highly preferred&nbsp;</li><li>Experience with ML Ops/AI Ops including experiment tracking tools like LangFuse and DVC&nbsp;</li><li>Experience with deep learning frameworks such as PyTorch, Tensorflow and Hugging Face Transformers Work in a way that works for you We promote a healthy work/life balance across the organization. </li><li>We offer an appealing working prospect for our people.&nbsp;</li><li>With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate. </li><li>Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.</li></ul>

Responsibilities: <ul><li>Develop and maintain data pipelines for efficient extraction, transformation, and loading (ETL) processes.</li><li>Design and optimize data storage solutions, including Amazon Redshift data warehouses and Amazon S3 data lakes</li><li>Ensure data quality and integrity through validation, cleansing, and error handling processes.</li><li>Collaborate with data analysts, data architects, and software engineers to understand data requirements and deliver relevant data sets for business intelligence.</li><li>Implement data security measures and access controls to protect sensitive information.</li><li>Automate and improve data processes and workflows for scalability and efficiency.</li><li>Monitor data infrastructure performance and address any issues promptly.</li><li>Stay updated on industry trends and emerging technologies in data engineering.</li><li>Document data pipelines, processes, and best practices to facilitate knowledge sharing.</li><li>Continuously optimize data architecture to support the companys evolving data needs.</li><li>Work cross-functionally to drive data-driven decision-making within the organization.</li></ul> Requirements: <ul><li>Bachelors degree in Computer Science, Information Technology.</li><li>Minimum 6 years of experience in data engineering - CS</li><li>Knowledge of AWS services, particularly Glue, Redshift and S3.</li><li>Data Storage and Management - Amazon S3, Amazon RDS and DynamoDB</li><li>Data Processing and ETL - AWS Glue</li><li>Data Warehousing - Amazon Redshift</li><li>Programming and Scripting:</li><li>Proficiency in languages like Python, Java, or Scala for data manipulation and automation.</li><li>Data Modeling and Architecture&nbsp;</li><li>Monitoring and Optimization - Using AWS CloudWatch for monitoring and optimizing data workflows</li><li>Proficiency in SQL and database management.</li><li>Experience with ETL (Extract, Transform, Load) processes.</li><li>Familiarity with data warehousing and cloud platforms (AWS, Azure, or Google Cloud).</li><li>Strong data modeling skills</li></ul>

Role Description:The Data Engineering Senior Supervisor will lead a small team of data engineering professionals to design, build and operate high performance data centric products or solutions through the use of modern engineering practices and technologies.In this role, you will provide guidance to ensure the delivered data centric products or solutions are scalable, sustainable and robust.You will also lead team development and cross team relationships and delivery to advance the company's engineering delivery.Responsibilities:Lead a local or regional team of engineering professionals that design, develop, deploy and enhance new and existing data centric products or solutions through the use of modern platforms and technologies.Provide routine inputs and guidance to the data engineering team on business requirements analysis, technical specification's preparation, product delivery, testing and operation to support businesses strategic direction.Coach engineers, share relevant technical approaches, identify new trends, modern skills and present new methodologies within the data engineering community.Lead and develop a team, coach and make decisions related to talent management, hiring, performance, and disciplinary actions.Other duties as assignedRequirements:Minimum QualificationsBachelor's degree in a related field or equivalent experience.Minimum of four years of related work experience.Minimum of two years leading a team of Data Engineers.Preferred QualificationsConfirmed data engineering experience with data storage and management of large, heterogenous datasets, including formats, structures, and cataloging with such tools as Iceberg, Parquet, Avro, ORC, S3, HFDS, HIVE, Kudu or others.Experience leading Big Data engineering teams working in environments such as Hadoop and SparkExperience leading technology strategies with cloud Platforms including AWS, GCP or AzureExperience leading engineering teams working in streaming and stream integration or middleware platforms, tools, and architectures such as Kafka, Flink, JMS, or Kinesis.Confirmed knowledge of best practice patterns and how to apply them to modern data architectures, including data warehouses, data lakes, data mesh, hubs and associated capabilities including ingestion, governance, modeling, observability and more.Experience leveraging transformation and modeling tools, including SQL based transformation frameworks, orchestration and quality frameworks including dbt, Apache Nifi, Talend, AWS Glue, Airflow, Dagster, Great Expectations, Oozie and others.Strong programming knowledge of SQL, Python, R, Java, Scala or equivalent.Proficiency in engineering tooling including docker, git, and container orchestration services.Strong experience leading devops teams with demonstratable understanding of associated best practices for code management, continuous integration, and deployment strategies.Experience and knowledge of data governance considerations including quality, privacy, security associated implications for data product development and consumption.A passion for quality and continuous improvement with an owners mindset.Ability to work effectively as part of a team, group and cultureAbility to navigate ambiguity and work in agile ways.

Skills

Industry

Location

Jobtitle

3 scala Jobs found

Senior Data Scientist II

Senior Data Engineer

Data Engineer / Senior / Supervisor

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

3 scala Jobs found

Senior Data Scientist II

Senior Data Engineer

Data Engineer / Senior / Supervisor

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.