Senior Data Engineer (EST)

Brief Description

We are currently looking for Data Engineers with EST availability to assist in developing intelligent solutions enabling our customers to accelerate discovery, acquire clinical insights, and address R&D challenges.

Responsibilities

Data organization and analysis: handling structured, semi-structured, unstructured, and image-based data.
Building data systems and pipelines
Preparing data for prescriptive and predictive modeling
Designing end-to-end pipelines within a hybrid big data architecture, using Cloud Native AWS, Python, SQL, etc.
Leveraging AWS Cloud services for building data pipelines and ensuring effective monitoring
Collaborating with data scientists and architects across various projects

Requirements

Highly preferred technical skills: Dataiku, Tableau, Streamlit, Artifactory
5+ years of Data Engineering experience utilizing designated technologies and tools.
Profound knowledge and hands-on experience with Python (Pandas, boto3), SQL, Spark, Databricks, DWH, Snowflake
Proficient use of orchestrators such as Airflow
Expertise with AWS services essential for Data Engineering: AWS Glue, AWS Lambda, S3, RDS, Redshift, Athena, SQS, SNS, etc.
Ability to write robust code with Python.
Deep understanding of pub-sub architecture
Strong upper-intermediate or higher (B2+) proficiency in English
Solid analytical and problem-solving skills
A background or experience in life science, particularly in neuroscience (NS) projects, is highly preferred.
Experience in designing laboratory and/or medical data management systems is a plus.
Willing to work East Coast Hours (GMT-4) - at least for the first two-three months, then the schedule may become more compromised/flexible.
Availability until 17:00 Eastern time
Experience in Dataiku, Tableau, Streamlit, and Artifactory