Data Engineer
We are seeking a skilled and motivated Data Engineer to join the IT RDM CI Data Excellence team. In this role, you will play a pivotal part in enhancing our data infrastructure, optimizing data flows, and ensuring the availability and quality of strategically critical data assets from both internal and external providers.
You will enable fast and reliable data delivery to the right environments, supporting cutting-edge use cases in Artificial Intelligence (AI) and Machine Learning (ML). Collaboration is key: you’ll work closely with researchers, data scientists, and analysts to build a consistent and scalable data ecosystem across multiple analytics and AI initiatives.
Tasks and responsabilities:
- Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics.
- Collaborate with data architects, modelers and IT team members to help define and evolve the overall cloud-based data architecture strategy, including data warehousing, data lakes, streaming analytics, and data governance frameworks.
- Collaborate with integration engineers, analysts, and other business stakeholders to understand data requirements and deliver solutions.
- Optimize and manage data storage solutions and data integrations (e.g., S3, Snowflake, dbt, Snaplogic) ensuring data quality, integrity, security, and accessibility.
- Leverage Databricks for scalable data processing, analytics, and advanced transformations.
- Implement data quality and validation processes to ensure data accuracy and reliability.
- Develop and maintain documentation for data processes, architecture, and workflows.
- Participate in code reviews and contribute to best practices for data engineering.
- Monitor and troubleshoot data pipeline performance and resolve issues promptly.
- Consulting and Analysis: Meet with defined stakeholders to understand and analyze their processes and needs. Determine requirements to present possible solutions or improvements.
- Technology Evaluation: Stay updated with the latest trends in data engineering, cloud technologies, and big data platforms.
- Expert Communities: Engage actively in internal expert groups to exchange knowledge, mentor junior colleagues, and contribute to improving inefficient processes.
- Cloud-Based Data Solutions: Utilize AWS cloud services (e.g., S3, Lambda, Step function, KMS, …) to support data engineering workflows;Develop infrastructure as code for data pipelines using tools like Jenkins and AWS CloudFormation.
- Performance Optimization: Monitor and optimize data pipelines for performance, scalability, and cost efficiency;Troubleshoot and resolve data-related issues in a timely manner.
Requirements:
-
- Bachelor’s/Master’s degree in Computer Science, Engineering, or related field or equivalent proven experience (minimum 5 years) as a Data Engineer, Software Developer, or similar role.
- Proficiency with the Apache ecosystem (Parquet, Iceberg, Spark, Kafka, Airflow).
- Strong hands-on experience with AWS data services (Kinesis, Glue, Appflow, Lambda, S3).
- Demonstrated experience with Snowflake and dbt (dbt labs) for building and modeling data pipelines
- Strong analytical skills working with unstructured datasets.
- Experience with relational SQL and NoSQL databases, preferably Snowflake and/or Databricks.
- Familiarity with data pipeline and workflow orchestration tools.
- Strong project management and organizational skills.
- Excellent English written and verbal communication skills.
- Snaplogic knowledge is a plus.
- Preferred Skills:
- Proficiency in scripting languages such as Python or Scala.
- Familiarity with data visualization tools (e.g., Tableau, Power BI, QuickSight).
- AWS Cloud Practitioner, Architecture, Big Data or Data Analytics certification.
NICE-TO-HAVE Qualifications:
- AWS Certified Big Data or AWS Certified Solutions Architect certification.
- Experience with Databricks and Snowflake.
- Knowledge of containerization technologies like Docker and Kubernetes.
- Experience with CI/CD pipelines and DevOps best practices.
#IamBoehringerIngelheim because…
With us, you can grow, collaborate, innovate, and improve lives. We offer challenges in a global, respectful, and family-like work environment where ideas drive our innovative mindset. Flexible learning and continuous development for our team are key because your growth is our growth.
At Boehringer Ingelheim, gender equality is one of our top priorities. We not only comply with current regulations but also strive to promote it in all areas of our organization, as established in our III Equality Plan. We are committed to creating an inclusive and equitable work environment for everyone!
What do we offer?
Participation in international projects and collaboration with multidisciplinary teams.
Professional development opportunities and continuous training.
Dynamic, flexible, and innovation-oriented work environment.