Data Engineer | Staff | IT Enterprise Data & Platforms Japan

The Position

Our IT EDP Data & Analytics team is seeking a talented and experienced Data Engineer. The ideal candidate will be responsible for building and enhancing reliable, scalable data products that enable high-impact insights, accelerate decision-making, and improve patient outcomes.

This individual will play a key role in delivering a modern data ecosystem across cloud and enterprise platforms. With a strong engineering mindset, the individual will drive change, champion continuous improvement, and thrive in a fast-paced environment with evolving priorities.

Tasks and Responsibilities

  • Design, build, and maintain end‑to‑end data pipelines and integrations to support HP Commercial Data & Analytics use cases.
  • Develop, operate, and optimize integrations using SnapLogic and AWS services such as S3, AWS Lambda, and AWS Glue, and Apache Airflow to ensure robust ingestion, transformation, and orchestration.
  • Implement and maintain analytics‑ready data models in Snowflake, ensuring performance, scalability, and cost‑efficient design.
  • Build transformation logic and analytics layers using dbt , including modular modeling, testing, documentation, and deployment best practices.
  • Contribute to and enforce data governance standards by leveraging tools such as Collibra, ensuring metadata quality, lineage, ownership, and consistent definitions.
  • Partner with Data Quality stakeholders to implement and monitor quality controls using Attaccama, including rules, profiling, exception handling, and remediation workflows.
  • Support data lifecycle processes and operationalization of data products (as applicable in the ecosystem) to align delivery with platform and product standards.
  • Proactively identify opportunities to simplify architecture, automate repetitive work, and reduce operational effort (observability, alerting, self‑healing patterns).
  • Ensure all solutions follow security, privacy, and compliance expectations (e.g., regulated environment practices, audit readiness, access controls, data handling).
  • Collaborate closely with Product Owners, Data Scientists, Analysts, Architects, and business stakeholders to translate needs into reliable, reusable data assets.
  • Act as a role model for engineering excellence: version control, CI/CD, code reviews, documentation, and operational runbooks.

Requirements

  • Degree in Computer Science, Engineering, Data/Information Systems, or a related field, with 4+ years of relevant experience in data engineering, analytics engineering, or similar roles.
  • Hands‑on experience building integrations and pipelines using tools such as SnapLogic (or comparable iPaaS) and cloud services — specifically AWS S3, Lambda, and Glue, and Apache Airflow
  • Strong experience with Snowflake including data modeling, performance tuning, and secure data access patterns.
  • Proven experience with dbt (models, tests, macros, documentation, environments, CI/CD integration).
  • Familiarity with data governance and metadata management, ideally with Collibra; understanding of lineage, stewardship, and data catalog practices.
  • Experience implementing data quality controls and monitoring, ideally with Attaccama (or equivalent tooling and approaches).
  • Solid knowledge of software engineering fundamentals: Python/SQL, Git, coding standards, automated testing, and production support practices.
  • Demonstrated ability to work independently, manage priorities, and proactively drive work forward in a dynamic environment.
  • Strong stakeholder management, analytical thinking, and structured problem‑solving skills.
  • Excellent communication skills in English and Japanese, enabling clear interaction with technical and non‑technical stakeholders.

Nice to have

  • Experience with regulated environments (e.g., GxP), validation, audit readiness, or privacy‑by‑design implementation.
  • Familiarity with data platform observability (pipeline monitoring, data drift, SLAs/SLOs)
  • Exposure to domain data in pharmaceutical commercial areas.