Data Engineer / データエンジニア

Das ist der Job

About PayPay PayPay is a FinTech company that has grown to over 70M users (as of July 2025) since its launch in 2018.

Darum lohnt es sich

Our team is diverse with members from over 50 countries, sharing a vision that encourages risk‑taking and continuous growth.

Job Description As a Data Engineer on the next‑generation digital financial platform team, you will design, build, and operate a modern data engineering infrastructure that enables data‑driven innovation across PayPay Bank and the broader PayPay Group.

Organization / Team The assigned organization leads the design and operation of reliable, highly scalable data engineering foundations to accelerate data usage for the group. It focuses on modern data technologies and supports product enhancements, marketing initiatives, and fraud detection.

Leverage modern data technologies to create a scalable, trusted platform that enhances decision‑making and customer experience. Experience leading teams and mentoring engineers. Views data platforms as products, motivated to improve productivity for engineers, analysts, and product teams.

Committed to continuous learning and sharing knowledge with the team. Benefits Social insurance (health, pension, employment, compensation). 401K. After joining, you are expected to be seconded to PayPay Bank as a member of this project.

Background The rapid growth of the business has increased the importance of data across PayPay Bank and the PayPay Group. Establishing robust, secure, and scalable data engineering foundations is an urgent task to support product, marketing, and risk initiatives.

Responsibilities Design, develop, and operate robust and scalable data ingestion pipelines using Databricks, AWS DMS, and Terraform. Develop large‑scale data processing workflows with Spark, Python, and SQL. Build data integration platforms that connect banking services, payment systems, internal applications, and external data sources.

Optimize pipelines by combining CDC, streaming, and batch processing architectures. Build and maintain a data lakehouse and data catalog with Databricks Lakehouse and Unity Catalog. Design and operate data governance capabilities, including quality management, metadata management, lineage, access control, and audit logging.

Improve performance, optimize costs, and enhance reliability in large‑scale environments. Implement SRE and observability practices: monitoring, alerting, dashboards, and incident response. Automate infrastructure with Infrastructure as Code (Terraform). Develop and maintain shared frameworks, tools, templates, and CI/CD pipelines.

Partner with product, analytics, risk, security, compliance, and other PayPay Group companies to drive data utilization. Operate data platforms in compliance with security, privacy, regulatory, and internal control requirements of a financial institution.

Tech Stack Cloud: AWS Data Platform: Databricks, Snowflake, Delta Lake, Data Lakehouse Processing: Apache Spark, Scala, Python, SQL Orchestration: Airflow, Dagster, Prefect Streaming / Ingestion: Kafka, CDC tools Infrastructure: Terraform, GitOps, CI/CD Governance: Unity Catalog, AWS Lake Formation, Data Catalog, Metadata Management Observability: Prometheus, Grafana, CloudWatch, Datadog Collaboration: GitHub, Jira, Confluence, Slack Attractiveness of This Position Build the data foundation that powers next‑generation digital financial services, balancing bank reliability with PayPay speed and reach.

Drive data‑enabled innovation supporting product development and business growth while meeting stringent security, governance, compliance, and audit requirements. Required Experience / Skills 4+ years of professional experience as a Data Engineer or related role.

Hands‑on experience building, operating data lakes, warehouses, or lakehouse platforms. Experience with Spark / Databricks / Delta Lake for large‑scale data processing. Strong programming in Python, PySpark, SQL, or related technologies. Experience with orchestration tools (Airflow, Dagster, Prefect). Experience developing and operating on AWS.

Experience with Terraform for IaC. Proven ability to design and improve large‑scale pipelines focusing on performance, reliability, availability, and operational excellence. Business‑level Japanese proficiency (native or JLPT N1/N2).

Desired Experience / Skills Experience building data platforms in financial domains (banking, fintech, payments, credit, securities, insurance). Experience with event‑driven data architectures and streaming (Kafka). Experience with CDC tools (Canal, Debezium, Maxwell).

Experience with data cataloging and access management (Unity Catalog, AWS Lake Formation). Experience improving monitoring and observability (Prometheus, Grafana, Datadog, CloudWatch). Experience building CI/CD pipelines (GitHub Actions, Jenkins). Experience with Kubernetes, EKS, Argo CD, or related platforms.

Experience with data quality, lineage, contracts, MDM. Experience designing access controls, encryption, masking, audit logging for sensitive data. Experience establishing engineering standards and guidelines. Business‑level English communication. Experience integrating AI‑assisted development into system design.

Contributions to AI open‑source projects or AI‑driven workflow automation. Desired Candidate Profile Passionate about building user‑first financial services and committed to better financial experiences. Balances reliability required of a bank with agility expected of a fintech.

Designs scalable architectures and operational models for long‑term success. Handles complex challenges, collaborates with stakeholders, and drives initiatives independently. Sees security, governance, compliance as foundations for trusted data utilization. PayPay 5 Sense Reference PayPay 5 senses to learn what we value at work.

Working Conditions Full Time Hybrid Workstyle (remote and office as per guidelines). Work Hours Super Flex Time (No Core Time) In principle, 9:00‑5:45 + 1h break (actual working hours: 7h45m + 1h break) Holidays Weekends, national holidays, New Year’s break, company‑designated special days.

Paid Leave Annual leave (up to 14 days in the first year, proportionally by month). Personal leave (5 days each year, proportionally by month). Special paid leave for illness, injury, hospital visits, etc., under PayPay’s system. Salary Annual salary paid in 12 installments. Based on skills, experience, and abilities. Reviewed once a year.

Late overtime allowance. Can opt for digital salary payment via PayPay Paycheck. Translation/interpretation support. VISA sponsor and relocation support. Other Information PayPay Inside‑Out (Corporate Blog). JP and ENG versions. PayPay Product Blog. JP and ENG versions. PIVOT動画: “PayPayが仕掛ける金融革命”. #J-18808-Ljbffr