Data Analysis Platform EngineerTranslated from Japanese

▼Job Description 【Responsibilities】 1. ETL Pipeline Design and Development Build a high-performance ETL system to process corporate cloud billing data using a serverless architecture centered around AWS Lambda and Step Functions. ＜Technical Features＞ ・Vector computation processing utilizing the Python ecosystem (Pandas/NumPy) ・Highly maintainable design applying design patterns (Template Method, Strategy, etc.) ・Development emphasizing type safety (utilizing Type Hints, static analysis tools) ・Support for diverse data sources (S3, Redshift, RDS, etc.) ・Highly readable data structure definition (utilizing dataclass, NamedTuple) 2. Workflow Orchestration Manage complex data pipelines using AWS Step Functions and achieve operational automation through Infrastructure as Code. ＜Key Technical Elements＞ ・Parameter control utilizing JSONata/JSONPath ・Infrastructure code management with CloudFormation ・Implementation of error handling and retry control 3. Data Visualization and BI Development Visualize processed data using Looker and build dashboards that provide valuable insights to customers. 【Development Process and Work Style】 ・Project Promotion Method Take full responsibility from requirements definition to operation for each task, driving development with a high degree of ownership. 1. Requirements Analysis: Specifying technical details through dialogue with stakeholders 2. Design & Implementation: Efficient development in a modern development environment (utilizing AI tools like Cursor) 3. Quality Assurance: Ensuring quality through code reviews based on GitHub PRs 【Team Structure】 A team of 5 engineers covering all areas of data engineering. We offer technical freedom and opportunities for individual growth, achievable due to our lean and agile team. ▼Required Skills/Experience ・Python Development Experience: Practical experience implementing data processing with Pandas. ・Large-scale ETL Processing: Experience building data processing systems with a focus on performance. ・Object-Oriented Design: Practical experience in class design considering maintainability and extensibility. ・Team Development: Experience in collaborative development using GitHub. ・Quality Awareness: Coding ability that emphasizes maintainability and readability, not just functionality. ▼Preferred Skills/Experience ・AWS Serverless: Experience building workflows with Step Functions and Lambda. ・FinOps Knowledge: Understanding of cloud billing data such as AWS Cost and Usage Reports (CUR). ▼Ideal Candidate Profile ＜Technical Stance＞ ・Design Thinking: Ability to design not only to meet specifications but also considering future scalability and maintainability for other team members. ・Ownership: Ability to take responsibility from understanding requirements to implementation and operation. ・Commitment to Quality: Ability to balance performance optimization and data integrity. ＜Growth Mindset＞ ・Interest in New Technologies: Eagerness to learn about rapidly evolving cloud technologies and data engineering fields. ・Business Understanding: Development attitude that focuses on creating business value, not just technical implementation. ▼Job Appeal ＜Technical Growth＞ ・Acquire end-to-end data pipeline construction and operation skills. ・Experience in designing and operating large-scale systems. ・Build expertise in the FinTech/FinOps domain. ＜Business Growth＞ ・Experience as a pioneer in a rapidly growing market. ・Experience developing systems that influence corporate management decisions. ・Expanding technical responsibilities alongside product growth. ▼Development Environment ＜Tech Stack＞ ・Languages & Libraries: Python (Pandas, Numpy) ・Cloud: AWS (Lambda, Step Functions, S3, Redshift, RDS, CloudFormation) ・Data Storage: Redshift, RDS, S3 (CSV, Parquet, JSON) ・Visualization: Looker (Defined with LookML) ・Development Environment: GitHub, Cursor, uv, Ruff, ty, pytest ▼Employment Type Full-time employee (No fixed term) ▼Trial Period 3-month trial period. Conditions remain unchanged during this period. ▼Salary Annual salary: ¥4,500,000 - ¥7,000,000 ▼Bonus 1/14 of the above annual salary will be paid in summer (July) and winter (January). ▼Minimum Annual Salary (¥10,000s) 450 ▼Maximum Annual Salary (¥10,000s) 700 ▼Work Location NHN Atelier, 3-1-8 Nishi-Shimbashi, Minato-ku, Tokyo 105-0003 ▼Working Hours Flextime system (Core time: 11:00 - 15:00) Start time: Between 8:00 and 11:00. End time: Between 15:00 and 22:00. Standard working hours: 7.5 hours/day. Monthly prescribed working hours: 150 hours. ▼Break Time 1 hour within the above hours if working 6 hours or more. ▼Overtime Work Yes (Company average: 10 hours) ▼Holidays, Paid Leave, Special Leave Saturdays, Sundays, and national holidays (following the calendar). Approximately 125 days off per year. ▼Benefits https://recruit.nhn-japan.com/benefit#health-care ▼Insurance Enrollment Health Insurance: Yes, Employee Pension Insurance: Yes, Employment Insurance: Yes, Workers' Accident Insurance: Yes ▼Measures to Prevent Passive Smoking at the Workplace No smoking within the premises (smoking area available outdoors). ▼Education, Skill Improvement, Career Advancement Post-Hire Roadmap / Image of Work After Joining We generally adopt a clustering system where multiple people are assigned to each project. Each project has a "Primary Lead" and a "Secondary Lead." You will initially participate as a Secondary Lead and gradually transition to a Primary Lead. This environment allows for skill development with peace of mind, avoiding knowledge silos. ・3 Months: Participate in projects within a cluster team, acquiring internal standards and practical experience. ・6 Months: As a Primary Lead for small to medium-sized projects, independently drive from design to production deployment/operation handover. ・1 Year: Technical lead for multiple projects. Standardize processes while leading advanced proposals and architectural decisions. ▼Health Low overtime hours, industrial physician consultations available. ▼Interview/Selection Process Document Screening You will be asked to prepare and submit application documents. Depending on the position, you may be asked to submit a portfolio or take a web test. 1st Interview An interview to confirm if your professional skills and experience match the job opening. We will discuss your past work experience. Final Interview To confirm if NHN's work style and values align with yours, we will discuss our respective visions and values. Onboarding We provide various support from offer to joining the company. An orientation and Welcome Lunch will be held on your first day.