Home Credit Vietnam

Home Credit Vietnam

Sống Vui cùng Home Credit

Data Engineer (Hadoop/Spark)

Objective

  • Develop and maintaining data pipelines in order to prepare well-structured data for analytic & reporting activities of business users and the needs of the company
  • Serve as a trustworthy partner for Risk Modelling team providing ecosystem and data to enable faster model development, deployment and innovation delivery
  • Support implementing strategy to reduce dependence on DWH Analytical Playgrounds by migrating to Data Marts and Hadoop as core data platform

Trách nhiệm công việc:

The Data & Feature Engineer's main objective is to drive data availability for business analytic & reporting purposes. Key areas of responsibility:

  • Analyze data from data producers and transform them into unified form, organize them within the data platforms and/or analytical/production feature store, produce base & derived features in line with Risk Modelling team requirements
  • Develop, maintain and monitor data pipelines preparing suitable data for analytic & reporting activities
  • Set up effective data quality monitoring to detect and remedy discrepancies (collaborate with HQ teams)
  • Drive utilization of Big Data Hadoop platform to reduce dependence on DWH Analytical Playgrounds
  • Support implementation of Feature Store solution aiming to significantly transform data preparation, model development, deployment and monitoring
    • Build local expertise for end-to-end development, deployment and monitoring of ML models using Feature Store solution
    • Deliver data processing mechanisms for real-time data processing and analytical use to utilize the value of new technologies

Kỹ năng & Chuyên môn:

Experience and expertise

Need-to-have areas

  • Experience as a Data Engineer
  • Experience with Big Data ecosystem, data integration, transformation, processing and visualization tools (Hadoop, Hive, Spark, Kafka, NiFi, Airflow, Jupyter) is a big plus
  • Programming Language: SQL and Python on intermediate level
  • University degree in Computer Science, Engineering or related field is preferred
  • Good written and oral communication skills
  • Able to communicate in English

Nice-to-have areas

  • Experience with PowerBI/Tableau BI tools
  • Experience with ML Ops is advantage
  • Experience from working in the data-related area in online, fin-tech, e-commerce, digital, IT dev
  • Able to communicate efficiently as well as to interpret and promote a big data culture to the organization

Personal characteristics 

  • Real passion for data, new data technologies, and discovering new and interesting solutions to the company’s data needs
  • Ability to work on own initiative and to tight deadlines, resilient to pressure
  • Ability to formulate, explain, discuss and negotiate topics with IT and Business teams
  • Good analytical and problem-solving skills
  • Ability to critically review and identify potential data discrepancies
1 tuần trước

Địa điểm

Tầng G, 8 và 10 Tòa nhà Phụ Nữ, số 20 Nguyễn Đăng Giai, Phường Thảo Điền, Thành phố Thủ Đức, Thành phố Hồ Chí Minh

Số năm kinh nghiệm

2 năm

Cấp bậc

Chuyên viên

Loại hình

Kỹ năng

Quy trình phỏng vấn

  • Vòng 1:

    CV application & Git/Projects with relevant coding examples
  • Vòng 2:

    Behavioral & Cognitive Assessment
  • Vòng 3:

    Onsite Interview with Head Department

Website

Địa điểm

Tầng G, 8 và 10 Tòa nhà Phụ Nữ, số 20 Nguyễn Đăng Giai, Phường Thảo Điền, Thành phố Thủ Đức, Thành phố Hồ Chí Minh

Quy mô công ty

Over 1000

Ngành nghề

Các công nghệ sử dụng

Quốc tịch công ty

Czech-Republic