Data Engineer

Your role & responsibilities:

  • Collect data from events on mobile platforms and process this data in preparation for transformation and analysis.
  • Design and maintain data transformation jobs using tools and languages like Airflow, Python, and Spark.
  • Collaborate with the data analysis team to determine necessary reports and data analysis requirements.
  • Develop and maintain analytic reports based on transformed data stored in the Data Warehouse.
  • Ensure stability and high performance for data processing procedures and analytic reports.
  • Think critically and propose data collection, processing, and storage improvements to optimize performance and scalability.
  • Other tasks may be assigned upon request by the Manager.

Your skills & qualifications:

  • At least 2 years of experience in a similar role. 
  • Proficient use of the Python programming language for data handling and transformation.
  • Knowledge in building complex data processing workflows using Apache Spark.
  • Proficiency in writing complex SQL queries.
  • Familiarity with database design principles and ETL (Extract, Transform, Load) processes.
  • Basic understanding of Spring Boot for creating APIs serving reports.
  • Experience with ClickHouse, and Apache Airflow is a plus

Personality Requirements:

  • Hard-working, responsible, and strong interpersonal and communication skills.
  • Ability to work independently and in teamwork and can work under high pressure. 
1 week ago

Location

  • Phòng 514 Tòa nhà Toyota Mỹ Đình, Phường Mỹ Đình 2, Quận Nam Từ Liêm, Thành phố Hà Nội

Website

Location

  • Phòng 514 Tòa nhà Toyota Mỹ Đình, Phường Mỹ Đình 2, Quận Nam Từ Liêm, Thành phố Hà Nội

Company size

25-99

Industry

Tech stack

Nationality

Netherlands