Data Engineer

Data Integration

• Obtain and integrate data and information from various sources into the centralized platforms, solutions, and statistical models.
• Write scripts and ingest raw data to build and maintain optimized data pipelines and ETL solutions as business support tools in providing analysis.
• Ensure data assets are organized and stored in an efficient way so that information is easy to access and retrieve.

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Business Information System, or Information Technology
• At least 3 years of relevant experience with developing, debugging, scripting and employing big data technologies (e.g. Hadoop/S3, Spark, Kafka, Flink), database technologies (e.g. SQL, NoSQL: MySQL, PostgresSQL, ElasticSearch, ClickHouse), caching (Resdis, SSDB…), business intelligence (preferably Superset, PowerBI) and programming languages (preferably Scala/Java, or Python – willing to learn Scala/Java).
• Experience in designing and building dimensional data models, ETL processes, applied data warehouse concepts and methodologies, optimized data pipelines and assisted the architect as needed
• Experience in using Data Orchestration tools: Airflow, Airbyte, DBT…
• Experience monitoring complex system and solving data and systems issues having a consistent and algorithmic approach to resolving them
• Understanding of Information Security principles to ensure compliant handling and management of all data
• Experience working in Agile teams to support digital transformation projects, having a clear understanding of Agile principles, practices and Scrum methodologies