IT - Data Engineering (Services Contract)

• Collaborate with cross-functional teams to understand data requirements and objectives.
• Design and implement scalable and secure data pipelines and data APIs for collecting, processing, storing, and delivering data downstream.
• Develop and maintain datasets, ensuring accuracy, completeness, and compliance with security standards.
• Work closely with data analysts and data services team to understand data needs and implement solutions that meet compliance requirements.
• Implement robust data quality checks and validation processes to identify and rectify inconsistencies, ensuring data integrity.
• Monitor and optimize data processing and storage for efficiency, cost-effectiveness, and compliance.
• Identify and implement solutions to enhance the performance of data pipelines, with a focus on security best practices.
• Apply expertise in security practices, ensuring the protection of sensitive data.
• Writing technical documents (ERD, Operation guide ...) to transfer working pipelines to the operation team.
• Report the progress/issue status to DE leader.

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3+ years of experience as a Data Engineer, Backend Developer, or similar roles.
• Experience in data modeling, data lake, data warehouse, and streaming data.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Strong proficiency in big data tech stack such as Hadoop, Spark, Flink, Kafka.
• Strong proficiency in Airflow for designing and managing complex workflows and dependencies.
• Solid understanding of data analytics and flow analysis for downstream app.
• Familiarity with database systems (e.g., SQL, NoSQL) and data integration tools.
• Strong analytical and problem-solving skills with a detail-oriented mindset.
• Excellent communication and collaboration skills to work effectively with cross-functional teams, ready to help other team members.
• Knowledge of security practices in the context of data handling.
• Familiarity with version control systems (e.g., Git) and agile software development practices and tools (JIRA, Confluence)
• Be able to manage time effectively & deliver high-quality work.
• Ability to work independently and manage multiple tasks within deadlines.
• Possess a proactive mindset & positive attitude, able to bring in good influences to your teammates & stakeholders.
• Ability to read and understand English fluently. 

It is a plus if you have:

• Knowledge about Data Architecture in the bank, Data model using Data Vault 2.0.
• Knowledge and methods to build a data-driven working environment.
• Know-how to set up, configure and maintain a data self-service environment.
• Know-how and the scripting and coding prowess to set up, configure and maintain a machine learning model development environment.

Note:

• Contract: 12 months (high ability to extend)
• Bonus: every 6 months