Senior Data Engineer

3 ngày trước

Trách nhiệm công việc

• Work with the scrum master, PO and team lead, to understand the backlog and priorities that need to be delivered to support business needs in our Real Estate, Ecommerce and Logistics business
• Apply your skills and experience in data crawler/ web scraping
• Apply your experience in modern data modeling techniques
• Your ability to work closely with business, connect with them and understand their needs to deliver data products that reflect business requirements and deliver value to our business will set you apart and help you excel at this role

Kỹ năng và chuyên môn

Technical Skills (2 years experiences)

• Experience running large scale data crawler/ web scraping
• Experience with data parsing - knowledge of Regular expression, HTML, CSS, DOM, Javascript and XPATH
• Strong programming skills in Python
• Experience with data modeling (Dimensional, 3NF or Data Vault)
• Experience and understanding of SQL and database systems:Dremio, Presto, Trino query engines, MySQL, PostgreSQL, MSSQL, Oracle…
• Develop, test and deploy data pipeline design, experience with ETL frameworks/tools, Airflow (or similar DAG), Spark using dbt
• Work with different types of source systems (sql/nosql/document-based, structured/semi-structured/unstructured, batch,near-realtime and real-time,...)
• Experience with developing and deploying CI/CD pipelines

Non Technical Skills (2 years experience)

• Experience working with teams to deliver data projects, taking ownership, responsibility and management of assigned scope
• Good communication skills - verbal and written
• Proactive problem solver, eye for detail, process driven
• Nice to have:
  • Industry experience in Real Estate, Ecommerce, Logistics or experience with sales
  • Comprehend, speak, read, write fluently in both Vietnamese & English