Data Engineer (AWS, Product, US Telecommunications)

Expired

Trách nhiệm công việc

• Design and implement scalable, reliable data pipeline including ingestion, process, and analysis of data coming from diverse sources.
• Develop data models, schemas and data Warehouse.
• Develop data services to enable user-facing analytics and model inference.
• Collaborate with Data Scientists to design and deploy a machine learning pipeline to enable quick life-cycle release.
• Collaborate with Leaders and Data Analysts to define key metrics and prepare data pipelines to help an internal team perform self-service on the analytical platform.

Kỹ năng và chuyên môn

• Diploma / Bachelor's degree in Software Engineering, Information Technology or related majors.
• 3+ years of experience in the following:
• • Have at least 3 years of experience in AWS cloud: Familiar with AWS microservices such as Glue, S3, Step Function, Lambda, REST API Gateway, Cloud watch, RDS, Redshift…
  • AWS solution architecture / AWS Certified Data Analytics certification will be preferable.
  • Proficiency in Python and SQL.
  • Experience in building and operating distributed big data systems.
  • Experience in building and optimizing the performance of Data Warehouses and data models.
  • Using and managing workflow management systems.
  • Proficiency in building and maintaining ETL pipelines (Airflow, Nifi).
  • Have experience with the Infrastructure of Code (IaC) with Terraform.
  • Able to build CI/CD pipeline to integrate with cloud infrastructure.