As a Data Engineer, you will play a key role in designing, developing, and optimizing data management systems to support business decision-making and innovation. Your responsibilities will include:
1
Your role & responsibilities
Designing, building, testing, and maintaining scalable data pipelines and management systems
Developing high-performance algorithms, predictive models, and prototypes to improve data efficiency
Ensuring data architecture aligns with business requirements and industry best practices
Integrating emerging data management and software engineering technologies into existing data structures
Establishing efficient processes for data mining, modeling, and production
Creating and optimizing custom software components and analytics applications
Exploring new ways to leverage existing data for business insights and operational improvements
Utilizing a wide range of programming languages and tools to integrate data systems effectively
Implementing and updating disaster recovery strategies for data infrastructure
Continuously enhancing data reliability, quality, and security through best practices and innovative solutions
2
Your skills & qualifications
Bachelor's degree in Data Science, Computer Science, IT, or related field
At least 4 years of experience as a Data Engineer or in a similar role
Expertise in Data Modeling, Architecture, Warehousing, and Lakes
Proficiency in Linux/Unix, shell scripting, and at least one scripting language (Python, R, etc)
Experience with ETL tools (e.g., Spark, Nifi, Pentaho)
Hands-on experience with HDFS-based analytics (processing, storage, governance, security)
Solid understanding of RDBMS (MySQL, PostgreSQL, or similar) and NoSQL
Cloud experience (Azure) preferred; microservices deployment is a plus
