Senior Data Engineer ~ Up to $3000

Expired

Trách nhiệm công việc

• Work with partners in building a centralized data source for data lake and data warehouse.
• Develop the Data Warehouse system according to the organization's development direction.
• Develop Data marts to serve data exploitation needs.
• Design, develop and deploy high volume data applications to ingest, transform, and store data to be used in modeling, data analytics and other business functions.
• Strategically obtain and integrate data and information from various sources into the firm’s platforms, solutions; analyze and improve efficiency, scalability, reliability and performance of such platforms and systems infrastructure
• Design, develop and maintain data pipelines in a DevOps operating model, catering to both structured and unstructured sources.
• Collaborate with other data team members to understand the requirements to build reusable data assets to enable using and deploying better data applications.
• Ensure data assets are organized and stored in an efficient way so that information is high quality, reliable, flexible, and efficient.
• Troubleshoot and resolve data-related issues and incidents.
• Keep up-to-date with emerging technologies and industry best practices to ensure the data lakehouse remains cutting-edge.

Kỹ năng và chuyên môn

Qualifications:

• Bachelor & or Master’s degree in Computer Science, Data Engineering, Statistics, Mathematics,
• Quantitative Analysis, Software Engineering or Information Technology

Work Experience:

• At least 5 years of experience with developing, debugging, scripting and employing Cloud Analytics Platform (e.g. Azure, GCP, AWS, Snowflake), database technologies (e.g. MS SQL, Oracle), and programming languages (e.g. Python, R, Scala, C#, C, Java) with preference towards functional/trait oriented
• Hands on experience with data integration with messaging, APIs and files
• Experience in designing and building dimensional data models, ETL processes, applied data warehouse concepts and methodologies, optimized data pipelines
• Deep experience with monitoring complex system and solving data and systems issues having a consistent and algorithmic approach to resolving them
• Understanding of Information Security principles to ensure compliant handling and management of all data
• Experience working in Agile teams and utilizing DevOps practices
• Strong collaboration skills with demonstrated ability to work across various business and technology functions
• Have initiative in problem solving, teamwork skills, ability to work under pressure