Job Description

Our client is seeking a highly motivated and self-driven Data Engineer with approximately 5 years of experience to join their growing data team. The ideal candidate will have strong analytical skills, the ability to work independently, and a proactive mindset to ask the right questions and lead small-scale initiatives. You will be responsible for designing, building, and maintaining scalable data pipelines and solutions in a cloud-based environment.

Key Responsibilities:

• Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF), Blob, On premise systems and Azure Functions.
• Work independently on data engineering tasks, from requirement gathering to deployment.
• Collaborate with cross-functional teams to understand data needs and deliver high-quality solutions.
• Lead small projects or initiatives, ensuring timely delivery and stakeholder communication.
• Develop and optimize data models for OLTP systems and relational databases.
• Write efficient SQL queries and scripts for SQL Server; Oracle experience is a plus.
• Implement data quality checks, monitoring, and alerting mechanisms.
• Use Python for data transformation, automation, and integration tasks.
• Ensure data security, compliance, and governance best practices are followed.

Required Skills & Qualifications:

• 5+ years of experience in data engineering or a related field.
• Strong experience with Azure Cloud Services, especially ADF and Azure Functions.
• Proficient in SQL and working with relational databases (SQL Server required, Oracle optional).
• Solid understanding of OLTP systems and data modeling principles.
• Strong programming skills in Python.
• Knowledge of CDC process implementation.
• Excellent analytical and problem-solving skills.
• Ability to work independently and take ownership of tasks.
• Strong communication skills with the ability to ask the right questions and lead discussions.

Nice to Have:

• Experience with CI/CD pipelines and DevOps practices in Azure.
• Familiarity with data warehousing concepts and tools.
• Knowledge of data governance and security best practices.