Job Description
We are seeking a talented and experienced Data Engineer to design, develop, and maintain efficient data pipelines and architectures. In this role, you will play a pivotal part in building and optimizing our data infrastructure to ensure seamless data processing, analytics, and insights across the organization.
Key Responsibilities
- Develop, maintain, and optimize scalable ETL pipelines to process structured and unstructured data from diverse sources.
- Design and implement data architectures to meet technical and business requirements.
- Collaborate with business analysts and software engineers to support analytics, machine learning, and reporting initiatives.
- Monitor and troubleshoot data pipelines to ensure data quality, accuracy, and availability.
- Enhance data warehouse performance through optimization techniques.
- Leverage Microsoft Fabric to store, process, and analyze large-scale datasets.
- Ensure adherence to data security, governance, and compliance standards.
- Create and maintain comprehensive technical documentation for data systems, processes, and workflows.
- Automate data ingestion, transformation, and storage processes.
- Stay informed on emerging technologies and best practices in data engineering.
Qualifications
Required:
- Education: Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent work experience).
- Experience:
- 5+ years in data engineering or related roles.
- 3+ years of experience with T-SQL (Microsoft SQL Server).
- 5+ years working with ETL tools and frameworks (e.g., Azure Data Factory).
- 2+ years of experience with programming languages for data manipulation, such as Python.
- Expertise with cloud-based platforms (Azure) and data services (e.g., Azure Data Lake, Azure Synapse, Azure SQL Database).
- Strong knowledge of data warehousing concepts, data modeling, and architectural principles.
- Familiarity with data visualization tools like Power BI (preferred).
- Excellent problem-solving, analytical, and communication skills.
Preferred:
- Experience with real-time streaming tools (e.g., Azure Stream Analytics).
- Knowledge of machine learning pipelines and model deployment workflows.
- Relevant certifications, such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Fabric Analytics Engineer Associate.
- Familiarity with data governance frameworks and tools.
- Practical experience with Microsoft Fabric.
Join us to build cutting-edge data infrastructure and make a meaningful impact by enabling data-driven decision-making across the organization. Apply today to be part of our innovative and collaborative team!