Job Description
One of our non-profile clients is looking for a Data Engineer with experience in Microsoft Fabric to join their team on a Term contract of 2 years. Under the direction of Senior Manager, Data and Analytics Architecture, the Data Engineer will be responsible for implementing an end-to-end analytics solution using Microsoft Fabric to ingest data from various sources, create a semantic model, and enable dashboard/visualization creation for the business team. Additionally, She/He will assist the data management team in implementing data governance frameworks, policies, and controls. Primary Responsibilities include:
Data Integration
- Design and implement data pipelines in Microsoft Fabric, including source mapping and documentation.
- Configure data refresh patterns for real-time and scheduled syncs
- Maintain pipeline reliability through error handling and schema change management
Fabric Semantic model Development
- Create and optimize semantic models including defining business entities, relationships, and security requirements.
- Ensure semantic models accurately reflect all business requirements and specifications before development, including comprehensive review with stakeholders.
- Develop calculated columns and measures using DAX, documenting all business rules and logic.
Data Governance & Quality
- Implement data governance policies including classification, sensitivity, access controls, and quality validation through Microsoft Purview integration.
- Manage data quality through retention strategies, lineage tracking, and metadata management.
Environment Management
- Set up development, testing, and production environments
- Configure workspace settings and security
- Configure lake house settings if required for additional data processing.
Experience
5+ years Data Engineering experience with Microsoft data platforms (Azure Synapse, Azure Data Factory, Power BI, SSIS)
Proficient (Must Have)
- Advanced T-SQL and data modeling
- ETL/ELT pipeline design and implementation
- Medallion architecture implementation
- Microsoft Fabric fundamentals
- Power Query and M language
- Database experience (SQL Server, Azure SQL)
- Power BI semantic model development (Advanced DAX, Star schema)
- Basic security implementation (RLS)
- Version control with Azure DevOps
- Cross-functional team collaboration
- Technical documentation
Nice to Have
- Python, PySpark, PowerShell
- Oracle database experience
- Dataverse expertise
- CI/CD implementation
- Data quality frameworks and Metadata management