Data Engineer

Our client, a top tier Management & Strategy Consulting firm if looking for a qualified Data Engineer. The ideal candidate will possess in-depth expertise in data integration, and transformation using Azure Data Factory, Data Flow, SQL Server, ETL processes, and data modelling. This role requires a highly skilled professional who can design and implement complex data solutions that drive business intelligence and analytics.

Essential Requirements and Responsibilities :

·       Design, develop, and maintain robust ETL processes to integrate data from various sources into the data warehouse using Azure Data Factory and Data Flow.
·       Ensure data quality and integrity throughout the ETL process
·       Develop and maintain comprehensive data models and database structures on SQL Server.
·       Implement best practices for data warehousing, including normalization, indexing, and query optimization.
·       Design and build scalable, high-performance data solutions that meet business requirements.
·       Create views and sql scripts to Power BI based reporting.
·       Optimize and tune SQL queries, stored procedures, and data flows for maximum performance and efficiency.
·       Monitor system performance and troubleshoot data-related issues as they arise.
·       Collaborate with data analysts, data scientists, and business users to understand their data needs and provide technical support.
·       Maintain comprehensive documentation of data processes, workflows, and system architecture.
·       Ensure compliance with data governance policies and procedures.
·       Minimum of 5-7 years of experience in data development, with a strong focus on Azure Data Factory, Data Flow, SQL Server, ETL, data modelling, and basic knowledge of Power BI.
·       Proficient in Azure Data Factory, Data Flow, and other Azure data services.
·       Extensive experience with SQL Server, including T-SQL, stored procedures, and performance tuning.
·       Strong knowledge of ETL concepts and tools.
·       Expertise in data modelling techniques and best practices.
·       Experience with other Azure services such as Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics.
·       Familiarity with other BI tools and platforms a plus.
·       Certifications in Azure or other relevant technologies a plus