Software Developer – ETL – Senior
- Pay Rate: Flexible – Onsite
- Location: Toronto, Ontario
- Contract Length: 6 Months
We at Raise are hiring right now for one of our Clients. If you’re interested, apply below for your chance to join a great place to work.
Responsibilities:
- As a member of the data team, you will be responsible for the migration of digital files to an enterprise OpenText based document management solution, the migration of historical data from legacy systems to a data warehouse/lakehouse, building data assets in the lakehouse, and creating PowerBI reports. A high-level list of deliverables for the data migration team follows:
- Data Warehouse Design: analyze business requirements and the data warehouse/lakehouse/golden layer on Microsoft Azure
- Data extraction: Identify/define data to be extracted and migrated to the data warehouse/lakehouse or document storage solution
- Data Integration and ETL: help develop and automate ETL processes to load data from external solutions into the data warehouse/lakehouse (bronze/silver/golden layers) and integrate data into the data warehouse.
- Digital file migration: Identify/define data/files to be extracted and migrated to the OPGT’s OpenText based document management solution
- Data Integration and ETL: help develop and automate ETL processes to load digital files from external storage solutions into the enterprise OpenText based document storage solution
- Data Modeling: create logical and physical data models that align with the project’s reporting and analytical needs.
- Data Security and Governance: implement appropriate security controls to protect sensitive data within the data warehouse and reports.
- Reporting and Visualization: develop reports, dashboards and visualizations as per reporting MVP. Ensure the quality, accuracy and integrity of reports.
- Performance Optimization: fine-tune the data warehouse and reporting processes to optimize query performance and overall system efficiency.
- Other duties as assigned.
You will also be required to:
- Complete work and achieve milestones within the assigned deadlines.
- Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
- Submit Deliverables for the Cluster/Ministry approval as they are completed.
- Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
- Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
- Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
- Provide knowledge and skill transfer to a designated Cluster/Ministry staff
- Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.
Mandatory Requirements:
- 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
- Proficiency in Azure Synapse workspaces, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
- Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
- Proven experience working with data from Dynamics 365 CE and Dynamics 365 F&O as an ETL developer
Desired Skills and Experience:
- 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
- Experience in integrating various data sources and systems, both on-premises and in the cloud, using Azure ETL services or other ETL tools
- Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
- Expertise in data transformation techniques, such as data cleansing, aggregation, enrichment, and normalization using Azure cloud technologies
- Understanding of data quality management practices, including data profiling, data validation, and error handling within ETL processes.
- Understanding of data governance principles, data privacy regulations and experience working with high-sensitivity data, and knowledge of best practices for data security and compliance in Azure.
- Ability to monitor and troubleshoot ETL processes, optimize query performance, and implement efficient data processing techniques in Azure.
- Proficiency in, Azure Synapse workspaces, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
- Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.
- Proficiency in scripting languages like Python, and experience with Azure-specific scripting using PowerShell or Azure CLI.
- Expert in data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modelling, query performance analysis & tuning
- Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
- Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.
- Experience with SQL Server Management Studio, Azure data management tools, XRM toolbox, data modeling tools
- Proven experience working with data from Dynamics 365 CE and Dynamics 365 F&O as an ETL developer
Nice to have:
- Azure cloud certifications (e.g. Azure fundamentals, Azure Data Engineer associate, Azure Database Administrator associate)
Resumes Evaluation/Criteria:
Criteria 1: ETL – 30 Points
- Demonstrated experience with ETL development, data pipelines, workflow orchestration and data ingestion, transformation, and movement
- Demonstrated experience in integrating various data sources and systems, both on-premises and in the cloud, using Azure ETL services or other ETL tools
- Demonstrated experience working with Azure Synapse workspaces, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
- Demonstrated experience with data manipulation languages (T-SQL, PL/SQL), data definition languages, query performance analysis & tuning
- Demonstrated experience with SQL Server, Oracle, Azure SQL Databases
- Demonstrated experience with data modeling tools
- Demonstrated experience in scripting languages like Python and with Azure-specific scripting using PowerShell or Azure CLI.
- Experience with software development lifecycle
- Experience with data modeling, physical database design, data flow diagrams
Criteria 2: Azure Platform – 20 Points
- Demonstrated experience with Azure Synapse Workspaces
- Demonstrated experience Azure data management tools, DevOps, Synapse Studio
- Experience in Azure resource configuration and administration such as Azure Data Lake, Blob Storage, Key Vault, Application Insight resources, resource groups and subscriptions.
- Familiar with Azure cloud platform
- Azure cloud certifications
Criteria 3: Dynamics 365 CE & FO – 30 Points
- Demonstrated experience working with integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
- Proven experience working with data from Dynamics 365 CE and Dynamics 365 F&O as an ETL developer
Criteria 4: DevOps and CI/CD – 20 Points
- Demonstrated experience with continuous integration/continuous deployment (CI/CD) tools and processes around DevOps, data workflows, Synapse workspaces.
Looking for meaningful work? We can help!
Raise is an established hiring firm with over 65 years of experience. We believe strongly in making the world a better place through work, which is why we’re a certified B Corporation and donate 10% of our profits to charity.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer, and request accommodation: https://raise.jobs/accommodations/
In order to submit candidates for roles, our clients will sometimes require personal information to confirm the identity of applicants and their legal status to work. Raise will never ask you for personal or banking information unless you have been selected for a job. If you are ever unsure about the legitimacy of this or another job posting by Raise (or have any other questions), please contact us at +1 800-567-9675 or hello@raiserecruiting.com