Data Engineer -Senior
· Pay Rate: (flexible)
· Location: Toronto ON
· Contract Length: 3YEARS
We at Raise are hiring right now for one of our Government Sector Clients. If you’re interested, apply below for your chance to join a great place to work.
RESPONSIBILITIES
- Work with the Enterprise Data project team in designing, developing and maintaining the TTC enterprise data warehouse, data marts, data lakes
- Responsible for designing, developing and documenting SSIS and/or Azure Data Factory (ADF) packages to integrate data from multiple systems
- Responsible for designing, developing and documenting complex T-SQL, stored procedures, views, triggers, indexes, etc.
- Develop and maintain Databricks notebooks and jobs using Python (PySpark) and SQL for batch and streaming workloads
- Build curated, analytics-ready datasets following layered patterns (e.g., bronze/silver/gold) and data product principles.
- Implement Delta Lake best practices
- Responsible for designing and implementing data quality processes
- Assist in the data modelling of the data warehouse/data mart/data lake solution(s)
- Advanced data analysis to provide meaningful data driven insights
- Work closely with the business analyst(s), and other team members, to understand requirements
- Convert business requirements to technical specifications.
- Perform knowledge transfer meetings and sessions.
- Research, propose, document, and share technical solutions with the team.
- Recommend and implement improvements to data quality, automation, and workflows
- Provide accurate time estimates for work to be undertaken
Skills and Certifications
Mandatory Requirements
5+ years of experience in:
- Database development or data engineering for enterprise level solutions
- Hands-on experience working with:
- Microsoft Azure Synapse and/or SQL Data Warehouse and SQL Server 2016 or later.
- Microsoft Azure Data Factory and other related Azure Services
- Azure Databricks
- CI/CD pipelines (Azure DevOps)
- SQL and Python programming
- Developing Microsoft Power BI reports or other data visualization tools
Other Certifications / Skills
- A university degree in Computer Science, or the equivalent, combined with directly related experience in a business or computer related discipline.
- Optimize, analyze and improve data integration packages
- Expert understanding and enterprise scale experience working with Data Warehouse (DW) and Business Intelligence (BI) implementations
- Strong understanding of data modelling techniques and data warehouse/data lake design
- Experience with data quality, data cleansing and data stewardship processes and techniques
- Ability to solve complex data problems by analysis, develop appropriate solutions and clearly communicate those solutions to the team.
- Ability to work efficiently and provide accurate time estimates for work to be undertaken.
- Well-developed interpersonal, oral and written communication skills, strong analytical and problem-solving skills.
- Understanding of the Ontario Human Rights Code (OHRC) and the Accessibility for Ontarians with Disabilities Act (AODA)
Deliverables
· Detailed technical design and functional specifications.
· Completed system components 'unit tested' and ready for System, QA and User Acceptance testing.
· Technical support during the various stages of testing (system integration, QA, User Acceptance)
· Implementation preparation.
· Technical documentation
· Post implementation support
· Status Reports
Looking for meaningful work? We can help
Raise is an established hiring firm with over 65 years of experience. We believe strongly in making the world a better place through work, which is why we’re a certified B Corporation and donate 10% of our profits to charity.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer, and request accommodation: https://raise.jobs/accommodations/
In order to submit candidates for roles, our clients will sometimes require personal information to confirm the identity of applicants and their legal status to work. Raise will never ask you for personal or banking information unless you have been selected for a job. If you are ever unsure about the legitimacy of this or another job posting by Raise (or have any other questions), please contact us at +1 800-567-9675 orhello@raiserecruiting.com