Senior Developer
Pay Rate:(flexible)
Location:Toronto Ontario
Contract Length: 6 Months
We at Raise are hiring right now for one of our Clients. If you’re interested, apply below for your chance to join a great place to work.
Qualifications
- A senior NiFi developer should have a robust skillset to design, develop, and maintain complex data integration workflows using Apache NiFi. Below is a comprehensive list of key skills and expertise required:
Technical Skills
o Expertise in Apache NiFi
- Deep understanding of NiFi architecture, components (processors, controller services, flowfiles, etc.), and dataflow concepts.
- Proficiency in creating, managing, and optimizing NiFi dataflows for highthroughput, low-latency data processing.
- Familiarity with NiFi Expression Language for dynamic configuration and routing.
o Data Integration and ETL
- Strong experience in designing and implementing ETL (Extract, Transform, Load) pipelines.
- Ability to integrate diverse data sources (databases, APIs, file systems, message queues, etc.) and sinks.
- Understanding of data formats (JSON, XML, CSV, Avro, Parquet, etc.) and schema management.
o Programming and Scripting
- Proficiency in Java, Groovy, Python for automation and custom logic.
- Familiarity with REST API integration for interacting with NiFi’s API for automation and monitoring. o Big Data Ecosystem
- Knowledge of integration with big data tools like Hadoop, Kafka, Spark, Hive, or HBase.
- Experience with message brokers (e.g., Kafka, RabbitMQ) for real-time data streaming.
- Understanding of cloud-based data platforms (AWS, Azure, Google Cloud) and their integration with NiFi.
o Database and Storage Systems
- Proficiency in working with relational databases (e.g., MySQL, PostgreSQL, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra).
- Familiarity with cloud storage solutions (e.g., S3, Azure Data Lake, Google Cloud Storage).
- Knowledge of SQL for querying and transforming data.
o DevOps and CI/CD
- Experience with containerization (Docker, Kubernetes) for deploying NiFi in modern environments.
- Familiarity with CI/CD pipelines (Jenkins, GitLab CI, etc.) for automating NiFi flow deployments.
- Knowledge of infrastructure as code (IaC) tools like Terraform or Ansible for environment setup.
o Monitoring and Performance Tuning
- Expertise in monitoring NiFi performance using tools like NiFi’s built-in monitoring, Grafana, or Prometheus.
- Ability to optimize dataflows for performance, scalability, and resource efficiency.
- Experience with logging, debugging, and troubleshooting NiFi issues.
o Security
- Understanding of NiFi security features, including SSL/TLS, authentication (LDAP, Kerberos, OAuth), and authorization (role-based access control).
- Knowledge of data encryption, secure data transfer, and compliance with standards like GDPR or HIPAA.
Soft Skills
o Problem-Solving
- Ability to analyze complex data integration challenges and design efficient solutions.
- Strong debugging and troubleshooting skills to resolve pipeline issues.
o Collaboration and Communication
- Experience working with cross-functional teams (data engineers, analysts, DevOps, etc.).
- Ability to document dataflows and communicate technical concepts to nontechnical stakeholders.
o Leadership and Mentorship
- Ability to guide junior developers, review code, and enforce best practices.
- Experience leading NiFi-based projects or initiatives.
Domain Knowledge
o Data Engineering Best Practices
- Understanding of data governance, lineage, and metadata management.
- Familiarity with data quality frameworks and ensuring data integrity in pipelines.
o Industry-Specific Knowledge
- Depending on the organization, knowledge of industry-specific data standards is a plus.
Tools and Platforms
- Version Control: Git, GitHub, GitLab, etc.
- Cloud Platforms: AWS (S3, Redshift, Lambda), Azure (Data Factory, Blob Storage), Google Cloud (BigQuery, Cloud Storage).
- Monitoring Tools: Prometheus, Grafana, ELK Stack.
- Testing: Unit testing frameworks and integration testing for dataflows.
Experience Level
- 5+ years of experience working with Apache NiFi.
- Hands-on experience with large-scale, production-grade NiFi deployments.
- Proven track record of delivering complex data integration projects.
- A senior NiFi developer should combine deep technical expertise with practical experience in building scalable, secure, and efficient data pipelines while staying adaptable to evolving technologies and business needs.
Deliverables
- Validate and update requirement document, to design , development and production roll out and support for above mentioned initiative.
Looking for meaningful work? We can help
Raise is an established hiring firm with over 65 years of experience. We believe strongly in making the world a better place through work, which is why we’re a certified B Corporation and donate 10% of our profits to charity.
We strive to build teams that reflect the diversity of the communities we work in. We encourage all qualified applicants to apply, including people from traditionally underrepresented groups such as women, visible minorities, Indigenous peoples, people identifying as LGBTQ2SI, veterans, and people with visible/nonvisible disabilities.
We have a dedicated webpage for accommodations where you can learn more about what we offer, and request accommodation: https://raise.jobs/accommodations/
In order to submit candidates for roles, our clients will sometimes require personal information to confirm the identity of applicants and their legal status to work. Raise will never ask you for personal or banking information unless you have been selected for a job. If you are ever unsure about the legitimacy of this or another job posting by Raise (or have any other questions), please contact us at