Data Flow Engineer

At Quento, the ICT arm of the Qualco Group, we deliver comprehensive and innovative solutions across AI, Digital Engineering, Cloud, and Cybersecurity, helping businesses accelerate digital transformation. With a presence in Greece, Luxembourg, and Belgium, and backed by the expertise of the Qualco Group, we combine deep technical knowledge with strategic partnerships to support business growth.

At Quento Technologies S.A., we empower our people to innovate and lead in delivering transformative ICT solutions to our clients worldwide. Quento Technologies seeks a highly motivated and experienced Data Flow Engineer.

Responsibilities:

• Design, implementation, testing and maintenance of complex data flows in Cloudera DataFlow (Apache NiFi) - ingest, transform, enrich, route, egress;
• Building and optimisation of CDC-based pipelines (real-time / near-real-time) with usage of NiFi, Kafka, Debezium / SQL CDC connectors;
• Integration with external systems via REST API, JDBC, Kafka and other protocols;
• Managing data schemas (Avro), metadata and lineage in Apache Atlas;
• Configuration of security and governance (Ranger policies) for data flows;
• Monitoring, alerting and troubleshooting performance / reliability of data pipelines;
• Collaboration with data engineers, architects and business stakeholders on defining requirements and architecture of data flows;
• Creation and maintenance of SOPs and documentation for data flows, and runbooks;
• Participation in CDP / NiFi / Kafka upgrades and migrations;
• Ensuring that all activities and duties are carried out in full compliance with regulatory requirements and supporting the continued implementation of the Group Anti-Bribery and Corruption Policy. 

• Bachelor's degree;
• Minimum 8 years of IT professional experience;
• Minimum 6 years of experience in similar position;
• Hands-on experience in daily working with Apache NiFi, preferably in CDP environment - design, deployment, monitoring, troubleshooting of advanced flows - min. 2-3 years of hands-on;
• Documented experience in realisation of at least one big integration project using NiFi as central tool (API calling, db integrations, transformations, data routing and delivery);
• Practical knowledge and experience with Apache Iceberg, preferably in CDP environment - table creation/management, NiFi/Spark/Flink integration;
• Experience in implementation of CDC pipelines to/from relational databases;
• Practical knowledge of configuring and managing governance/lineage in Apache Atlas + Ranger in the context of NiFi flows (tagging, policies, audit);
• Experience in working with Apache Kafka in CDP ecosystem (integration NiFi -> Kafka -> downstream consumers, schema management with Avro);
• Expert knowledge in defining, designing, implementing and maintaining complex data flows in Apache NiFi (Cloudera DataFlow);
• Adanced Python programming skills (data processing, NiFi custom logic, flow automation, integrations);
• Advanced in building integrations based on REST API (endpoints' calling, OAuth/JWT authentication, rate limiting, error recovery);
• Hands-on experience in building CDC-based data flows (Change Data Capture) - using native NiFI processes/connectors as well as with SQL Builder;
• Good knowledge of Apache Iceberg (tables, schema evolution, partitioning);
• Knowledge on data governance and catalog in CDP: Apache Atlas (metadata, lineage, tagging) and Apache Ranger (security policies, authorization);
• Experience with Apache Kafka as message broker (topics, producers/consumers, schema registry, NiFi integration) and Apache Avro as serialization standard (schema evolution, compatibility etc.);
• At least 1 certification among:
  • Cloudera Certified Developer for Apache NiFi or an equivalent certification
  • Cloudera Data Flow (CFM) related certification or an equivalent certification
• Very good knowledge of the English language (B2).

This role is an on - site opportunity Poland.

CV submitted in English.

Your race, gender identity and expression, age ethnicity or disability make no difference in Quento we want to attract, develop, promote, and retain the best people based only on their ability and behavior.

Disclaimer: Quento collects and processes personal data in accordance with the EU General Data Protection Regulation (GDPR). We are bound to use the information provided within your job application for recruitment purposes only and not to share these with any third parties. For more details on the processing of your personal data during the Recruitment procedure, please be informed in the Recruitment Notice, before the submission of your application.