Senior Data Engineer - Real-Time Streaming
About this role
We are looking for a Senior Data Engineer with deep expertise in real-time data streaming and distributed data processing to design, build, and scale next-generation data platforms. This role is critical in enabling event-driven architecture and real-time analytics for mission-critical banking systems, particularly across risk and compliance functions.
You will collaborate closely with data architects, platform engineers, and business stakeholders to deliver low-latency, high-throughput data pipelines that power advanced analytics and decision-making.
Key Responsibilities
- Design, develop, and maintain real-time streaming pipelines using Apache Kafka, PySpark, and Flink
- Build scalable and fault-tolerant event-driven data architectures
- Process high-volume streaming data with low latency and high reliability
- Integrate data from multiple sources into centralized data platforms (Data Lake / Lakehouse)
- Optimize data pipelines for performance, scalability, and cost efficiency
- Ensure data quality, governance, and compliance aligned with banking standards
- Work with cross-functional teams to translate business requirements into technical solutions
- Monitor and troubleshoot streaming jobs and production pipelines
Required Skills & Experience
- 5+ years of experience in Data Engineering
- Strong hands-on experience with:
- PySpark / Spark Streaming
- Apache Kafka (Producers, Consumers, Kafka Streams)
- Apache Flink or other real-time processing frameworks
- Experience building real-time / near real-time data pipelines
- Strong understanding of distributed systems and event-driven architecture
- Proficiency in Python / Java / Scala
- Experience with data lakes, ETL/ELT pipelines, and big data ecosystems
- Knowledge of cloud platforms (AWS / Azure / GCP) is a plus
- Familiarity with banking, risk, or compliance data systems is highly preferred
Preferred Qualifications
- Experience working in financial services or banking domain
- Exposure to data governance, regulatory reporting, or compliance systems
- Knowledge of CI/CD pipelines and DevOps practices for data platforms
Frequently Asked Questions
Is the salary disclosed for the Senior Data Engineer - Real-Time Streaming position at cu9XaZB8i9r9X8CdwN62f7?
The salary for this Senior Data Engineer - Real-Time Streaming role at cu9XaZB8i9r9X8CdwN62f7 is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the Senior Data Engineer - Real-Time Streaming position at cu9XaZB8i9r9X8CdwN62f7 located?
This Senior Data Engineer - Real-Time Streaming role at cu9XaZB8i9r9X8CdwN62f7 is based in Chennai, Tamil Nadu, India. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
How do I apply for the Senior Data Engineer - Real-Time Streaming position at cu9XaZB8i9r9X8CdwN62f7?
Click the "Apply Now" button on this page. You will be redirected to cu9XaZB8i9r9X8CdwN62f7's official application portal hosted on workable where you can submit your application directly.
When was the Senior Data Engineer - Real-Time Streaming job at cu9XaZB8i9r9X8CdwN62f7 posted?
This Senior Data Engineer - Real-Time Streaming position at cu9XaZB8i9r9X8CdwN62f7 was posted on Apr 6, 2026. Apply as soon as possible — early applications are often reviewed first.
Senior Data Engineer - Real-Time Streaming
cu9XaZB8i9r9X8CdwN62f7
You'll be redirected to cu9XaZB8i9r9X8CdwN62f7's official application page on workable.