Kafka Architect - #1619849

Capgemini


Date: 1 day ago
City: Leeds
Contract type: Full time
Work schedule: Full day
Capgemini

Job Title: Kafka Architect


Get The Future You Want!


Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.


Your Role


A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms. As part of the CTO Data Ingestion Service, the incumbent will be required to:



  • Designing and architecting scalable, real-time systems in Kafka.

  • Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability.

  • Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam.

  • Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs.

  • Implementing security measures to protect Kafka clusters and data streams.

  • Monitoring Kafka performance and troubleshooting issues to ensure optimal performance. Providing technical guidance and support to development operations teams.

  • Staying updated with the latest Kafka features, updates and industry practices.

  • Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks.

  • Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.

  • Experience with cloud platform such as GCP Pub/Sub.

  • Excellent problem-solving skills.


Your Profile



  • Knowledge of Kafka data pipelines and messaging solutions to support critical business operations and enable real-time data processing.

  • Monitoring Kafka performance, enhancing decision making and operational efficiency

  • Collaborating with development teams to integrate Kafka applications and services.

  • Maintain an architectural library for Kafka deployment models and patterns

  • Helping developers to maintain Kafka connectors such as JDBC, MongoDB and S3 connectors, along with topics schemas, to streamline data ingestion from databases, NoSQL data stores and cloud storage, enabling faster data insight.


About Capgemini


Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.


Get The Future You Want | www.capgemini.com

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Roadside Vehicle Technician

Perfect Placement,
6 hours ago
Roadside Vehicle Technician Required Location: Leeds and Surrounds Salary: £35,000 basic, with OTE of up to £48,000 per annum We are currently working with a UK Wide Recovery Business who are seeking Roadside Vehicle Technicians to join their team. This...

Special Education Needs Tutor

Targeted Provision Ltd,
7 hours ago
Core subject (Maths, English, or Science) SEN/SEND Tutors for Young People with SEND, SEMH, and other Additional Educational Needs required in West Yorkshire. Multiple positions are available and hiring is ongoing to meet the wide variety of needs we support....

Senior Claims Handler

Avencia Consulting,
9 hours ago
About us Avencia consulting is partnered with a leading insurer who are looking to hire a Senior Claims Handler in their Construction & Liability team in Leeds. What you'll be doing Take full responsibility and accountability for your workload of...
Avencia Consulting