[FI689] - Senior Staff Kafka/ Rabbit MQ Platform Engineer

May 30, 2025

Who are we? Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at software speed. Equinix enables organizations to access all the right places, partners and possibilities to scale with agility, speed the launch of digital services, deliver world-class experiences and multiply their value, while supporting their sustainability goals. Our culture is based on collaboration and the growth and development of our teams. We hire hardworking people who thrive on solving challenging problems and give them opportunities to hone new skills and try new approaches, as we grow our product portfolio with new software and network architecture solutions. We embrace diversity in thought and contribution and are committed to providing an equitable work environment that is foundational to our core values as a company and is vital to our success. Job Summary We are seeking a seasoned RabbitMQ and Kafka Platform Engineer with 7+ years of experience, including a strong track record of leading end-to-end design and implementation of enterprise-grade messaging solutions. This role requires deep expertise in RabbitMQ (self-hosted), Kafka, and related technologies, along with a solid understanding of distributed systems and messaging frameworks. The ideal candidate will have demonstrated leadership in guiding engineering teams, setting technical direction, and driving the development of high-performance, scalable, and reliable communication platforms. Responsibilities Design and Architecture - Architect and implement RabbitMQ solutions tailored to the organization's needs - Develop and maintain efficient message-routing strategies, including exchanges, queues, and bindings - Optimize RabbitMQ clusters for scalability, fault tolerance, and performance Deployment and Management - Deploy RabbitMQ clusters in on-premise, cloud, or hybrid environments - Managing users and permissions, ensuring that only authorized users have access to specific queues and exchanges, and implementing security best practices - Monitor and troubleshoot RabbitMQ nodes to ensure system health and uptime - Implementing backup strategies for RabbitMQ data and ensuring that there are recovery plans in place in case of failures - Keeping RabbitMQ and its dependencies up to date with the latest versions and security patches Performance Optimization - Analyze and resolve performance bottlenecks in message processing - Optimize resource utilization by fine-tuning RabbitMQ configurations - Implement caching, clustering, or sharding strategies as needed Security and Compliance - Implement robust authentication and authorization mechanisms (e.g., TLS, OAuth) - Ensure RabbitMQ clusters comply with organizational security policies and best practices - Perform regular security audits and vulnerability assessments Collaboration and Support - Work with developers to define messaging patterns and best practices - Provide support and training to teams on RabbitMQ usage - Collaborate with DevOps teams to integrate RabbitMQ into CI/CD pipelines Monitoring and Alerting: - Set up monitoring tools (e.g., Prometheus, Grafana) to track RabbitMQ metrics - Implement alerting mechanisms to proactively address potential issues Responsibilities Kafka Infrastructure Design and Management - Architect, deploy, and maintain Kafka clusters in on-premise and cloud environments - Ensure high availability, scalability, and fault tolerance of the Kafka platform - Implement and manage Kafka components, including brokers, Zookeeper, Kafka Connect, Kafka Streams, and Schema Registry - Managing user access and permissions, ensuring that only authorized users and applications can produce or consume messages from specific topics - Configuring data retention policies for topics, managing log segments, and ensuring that old data is cleaned up according to organizational policies - Configure and manage Kafka topics, partitions, and replication - Develop and implement backup and disaster recovery plan for Kafka cluster Monitoring and Performance Optimization - Continuously analyze system performance, troubleshoot issues, and optimize resource utilization - Address bottlenecks in message throughput and processing Security and Compliance - Configure and manage Kafka security features, including encryption, authentication (SASL), and ACLs - Ensure the Kafka environment complies with organizational and regulatory standards Collaboration and Support - Collaborate with development, data engineering, and DevOps teams to implement event-driven solutions - Provide technical guidance and troubleshooting expertise for Kafka-related issues - Maintain clear documentation for Kafka infrastructure and processes Leadership - Lead cross-functional teams in the architecture, deployment, and optimization of messaging solutions, ensuring alignment with enterprise-scale system requirements and business objectives - Drive technical strategy and decision-making for messaging platforms, mentoring junior engineers and fostering best practices across development, deployment, and operations Qualifications - Platform Management experience in any Messaging Product like Solace etc. - Good scripting skills ( Python, etc.) - Working knowledge of Ansible & Automation - Knowledge of any Cloud is plus - strong verbal and written communication skills Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form. Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.

Back to blog

DISCLAIMER