Lead Big Data Engineer (Java/Scala)

Job Description

GR8 Tech is seeking a Lead Data Engineer to drive the design and implementation of their real-time data streaming platform. The Lead Data Engineer will lead initiatives for real-time analytics and personalized user experiences by building scalable, low-latency data pipelines using Kafka Streams, Flink, and the JVM ecosystem (Java/Scala). This is a hands-on leadership role that requires working across engineering, data, and product teams to architect high-throughput systems, mentor engineers, and shape the company's long-term data strategy.Role involves:

• Designing and implementing real-time streaming pipelines using Kafka, Flink, and Kafka Streams
• Leading architecture and design decisions for the event-driven data platform
• Mentoring mid-level/senior engineers and fostering best practices in stream processing
• Collaborating with cross-functional teams to translate business requirements into robust data systems
• Ensuring data quality, observability, and reliability in streaming data
• Championing performance, fault tolerance, and exactly-once semantics in streaming jobs
• Evaluating and adopting new technologies to drive innovation
• Defining project goals and deliverables with stakeholders
• Enforcing quality assurance standards and ensuring thorough testing before release
• Promoting agile methodologies and improving development processes
• Acting as the primary point of contact between the team and management
• Maintaining comprehensive documentation for system architecture and technical designs

Requirements:

• At least 5 years of experience in a similar role with leadership experience
• Expertise with Apache Kafka and hands-on experience with Flink, Kafka Streams, or similar real-time systems
• Strong programming skills in Java, Scala
• In-depth understanding of distributed systems, data consistency models, and streaming semantics
• Experience with CI/CD, containerization, and infrastructure-as-code tools is a plus
• Ability to motivate and inspire a team, with experience in hiring and retaining top talent
• Knowledge of team role models and how to create a supportive, inclusive work environment
• Commitment to mentoring and professional growth of team members
• Proven ability to deliver projects on time, within scope and budget, with clear goal-setting (KPIs/OKRs)
• Advanced problem-solving skills and the ability to assess risks and mitigate them
• Ability to implement and monitor team KPIs, identify inefficiencies, and drive process improvements
• Proficiency in written and verbal communication
• Excellent communication and collaboration skills

GR8 Tech offers:

• Benefits Cafeteria: Sports compensation, Medical coverage, Psychological support, Home-office coverage
• Work-life balance: Remote work, Coworking compensation, Childcare budget, Maternity leave, Paternity leave, Additional 2 days for family events
• GR8 Culture: Open feedback, transparent communication, Growth and development, Tolerance to experiment and mistakes, Supportive environment