Principal Data Engineer

Job Description

Lantern is seeking a Principal Data Engineer to play a pivotal role in shaping the future of its Data Platform. In this role, the individual will be responsible for developing and implementing the strategic vision for the platform, championing advanced Data Engineering, ML, and AI capabilities across the organization. They will also mentor team members and apply their expertise in Data Architecture and software engineering best practices to strengthen the platform's foundation.Responsibilities include:

• Architecting and building platform foundations, including Observability, lineage, and Quality Control Frameworks.
• Modularizing platform frameworks to support diverse data needs and data formats.
• Collaborating with Data Engineers, Architects, and Business Analysts to improve data reliability and interpretability.
• Building technical design documents and evaluating emerging technologies.
• Championing software engineering best practices, including code standards and CI/CD.
• Evolving platform capabilities to integrate ML and AI Models.
• Partnering with business stakeholders and technology leadership to define Data Strategy and Roadmap.
• Fostering a positive team environment and mentoring team members.

Requirements:

• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• 12+ years of experience in Data Engineering, with at least 5+ years as Principal Engineer.
• 5+ years of experience with programming languages (Python, Scala etc.), with a deep understanding of Spark and Databricks.
• 3+ years of working with EDI or HIE standards (e.g. X12, HL7, and/or FHIR).
• Proven leadership experience managing and developing data engineering teams.
• Prior experience with designing and managing large scale data infrastructure.
• Expertise with cloud platforms, databases, and modern data stack with proficiency in Distributed Data Systems (e.g. Kafka, NoSQL).
• Experience in building data lakes to support high speed querying by the end users.
• Knowledge of AI/ML technologies to support various business use cases.
• Knowledge of OOA/D and N-tier web or mobile applications best practices
• Strong communication skills.
• Experience or knowledge with creating RESTful API’s and data visualizations.

Lantern offers:

• Medical Insurance
• Dental Insurance
• Vision Insurance
• Short & Long Term Disability
• Life Insurance
• 401k with company match
• Paid Time Off
• Paid Parental Leave