Data Architect Engineer

Job Description

Luminar Technologies is seeking a Data Architect Engineer to lead enterprise-level initiatives in building reliable and scalable data pipelines. The ideal candidate will possess in-depth experience with Databricks and AWS, driving the design, implementation, and management of data pipelines. This role involves close collaboration with stakeholders across the organization, including business leaders, IT leadership, and external partners.Responsibilities include:

• Building data pipelines using Delta Live Table Framework.
• Managing internal/external tables & volumes on Unity Catalog.
• Implementing DevOps processes on the Databricks platform.
• Programming and debugging in Python and SQL.
• Managing Databricks on AWS.
• Building monitoring tools.
• Developing RAGs and AI functions in Databricks.
• Defining data requirements for various data structures.

Minimum qualifications include:

• 5+ years of experience in data engineering, data science, or technical architecture.
• Bachelor’s or master’s degree in computer science, Information Systems, or a related field.
• Hands-on experience with Databricks, Python, SQL, and Spark.
• Knowledge of security, privacy, and compliance requirements.
• Excellent communication and interpersonal skills.

Preferred qualifications include:

• Databricks Certification.
• 10+ years of experience in data engineering, data science, or technical architecture.