Senior Software Engineer

Job Description

DeepIntent is seeking a Senior Software Engineer to establish a formal data practice for the organization. The Senior Software Engineer will be responsible for building and operating scalable and robust data architectures, creating pipelines for self-service data usage, and implementing DataOps practices. They will collaborate with business stakeholders, software engineers, machine learning engineers, and analysts to design, develop, and operate data pipelines that support data scientists and machine learning engineers. The ideal candidate will build simple, highly reliable data storage, ingestion, and transformation solutions.Responsibilities:

• Establish formal data practice for the organisation.
• Build & operate scalable and robust data architectures.
• Create pipelines for the self-service introduction and usage of new data.
• Implement DataOps practices
• Design, Develop, and operate Data Pipelines which support Data scientists and machine learning Engineers.
• Build simple, highly reliable Data storage, ingestion, and transformation solutions which are easy to deploy and manage.
• Collaborate with various business stakeholders, software engineers, machine learning engineers, and analysts.

Requirements:

• Experience in designing, developing and operating configurable Data pipelines serving high volume and velocity data.
• Experience working with public clouds like GCP/AWS.
• Good understanding of software engineering, DataOps, data architecture, Agile and DevOps methodologies.
• Experience building Data architectures that optimize performance and cost, whether the components are prepackaged or homegrown.
• Proficient with SQL, Java, Spring boot, Python or JVM-based language, Bash.
• Experience with any of Apache open source projects such as Spark, Druid, Beam, Airflow etc. and big data databases like BigQuery, Clickhouse, etc
• Good communication skills with the ability to collaborate with both technical and non-technical people.
• Ability to Think Big, take bets and innovate, Dive Deep, Bias for Action, Hire and Develop the Best, Learn and be Curious

Benefits:

• Competitive base salary plus performance based bonus or commission
• Comprehensive medical, dental, and vision coverage
• 401K match program
• Generous PTO policy and paid holidays
• Remote friendly culture with flexible work options
• Career development and advanced education support
• WFH and internet stipends