Job Description
GR8 Tech, a global product company in the iGaming industry, is seeking a Middle Data Engineer. The ideal candidate will be responsible for developing and maintaining data transformation pipelines, data collecting from various sources, data modeling, data quality testing automation, semantic layer developing and integrating, and designing and implementing REST-based APIs.GR8 Tech offers benefits such as sports compensation, medical coverage, psychological support, and home-office coverage. They also provide remote work options, coworking compensation, childcare budget, and additional leave days.
Responsibilities: - Developing and maintaining data transformation pipelines
- Data collecting from Kafka, Google Analytics, Firebase, Appsflyer, Cloudflare, and other third-party apps
- Data modeling: building a centralized data catalog with well-validated and documented data marts
- Data quality/integrity testing automation
- Semantic layer developing and integrating
- Designing and implementing REST-based APIs
Requirements: - Experience with storage formats like Parquet, ORC, AVRO, JSON, CSV, TSV
- Experience with distributed computation technologies such as HDFS, Spark, Presto / Trino / Drill, Apache Flink
- Experience with relational databases (PostgreSQL, Microsoft SQL Server, etc.)
- Experience with columnar storages: AWS Redshift, Google BigQuery, Clickhouse etc
- Experience with metadata management tools like DataHub, Openmetadata etc
- Knowledge of data access management (RBAC, TBAC, RLS, CLS, Data Masking)
- Experience with ETL, Data Warehousing tasks
- Experience with job scheduling and task queues
- Experience with cloud providers: AWS, Google Cloud Platform, etc.
- Experience designing and implementing REST APIs (Aiohttp, Flask, FastAPI)
- Knowledge of performance tuning of ETL Jobs, SQL’s, Partitioning, Indexing
- Knowledge of database theory: types, their pros and cons
- Knowledge of streaming data processing: Kafka, AWS Kinesis, RabbitMQ, Redpanda etc.
GR8 Tech offers: - Sports compensation
- Medical coverage
- Psychological support
- Home-office coverage
- Remote work
- Coworking compensation
- Childcare budget
- Maternity leave
- Paternity leave
- Additional 2 days for family events
- Open feedback and transparent direct communications
- Growth and development opportunities
- High tolerance to experiment and mistakes
- Supportive friendly environment