Data Engineer

Data pipeline maintenance and operation Processing data to meet functional and non-functional business

Identification, design, implement in internal processes for automatizing manual processes and optimizing data provision DW data modeling and ETL design and development Real-time streaming data collection and processing development Design about GCP/AWS-based data platform environment and architecture K8S (GKE/EKS) Container-based service architecture design and development MLOps architecture design/development and service. JOB

REQUIREMENTS: Experience in Data modeling, DW construction and operation Knowledge and experience in intermediate SQL/Python practical Experience in ETL pipeline design and development (using SQL, Python) Experience in using data pipeline and workflow management tools (Airflow, Apache Beam, etc.) Cloud engineering experience in using AWS/GCP cloud services (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS, etc.) (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS,...) Experienced in real-time data processing and application development (Kafka, Storm, Spark Streaming,...) Experience in building and providing MLOps services COMPENSATION &

Lifetime Savings

Training/Certification

Wellness Facilities

Annual Leave

Free Meals

Remote work options

Flexible Hours

Laptop Provided

Employee Award

Insurance

Career Path

Team-building events