SotaTek logo

Data Engineer (HN/HCM)

SotaTek

Quận Cầu Giấy, Hà Nội, Vietnam
15 - 35 triệu3 - 5 yearsĐăng gần đâyNguồn: Glints
Ứng tuyển trên Glints

Tổng quan công việc

Data pipeline maintenance and operation Processing data to meet functional and non-functional business

Kỹ năng chính

PythonSQLdata engineerdata engineeringdata modelingredisdatabase systemsdata processingdata integrationetlhadoopgoogle bigqueryenglish languagemongodbmicrosoft sql serverextracttransformload etl

Yêu cầu

Identification, design, implement in internal processes for automatizing manual processes and optimizing data provision DW data modeling and ETL design and development Real-time streaming data collection and processing development Design about GCP/AWS-based data platform environment and architecture K8S (GKE/EKS) Container-based service architecture design and development MLOps architecture design/development and service. JOB

REQUIREMENTS: Experience in Data modeling, DW construction and operation Knowledge and experience in intermediate SQL/Python practical Experience in ETL pipeline design and development (using SQL, Python) Experience in using data pipeline and workflow management tools (Airflow, Apache Beam, etc.) Cloud engineering experience in using AWS/GCP cloud services (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS, etc.) (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS,...) Experienced in real-time data processing and application development (Kafka, Storm, Spark Streaming,...) Experience in building and providing MLOps services COMPENSATION &

Quyền lợi

Team-building events

Employee Award

Insurance

Flexible Hours

Career Path

Lifetime Savings

Training/Certification

Free Meals

Wellness Facilities

Annual Leave

Remote work options

Laptop Provided

Thông tin bổ sung

Tín hiệu vai trò

Kỹ sư

Ngôn ngữ

Tiếng Anh