Tổng quan công việc
Data pipeline maintenance and operation Processing data to meet functional and non-functional business
Kỹ năng chính
Yêu cầu
Identification, design, implement in internal processes for automatizing manual processes and optimizing data provision DW data modeling and ETL design and development Real-time streaming data collection and processing development Design about GCP/AWS-based data platform environment and architecture K8S (GKE/EKS) Container-based service architecture design and development MLOps architecture design/development and service. JOB
REQUIREMENTS: Experience in Data modeling, DW construction and operation Knowledge and experience in intermediate SQL/Python practical Experience in ETL pipeline design and development (using SQL, Python) Experience in using data pipeline and workflow management tools (Airflow, Apache Beam, etc.) Cloud engineering experience in using AWS/GCP cloud services (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS, etc.) (BigQuery, Dataproc, Dataflow, Composer, DataStore, DynamoDB, SNS, SQS, GKE, EKS,...) Experienced in real-time data processing and application development (Kafka, Storm, Spark Streaming,...) Experience in building and providing MLOps services COMPENSATION &
Quyền lợi
Team-building events
Employee Award
Insurance
Flexible Hours
Career Path
Lifetime Savings
Training/Certification
Free Meals
Wellness Facilities
Annual Leave
Remote work options
Laptop Provided
Thông tin bổ sung
Kỹ sư
Tiếng Anh
