KỸ NĂNG
- Data Engineer
MÔ TẢ CÔNG VIỆC
Design, develop, and maintain scalable data pipelines using Apache Airflow, with strong hands-on experience in Airflow 3.0.
Build and maintain data ingestion pipelines from APIs, FSPT, and other external data sources.
Develop and manage data processing workflows on Databricks, particularly within the Silver Layer.
Design and implement data solutions using AWS services, including S3, DynamoDB, MWAA, and Secrets Manager.
Collaborate closely with Data Scientists to understand data requirements and design effective, scalable technical solutions.
Troubleshoot, optimize, and improve data pipelines to ensure data quality, reliability, and performance.
YÊU CẦU CÔNG VIỆC
3–5 years of professional experience in Data Engineering.
Strong hands-on experience with Apache Airflow, especially Airflow 3.0.
Experience building data ingestion pipelines from APIs and FSPT.
Practical experience with Databricks, particularly working with the Silver Layer.
Good knowledge and hands-on experience with AWS, including:
+ Amazon S3
+ DynamoDB
+ Amazon MWAA
+ AWS Secrets Manager
Strong understanding of data pipeline architecture, ETL/ELT processes, and data engineering best practices.
Ability to analyze requirements and design technical solutions that effectively support Data Science use cases.
Strong problem-solving and troubleshooting skills.
Fluent English communication skills, both written and verbal, with the ability to work effectively with international teams.
Nice to Have
Knowledge or hands-on experience with Web Crawling and Web Scraping.
Experience working with large-scale data processing and distributed data platforms.
Experience collaborating directly with Data Scientists, ML Engineers, or Analytics teams.
Familiarity with data quality, monitoring, and pipeline optimization.
QUYỀN LỢI
Receive 100% salary from the onboarding date.
Participate in company activities: Teambuilding, travel, vacation and other activities.
Work with large and advanced systems, have the opportunity to develop comprehensive technology skills with complex problems, requiring high accuracy.
MỨC LƯƠNG
Hỗ trợ ứng tuyển