Data Engineer
DIT Consulting Services Co.,Ltd.- Maintan existing data pipelines and make sure all pipelines is ready to use.
- Monitor and troubleshoot data pipeline performance and data quality issues.
- Develop, test, and deploy ETL (Extract, Transform, Load) processes.
- Build and optimize data architectures, ensuring high availability and performance.
- Integrate structured and unstructured data from multiple sources.
- Collaborate with cross-functional teams to improve data accessibility and usability.
- Implement data governance, security, and compliance best practices.
- Automate data processing workflows and optimize data storage solutions.
- Document data engineering processes, pipelines, and infrastructure.
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and database management (ORACLE, PostgreSQL, MySQL, etc.).
- Experience with big data technologies such as Cloudera, ORACLE Essence Plus.
- Proficiency in programming languages such as Python, Java, or Scala.
- Knowledge of cloud platforms like AWS, Azure, or Google Cloud.
- Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, or Luigi).
- Familiarity with data warehousing solutions such as Snowflake, Redshift, or BigQuery.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Excellent communication and teamwork skills.
- ทำงานสัปดาห์ละ 5 วัน
