Deskripsi Pekerjaan:

Dealls is seeking a passionate and experienced Data Engineer to join our fast-growing team. In this role, you will play a pivotal role in building and maintaining our data infrastructure, ensuring the efficient and scalable collection, transformation, and analysis of data that drives our business decisions.

You will be the first Data Engineer in our team – so if you're someone who enjoys challenges & wants to be the pioneer of our data infrastructure, we will be eagerly waiting for your application!

Responsibilities:

• Design, develop, and implement scalable data pipelines using technologies like Python, SQL, Spark, and cloud platforms (e.g., AWS, GCP).
• Extract, transform, and load (ETL) data from various sources including databases, APIs, and log files.
• Implement data quality checks and monitoring systems to ensure data accuracy and consistency.
• Optimize data pipelines for performance and efficiency.
• Develop and maintain data models and data warehouses.
• Collaborate with data analysts and scientists to understand their data needs and translate them into technical requirements.
• Document data pipelines and processes for clarity and maintainability.
• Stay up-to-date with the latest trends and technologies in data engineering.

Kualifikasi:

• Bachelor’s Degree (S1) in Computer Science or related field.
• Min. of 2+ yrs of experience in a data engineering / data architect / software engineering role. 
• Strong hands-on experience in java, python is required. Must have shipped multiple projects with a major hands-on contribution to each project.
• Experience in Big data technologies: Hadoop ecosystem (map-reduce, spark, Kafka)
• Experience in different storage technologies: OLTP like Postgres, OLAP like Redshift, Google BigQuery, NoSQL like Redis, HBase, Kafka
• Familiarity with machine learning algorithms and concepts (gradient descent, logistic regression) and software libraries like pandas, TensorFlow, etc.