Big Data Platform Developer

Holding Group · Doha, Qatar

دوام كامل · mid

المهارات · Skills: Python، Java، Scala، SQL، Kafka، CI/CD، Linux، Spark

We are looking for an experienced and innovative Big Data Platform Developer to join our technology and data engineering team.

The successful candidate will design, develop, implement, and maintain scalable big data platforms and data processing solutions, working closely with data engineers, software developers, data scientists, architects, and business stakeholders to build high-performance data platforms that support analytics, reporting, artificial intelligence, and business intelligence initiatives.

Key responsibilities

Design, develop, and maintain scalable big data platforms and data processing solutions.
Develop and optimize high-volume, high-performance data pipelines for structured and unstructured data.
Build reliable ETL/ELT pipelines for data ingestion, transformation, processing, and integration.
Work with distributed data processing technologies such as Apache Spark, Hadoop and Kafka.
Design data ingestion from databases, APIs, applications, logs, IoT devices, and other sources.
Develop batch and real-time streaming data processing solutions.
Implement data quality, validation, monitoring, and error-handling mechanisms.
Develop scalable storage using data lakes, data warehouses, and modern data platforms.
Implement security, access control, encryption, and governance across data platforms.
Collaborate with DevOps and cloud teams on CI/CD and infrastructure automation.

Required qualifications

Bachelor's degree in Computer Science, Information Technology, Software Engineering, Data Engineering, or a related field.
5+ years of experience in data engineering, big data development, or data platforms.
Strong programming experience in Python, Java, or Scala.
Strong experience with Apache Spark and distributed data processing.
Hands-on experience developing and managing ETL/ELT data pipelines.
Strong knowledge of SQL and relational databases.
Good understanding of data modeling, data integration, and data warehousing concepts.
Experience working with Linux/Unix environments.

قدّم على الموقع الأصلي · Apply on the original posting ↗ (عبر Indeed)

كل الوظائف · All jobs · قيّم مهارتك مجانًا · Free skill assessment