Lead Engineer/ Engineer, Data Platform & Engineering, AI Data Engineering, xData

The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA), which aims to pioneer innovative solutions and develop world-class science and technology capabilities to transform and empower the Home Team in delivering safety and security for Singapore. The HTxAI movement is aligned with Singapore’s National AI Strategy to position Singapore as a global leader in AI by 2030. As part of its AI strategy, the HTxAI movement will leverage partnerships and collaborations with industry and academia to strengthen HTX’s internal AI capabilities and advance its AI research and development (R&D). As an Engineer, Data Platform & Engineering, you will play a critical role in developing and managing data pipelines, engineering data infrastructure, that supports AI model development and deployment, ensuring data governance, quality and security. This position requires a strong foundation in data engineering, and data architecture, with a passion for solving complex data challenges.

Objective: Design, develop and manage data pipelines and data architectures to enable seamless ETL and ELT processes, ensuring data flows efficiently between Home Team Departments (HTD), Whole Of Government (WOG), and Next Generation Infrastructure (NGINE) to support AI use cases and products. Responsibilities: o Design, build and deploy data platform using tools (e.g. React web framework, S3 API-compatible object store i.e. MinIO) that will support AI initiatives e.g. model training, streaming data for real-time inferencing/training. o Design, build, and maintain data pipelines using ETL and orchestration tools (e.g., Apache Spark, Talend, Apache Airflow) and data processing frameworks (e.g., Spark) to streamline data ingestion, transformation, and loading. o Implement workflows to operationalize data processes within HTD, enabling real-time and batch data operations. o Ensure high data availability, reliability, and integrity by leveraging SQL and programming languages such as Python and Java.

Education: o Bachelor’s/Master’s degree in Computer Science, Data Engineering, Information Systems, or related fields. Experience: o Minimum 3 years of professional experience as a data engineer or in a related field. o Hands-on experience with ETL and orchestration tools (e.g., Apache Spark, Talend, Apache Airflow) and big data ecosystems/platforms (e.g., Hadoop, Databricks). o Proven experience in designing and implementing data platform and working with data lakes. o Strong programming skills in Python, Java, and SQL. o Experience with cloud platforms (e.g., AWS, Azure, GCP) and modern data stack tools. Technical Skills: o Proficiency in data modelling, pipeline orchestration, and data pipeline performance optimization. o Proficiency in Kubernetes, Terraform and Ansible. o Familiarity with data governance frameworks and data cataloguing tools. o Knowledge of AI/ML integration with data platforms is a strong advantage. o Knowledge of React web frameworks e.g. Next.js is a strong advantage. Key Competencies: o Strong analytical and problem-solving skills with attention to detail. o Excellent communication skills to engage with technical and non-technical stakeholders. o Ability to work collaboratively in a dynamic and fast-paced environment. All new hires are appointed on a two-year contract in the first instance and will be assessed and considered for permanent tenure over time, based on performance. As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment. All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement. #LI-HL1