The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA) which aims to pioneer innovation solutions and develop world class science and technology capabilities to transform and empower the Home Team in delivering safety and security for Singapore. The HTX AI Product team is committed to empower our Home Team Department (HTD)'s flagship projects through the seamless integration of AI technologies. From identifying opportunities to delivery, launch, and continuous enhancement, AI Product team aims to push boundaries and setting new standards in homeland security. We are looking for enthusiastic engineer to join our team in building a Large Language Model. You'll work with proprietary datasets and help deploy models into production. If you're passionate about machine learning and eager to work on cutting-edge technology, we'd love to hear from you. Experience with full-stack development is a plus.

Key Responsibilities: Design and implement scalable architectures for pre-training, post-training, and fine-tuning LLM / LMM on distributed GPU clusters. Perform pre-training / post-training of LLM / LMM. Develop and optimise custom evaluation metrics and pipelines to assess LLM / LMM performance across various tasks. Utilize SLURM for efficient job scheduling and resource management in high-performance computing environments. Leverage AI frameworks such as PyTorch, DeepSpeed, related to build and train state-of-the-art LLM / LMM. Contribute to research publications and collaborate with academic and industry partners to advance LLM capabilities. Implement techniques for model optimization, including mixed-precision training and model parallelism. Ensure reproducibility and scalability of training workflows through robust version control and documentation practices. Collaborate with cross-functional teams to integrate LLMs into downstream applications and services.

Key Experience: Education: Bachelor's / Master’s degree in Computer Science, Engineering, Mathematics, or a related field. Proficiency in Python and deep learning frameworks, particularly PyTorch. Experience with distributed training using SLURM and multi-GPU setups. Experience in fine-tuning and evaluating large-scale language models. Understanding of machine learning principles and best practices. Excellent problem-solving skills and ability to work in a collaborative environment. Familiarity with cloud-based machine learning platforms and infrastructure. Experience with reinforcement learning and instruction tuning is a plus. Familiarity with model optimization libraries such as DeepSpeed and techniques like ZeRO is a plus. Contributions to open-source projects or publications in AI/ML conferences is a plus. *** All new hires are appointed on a two-year contract in the first instance and will be assessed and considered for permanent tenure over time, based on performance. As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment. All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement.

HTX is the world’s first Science and Technology agency that integrates a diverse range of scientific and engineering capabilities to innovate and deliver transformative and operationally-ready solutions for homeland security. As a statutory board of the Ministry of Home Affairs and integral to the Home Team, HTX works at the forefront of science and technology to empower Singapore’s frontline of security. Our shared mission is to amplify, augment and accelerate the Home Team’s advantage and secure Singapore as the safest place on planet earth.