Data Engineer (Big Data Processing)

As a data engineer in a team that is responsible for mission-critical data analytics systems, you will contribute to the development and maintenance of high-performance data pipelines and systems related to national security. You will be involved in complex technical projects to collect, parse and process large datasets with the aim of turning them into useful information and insights. Join us to seize the opportunity to use cutting-edge technologies to protect the nation.

• Design and build data pipelines that are scalable, robust and maintainable to ingest crucial data using cutting-edge platforms and technologies • Work with product managers, engineering managers and key stakeholders to deliver impactful data products that meet our business needs • Optimise performance of large-scale data pipelines for low latency, high throughput and high reliability • Ensure data integrity, quality and governance through robust design and operational monitoring • Build and experiment with Agentic AI systems (e.g. multi-step autonomous agents, tool-using LLM workflows) • Troubleshoot and resolve complex issues in critical data pipelines • Implement data engineering best practices, including testing, orchestration and monitoring of data pipelines • Participate in technical discussions with the team and key stakeholders to shape the future of our data products

• Background in computer science or equivalent • Strong foundations in programming languages such as Scala or Java • Familiarity with the following technologies: Spark, Kafka, Hadoop, Elastic stack, Kudu • Familiarity with AI-assisted development tools and concepts, exposure to agentic AI systems would be a plus • Able to communicate technical details effectively and clearly • Good interpersonal, analytical and problem-solving skills to get things done in a dynamic environment As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.