logo
Urban Redevelopment Authority

Data Engineer Intern (Data Pipeline Development)

Urban Redevelopment Authority

Internship

Closing on 31 Jan 2025

What the role is

The Data Engineering (DE) Team in the Urban Redevelopment Authority (URA) is responsible for applying advanced methods in data engineering to enhance various aspects of urban planning and development. The team comprises data engineers, analysts, cloud engineers, and planners who work together to provide innovative solutions to complex urban challenges. Join our team to contribute to the Planning Sectoral Data Hub (PSDH), a key data platform supporting diverse planning sectors. This role offers an exciting, dynamic, and enriching experience where you’ll engage with a variety of users and stakeholders to enhance the capabilities and reliability of PSDH.

What you will be working on

Internship Job Scope: 1. Data Pipeline Development and Support: Assist in designing and building data pipelines to enable efficient data flow from the source system to the PSDH Data Lakehouse. Utilize SQL and Python for ETL processes, and leverage Azure cloud services such as Databricks for pipeline orchestration, ensuring efficiency, scalability, and data integrity throughout the process. 2. Data Ingestion and Management Approval: Support the ingestion of data from source system into PSDH, including preparing documentation and seek data owner/management approval to initiate the data ingestion. 3. Data Migration: Ingest datasets from DWH into PSDH as a preliminary step toward a larger migration exercise. This includes identifying suitable datasets, evaluating ingestion feasibility, and documenting insights to guide future migration efforts. 4. User Transition Assistance: Liaise with users to support their transition to PSDH, including gathering requirements, coordinating timelines, and facilitating onboarding to the new platform. 5. Documentation and Best Practices: Create and update documentation on pipeline processes, data ingestion steps, and best practices for using PSDH. Learning Outcomes: • Data Pipeline Engineering: Gain hands-on experience in designing, building, and managing data pipelines, utilizing SQL and Python for data transformation and transport, and leveraging cloud technologies like Databricks for orchestration. • Data Lakehouse Architecture and Governance: Develop an understanding of the PSDH Data Lakehouse framework, including key components and design principles. Learn how to implement data governance policies to ensure data quality and compliance. • Stakeholder Engagement Process: Build skills in liaising with stakeholders, gathering user requirements, and supporting the formal approval process for significant data ingestion. • Technical Documentation: Learn to document technical workflows and create user guides, gaining insights into best practices for data ingestion and supporting user transitions.

What we are looking for

• Undergraduates / Postgraduates currently pursuing Computer Science / Information Technology or relevant fields. • Familiarity with SQL, Python, Jenkins, Git. • Knowledge in Azure Cloud (e.g. Azure Data Factory, Azure Databricks) will be an added advantage. • Please indicate your availability for the internship in your application, including the start and end date. • Note that only shortlisted candidates will be notified.

About Urban Redevelopment Authority

The Urban Redevelopment Authority (URA) is Singapore's national land use planning authority. URA prepares long term strategic plans, as well as detailed local area plans, for physical development, and then co-ordinates and guides efforts to bring these plans to reality. Prudent land use planning has enabled Singapore to enjoy strong economic growth and social cohesion, and ensures that sufficient land is safeguarded to support continued economic progress and future development.