Senior Data Engineer (Project Based)

Deskripsi pekerjaan

Persyaratan

• ✓ Bachelor's degree in Computer Science, Information Technology, Statistics, or related field.
• ✓ 5+ years of data engineering experience in production environments, including at least one large-scale data consolidation or migration project.
• ✓ Deep expertise in PostgreSQL — advanced schema design, partitioning, indexing, query performance tuning, and referential integrity enforcement.
• ✓ Hands-on experience building and maintaining ETL/ELT pipelines for heterogeneous data sources.
• ✓ Proficiency in at least one ETL orchestration tool (Airflow, dbt, Prefect, or equivalent).
• ✓ Experience with data migration from legacy systems — including schema mapping, data cleansing, validation, and rollback planning.
• ✓ Proficiency in SQL across multiple dialects; experience with data sourced from various RDBMS (SQL Server, MySQL/MariaDB, PostgreSQL).
• ✓ Experience setting up and querying analytical data stores — ClickHouse, BigQuery, Redshift, or equivalent columnar/OLAP databases.
• ✓ Understanding of message broker integration (RabbitMQ, Kafka) for streaming data pipelines.
• ✓ Strong data modeling skills — entity-relationship design, normalization, slowly changing dimensions, and audit trail schema patterns.
• ✓ Familiarity with REST API consumption for data ingestion from external systems.
• ✓ Experience with data quality validation frameworks and reconciliation reporting post-migration.
• ✓ Comfortable working with Docker and running pipelines in containerized environments.
• ✓ Solid understanding of data governance principles — lineage, access control, sensitive data classification.
• ✓ Experience with PostGIS or spatial databases for geospatial data storage and querying. (Plus)
• ✓ Familiarity with geospatial data formats — Shapefile, GeoJSON, coordinate reference system transformations. (Plus)
• ✓ Experience integrating with government or inter-agency data systems and APIs. (Plus)
• ✓ Familiarity with Grafana, Prometheus, or equivalent for data pipeline observability. (Plus)
• ✓ Experience with object storage (MinIO/S3) for managing large file and document datasets. (Plus)
• ✓ Familiarity with frequency management, spectrum monitoring, or telecommunications domain. (Plus)

Skill yang dibutuhkan