Key Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines for data extraction, transformation, and loading (ETL) from various sources into data warehouses or data lakes.
- Optimize and tune data pipelines for performance and efficiency.
- Create and maintain data models that support business reporting and analytics requirements.
- Implement data partitioning, indexing, and optimization strategies
- Perform data transformation and cleansing to prepare data for analysis.
- Implement data validation and enrichment processes.
- Monitor data pipelines and systems for performance, reliability, and data quality issues.
- Continuously optimize and improve data processing and storage.
- Additional duties as assigned.
Required Skills:
- Proficiency in data engineering concepts, including ETL processing, data warehousing, and data modeling
- Knowledge or experience with geospatial databases such as PostgreSQL/PostGIS/SQL Server/SQL Server Spatial, including schema design and optimization
- Strong SQL skills for data querying and manipulation, including spatial queries
- Experience using ETL tools and frameworks for data pipeline development
- Experience working with database tools in AWS (S3, DMS, EC2)
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills.
- Familiarity in data querying and manipulation, including spatial queries
- Experience with big data computing
Preferred experience:
- Familiarity with Geospatial Database concepts a plus
- Strong technical and analytical skills
- Experience working on an Agile team a plus
- Working in repositories, specially GIT
Required Education:
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
United States
