dataautomation 2023.09 - 2023.11
Public Parking Lot Big Data Analysis Project (Seoul City)
Data Engineer
Participated in a project to analyze optimal locations utilizing Seoul City's big data (parking lots, commercial districts, population movement). Constructed a data processing ETL pipeline and an API for ML training using Python and AWS services, and visualized the analysis results on a GIS-based map.
Tech Stack
Python SQL AWS Lambda AWS S3 AWS DynamoDB QGIS
Roles & Responsibilities
- Data Engineer: Responsible for the technical design of the overall data pipeline and analysis models, and built and operated an AWS-based automated data collection and processing pipeline.
Outcomes
- Advanced to the finals and won the Excellence Award at the Seoul City Big Data Contest
- Realized pipeline efficiency by optimizing large-scale data processing processes.