工作经历
2023-03-01 -至今PAL Automation Senior Software Engineer
I'm currently developing Python Django web app for clients to access, and provide reporting service.
2022-03-01 -2024-03-01North Star IncSenior Software Engineer
Work on Python based microservice layer. Mainly do REST API end-points develop and debugging, unit testing by writing test cases. Also do ETL data pipeline with stacks: Airflow + Spark + MySQL + Snowflake.
2018-06-01 -2022-03-01Pixar IncSenior software engineer
Designed and Implemented Scada system using Python Django framework. HTML, CSS, JAVASCRIPT, PYTHON, DJANGO, MYSQL, REDIS, GIT, GITHUB
教育经历
1970-01-01 - University of SaskatchewanComputer Science硕士
技能
This project is to resolve foot 3D model adjustment and measure various parameters for later analysis. A Python script is required, and advanced algorithm for calculation and rotation are the key points.
This project is just a demo to show how ETL is implemented in Spark. Use ETL stack: Airflow + spark to implement data pipeline. (read from data sources, transform data, write to a destination) Airflow is for workflow management. Spark is for data transformation.