SKILL.md
Harvard Art Museums Data Engineering & Analytics
Skill by ara.so — Data Skills collection.
This project demonstrates a complete data engineering workflow: extracting data from the Harvard Art Museums API, transforming it into relational tables, loading into SQL databases, and building interactive analytics dashboards with Streamlit.
What This Project Does
- API Integration: Fetches artifact data from Harvard Art Museums API with pagination and rate limiting
- ETL Pipeline: Transforms nested JSON into structured relational tables (metadata, media, colors)
- SQL Storage: Loads data into MySQL/TiDB Cloud with proper schema design
- Analytics: Executes 20+ predefined analytical queries
- Visualization: Interactive Plotly dashboards for data exploration
Installation
Harvard Art Museums Data Engineering & Analytics
Skill by ara.so — Data Skills collection.
This project demonstrates a complete data engineering workflow: extracting data from the Harvard Art Museums API, transforming it into relational tables, loading into SQL databases, and building interactive analytics dashboards with Streamlit.
What This Project Does
- API Integration: Fetches artifact data from Harvard Art Museums API with pagination and rate limiting
- ETL Pipeline: Transforms nested JSON into structured relational tables (metadata, media, colors)
- SQL Storage: Loads data into MySQL/TiDB Cloud with proper schema design
- Analytics: Executes 20+ predefined analytical queries
- Visualization: Interactive Plotly dashboards for data exploration