SKILL.md
Harvard Art Museums Data Engineering App
Skill by ara.so — Data Skills collection.
This project provides an end-to-end data engineering and analytics application built on the Harvard Art Museums API. It demonstrates real-world ETL pipelines, SQL database design, analytical queries, and interactive visualization using Streamlit.
What This Project Does
The application follows a complete data pipeline: API → ETL → SQL → Analytics → Visualization
- Collects artifact data from Harvard Art Museums API with pagination and rate limiting
- Transforms nested JSON into normalized relational tables
- Loads data into MySQL/TiDB Cloud databases
- Analyzes with 20+ predefined SQL queries
- Visualizes results through interactive Plotly dashboards in Streamlit
Installation
Harvard Art Museums Data Engineering App
Skill by ara.so — Data Skills collection.
This project provides an end-to-end data engineering and analytics application built on the Harvard Art Museums API. It demonstrates real-world ETL pipelines, SQL database design, analytical queries, and interactive visualization using Streamlit.
What This Project Does
The application follows a complete data pipeline: API → ETL → SQL → Analytics → Visualization
- Collects artifact data from Harvard Art Museums API with pagination and rate limiting
- Transforms nested JSON into normalized relational tables
- Loads data into MySQL/TiDB Cloud databases
- Analyzes with 20+ predefined SQL queries
- Visualizes results through interactive Plotly dashboards in Streamlit