数据与研究

harvard-art-museums-data-engineering-pipeline

Name: harvard-art-museums-data-engineering-pipeline
Author: reason-machines

reason-machines/data-skills

Build end-to-end data engineering pipelines with Harvard Art Museums API, ETL, SQL analytics, and Streamlit dashboards

安装命令

$ npx skills add https://github.com/reason-machines/data-skills --skill harvard-art-museums-data-engineering-pipeline

SKILL.md

Skill by ara.so — Data Skills collection.

The Harvard-Artifacts-Collection-Data-Engineering-Analytics-App is a complete data engineering solution that demonstrates:

API Integration: Fetching artifact data from Harvard Art Museums API with pagination and rate limiting
ETL Pipeline: Extracting, transforming, and loading nested JSON into normalized SQL tables
Database Design: Multi-table relational schema with proper foreign keys
SQL Analytics: 20+ predefined analytical queries for insights
Interactive Visualization: Streamlit dashboards with Plotly charts

This project serves as a reference architecture for building production-grade data pipelines.

Skill by ara.so — Data Skills collection.

The Harvard-Artifacts-Collection-Data-Engineering-Analytics-App is a complete data engineering solution that demonstrates:

API Integration: Fetching artifact data from Harvard Art Museums API with pagination and rate limiting
ETL Pipeline: Extracting, transforming, and loading nested JSON into normalized SQL tables
Database Design: Multi-table relational schema with proper foreign keys
SQL Analytics: 20+ predefined analytical queries for insights
Interactive Visualization: Streamlit dashboards with Plotly charts

This project serves as a reference architecture for building production-grade data pipelines.