Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

data-cleaning-annotation-workflow

bởi deyashmukh

DevOps & Cloud
454Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Complete workflow for time series datasets (Energy, Manufacturing, Climate) on Kaggle to Data Annotation platform.

Mô tả

Kỹ năng này làm gì

Covers the end-to-end pipeline for preparing time series datasets from Kaggle and uploading them to the Data Annotation platform at data.smlcrm.com. Handles CSV cleaning with pandas, metadata configuration, column type and unit assignment, and group tagging until the dataset reaches CLEAN status.

Combines dataset discovery, cleaning, and platform-specific annotation configuration into one repeatable workflow instead of handling each step ad hoc.

Khi nào nên dùng

  • Preparing Kaggle energy datasets for ML annotation
  • Configuring time/target/covariate columns in data.smlcrm.com
  • Assigning group tags across all variables in a dataset
  • Cleaning raw industrial CSVs before model training
  • Uploading manufacturing or climate data with full metadata

Quy trình ví dụ

ĐẦU VÀO

User asks: Prepare the steel industry energy consumption dataset from Kaggle for annotation

AGENT
  1. 1

    Downloads CSV from kaggle.com/datasets/csafrit2/steel-industry-energy-consumption

  2. 2

    Runs scripts/clean_dataset.py to strip whitespace, remove duplicates, fill missing values, and parse timestamps

  3. 3

    Uploads the raw CSV to data.smlcrm.com with name, domain, source URL, and description

  4. 4

    Configures each column with its type (Time, Target, Covariate, Group) and units (kWh, kVarh, tCO2, ratio, seconds)

  5. 5

    Selects all target and covariate variables, applies all group tags (WeekStatus, Day_of_week, Load_Type), then uploads the cleaned file

ĐẦU RA

Dataset status changes from RAW to CLEAN with all columns typed, units set, and group assignments complete

Yêu cầu

  • Kaggle account (for dataset downloads via CLI or browser)
  • Kaggle API key and kaggle.json configured (if using CLI download)
  • Account on data.smlcrm.com

Cài đặt

clawhub install deyashmukh/data-cleaning-annotation-workflow

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết