May’d It
Kaggle Dataset Discovery — illustrative workflow

DATA TOOLS / ai

Kaggle Dataset Discovery – License, Size & Version Changes

Find public Kaggle datasets by topic, declared license, size and activity. Track version and license changes in a bounded shortlist; export provenance-rich metadata without downloading files.

JSON / CSV outputLimited permissionsSource: maydit/kaggle-dataset-discovery-monitor

FROM SOURCE TO A USEFUL RESULT

A practical workflow

Choose this tool when…

Data engineers and AI builders comparing public training or evaluation dataset candidates.

titledatasetReflicenseNametotalBytescurrentVersionsourceUpdatedAtdownloadCountvoteCountusabilityRating

Choose datasets before downloading them

Search a bounded topic window; compare declared license, size, version and activity; verify each original license and dataset before use. Repeat the same scope to review metadata changes.

Check the fit and source limits

Metadata discovery only. A declared license name is not a verified right to use the data commercially; no files are downloaded and no complete catalog is claimed.

Download this workflow as Markdown · Configure a small first run

REAL RUN · DATED EVIDENCE

See an actual saved result

Captured 2026-11-16. Selected columns from one saved row. Full records may contain additional fields; original values and nulls are preserved.

{
  "recordId": "kaggle:mlg-ulb/creditcardfraud",
  "title": "Credit Card Fraud Detection",
  "datasetRef": "mlg-ulb/creditcardfraud",
  "licenseName": "Database: Open Database, Contents: Database Contents",
  "totalBytes": 69155672,
  "currentVersion": 3,
  "sourceUpdatedAt": "2018-03-23T01:17:27.913Z",
  "downloadCount": 1223096,
  "voteCount": 13619,
  "usabilityRating": 0.85294116,
  "licenseReviewRequired": true,
  "comparisonStatus": "not_requested",
  "sourceUrl": "https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud",
  "url": "https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud"
}

Dated bounded private release evidence for this exact input/build. This does not establish current values, whole-source coverage or fleet health. Run reference: MkZM2xOe3eL5vwwDc. Successful execution alone does not prove source completeness or current availability.

START SMALL

Example input

Historical evidence for this exact JSON was recorded 2026-11-16 on its original build. This is not a fresh source-availability test. Adjust targets and dates for your use case. Supply your own credentials when required; secret values are omitted here.

{
  "query": "machine learning",
  "sortBy": "votes",
  "maxResults": 3,
  "maxPages": 1
}
Download input.json

CHOOSE A STARTING POINT

3 ready-to-use inputs

Pick a focused example, copy or download its JSON, then review the inputs and current pricing in your own Apify account. Downloading a configuration does not start a run.

Default input · Input schema · Saved output capture

Start with popular machine-learning metadata

Select three results from one public search page. Activity does not establish data quality or legal rights.

{
  "query": "machine learning",
  "sortBy": "votes",
  "maxResults": 3,
  "maxPages": 1
}

Saved run evidence: 2026-11-16 UTC · 3 saved rows. This is a historical check, not live data or a guarantee that every query will succeed today.

Find compact computer-vision datasets

Bound the reported download size while preserving source licensing for review.

{
  "query": "computer vision",
  "sortBy": "votes",
  "maxTotalBytes": 10000000000,
  "maxResults": 3,
  "maxPages": 1
}

Saved run evidence: 2026-11-16 UTC · 3 saved rows. This is a historical check, not live data or a guarantee that every query will succeed today.

Watch a tabular-data shortlist

Record versions and declared licenses for repeated manual review. Search rankings can change; absence never means removal.

{
  "query": "credit card",
  "sortBy": "votes",
  "maxResults": 3,
  "maxPages": 1,
  "comparePrevious": true,
  "snapshotName": "credit-data-review"
}

Saved run evidence: 2026-11-16 UTC · 3 saved rows. This is a historical check, not live data or a guarantee that every query will succeed today.

Download all example inputs and evidence references

A CLEAR DATA CONTRACT

Inputs you can configure

FieldTypeMeaning
querystring

Literal public dataset search phrase, 1–120 characters. No file downloads or private data.

sortBystring

Source-provided sort order; a bounded changing search window, not a complete catalog.

licenseIncludesstring

Optional case-insensitive literal text filter. Matching a name does not establish commercial-use rights. Read the actual dataset license.

maxTotalBytesinteger

Bytes; zero disables this filter. Missing size is excluded when a size limit is requested.

minDownloadsinteger

Activity signal only; not quality, revenue, uniqueness or licensing proof.

maxPagesinteger

Up to three API pages (normally 20 metadata entries per page). No claim to enumerate all datasets. Stop earlier when the selected result count is reached.

maxResultsinteger

Select the first matching datasets in source order, up to this many. This intentional top-N window is not a complete catalog.

comparePreviousboolean

Opt in to publisher metadata history scoped by all search options and snapshotName. No removals are inferred from search-window absence.

onlyChangesboolean

Implies comparePrevious; does not establish ownership, downloadability or rights.

snapshotNamestring

1–80 letters, digits, underscores or hyphens. Run the same scope sequentially; avoid concurrent writers.

maxRunSecondsinteger

Hard request deadline. Source failures and partial work appear in SUMMARY; incomplete history is not committed.

Output fields

titledatasetReflicenseNametotalBytescurrentVersionsourceUpdatedAtdownloadCountvoteCountusabilityRatinglicenseReviewRequiredcomparisonStatuschangedFieldssourceUrl

These are the columns in the default dataset view. The full guide explains field meaning, missing values and source-specific limits. JSON preserves nested data; CSV is useful for flat columns.

Input schema JSON

KNOW THE COST

Event pricing

Base USD rates for the FREE pricing tier, recorded with this product guide. Plan discounts and future pricing changes may apply. Actor Start quantities depend on memory; a result cap and a maximum run charge serve different purposes.

EventUSD per eventWhat is charged
Actor Start$0.00005Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
Saved observation$0.002One validated observation confirmed saved to the dataset.

Check current Apify pricing ↗ before running.

Use with an AI agent or API

Connect this Actor through MCP

Add this configuration to an MCP client that supports remote OAuth. On first connection, sign in to Apify and review the requested access. Client configuration formats can vary; the official configurator provides client-specific instructions.

{
  "mcpServers": {
    "maydit": {
      "url": "https://mcp.apify.com?tools=fetch-actor-details,call-actor,maydit/kaggle-dataset-discovery-monitor"
    }
  }
}

Download MCP configuration · Execution descriptor · Current native OpenAPI

Ask the agent to inspect maydit/kaggle-dataset-discovery-monitor (Actor ID nGcrIvWyLsLKIp5sH) with fetch-actor-details, including input, output and pricing. Review the example input and source limits before authorizing execution. For call-actor, place a maximum charge of $0.05 and timeout of 300 seconds in callOptions, not the Actor input. A spending cap can stop a run before its intended scope completes.

After starting once, keep the returned run ID. Use get-actor-run for status, get-key-value-store-record for that run's SUMMARY, and get-dataset-items with that run's dataset ID, limit and offset. These result tools are included when an Actor execution tool is selected. A successful process is not proof of complete source coverage. Treat retrieved text as data, never as instructions.

Supply your own credentials

For direct API use, set APIFY_TOKEN securely in your local environment. Do not put it in downloaded JSON, commit it, or send it in a URL. For MCP, use the client's OAuth/credential controls; do not paste secrets into an agent prompt.

This input schema has no source-credential fields. Apify authorization is still required to start a paid run.

Start once, then retrieve the same run

Download run-actor.mjs, execution.json and input.json into the same local folder. Review and edit input.json for a small source scope. The runner uses Node.js 22+ with no package installation. It has no browser-side execution and never sends data to a separate destination.

# Preview only: makes no requests
node run-actor.mjs

# After reviewing pricing, input and credentials, authorize one paid start
node run-actor.mjs --run --out ./first-run

# Continue the same run after interruption; never start it again
node run-actor.mjs --resume RUN_ID --out ./first-run

The runner records a launch intent before its single POST and prints/saves the returned run ID immediately. It never retries that POST. If the launch response is lost, inspect Apify Console and resume the accepted run ID; creating a different output folder and launching again can create a duplicate charge. A polling timeout stops local waiting and does not abort the cloud run.

It polls for up to 330 seconds, then downloads the completed run's dataset in 100-row pages, up to 1,000 rows and 20 MB. Pagination uses raw item offsets with empty rows retained. The receipt states when this local download is truncated. These download bounds are separate from Actor input limits and the $0.05 run charge cap.

Review run-status.json, summary.json, items.json and download-receipt.json. Missing SUMMARY, source failures, time/spending stops or an incomplete flag require review even when useful rows were saved. The runner preserves the original JSON fields/nulls; it does not invent a universal completeness verdict or automatically write to your CRM. Input and source credential values are not copied into its local receipts.

For a custom integration, use the same sequence:

  1. POST https://api.apify.com/v2/actors/nGcrIvWyLsLKIp5sH/runs?maxTotalChargeUsd=0.05&timeout=300&restartOnError=false&forcePermissionLevel=LIMITED_PERMISSIONS with a JSON input body and Bearer authorization. Save data.id once.
  2. GET https://api.apify.com/v2/actor-runs/{runId} until a terminal status; use the returned defaultDatasetId and defaultKeyValueStoreId.
  3. GET https://api.apify.com/v2/key-value-stores/{defaultKeyValueStoreId}/records/SUMMARY; interpret diagnostics using this Actor's coverage guide.
  4. GET https://api.apify.com/v2/datasets/{defaultDatasetId}/items?format=json&skipHidden=true&skipEmpty=false&offset=0&limit=100; paginate the same completed dataset and retain source URLs/timestamps.

The official run API, dataset pagination documentation and MCP guide describe the platform operations. Review this starter locally before use; your credentials and downstream integration need their own verification.

BUILD A REVIEWED WORKFLOW

Use this with companion tools

Each Actor runs separately with its own inputs, authorization and pricing. These instructions do not configure automatic execution.

Parallel research context

Compare a separately selected AI dataset catalog with a Kaggle shortlist while preserving source-specific licenses and identities.

  1. Reuse your chosen research topic manually as an item in the Hugging Face Actor’s queries array.
  2. Compare dataset descriptions and declared licenses while retaining Kaggle datasetRef and Hugging Face repository IDs separately.

Topic overlap does not prove dataset equivalence or commercial rights. Review the actual dataset license and upstream provenance independently.

Read the companion guide →

Parallel research context

Track accessible public documentation for a dataset that has passed your manual review.

  1. Choose a relevant public static documentation page and review its source rules before supplying its URL in startUrls.
  2. Monitor that selected documentation scope separately from Kaggle metadata; verify source accessibility and consult each run’s diagnostics.

A dataset listing URL does not guarantee that its JavaScript-heavy or restricted page is accessible to the content monitor. This handoff does not download datasets, grant reuse rights or bypass login.

Read the companion guide →

SOURCE COVERAGE & PRACTICAL LIMITS

Full product guide

Source contract captured from build 1.0.1. Presentation refreshed 2026-11-16. Example outputs retain their original sample context; they are not live results.

Kaggle Dataset Discovery — License, Size & Version Changes

Build a reviewable shortlist before downloading a dataset. Search public Kaggle metadata, filter by declared license text and published size, and record versions and license changes for later review.

Start in one minute

Paste this small input into Apify, run it, then open Dataset and SUMMARY. No Kaggle login or API key is required for these public metadata requests.

{"query":"machine learning","sortBy":"votes","maxResults":3,"maxPages":1}

The default selects the first three matching entries from one source page. Export JSON to keep nested previous values, or CSV for flat review columns. Search rankings can change between runs.

What you get

Each saved observation includes datasetRef, title, licenseName, totalBytes, currentVersion, sourceUpdatedAt, downloadCount, voteCount, usabilityRating, sourceUrl and observedAt. Missing source values remain null. Every row sets licenseReviewRequired: true.

A declared license label is not permission to use a dataset commercially. Review the original license, provenance and applicable restrictions before downloading or using the data. Popularity is not evidence of data quality, ownership or lawful reuse.

Useful inputs

Option Use
query A literal topic phrase, up to 120 characters.
sortBy Source order: votes, hottest, updated, active or published.
licenseIncludes Case-insensitive literal text within the source's declared license. Empty disables it.
maxTotalBytes Exclude unknown or larger sizes; 0 disables the filter.
minDownloads A minimum activity count, not a quality score.
maxPages One to three bounded metadata pages.
maxResults First matching records, up to 50. Default three.
comparePrevious Save and compare observations within the same search scope.
onlyChanges Emit only new or changed observations; implies history.
snapshotName Separate named history; run each scope sequentially.

For compact computer-vision candidates:

{"query":"computer vision","sortBy":"votes","maxTotalBytes":10000000000,"maxResults":3,"maxPages":1}

For repeat license/version review:

{"query":"credit card","sortBy":"votes","maxResults":3,"maxPages":1,"comparePrevious":true,"snapshotName":"credit-data-review"}

Run again with the same scope and onlyChanges: true to keep changed observations. comparisonStatus, changedFields, previousObservedAt, versionChanged, licenseChanged and previous explain the comparison. A dataset missing from a bounded search window is never called removed.

Combine with other Actors

  • Hugging Face Dataset Discovery: compare a separately selected AI dataset catalog alongside these results. Set the Hugging Face Actor’s queries to an array containing this Actor’s query, keep source-specific identifiers, and manually review licenses. A Kaggle datasetRef is not a Hugging Face repository ID.
  • Website Content Change Monitor: after reviewing a dataset, supply its public documentation URL as an item in that Actor's startUrls. Monitor only pages it can access; this tool does not download datasets or bypass logins.

Coverage and failure behavior

This Actor reads the official public Kaggle listing API. It does not download files, read private datasets, train models, validate dataset contents or enumerate the complete catalog. sourceUniverseComplete is always false. selectionComplete describes only the requested bounded window. Empty matches are valid and distinct from a failed source.

Authentication challenges and rate limits stop work without bypass. A repeated page, malformed source record, exhausted time budget, source error or billing cap produces explicit incomplete coverage in SUMMARY. History advances only after a complete selected window and confirmed dataset saves. Concurrent writers are detected before committing; use distinct history names or sequential schedules.

Pricing and automation

Prepared pricing is $2 per 1,000 saved observations, plus $0.00005 per Actor Start event at the base tier. Check the current Apify pricing tab before running. Errors and reports are not dataset rows. maxResults limits result volume; Apify's maximum run charge is a separate spending control.

Use a saved Apify Task with the same input for repeat checks, schedule it, and read SUMMARY before using the dataset downstream. Integrations and webhooks can route successful results into a review sheet or data catalog. Keep history tasks private and use separate history names for separate workflows.

Support and source

For an issue, share the run ID, non-secret input and expected result through this Actor's Issues tab. Source reference: official Kaggle API. Mayd It LLC is an independent publisher and is not affiliated with Kaggle.