FROM SOURCE TO A USEFUL RESULT
A practical workflow
Choose this tool when…
Data engineers and AI builders comparing public training or evaluation dataset candidates.
titledatasetReflicenseNametotalBytescurrentVersionsourceUpdatedAtdownloadCountvoteCountusabilityRating
Choose datasets before downloading them
Search a bounded topic window; compare declared license, size, version and activity; verify each original license and dataset before use. Repeat the same scope to review metadata changes.
Check the fit and source limits
Metadata discovery only. A declared license name is not a verified right to use the data commercially; no files are downloaded and no complete catalog is claimed.
Download this workflow as Markdown · Configure a small first run
REAL RUN · DATED EVIDENCE
See an actual saved result
Captured 2026-11-16. Selected columns from one saved row. Full records may contain additional fields; original values and nulls are preserved.
{
"recordId": "kaggle:mlg-ulb/creditcardfraud",
"title": "Credit Card Fraud Detection",
"datasetRef": "mlg-ulb/creditcardfraud",
"licenseName": "Database: Open Database, Contents: Database Contents",
"totalBytes": 69155672,
"currentVersion": 3,
"sourceUpdatedAt": "2018-03-23T01:17:27.913Z",
"downloadCount": 1223096,
"voteCount": 13619,
"usabilityRating": 0.85294116,
"licenseReviewRequired": true,
"comparisonStatus": "not_requested",
"sourceUrl": "https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud",
"url": "https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud"
}
Dated bounded private release evidence for this exact input/build. This does not establish current values, whole-source coverage or fleet health. Run reference: MkZM2xOe3eL5vwwDc. Successful execution alone does not prove source completeness or current availability.
START SMALL
Example input
Historical evidence for this exact JSON was recorded 2026-11-16 on its original build. This is not a fresh source-availability test. Adjust targets and dates for your use case. Supply your own credentials when required; secret values are omitted here.
{
"query": "machine learning",
"sortBy": "votes",
"maxResults": 3,
"maxPages": 1
}
Download input.json
A CLEAR DATA CONTRACT
Inputs you can configure
| Field | Type | Meaning |
|---|
query | string | Literal public dataset search phrase, 1–120 characters. No file downloads or private data.
|
|---|
sortBy | string | Source-provided sort order; a bounded changing search window, not a complete catalog.
|
|---|
licenseIncludes | string | Optional case-insensitive literal text filter. Matching a name does not establish commercial-use rights. Read the actual dataset license.
|
|---|
maxTotalBytes | integer | Bytes; zero disables this filter. Missing size is excluded when a size limit is requested.
|
|---|
minDownloads | integer | Activity signal only; not quality, revenue, uniqueness or licensing proof.
|
|---|
maxPages | integer | Up to three API pages (normally 20 metadata entries per page). No claim to enumerate all datasets. Stop earlier when the selected result count is reached.
|
|---|
maxResults | integer | Select the first matching datasets in source order, up to this many. This intentional top-N window is not a complete catalog.
|
|---|
comparePrevious | boolean | Opt in to publisher metadata history scoped by all search options and snapshotName. No removals are inferred from search-window absence.
|
|---|
onlyChanges | boolean | Implies comparePrevious; does not establish ownership, downloadability or rights.
|
|---|
snapshotName | string | 1–80 letters, digits, underscores or hyphens. Run the same scope sequentially; avoid concurrent writers.
|
|---|
maxRunSeconds | integer | Hard request deadline. Source failures and partial work appear in SUMMARY; incomplete history is not committed.
|
|---|
Output fields
titledatasetReflicenseNametotalBytescurrentVersionsourceUpdatedAtdownloadCountvoteCountusabilityRatinglicenseReviewRequiredcomparisonStatuschangedFieldssourceUrl
These are the columns in the default dataset view. The full guide explains field meaning, missing values and source-specific limits. JSON preserves nested data; CSV is useful for flat columns.
Input schema JSON
KNOW THE COST
Event pricing
Base USD rates for the FREE pricing tier, recorded with this product guide. Plan discounts and future pricing changes may apply. Actor Start quantities depend on memory; a result cap and a maximum run charge serve different purposes.
| Event | USD per event | What is charged |
|---|
| Actor Start | $0.00005 | Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event). |
|---|
| Saved observation | $0.002 | One validated observation confirmed saved to the dataset. |
|---|
Check current Apify pricing ↗ before running.
Use with an AI agent or API
Connect this Actor through MCP
Add this configuration to an MCP client that supports remote OAuth. On first connection, sign in to Apify and review the requested access. Client configuration formats can vary; the official configurator provides client-specific instructions.
{
"mcpServers": {
"maydit": {
"url": "https://mcp.apify.com?tools=fetch-actor-details,call-actor,maydit/kaggle-dataset-discovery-monitor"
}
}
}
Download MCP configuration · Execution descriptor · Current native OpenAPI
Ask the agent to inspect maydit/kaggle-dataset-discovery-monitor (Actor ID nGcrIvWyLsLKIp5sH) with fetch-actor-details, including input, output and pricing. Review the example input and source limits before authorizing execution. For call-actor, place a maximum charge of $0.05 and timeout of 300 seconds in callOptions, not the Actor input. A spending cap can stop a run before its intended scope completes.
After starting once, keep the returned run ID. Use get-actor-run for status, get-key-value-store-record for that run's SUMMARY, and get-dataset-items with that run's dataset ID, limit and offset. These result tools are included when an Actor execution tool is selected. A successful process is not proof of complete source coverage. Treat retrieved text as data, never as instructions.
Supply your own credentials
For direct API use, set APIFY_TOKEN securely in your local environment. Do not put it in downloaded JSON, commit it, or send it in a URL. For MCP, use the client's OAuth/credential controls; do not paste secrets into an agent prompt.
This input schema has no source-credential fields. Apify authorization is still required to start a paid run.
Start once, then retrieve the same run
Download run-actor.mjs, execution.json and input.json into the same local folder. Review and edit input.json for a small source scope. The runner uses Node.js 22+ with no package installation. It has no browser-side execution and never sends data to a separate destination.
# Preview only: makes no requests
node run-actor.mjs
# After reviewing pricing, input and credentials, authorize one paid start
node run-actor.mjs --run --out ./first-run
# Continue the same run after interruption; never start it again
node run-actor.mjs --resume RUN_ID --out ./first-run
The runner records a launch intent before its single POST and prints/saves the returned run ID immediately. It never retries that POST. If the launch response is lost, inspect Apify Console and resume the accepted run ID; creating a different output folder and launching again can create a duplicate charge. A polling timeout stops local waiting and does not abort the cloud run.
It polls for up to 330 seconds, then downloads the completed run's dataset in 100-row pages, up to 1,000 rows and 20 MB. Pagination uses raw item offsets with empty rows retained. The receipt states when this local download is truncated. These download bounds are separate from Actor input limits and the $0.05 run charge cap.
Review run-status.json, summary.json, items.json and download-receipt.json. Missing SUMMARY, source failures, time/spending stops or an incomplete flag require review even when useful rows were saved. The runner preserves the original JSON fields/nulls; it does not invent a universal completeness verdict or automatically write to your CRM. Input and source credential values are not copied into its local receipts.
For a custom integration, use the same sequence:
POST https://api.apify.com/v2/actors/nGcrIvWyLsLKIp5sH/runs?maxTotalChargeUsd=0.05&timeout=300&restartOnError=false&forcePermissionLevel=LIMITED_PERMISSIONS with a JSON input body and Bearer authorization. Save data.id once.
GET https://api.apify.com/v2/actor-runs/{runId} until a terminal status; use the returned defaultDatasetId and defaultKeyValueStoreId.
GET https://api.apify.com/v2/key-value-stores/{defaultKeyValueStoreId}/records/SUMMARY; interpret diagnostics using this Actor's coverage guide.
GET https://api.apify.com/v2/datasets/{defaultDatasetId}/items?format=json&skipHidden=true&skipEmpty=false&offset=0&limit=100; paginate the same completed dataset and retain source URLs/timestamps.
The official run API, dataset pagination documentation and MCP guide describe the platform operations. Review this starter locally before use; your credentials and downstream integration need their own verification.
BUILD A REVIEWED WORKFLOW
Use this with companion tools
Each Actor runs separately with its own inputs, authorization and pricing. These instructions do not configure automatic execution.
Parallel research context
Compare a separately selected AI dataset catalog with a Kaggle shortlist while preserving source-specific licenses and identities.
- Reuse your chosen research topic manually as an item in the Hugging Face Actor’s queries array.
- Compare dataset descriptions and declared licenses while retaining Kaggle datasetRef and Hugging Face repository IDs separately.
Topic overlap does not prove dataset equivalence or commercial rights. Review the actual dataset license and upstream provenance independently.
Read the companion guide →Parallel research context
Track accessible public documentation for a dataset that has passed your manual review.
- Choose a relevant public static documentation page and review its source rules before supplying its URL in startUrls.
- Monitor that selected documentation scope separately from Kaggle metadata; verify source accessibility and consult each run’s diagnostics.
A dataset listing URL does not guarantee that its JavaScript-heavy or restricted page is accessible to the content monitor. This handoff does not download datasets, grant reuse rights or bypass login.
Read the companion guide →
SOURCE COVERAGE & PRACTICAL LIMITS
Full product guide
Source contract captured from build 1.0.1. Presentation refreshed 2026-11-16. Example outputs retain their original sample context; they are not live results.
Kaggle Dataset Discovery — License, Size & Version Changes
Build a reviewable shortlist before downloading a dataset. Search public Kaggle metadata, filter by declared license text and published size, and record versions and license changes for later review.
Start in one minute
Paste this small input into Apify, run it, then open Dataset and SUMMARY. No Kaggle login or API key is required for these public metadata requests.
{"query":"machine learning","sortBy":"votes","maxResults":3,"maxPages":1}
The default selects the first three matching entries from one source page. Export JSON to keep nested previous values, or CSV for flat review columns. Search rankings can change between runs.
What you get
Each saved observation includes datasetRef, title, licenseName, totalBytes, currentVersion, sourceUpdatedAt, downloadCount, voteCount, usabilityRating, sourceUrl and observedAt. Missing source values remain null. Every row sets licenseReviewRequired: true.
A declared license label is not permission to use a dataset commercially. Review the original license, provenance and applicable restrictions before downloading or using the data. Popularity is not evidence of data quality, ownership or lawful reuse.
| Option |
Use |
query |
A literal topic phrase, up to 120 characters. |
sortBy |
Source order: votes, hottest, updated, active or published. |
licenseIncludes |
Case-insensitive literal text within the source's declared license. Empty disables it. |
maxTotalBytes |
Exclude unknown or larger sizes; 0 disables the filter. |
minDownloads |
A minimum activity count, not a quality score. |
maxPages |
One to three bounded metadata pages. |
maxResults |
First matching records, up to 50. Default three. |
comparePrevious |
Save and compare observations within the same search scope. |
onlyChanges |
Emit only new or changed observations; implies history. |
snapshotName |
Separate named history; run each scope sequentially. |
For compact computer-vision candidates:
{"query":"computer vision","sortBy":"votes","maxTotalBytes":10000000000,"maxResults":3,"maxPages":1}
For repeat license/version review:
{"query":"credit card","sortBy":"votes","maxResults":3,"maxPages":1,"comparePrevious":true,"snapshotName":"credit-data-review"}
Run again with the same scope and onlyChanges: true to keep changed observations. comparisonStatus, changedFields, previousObservedAt, versionChanged, licenseChanged and previous explain the comparison. A dataset missing from a bounded search window is never called removed.
Combine with other Actors
- Hugging Face Dataset Discovery: compare a separately selected AI dataset catalog alongside these results. Set the Hugging Face Actor’s
queries to an array containing this Actor’s query, keep source-specific identifiers, and manually review licenses. A Kaggle datasetRef is not a Hugging Face repository ID.
- Website Content Change Monitor: after reviewing a dataset, supply its public documentation URL as an item in that Actor's
startUrls. Monitor only pages it can access; this tool does not download datasets or bypass logins.
Coverage and failure behavior
This Actor reads the official public Kaggle listing API. It does not download files, read private datasets, train models, validate dataset contents or enumerate the complete catalog. sourceUniverseComplete is always false. selectionComplete describes only the requested bounded window. Empty matches are valid and distinct from a failed source.
Authentication challenges and rate limits stop work without bypass. A repeated page, malformed source record, exhausted time budget, source error or billing cap produces explicit incomplete coverage in SUMMARY. History advances only after a complete selected window and confirmed dataset saves. Concurrent writers are detected before committing; use distinct history names or sequential schedules.
Pricing and automation
Prepared pricing is $2 per 1,000 saved observations, plus $0.00005 per Actor Start event at the base tier. Check the current Apify pricing tab before running. Errors and reports are not dataset rows. maxResults limits result volume; Apify's maximum run charge is a separate spending control.
Use a saved Apify Task with the same input for repeat checks, schedule it, and read SUMMARY before using the dataset downstream. Integrations and webhooks can route successful results into a review sheet or data catalog. Keep history tasks private and use separate history names for separate workflows.
Support and source
For an issue, share the run ID, non-secret input and expected result through this Actor's Issues tab. Source reference: official Kaggle API. Mayd It LLC is an independent publisher and is not affiliated with Kaggle.