Create custom problem

POST

issues

custom

curl --request POST \
  --url https://api.promptster.ai/v1/issues/custom \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data @- <<EOF
{
  "title": "Rate limiter lets bursts through after a restart",
  "taskBrief": "After a deploy, the token bucket starts full for every client, so the first minute lets 10x the allowed traffic through. Make the bucket state survive a restart. The hidden tests exercise limiter.py directly.",
  "repoUrl": "https://github.com/your-org/rate-limiter",
  "commitSha": "3f1c2a9",
  "isPrivate": false,
  "language": "python",
  "difficulty": "standard",
  "skillTags": [
    "rate-limiting",
    "persistence"
  ],
  "estimatedMinutes": 60,
  "testSuiteConfig": {
    "setupCommand": "python3 -m venv .venv && .venv/bin/pip install -q -r requirements.txt pytest",
    "testCommand": ".venv/bin/python -m pytest -q tests/test_hidden_limiter.py",
    "testFramework": "pytest",
    "timeoutSeconds": 300,
    "testFiles": [
      {
        "fileName": "test_hidden_limiter.py",
        "destination": "tests/test_hidden_limiter.py",
        "content": "from limiter import Limiter\n\ndef test_state_survives_restart(tmp_path):\n    a = Limiter(rate=1, burst=1, state_dir=tmp_path)\n    assert a.allow('c')\n    b = Limiter(rate=1, burst=1, state_dir=tmp_path)\n    assert not b.allow('c')\n"
      }
    ]
  }
}
EOF

{
  "issue": {
    "id": "<string>",
    "issueTitle": "<string>",
    "repoUrl": "<string>",
    "brokenSha": "<string>",
    "taskBrief": "<string>",
    "language": "<string>",
    "difficulty": "<string>",
    "isCustom": true,
    "isPrivate": true,
    "isTicketFlow": true,
    "status": "<string>",
    "prepStatus": "pending",
    "prepError": "<string>",
    "testSuiteVerified": true,
    "issueUrl": "<string>"
  }
}

{
  "error": "Invalid body",
  "details": [
    {
      "path": [
        "testSuiteConfig",
        "setupCommand"
      ],
      "message": "Setup must not run tests."
    }
  ]
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "brief_restates_requirement",
  "personaId": "dana",
  "message": "The brief repeats wording from the hidden spec. Briefs set tone, not facts."
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

Authorizations

Authorization

string

header

required

Organization API key from Settings → API. Send Authorization: Bearer psk_live_… .

Body

application/json

Option 1
Option 2

POST creates; PUT fully replaces. language is trimmed and lowercased before validation. A successful save starts preparation; inspect issue.prepStatus, including on the initial response.

repoUrl

string<uri>

required

GitHub repository URL: https://github.com/owner/repo

language

enum<string>

required

Available options:

typescript,

javascript,

python,

go,

rust,

java,

ruby,

csharp

difficulty

enum<string>

required

Available options:

warmup,

standard,

deep

testSuiteConfig

object

required

Show child attributes

ticketFlow

object

required

Persona and requirement IDs must each be unique. Owners and unavailability personaId must refer to a persona. fromSec must precede toSec. With ticketFlow, the ticket replaces title and taskBrief.

Show child attributes

title

string

Required string length: 1 - 200

taskBrief

string

Required string length: 1 - 8000

brief

object

Show child attributes

commitSha

string

Omit to pin the current default-branch head.

Pattern: ^[0-9a-fA-F]{7,40}$

isPrivate

boolean

default:false

Uses the organization GitHub token from Settings → GitHub access. Candidates receive a snapshot without credentials or history.

skillTags

string[]

Maximum array length: 20

Minimum string length: 1

problemType

enum<string>

default:bug_fix

Available options:

bug_fix,

feature,

performance

estimatedMinutes

integer

Required range: 1 <= x <= 600

Response

Success

issue

object

required

Show child attributes

curl --request POST \
  --url https://api.promptster.ai/v1/issues/custom \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data @- <<EOF
{
  "title": "Rate limiter lets bursts through after a restart",
  "taskBrief": "After a deploy, the token bucket starts full for every client, so the first minute lets 10x the allowed traffic through. Make the bucket state survive a restart. The hidden tests exercise limiter.py directly.",
  "repoUrl": "https://github.com/your-org/rate-limiter",
  "commitSha": "3f1c2a9",
  "isPrivate": false,
  "language": "python",
  "difficulty": "standard",
  "skillTags": [
    "rate-limiting",
    "persistence"
  ],
  "estimatedMinutes": 60,
  "testSuiteConfig": {
    "setupCommand": "python3 -m venv .venv && .venv/bin/pip install -q -r requirements.txt pytest",
    "testCommand": ".venv/bin/python -m pytest -q tests/test_hidden_limiter.py",
    "testFramework": "pytest",
    "timeoutSeconds": 300,
    "testFiles": [
      {
        "fileName": "test_hidden_limiter.py",
        "destination": "tests/test_hidden_limiter.py",
        "content": "from limiter import Limiter\n\ndef test_state_survives_restart(tmp_path):\n    a = Limiter(rate=1, burst=1, state_dir=tmp_path)\n    assert a.allow('c')\n    b = Limiter(rate=1, burst=1, state_dir=tmp_path)\n    assert not b.allow('c')\n"
      }
    ]
  }
}
EOF

{
  "issue": {
    "id": "<string>",
    "issueTitle": "<string>",
    "repoUrl": "<string>",
    "brokenSha": "<string>",
    "taskBrief": "<string>",
    "language": "<string>",
    "difficulty": "<string>",
    "isCustom": true,
    "isPrivate": true,
    "isTicketFlow": true,
    "status": "<string>",
    "prepStatus": "pending",
    "prepError": "<string>",
    "testSuiteVerified": true,
    "issueUrl": "<string>"
  }
}

{
  "error": "Invalid body",
  "details": [
    {
      "path": [
        "testSuiteConfig",
        "setupCommand"
      ],
      "message": "Setup must not run tests."
    }
  ]
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "brief_restates_requirement",
  "personaId": "dana",
  "message": "The brief repeats wording from the hidden spec. Briefs set tone, not facts."
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

{
  "error": "<string>",
  "code": "<string>",
  "message": "<string>",
  "details": [
    "<unknown>"
  ],
  "personaId": "<string>"
}

Get Started

Understanding Sessions

Guides

API Reference

Custom problems

Assessments

Keys

Sessions

Candidates

Analytics

Problem Library

Hooks

Branding

Webhooks

Resources

Create custom problem

Authorizations

Body

Response