Assessing skills through real work
I created Skill Studio at Superset: a platform for assessing skills through real tasks, conversations, and simulations. It brings the assessment tools I built into one place, so candidates can demonstrate how they approach a problem and work through it.
My role
I owned Skill Studio across product research, design, and development as Superset’s fractional Head of AI Products. My work covered both the individual assessment experiences and the studio that brings them together.
What I built
- Agent Builder — design a GenAI workflow by connecting nodes and configuring each step to solve a business problem.
- Idea to Agent — turn an idea into an agent concept through AI-led questions, a structured summary, and an evaluation.
- SQL Murder Mystery — solve a mystery by querying data, investigating clues, and following an evidence trail.
- Roleplay Training — practise customer conversations with AI characters, including frustrated, angry, or confused customers.
- SQL Workbench — inspect a database schema, write queries, and run them against a real dataset.
- Case Interview — work through a consulting-style case with an AI facilitator, a briefing, and information revealed as the case progresses.
- Dev Ticket Simulation — fix a bug in a multi-file repository with a constrained AI assistant as part of the assessment.
- Coding Challenge — write and run Java or Python in a browser-based coding environment.
Simulations and skill challenges
The catalog spans business case interviews, mechanical design, developer tickets, production support, inbox triage, and customer roleplay. Hands-on challenges cover SQL, coding, spreadsheets, quantitative reasoning, and AI workflow design.
Tools around the assessment
Recruiter and sales tools support candidate access, interview demos, demo tracking, and reviewing submissions. The studio also groups internal builder tools and custom assessments alongside the candidate-facing experiences.
The screenshots show a mix of live and beta tools.
Related work: AVA
AVA is the voice interview product I built at Superset. Its project page shows the conversational interview, assessment, and coding experience.
Explore AVA →