Business Analyst Assessment: A Real-Work Exercise for Hiring
Two stakeholders want opposite things, a key detail is missing and the specification is due on Friday. This is a fictional illustration of the exercise Calavion would build with you.
Try CalavionWhat is a business analyst assessment?
A business analyst assessment is a way to check whether an applicant can do business analysis work before you hire them. Common formats are business analysis knowledge tests, situational judgement tests, requirements-writing exercises, case studies, role-play and interviews.
Calavion takes a practical approach. Working with a company, Calavion would turn a requirements situation your team has already handled, such as conflicting requirements and missing stakeholder information, into a controlled exercise. The applicant would read the stakeholder notes, the draft specification and the messages, then decide what to clarify, what to flag and what to write down. You would then review a Replay: a record of what was available, what they did and wrote, what changed and what stayed open.
You will also see the same idea called a business analyst skills test, a business analyst pre-employment assessment, a systems analyst assessment, a business analysis job simulation, a work sample assessment for business analysts or a business analyst case study. These terms are often used interchangeably, but they measure different things: some check knowledge, some check what applicants say they would do, and some let applicants do practical work.
What sets Calavion’s approach apart is the case. It would be your own handled requirements situation, you would approve the exact version, and you would read a Replay of what the applicant did and wrote.
Can you use Calavion for business analyst assessments today? At a glance
- Best suited to
- Business analysis done in writing: stakeholder notes, draft requirements, clarifying questions and handovers to a delivery team.
- What applicants would do
- Read stakeholder notes and a draft specification, spot conflicts and gaps, decide what to ask or escalate, and write the questions and the updated requirement.
- What employers would review
- A Replay of what was available, what the applicant did and wrote, what changed and what stayed open.
- What it does not do
- Connect to real tools, assess workshops, interviews or process mapping by voice, test modelling or SQL skills, score or rank applicants, or claim to predict job performance.
- Status
- Not built yet. No business analysis exercise has been built or run. Calavion builds each case with the company.
What would a real-work business analyst assessment look like? Example: conflicting requirements and a missing detail
It is Wednesday. Sales wants a customer discount field editable by any user, finance wants it locked to managers, the draft specification does not say who approves exceptions, and the delivery team needs the final requirement by Friday. The applicant decides what to ask, whom to ask and what to write.
The applicant would
- Read the stakeholder notes, the draft specification and the delivery team message
- Name the conflict and the missing detail in plain words
- Write a short question to each stakeholder that can be answered in one reply
- Draft the requirement with the open point marked, rather than guessing
- Tell the delivery team what is firm, what is open and when it will be settled
Each choice leaves the project in a different state: a guess written as a requirement, a stakeholder never asked, a delivery team building against something that will change. The employer would read the decisions, messages and action sequence in Replay.
This is an illustrative example. The company, the stakeholders and every record are invented.
Why should companies assess business analysts before hiring?
Business analysis is judged one decision at a time: what an analyst asks, flags and writes down. A resume lists tools and past projects, and an interview describes past behaviour. Neither directly shows how an applicant handles two stakeholders who disagree, a missing detail and a deadline. An assessment gives the company something observable to review before making an offer.
How would Calavion assess business analysis skills?
Calavion is a real-work hiring platform. For business analysis, Calavion would prepare a controlled exercise from a requirements situation your team has handled. Applicants would read records and write messages inside it, and you would read a Replay of what they did. You make the hiring decision.
- Bring one case. Choose a requirements situation your team has already handled.
- Calavion prepares it with you, by hand. Calavion reviews the material and replaces identifying details.
- You approve the exact version before any applicant sees it.
- Applicants work the case. They use an invite link, with no account, and work through records and written threads.
- You read Replay and decide. Replay shows what was available, what the applicant did and wrote, what changed and what stayed open.
What types of business analyst assessment are there?
Employers combine several methods. This table shows what each one checks and where it stops.
| Type | What it checks | Strength | Limit |
|---|---|---|---|
| Knowledge test | Business analysis terms, methods and common tools | Quick to give and compare | Shows knowledge, not behaviour |
| Situational judgment test | Chosen answers to business analysis scenarios | Standard scenarios are easy to compare | Shows what applicants say they would do |
| Knowledge or certification-style test | Business analysis terms and techniques | Quick and easy to compare | Shows knowledge, not behaviour |
| Requirements-writing exercise | Turning a brief into written requirements | Shows clarity and structure | Often generic, not your stakeholders or your systems |
| Case study | Analysing a described business problem | Shows reasoning | Does not show how the applicant handles live gaps and conflicts |
| Role-play | A rater plays a stakeholder in an elicitation interview | Shows questioning and listening | Hard to repeat the same way for every applicant |
| Work sample | A task taken from the job | Job relevance depends on how well the task represents the role | Takes time to design |
| Structured interview | The same questions for every applicant | Consistent and easy to run | Asks about past or hypothetical situations; does not show work being done |
| Calavion real-work exercise | Your own handled requirements situation in a controlled environment | Observable actions, messages and consequences | Not built yet for business analysis; written cases only; no automatic scores |
For the full method comparison, read work samples, job simulations, take-homes and real-work hiring.
Which business analyst assessment should you use?
These are common pairings, not rules. Most teams use more than one method, and the right choice depends on the role.
| Hiring need | Commonly suitable method | What it can show | What it cannot establish |
|---|---|---|---|
| Spotting gaps and conflicts | A job simulation built on a real requirements case | Judgment, questions and wording | Performance beyond the cases you chose |
| Writing requirements | A writing sample with the same brief for every applicant | Clarity and structure | How the applicant handled the gaps |
| Stakeholder interviews and workshops | A role-play with a rater | Questioning and listening by voice | Written organisation |
| Modelling and data skills | A task in a demo file or tool | Tool skill and accuracy | Judgment about conflicts |
| High-volume hiring | A short knowledge test as a first filter, then a practical exercise for a shortlist | Basic knowledge at scale | What the applicant does with a real requirements situation |
| Any business analysis role | A structured interview with the same questions for every applicant | Experience and how applicants explain their decisions | Work being done now |
How is a real-work business analyst assessment different from a business analyst skills test?
A business analyst skills test, the kind sold in many assessment libraries, usually asks multiple-choice or scenario questions and scores them against an answer key. It is quick to give and easy to compare, and it shows what an applicant knows or says they would choose. A real-work business analyst assessment, also called a business analyst job simulation or work sample assessment, shows what the applicant does with a case from the job. Many teams use both: a short test early, and a practical exercise for the shortlist. Calavion offers only the second. See what a job simulation is and work sample or skills assessment test.
Which skills should a business analyst assessment cover?
A useful assessment looks at the skills the job actually uses. Each skill below shows what it looks like in real work and what an employer would see in a Replay. Replay does not rate any trait. It shows the wording and the sequence of actions, and the employer interprets them.
| Skill | What it looks like in real work | What the employer would see in Replay |
|---|---|---|
| Reading the notes | Using stakeholder notes and the draft before acting | The records opened, and what the applicant referred to in the questions |
| Spotting conflicts and gaps | Seeing what disagrees and what is missing | Whether the applicant named the conflict and the missing detail |
| Asking good questions | Writing questions that can be answered in one reply | The questions the applicant wrote, word for word |
| Writing clear requirements | Stating what is needed without ambiguity | The requirement as drafted, with open points marked or not |
| Not guessing | Marking open points rather than filling them in | Whether any assumption was written as fact |
| Stakeholder communication | Writing to people with competing interests | The messages the applicant wrote, word for word |
| Escalation judgment | Knowing when a conflict goes to a sponsor | Whether and when the applicant escalated, and what they said |
| Handover and notes | Leaving a clear note on what is firm and open | Outstanding items and the final state of the requirement |
Which business analysis tasks can an assessment cover?
Business analysis happens in documents, spreadsheets, diagrams, email, workshops and interviews. Written tasks with notes and a draft can be assessed from the text alone. Workshops, interviews and modelling need other methods.
| Task | How it is usually assessed | Calavion today |
|---|---|---|
| Workshops and stakeholder interviews | Live role-play with a rater | Not covered. Calavion does not record voice or video |
| Process modelling, SQL and data analysis | A task in a demo file or tool | Not covered. Calavion does not run live tools |
| Reading notes and spotting conflicts | Work sample or simulation | Same written shape, but not built yet. Built with the company |
| Clarifying questions and requirement drafts | Writing sample or simulation | Same written shape, but not built yet. Built with the company |
| Handover notes to delivery teams | Work sample | Same written shape, but not built yet. Built with the company |
How do you assess workshops, interviews and modelling?
Calavion does not cover these, so you would use another method. These are common ways to assess them alongside a written exercise.
| Skill area | What a good test contains | Common method |
|---|---|---|
| Elicitation interview | A scripted stakeholder with hidden needs the applicant must draw out | Role-play with a rater and a short rating guide |
| Process modelling | The same process description for every applicant | A modelling task in a demo tool |
| Data skill | The same dataset and question for every applicant | A data or SQL task |
| Written requirements | A short brief turned into requirements | A writing sample |
What a rater listens for in a stakeholder interview
| What to listen for | Evidence that supports it | Evidence that raises a question |
|---|---|---|
| Open questions | Asks what the stakeholder is trying to achieve | Asks only yes or no questions |
| Listening | Checks back what was said before moving on | Interrupts or assumes |
| Probing | Follows up on a vague answer | Accepts a vague answer |
| Composure | Stays neutral when a stakeholder pushes a solution | Takes a side or gives way |
| Closing | Summarises what was agreed and what is still open | Ends without a summary |
Which business analysis roles can you assess this way?
Every role below needs its own case, which Calavion prepares with the company.
| Role | What the work involves | What to assess | Fit with Calavion |
|---|---|---|---|
| Business analyst | Turning business needs into clear requirements | Questions, writing and handling conflicts | Built with you |
| Systems analyst | Specifying how systems should support a process | Requirements and clear questions | Built with you |
| Requirements analyst | Writing and maintaining requirements | Clarity and not guessing | Built with you |
| Reporting analyst | Defining and producing business reports | Clear definitions and accuracy | Built with you |
| Business operations analyst | Analysing and improving processes | Reading the situation and clear summaries | Built with you |
| Product analyst or associate | Supporting product decisions with analysis | Clear questions and summaries | Built with you |
| Data scientist or data engineer | Building models or data pipelines | Technical data skill | Not covered: technical data work needs its own method |
| Management consultant | Advising leadership on strategy | Strategic judgment and presentation | Not covered: consulting judgment needs its own method |
If you hire for one of these roles, bring one case your team has handled and we will tell you whether it fits. See where Calavion applies and the design partner programme.
When should you use a real-work business analyst assessment?
A work-based method lets you review the actions and messages an applicant produces inside a controlled exercise, and it asks more of you than an automated test. Here is what to expect before you start.
Best fit
- Teams where analysts gather and clarify requirements through documents, email and chat
- Roles where spotting conflicts, asking good questions and not guessing matter together
- Hires where a wrong assumption written as a requirement is costly, so reviewing real work may be worth the time
What it asks of you
- Setup is a hands-on service: Calavion prepares each exercise with you, by hand. It is not self-serve software
- You review the Replay yourself, because Calavion does not score or rank applicants
- It is not an automated screening tool for very large applicant pools, and it does not assess workshops, modelling or data skills
How do you run a business analyst assessment?
Step by step
Start from the real job
List the three or four situations that most often go wrong in the role.
Choose one real case
Pick a requirements situation your team has handled, with stakeholder notes, a draft specification and messages to read, a constraint that limits what can be promised, and a consequence that follows.
Decide in advance what you will look for
For example reading the notes, spotting gaps and conflicts, wording questions to stakeholders, and follow-through.
Give every applicant the same case
Use the same instructions for every applicant.
Keep it job-related
Tell applicants what is recorded and who sees it.
Review the work itself
Look at the work, not only the final answer.
Use what you saw to shape the interview
Ask about what the applicant actually did.
Keep your own notes
Apply your local hiring rules, taking legal advice where needed.
What should you look for in an applicant’s work?
These are observations to discuss, not scores. Calavion does not currently score or rate applicants, and the employer decides.
Signs to ask about
- Picks a side between sales and finance
- Fills in who approves exceptions without asking
- Asks the stakeholders vague questions
- Tells the delivery team the requirement is final
- Leaves no note about what is open
Signs of careful work
- Reads the notes and the draft before replying
- Names the conflict and the missing detail
- Asks each stakeholder one clear question
- Marks the open point in the requirement
- Tells the delivery team what is firm and what is not
- Hands over open items clearly
Business Analyst interview questions and a note-taking guide
Use this guide to take your own notes against criteria you set in advance. It is a note-taking guide, not a score, and Calavion does not rate applicants. The table works from an exercise. The questions below it work without one.
| What to look at | Evidence that supports it | Evidence that raises a question | A question to ask |
|---|---|---|---|
| Reading the notes | Refers to the notes and the draft in the questions | Writes without checking | What did you check first, and why? |
| Conflict | Names the disagreement and who holds each view | Ignores or picks a side | How did you describe the conflict? |
| Missing detail | Names the gap and asks the right person | Fills the gap with an assumption | What did you do about who approves exceptions? |
| Questions | One clear question per stakeholder | Long or vague questions | What did you ask each stakeholder? |
| Requirement | Marks the open point | Presents a guess as fact | Which parts of the requirement are firm? |
| Ownership | Leaves a clear note on firm and open items | Leaves open items unnamed | What was still open when you finished, and who owns it? |
Questions that work without an exercise
- Two stakeholders want opposite things. What do you do first?
- Tell me about a time a requirement turned out to be wrong.
- How do you write a question a busy stakeholder will answer?
- How do you handle a detail nobody can tell you?
- When do you take a conflict to a sponsor?
- How do you hand a requirement to a delivery team when parts are still open?
What does research say about selection methods?
Calavion makes no claim that its exercise has been validated. These independent sources explain how work samples and selection methods are usually judged.
U.S. Office of Personnel Management
OPM describes work sample tests as tests that require applicants to perform tasks that mirror the tasks employees perform on the job. It says they suit situations where applicants are expected to have the required skills when they start. Work samples and simulations (OPM).
Research on selection methods
A 2022 review in the Journal of Applied Psychology revisited how well common selection methods predict job performance and ranked structured interviews highest among the methods it reviewed. Sackett, Zhang, Berry and Lievens (2022).
Legal context in the United States
The Uniform Guidelines on Employee Selection Procedures set out how employers should show that a selection procedure is job-related, including technical standards for validity studies. Rules differ by country and state, so take legal advice for your location. 29 CFR Part 1607.
What do applicants experience, and what is recorded?
This describes how Calavion’s exercise environment works today for customer service. A business analysis exercise would work the same way. Every applicant invited to the same approved exercise works the same approved version, with the same starting records and available actions. Applicants see a notice before they start. Calavion records what applicants do inside the environment: records opened, messages written and actions taken. It does not record the screen, webcam or keystrokes. Source files are never shown to applicants.
Business Analyst assessment: common questions
Short answers to what companies ask most often about assessing business analysts.
Does Calavion offer a business analysis exercise today?
No. No business analysis exercise has been built or run yet. Calavion would build the first one with a company, from a requirements situation it has handled. The only exercise Calavion has run end to end is a customer service cancellation case.
What is a business analyst assessment?
A business analyst assessment checks whether an applicant can do business analysis work before you hire them. Formats include business analysis knowledge tests, situational judgement tests, requirements-writing exercises, case studies, role-play and interviews. Calavion would use a real-work exercise built from a requirements situation your company has handled.
How do you assess a business analyst when hiring?
Use work that resembles the job. Give applicants a requirements situation with the records they would really read and a message to write, review what they did, then discuss it in the interview. A multiple-choice test shows knowledge or stated judgment, and an interview describes past or hypothetical behaviour. Neither shows the work itself.
What skills should a business analyst assessment cover?
It should cover the skills the job uses: reading the notes, spotting conflicts and gaps, asking good questions, writing clear requirements, not guessing, stakeholder communication, escalation judgment, and handover and notes.
What is a business analyst job simulation?
A business analyst job simulation is an exercise in which an applicant handles a realistic requirements situation instead of answering questions about one. Calavion’s version would be built from a case your own company handled, so the stakeholders, draft and constraints are yours.
Is this a business analyst skills test?
Not in the usual sense. A skills test checks terms or techniques against an answer key. A real-work exercise checks what an applicant does with stakeholder notes, a draft and a deadline. You can use both. For delivery-side work, see the project coordinator assessment.
Can Calavion test modelling, SQL or data analysis?
No. Calavion’s environment is built around written cases with records and message threads. It does not run live tools or test technical data skills, so those need a separate task.
How is a business analyst assessment different from an interview?
An interview asks applicants to describe how they would act or how they acted before. An assessment shows work the applicant does now. Calavion does not replace the interview. It gives the interview something concrete to examine.
Does Calavion score business analyst applicants?
Calavion does not currently produce automatic scores, applicant rankings or hiring decisions. Employers inspect the work and make the decision.
Do business analysis assessments predict job performance?
No assessment guarantees performance, and Calavion does not claim to predict it. Calavion shows observable work so that you can judge it yourself and then discuss it in the interview.
Can applicant actions affect real stakeholders or systems?
No. In Calavion’s exercises, applicants work in a controlled environment connected to no real stakeholder or system, and a business analysis exercise would work the same way.
What is Replay?
Replay is the record an employer reads after an applicant finishes the exercise. It shows what was available, what the applicant did and wrote, what changed and what stayed open. It is not a score.
Is a real-work business analyst assessment fair and legal?
That depends on where you hire and how you use it. Keep the criteria job-related, give every applicant the same case, tell applicants what is recorded and take legal advice for your location. Calavion makes no claim that its exercise removes bias or has been validated.
Can applicants use AI during a business analyst assessment?
That depends on the role. Decide it before you invite applicants and tell them the rules before they start. Calavion’s direction is to allow AI where the role permits it, with the rules fixed and disclosed up front. Replay shows what applicants did and wrote inside the exercise.
Is the exercise accessible?
Calavion has checked keyboard use and responsive layouts. Screen-reader testing and a formal accommodation process are not yet established, so do not assume full accessibility compliance. Plan adjustments for applicants who need them and tell applicants who to contact.
How long should a business analyst assessment be?
It should match the length of the work it represents. The right length depends on the case, and Calavion does not claim a universal time limit.
What are the trade-offs of a real-work business analyst assessment?
Each exercise is prepared with you by hand, and you review the Replay yourself because Calavion does not score or rank applicants. That takes more effort than an automated test. It suits teams hiring for roles where judgment matters more than volume.
How do we start?
Bring one requirements situation your team has already handled. Calavion prepares the exercise with you, you approve it, and you invite applicants. Launch access is free for our first three companies. After that, Starter is $49 a month and Business is $149 a month, and Enterprise is quoted. See pricing, become a design partner or request a demo.
What has Calavion run so far?
Calavion has run one exercise end to end: a customer service cancellation case, tested on the live system using fictional company data. A business analysis exercise would be built with you, from a requirements situation your team has handled.
See the project coordinator assessment, the compliance analyst assessment, the operations coordinator assessment, the account manager assessment, the technical support assessment, how Replay works, what real-work hiring is and all roles.
Further reading: How to choose real work for a hiring exercise, The Evidence Ladder for hiring and How to discuss applicant work without a score. Role family: Claims, compliance and analysis roles.
Build this exercise with us.
Bring one requirements situation your team has handled. Launch access is free for our first three companies. Calavion prepares the exercise with you, by hand, and you approve it before any applicant sees it.