Signed in as Local Super Admin · Super admin
FireSafeX Test Report
New flow, local stack: end-to-end browser suite
68 of 68 browser tests passed.
- 17/7Flow 1: Set up a new customer
- 25/5Flow 2: Courses: one shared library, customised per organization
- 36/6Flow 3: Assess employees
- 47/7Flow 4: A certificate's life: issued, valid until, expired, renewed
- 55/5Flow 5: Employee sign-in on the Quest: select your name
- 64/4Flow 6: Employee sign-in on the web or mobile app: name + employee ID
- 76/6Flow 7: Kits: pairing, activation and tracking
- 86/6Flow 8: Firmware update
- 95/5Flow 9: A device has a problem
- 109/9Flow 10: AI usage: limits, tracking, export
- R6/6Roles
- P2/2Phone width (390 px)
Who did each step
No role mismatches: every screenshot was taken as a role of its steps, or as a role noted below. 190 of 190 screenshots record who was signed in (120 read from the page header, 42 from the sign-in where a dialog covered the header, 28 simulators, public and signed-out pages).
Steps whose test also signs in as another role, by design:
- 1.3 Activates each Quest and kit together: Quest simulator Mako activates the Quest with the kit code on the headset itself.
- 3.8 Follows up or reschedules: Quest simulator The rescheduled employee retakes on the Quest, so the follow-up shows the new result.
- 4.5 Retakes and passes: Org admin The org admin checks the coverage on Overview after the renewal.
- 6.6 Join a live quiz: Org admin The org admin hosts the live quiz the employee joins.
- 10.7 Raises the limit: Org admin The organization's own admin sees the warning gone after the super admin raised the limit.
Each screenshot is checked against the lanes of the steps its test covers: Super admin, Org admin, Org admin · Manager (or the firmware simulator, their mobile app), Employee (or the Quest), the simulators. Signed-out and public pages count for anyone.
Server and app tests run separately; e2e.sh does not run them. Counts as of 19 Nov 2026.
Not covered
- Live voice on the QuestThe typed text path stands in for speech when the employee asks the AI expert.
- The no-Gemini-key pathThe server's offline stub answer is not exercised.
- The real Quest app and real BluetoothThe Quest headset and the companion app with its device are played by the simulators.
Flow 1
Set up a new customer
From a new organization to employees training. The customer never activates anything.
-
1.1Super admin (Mako)Creates the organizationPlatform › Organizations
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed1.1super admin creates the organization -
1.2Super admin (Mako)Works through the setup checklistInvites the org admin, chooses modules, languages and courses
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed1.2super admin works through the setup checklistSigned in as Local Super Admin · Super admin
-
004Checklist not ready
Signed in as Local Super Admin · Super admin -
005Invite org admin empty refused
Signed in as Local Super Admin · Super admin -
006Invite org admin
Signed in as Local Super Admin · Super admin -
007Modules
Signed in as Local Super Admin · Super admin -
008Languages
Signed in as Local Super Admin · Super admin -
009Courses library
Signed in as Local Super Admin · Super admin -
010Checklist ready
Signed in as Local Super Admin · Super admin
-
-
1.3Super admin (Mako)Activates each Quest and kit togetherWith the kit code, before shipping. The Quest is now set to this organization
Step for: Super admin (Mako)Screenshots as Super admin, Quest simulatorRoles matchAlso as Quest simulator, by design
Passed1.3super admin pairs a device and activates Quest and kit with the kit codeSigned in as Local Super Admin · Super adminQuest simulator
Also as Quest simulator Mako activates the Quest with the kit code on the headset itself.
-
1.4Super admin (Mako)Ships the kits
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed1.4super admin ships the kitSigned in as Local Super Admin · Super admin
-
1.5Org adminAccepts the invite and signs inLands on the organization overview
Step for: Org adminScreenshots as Org adminRoles match
Passed1.5–1.6org admin signs in, lands on the overview and adds an employeeSigned in as Wanda Walkthrough 184340 · Org admin
One test covers steps 1.5 and 1.6.
-
1.6Org adminAdds employeesEach gets an employee ID
Step for: Org adminScreenshots as Org adminRoles match
PassedTested with 1.5–1.6, shown under step 1.5.
-
1.7EmployeeStarts trainingOn the Quest by selecting their name; on the web or mobile app with name + employee ID
Step for: EmployeeScreenshots as Employee, Quest simulatorRoles match
Passed1.7the employee starts: employee app with name + ID, Quest by selecting the nameSigned in as Employee app: Sam Trainee 184340 · EFC1-000002Quest simulator
-
1.8Super admin (Mako)Overview shows ReadyOrg adminOverview shows Ready
Step for: Super admin (Mako) + Org adminScreenshots as Super admin, Org adminRoles match
Passed1.8overview shows Ready for the super admin and the org adminSigned in as Local Super Admin · Super adminWanda Walkthrough 184340 · Org adminSigned out
Flow 2
Courses: one shared library, customised per organization
Every course holds its chapters and two assessments: a Theory assessment and an Immersive assessment
-
2.1Super admin (Mako)Creates a course in Course libraryChapters, Theory assessment, Immersive assessment, translations
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed2.1–2.2super admin creates a library course and publishes it to all organizationsSigned in as Local Super Admin · Super admin
One test covers steps 2.1 and 2.2.
-
026Course library
Signed in as Local Super Admin · Super admin -
027New library course
Signed in as Local Super Admin · Super admin -
028Add chapter
Signed in as Local Super Admin · Super admin -
029Add question
Signed in as Local Super Admin · Super admin -
030Library course published
Signed in as Local Super Admin · Super admin
-
-
2.2Super admin (Mako)Publishes itEvery library course goes to all organizations by default
Step for: Super admin (Mako)Screenshots as Super adminRoles match
PassedTested with 2.1–2.2, shown under step 2.1.
-
2.3Org admin · ManagerFinds it in CoursesMarked by where it came fromLibrary
Step for: Org admin · ManagerScreenshots as Org adminRoles match
Passed2.3–2.5an organization finds it as Library, customises it (own copy) and adds its own courseSigned in as Hugo Admin · Org admin
One test covers steps 2.3 to 2.5.
-
2.4Org admin · ManagerUses it as is, or customises itA course changes only when someone changes it inside that organization. That makes the organization's own copyCustomised
Step for: Org admin · ManagerScreenshots as Org adminRoles match
PassedTested with 2.3–2.5, shown under step 2.3.
-
2.5Org admin · ManagerAdds the organization's own coursesEach also has both assessmentsOwn
Step for: Org admin · ManagerScreenshots as Org adminRoles match
PassedTested with 2.3–2.5, shown under step 2.3.
-
2.6Org admin · ManagerPublishes and schedulesFlow 3
Step for: Org admin · ManagerScreenshots as Org admin, EmployeeRoles match
Passed2.6–2.7the org admin publishes and schedules all three; the employee sees library, customised and own courses togetherSigned in as Hugo Admin · Org adminEmployee app: Priya Menon · HPC-000010
One test covers steps 2.6 and 2.7.
-
2.7EmployeeSees all three kinds together
Step for: EmployeeScreenshots as Org admin, EmployeeRoles match
PassedTested with 2.6–2.7, shown under step 2.6.
-
2.8Super admin (Mako)Updates the library course later
Step for: Super admin (Mako)Screenshots as Super admin, Org adminRoles match
Passed2.8–2.9a library update reaches unedited organizations; the edited one sees "Newer library version"Signed in as Local Super Admin · Super adminNora Admin · Org adminHugo Admin · Org admin
One test covers steps 2.8 and 2.9.
-
037Library update published
Signed in as Local Super Admin · Super admin -
038Unedited org updated automatically
Signed in as Nora Admin · Org admin -
039Edited org newer library version
Signed in as Hugo Admin · Org admin -
040Review library vs your copy
Signed in as Hugo Admin · Org admin -
041Keep mine notice gone
Signed in as Hugo Admin · Org admin
-
-
2.9Org admin · ManagerNot edited: gets the update automaticallyEdited: keeps its own copy, and sees "Newer library version" to review if it wants
Step for: Org admin · ManagerScreenshots as Super admin, Org adminRoles match
PassedTested with 2.8–2.9, shown under step 2.8.
2.9b"Reset to library" replaces the edited copy with the library courseSigned in as Hugo Admin · Org admin
Flow 3
Assess employees
One connected loop from scheduling to follow-up, covering both assessments of a course
-
3.1Org admin · ManagerOpens a courseLibrary, customised or own
Step for: Org admin · ManagerScreenshots as ManagerRoles match
Passed3.1–3.2manager opens a course and publishes & schedules it in one stepSigned in as Milo Manager · Manager
One test covers steps 3.1 and 3.2.
-
3.2Org admin · ManagerPublish & schedule in one stepWho, when, deadline
Step for: Org admin · ManagerScreenshots as ManagerRoles match
PassedTested with 3.1–3.2, shown under step 3.1.
-
3.3EmployeeSees it assigned, with its deadline
Step for: EmployeeScreenshots as EmployeeRoles match
Passed3.3–3.4employee sees the course with its deadline and takes the Theory assessmentSigned in as Employee app: Hana Kim · NWL-000010
One test covers steps 3.3 and 3.4.
-
3.4EmployeeTakes the Theory assessmentQuestions and a score
Step for: EmployeeScreenshots as EmployeeRoles match
PassedTested with 3.3–3.4, shown under step 3.3.
-
3.5EmployeeTakes the Immersive assessmentOn the Quest with the FireSafeX device; scored per skill
Step for: EmployeeScreenshots as Quest simulatorRoles match
Passed3.5the Immersive assessment arrives from the Quest, per skillSigned in as Quest simulator
-
3.6EmployeeGets the result and certificateFlow 4
Step for: EmployeeScreenshots as EmployeeRoles match
Passed3.6the employee gets the result and the certificateSigned in as Employee app: Hana Kim · NWL-000010
-
3.7Org admin · ManagerOpens the schedule's resultsPassed, failed, overdue, per person and per assessment
Step for: Org admin · ManagerScreenshots as ManagerRoles match
Passed3.7schedule results per person and per assessment, with exportSigned in as Milo Manager · Manager
-
3.8Org admin · ManagerFollows up or reschedules
Step for: Org admin · ManagerScreenshots as Manager, Quest simulatorRoles matchAlso as Quest simulator, by design
Passed3.8follow-up: overdue and failed employees are rescheduledSigned in as Milo Manager · ManagerQuest simulator
Also as Quest simulator The rescheduled employee retakes on the Quest, so the follow-up shows the new result.
-
058Ended schedule overdue and failed
Signed in as Milo Manager · Manager -
059Reschedule dialog preselected
Signed in as Milo Manager · Manager -
060Rescheduled new deadline
Signed in as Milo Manager · Manager -
061Quest retake after reschedule
Quest simulatorOther role, by design -
062Follow up passed after retake
Signed in as Milo Manager · Manager
-
Flow 4
A certificate's life: issued, valid until, expired, renewed
Certificates expire 1 year after they are issued
-
4.1EmployeePasses and receives the certificateIt shows the issue date and "Valid until"IssuedValid
Step for: EmployeeScreenshots as EmployeeRoles match
Passed4.1a passed employee holds a certificate with its issue date and "Valid until"Signed in as Employee app: Aarav Shah · NWL-000003
-
4.2Org admin · ManagerSees each employee's certificate statusOn People and on Overview: how many are covered right now
Step for: Org admin · ManagerScreenshots as Org adminRoles match
Passed4.2/4.3/4.6staff see each employee’s certificate status on People, the expiring and expired ones and the coverage on OverviewSigned in as Nora Admin · Org admin
One test covers steps 4.2, 4.3 and 4.6.
-
4.3Org admin · ManagerWarned before it lapsesThe employee is listed for renewalExpiring soonEmployeeSees "Expires on…" in the appExpiring soon
Step for: Org admin · Manager + EmployeeScreenshots as Employee, Org adminRoles match
PassedTested with 4.2/4.3/4.6, shown under step 4.2.
4.3an employee is warned before it lapses: "Expires on…" with Expiring soonSigned in as Employee app: Chen Wei · NWL-000005
-
4.4Org admin · ManagerSchedules the renewalThe same course again
Step for: Org admin · ManagerScreenshots as Org adminRoles match
Passed4.4staff schedule the renewal: the same course againSigned in as Nora Admin · Org admin
-
4.5EmployeeRetakes and passesA new certificate with a new "Valid until"Renewed
Step for: EmployeeScreenshots as Employee, Org adminRoles matchAlso as Org admin, by design
Passed4.5the employee retakes and passes: a new certificate, the old one is RenewedSigned in as Employee app: Chen Wei · NWL-000005Public page (Employee app: Chen Wei · NWL-000005)Nora Admin · Org admin
Also as Org admin The org admin checks the coverage on Overview after the renewal.
-
4.6EmployeeIf not renewed in timeThe certificate and its public verification page show it as expiredExpiredOrg admin · ManagerEmployee counts as not coveredExpired
Step for: Employee + Org admin · ManagerScreenshots as Employee, Org adminRoles match
PassedTested with 4.2/4.3/4.6, shown under step 4.2.
4.6an expired certificate shows as expired; a renewed one as Renewed next to the new Valid oneSigned in as Employee app: Dana Okafor · NWL-000006Employee app: Bianca Rossi · NWL-000004
4.6bthe public verification page: valid and expired, signed out and signed inSigned in as Public page (signed out)Public page (signed in as Nora Admin · Org admin)
Flow 5
Employee sign-in on the Quest: select your name
Nothing is typed on the headset: no organization code, no name, no employee ID, no PIN
-
5.1Quest headsetAlready set to its organizationDone by Mako before shipping
Step for: Quest headsetScreenshots as Quest simulatorRoles match
Passed5.1–5.3the Quest is set to its organization, lists the employees and one selects their nameSigned in as Quest simulator
One test covers steps 5.1 to 5.3.
-
5.2Quest headsetLists all the organization's employees
Step for: Quest headsetScreenshots as Quest simulatorRoles match
PassedTested with 5.1–5.3, shown under step 5.1.
-
5.3EmployeeSelects their own nameThat is the whole sign-in
Step for: EmployeeScreenshots as Quest simulatorRoles match
PassedTested with 5.1–5.3, shown under step 5.1.
-
5.4EmployeeChooses Theory or Immersive
Step for: EmployeeScreenshots as Quest simulatorRoles match
Passed5.4–5.6/5.8–5.9Theory then Immersive on the Quest; the result is saved under that employee; the next person selects their nameSigned in as Quest simulator
One test covers steps 5.4, 5.5, 5.6, 5.8 and 5.9.
-
5.5Quest headsetTheoryLessons and the Theory assessment
Step for: Quest headsetScreenshots as Quest simulatorRoles match
PassedTested with 5.4–5.6/5.8–5.9, shown under step 5.4.
-
5.6Quest headsetImmersiveHands-on mixed-reality training and the Immersive assessmentFireSafeX deviceDrives the simulationPin, aim and squeeze go to the Quest; the device vibrates back
Step for: Quest headset + FireSafeX deviceScreenshots as Quest simulatorRoles match
PassedTested with 5.4–5.6/5.8–5.9, shown under step 5.4.
-
5.7EmployeeCan ask the AI expert by voice
Step for: EmployeeScreenshots as Quest simulatorRoles match
Passed5.7the employee asks the AI expert (typed stand-in for voice) and gets an answerSigned in as Quest simulator
-
5.8Quest headsetSaves the result under that employee
Step for: Quest headsetScreenshots as Quest simulatorRoles match
PassedTested with 5.4–5.6/5.8–5.9, shown under step 5.4.
-
5.9EmployeeNext person selects their own name
Step for: EmployeeScreenshots as Quest simulatorRoles match
PassedTested with 5.4–5.6/5.8–5.9, shown under step 5.4.
Additional checks
Tests in this flow that check something next to the numbered steps.
Signed in as Quest simulator
Signed in as Milo Manager · Manager
Flow 6
Employee sign-in on the web or mobile app: name + employee ID
Where an employee checks courses, statuses and certificates. No PIN or other secret
-
6.1EmployeeOpens the employee appNo organization code or link needed
Step for: EmployeeScreenshots as EmployeeRoles match
Passed6.1–6.2the employee opens the app and signs in with only name and employee IDSigned in as Employee app (signed out)Employee app: Elif Demir · NWL-000007
One test covers steps 6.1 and 6.2.
-
6.2EmployeeTypes their name and employee IDThat is the whole sign-in; the employee ID finds the organization
Step for: EmployeeScreenshots as EmployeeRoles match
PassedTested with 6.1–6.2, shown under step 6.1.
-
6.3Web / mobile appMy trainingCourses assigned, with status and deadline
Step for: Web / mobile appScreenshots as EmployeeRoles match
Passed6.3–6.5My training, Results (Theory outcome consistent) and CertificatesSigned in as Employee app: Elif Demir · NWL-000007
One test covers steps 6.3 to 6.5.
-
6.4Web / mobile appResultsTheory and Immersive assessment scores
Step for: Web / mobile appScreenshots as EmployeeRoles match
PassedTested with 6.3–6.5, shown under step 6.3.
-
6.5Web / mobile appCertificatesIssued on, valid until, expired; download
Step for: Web / mobile appScreenshots as EmployeeRoles match
PassedTested with 6.3–6.5, shown under step 6.3.
-
6.6Web / mobile appJoin a live quiz
Step for: Web / mobile appScreenshots as Org admin, EmployeeRoles matchAlso as Org admin, by design
Passed6.6join a live quiz with the code from the hostSigned in as Nora Admin · Org adminEmployee app: Elif Demir · NWL-000007
Also as Org admin The org admin hosts the live quiz the employee joins.
-
094Live quiz host console
Signed in as Nora Admin · Org adminOther role, by design -
095Employee join a live quiz
Employee app: Elif Demir · NWL-000007 -
096Employee live quiz join page
Employee app: Elif Demir · NWL-000007 -
097Live quiz host sees the employee
Signed in as Nora Admin · Org adminOther role, by design -
098Employee live quiz lobby
Employee app: Elif Demir · NWL-000007
-
-
6.7EmployeeSigns outClears their identity and cached data from the device
Step for: EmployeeScreenshots as EmployeeRoles match
Passed6.7sign out clears the identity and cached data from the deviceSigned in as Employee app: Elif Demir · NWL-000007Employee app (signed out)
Flow 7
Kits: pairing, activation and tracking
One FireSafeX device is paired to exactly one Quest. All tracking and status changes happen in the super admin panel
-
7.1Super admin (Mako)Pairs the device to its QuestExclusive: one to one
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed7.1super admin pairs a free device to a kit; pairing is one to oneSigned in as Local Super Admin · Super admin
-
7.2Super admin (Mako)Activates the Quest and the kit togetherWith the kit code, before shipping
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed7.2–7.5activation state: activated with the kit code; a super admin resets the pairingSigned in as Local Super Admin · Super admin
One test covers steps 7.2 to 7.5.
-
7.3Kit (Quest + device)Arrives ready to useThe customer activates nothing
Step for: Kit (Quest + device)Screenshots as Super adminRoles match
PassedTested with 7.2–7.5, shown under step 7.2.
-
7.4Kit (Quest + device)Shared across the organizationEach session is saved under the employee who selected their name
Step for: Kit (Quest + device)Screenshots as Super adminRoles match
PassedTested with 7.2–7.5, shown under step 7.2.
-
7.5Super admin (Mako)Re-pairs when a part is replacedOnly a super admin can
Step for: Super admin (Mako)Screenshots as Super adminRoles match
PassedTested with 7.2–7.5, shown under step 7.2.
-
7.6Super admin (Mako)Tracks every kit and deviceIn Platform › Hardware › Kits & devices
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed7.6super admin tracks every kit and device: tabs, filters, exportSigned in as Local Super Admin · Super admin
-
7.7Super admin (Mako)Changes a kit's or device's status thereStatuses are changed only in the super admin panel
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed7.7super admin changes the kit and device status; every change is in the historySigned in as Local Super Admin · Super admin
-
7.8Org admin · ManagerSees the organization's kits in DevicesFirmware version and issues; cannot change a status
Step for: Org admin · ManagerScreenshots as Manager, Org adminRoles match
Passed7.8the manager sees the organization's kits but cannot change a statusSigned in as Milo Manager · Manager
7.8the org admin sees the organization's kits but cannot change a statusSigned in as Nora Admin · Org admin
Flow 8
Firmware update
Both sides can see which devices are on the latest version and which are not
-
8.1Super admin (Mako)Uploads and validates a releasePlatform › Hardware › Firmware
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed8.1super admin uploads and validates a releaseSigned in as Local Super Admin · Super admin
-
117Firmware rollout status before
Signed in as Local Super Admin · Super admin -
118Create release
Signed in as Local Super Admin · Super admin -
119Release draft both files missing
Signed in as Local Super Admin · Super admin -
120Wrong slot refused
Signed in as Local Super Admin · Super admin -
121Both files uploaded
Signed in as Local Super Admin · Super admin -
122Release validated
Signed in as Local Super Admin · Super admin
-
-
8.2Super admin (Mako)Publishes to one organization or severalNone pre-selected
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed8.2super admin publishes to one organization; none is preselectedSigned in as Local Super Admin · Super admin
8.2ba release is published to several organizations in one goSigned in as Local Super Admin · Super admin
-
8.3Org admin · ManagerSees which devices are outdatedUpdate available
Step for: Org admin · ManagerScreenshots as ManagerRoles match
Passed8.3the organization sees which devices are outdatedSigned in as Milo Manager · Manager
-
8.4Org admin · ManagerOpens the FireSafeX mobile app next to the devicesSigned in with their own staff account
Step for: Org admin · ManagerScreenshots as Firmware simulatorRoles match
Passed8.4–8.6the mobile app updates one device at a time; the device reports its new versionSigned in as Firmware simulator (signed in as Milo Manager)
One test covers steps 8.4 to 8.6.
-
127Mobile simulator devices
Firmware simulator (signed in as Milo Manager) -
128Mobile simulator attempt open one device at a time
Firmware simulator (signed in as Milo Manager) -
129Mobile simulator update completed
Firmware simulator (signed in as Milo Manager) -
130Mobile simulator next device
Firmware simulator (signed in as Milo Manager)
-
-
8.5Companion app + deviceConnects to one device over Bluetooth and installs the updateSeveral devices: one by one
Step for: Companion app + deviceScreenshots as Firmware simulatorRoles match
PassedTested with 8.4–8.6, shown under step 8.4.
-
8.6Companion app + deviceDevice reports its new version
Step for: Companion app + deviceScreenshots as Firmware simulatorRoles match
PassedTested with 8.4–8.6, shown under step 8.4.
-
8.7Super admin (Mako)Sees how many are on the latestWith the list of devices that are notOrg admin · ManagerDevice shows as currentUp to date
Step for: Super admin (Mako) + Org admin · ManagerScreenshots as Manager, Super adminRoles match
Passed8.7both sides see "N of M on the latest"Signed in as Milo Manager · ManagerLocal Super Admin · Super admin
Flow 9
A device has a problem
A ticket both sides can follow
-
9.1Org admin · ManagerDevices › kit › Report an issueDescribes what is wrong
Step for: Org admin · ManagerScreenshots as ManagerRoles match
Passed9.1the manager reports an issue on a kitSigned in as Milo Manager · Manager
-
9.2Super admin (Mako)Ticket arrives in Hardware › Support ticketsOpen
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed9.2–9.3the ticket arrives; the super admin takes it with a note for the organizationSigned in as Local Super Admin · Super admin
One test covers steps 9.2 and 9.3.
-
9.3Super admin (Mako)Takes the ticketNotes are visible to the organizationIn progress
Step for: Super admin (Mako)Screenshots as Super adminRoles match
PassedTested with 9.2–9.3, shown under step 9.2.
-
9.4Super admin (Mako)Decides the fixRemote helpRepairReplaceKit statusSuper admin changes the kit's statusIn Platform › Hardware
Step for: Super admin (Mako) + Kit statusScreenshots as Super adminRoles match
Passed9.4–9.5the super admin decides the fix, changes the kit status and closes the ticketSigned in as Local Super Admin · Super admin
One test covers steps 9.4 and 9.5.
-
9.5Super admin (Mako)Closes the ticketResolved
Step for: Super admin (Mako)Screenshots as Super adminRoles match
PassedTested with 9.4–9.5, shown under step 9.4.
-
9.6Org admin · ManagerFollows it in Devices › IssuesStatus and notes at every step
Step for: Org admin · ManagerScreenshots as ManagerRoles match
Passed9.6athe organization follows it: In progress with the note, and repliesSigned in as Milo Manager · Manager
9.6bthe organization sees it Resolved, with the fix, every note and the new kit statusSigned in as Milo Manager · Manager
Flow 10
AI usage: limits, tracking, export
Each organization has a monthly allowance of AI tokens and voice characters
-
10.1Super admin (Mako)Sets the organization's monthly limitsPlatform › AI usage
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed10.1/10.7the super admin raises the limit; the warnings clearSigned in as Local Super Admin · Super admin
One test covers steps 10.1 and 10.7.
-
10.2Quest trainer + translationUsage adds upVoice trainer in the Quest, course translation, speech
Step for: Quest trainer + translationScreenshots as Super admin, Org adminRoles match
Passed10.2asking the AI expert adds to the organization's usage, seen by the super admin and the org adminSigned in as Local Super Admin · Super adminWanda Walkthrough 184340 · Org admin
-
159Platform ai usage after a question
Signed in as Local Super Admin · Super admin -
160Super admin org ai usage question recorded
Signed in as Local Super Admin · Super admin -
161Org admin overview ai usage after a question
Signed in as Wanda Walkthrough 184340 · Org admin -
162Org admin ai usage question recorded
Signed in as Wanda Walkthrough 184340 · Org admin -
163Org admin ai usage request log
Signed in as Wanda Walkthrough 184340 · Org admin
-
-
10.3Org admin · ManagerOverview cardUsed this month against the limit
Step for: Org admin · ManagerScreenshots as Org admin, ManagerRoles match
Passed10.3–10.5the org admin sees the overview card, the AI usage page and the near-limit warningSigned in as Nora Admin · Org admin
One test covers steps 10.3 to 10.5.
10.3–10.5the manager sees the overview card, the AI usage page and the near-limit warningSigned in as Milo Manager · Manager
One test covers steps 10.3 to 10.5.
-
10.4Org admin · ManagerAI usage pageDaily trend and every requestExport CSV
Step for: Org admin · ManagerScreenshots as Org admin, ManagerRoles match
PassedTested with 10.3–10.5, shown under step 10.3.
Tested with 10.3–10.5, shown under step 10.3.
-
10.5Super admin (Mako)Warned as an organization nears its limitOrg admin · ManagerWarned as the limit nears
Step for: Super admin (Mako) + Org admin · ManagerScreenshots as Super admin, Org admin, ManagerRoles match
PassedTested with 10.3–10.5, shown under step 10.3.
Tested with 10.3–10.5, shown under step 10.3.
10.5athe super admin is warned that Northwind is near its limitSigned in as Local Super Admin · Super admin
-
10.6Quest trainer + translationAt the limit, the AI stops
Step for: Quest trainer + translationScreenshots as Org admin, Super admin, Manager, Quest simulatorRoles match
Passed10.6at the limit the AI stops and the org admin and a manager see it; raising the limit lets it answer againSigned in as Wanda Walkthrough 184340 · Org adminLocal Super Admin · Super adminFiona Flowmanager 184340 · ManagerQuest simulator
-
164Org admin adds a manager
Signed in as Wanda Walkthrough 184340 · Org admin -
165Platform ai usage limit below usage
Signed in as Local Super Admin · Super admin -
166Super admin org ai usage limit reached
Signed in as Local Super Admin · Super admin -
167Org admin overview ai limit reached
Signed in as Wanda Walkthrough 184340 · Org admin -
168Org admin ai usage limit reached
Signed in as Wanda Walkthrough 184340 · Org admin -
169Manager overview ai limit reached
Signed in as Fiona Flowmanager 184340 · Manager -
170Manager ai usage limit reached
Signed in as Fiona Flowmanager 184340 · Manager -
171Quest ai expert stopped at the limit
Quest simulator -
172Quest ai expert answers after raising the limit
Quest simulator -
173Org admin overview limit raised
Signed in as Wanda Walkthrough 184340 · Org admin -
174Org admin ai usage limit raised
Signed in as Wanda Walkthrough 184340 · Org admin
-
-
10.7Super admin (Mako)Raises the limitRecorded with who and when
Step for: Super admin (Mako)Screenshots as Super admin, Org adminRoles matchAlso as Org admin, by design
PassedTested with 10.1/10.7, shown under step 10.1.
10.7bthe organization is no longer warned and sees the new limitSigned in as Nora Admin · Org admin
Also as Org admin The organization's own admin sees the warning gone after the super admin raised the limit.
-
10.8Super admin (Mako)Exports usage for all organizations or oneExport CSV
Step for: Super admin (Mako)Screenshots as Super adminRoles match
Passed10.8the super admin exports usage for all organizations or oneSigned in as Local Super Admin · Super admin
Additional checks
Tests in this flow that check something next to the numbered steps.
Signed in as Hugo Admin · Org admin
Checks
Roles
Who may do what: managers cannot remove users, org admins cannot act on another org admin, and platform pages redirect everyone but the super admin.
Signed in as Local Super Admin · Super admin
Signed in as Milo Manager · Manager
Signed in as Nora Admin · Org admin
Signed in as Milo Manager · Manager
Signed in as Nora Admin · Org admin
Signed in as Hugo Admin · Org admin
Checks
Phone width (390 px)
The employee app and a staff page on a 390 px wide phone screen.
Signed in as Employee app (signed out)Employee app: Bianca Rossi · NWL-000004
Signed in as Milo Manager · Manager
17 fixes
Fixed along the way
Problems the suite found while it was being written, now fixed in the code it tests.
Results and certificates
- Immersive results from the Quest were refused: the course title was read from an empty field.
- A Theory result said Failed on one screen and Passed on another.
- Staff pages showed stale results until a reload.
- The public certificate page could show another certificate's details, and redirected staff on reload.
Sign-in and accessibility
- Employee sign-in failed when autocorrect changed the typed name. Autocorrect is off and the server tolerates spacing and character variants.
- Staff and employee menus were missing for screen readers.
- The employee app's selected menu label was invisible.
Forms and messages
- The organization image was required; it is now optional.
- The invite form showed one server error at a time.
- Firmware file slots were ambiguous.
- A new message waited behind an old one: a refused pairing still said "Kit created."
- The course page's own-copy notice was replaced by "Saved."
- A live quiz could not be created when the organization's language differed from the course text language.
AI usage
- Seeded AI usage was rewritten by the usage rebuild job.
- Reaching the AI limit only showed the 80% warning.
Seed data
- The seed had no free device to pair, and could stop halfway, leaving no kits.
- The seed printed the wrong super admin password.








































































































































