← All materials

Mission 9 kit · screen and print

Multimodal fusion

Image and audio predictions combine only through an explicit rule, such as image passes AND audio passes.

1OpenKeep this page beside the mission.
2UseTap, point, tally, or move pieces on screen.
3Print if usefulThe same content appears in print mode.
Piece 1 · cards · dots pattern

Image input cards

How to use it: Record the image label, score, and threshold as one separate input.

01

Image label

02

Image score

03

Image threshold

04

Image pass or fail

Piece 2 · cards · waves pattern

Audio input cards

How to use it: Record the frozen Audio Model v1 label, score, and threshold as a separate input.

01

Audio Model v1 ID

02

Audio label

03

Audio score

04

Audio threshold

05

Audio pass or fail

Piece 3 · log · grid pattern

FusionTrace

How to use it: Trace both predictions into the exact fusion rule and record one ACT plus one ASK AGAIN case.

01

Image result

02

Audio result

03

AND rule

04

Final state

05

Reason

Piece 4 · board · stripes pattern

Exact AND-rule board

How to use it: ACT only when image passes AND audio passes. Every other combination becomes ASK AGAIN.

01

PASS + PASS = ACT

02

PASS + FAIL = ASK AGAIN

03

FAIL + PASS = ASK AGAIN

04

FAIL + FAIL = ASK AGAIN

Safe mission inputs

Use the listed props and game signals.

Use prop images and game commands, then turn the camera and microphone off when testing ends.