scieee AI-readable full text Open interactive document viewer

Auditory Consequence Framing: Designing Sound to Reveal the Weight of Decisions in Critical Interfaces

McGregor, Iain

Abstract

This paper introduces the concept of auditory consequence framing, a design approach in which sound is used to make the consequences of user decisions perceptible before actions are taken. While interactive sound design typically focuses on confirmation or error feedback, little attention has been given to how sound might support anticipatory judgement, particularly in high-stakes environments. We explore how auditory cues might signal whether a decision is minor or far-reaching, reversible or irreversible, and whether it affects only the user or others as well. Drawing on the metaphor of the physical safety switch cover, we propose that sound can create a moment of attentional friction that helps users recognise the weight of their actions without interrupting flow. The paper outlines possible design strategies, presents a scenario from emergency response systems, addresses potential limitations, and situates the idea within existing work on auditory display and ethical interaction design. It is intended as a provocation and foundation for future prototyping, evaluation, and cross-sector collaboration.

Full text

1 Auditory Consequence Framing: Designing Sound to Reveal the Weight of Decisions in Critical Interfaces Dr Iain McGregor, Edinburgh Napier University, [email protected] Abstract This paper introduces the concept of auditory consequence framing, a design approach in which sound is used to make the consequences of user decisions perceptible before actions are taken. While interactive sound design typically focuses on confirmation or error feedback, little attention has been given to how sound might support anticipatory judgement, particularly in high-stakes environments. We explore how auditory cues might signal whether a decision is minor or far-reaching, reversible or irreversible, and whether it aIects only the user or others as well. Drawing on the metaphor of the physical safety switch cover, we propose that sound can create a moment of attentional friction that helps users recognise the weight of their actions without interrupting flow. The paper outlines possible design strategies, presents a scenario from emergency response systems, addresses potential limitations, and situates the idea within existing work on auditory display and ethical interaction design. It is intended as a provocation and foundation for future prototyping, evaluation, and cross-sector collaboration. 1. Introduction In critical environments, people are often required to act before the eIects of their decisions become fully visible. Auditory consequence framing explores how sound might help draw attention to those eIects, shifting perspective away from task completion toward an awareness of what an action may set in motion. The term refers to the use of sound to shape awareness of potential consequences before an action is committed, rather than to confirm, warn, or correct once an outcome is already in motion. Time-sensitive systems demand fast decisions under conditions of uncertainty. Action is frequently required with limited information and minimal opportunity for reflection. In such settings, decision-making tends to follow habitual pathways shaped by procedural familiarity and pressure to maintain pace. Interfaces are often designed to favour speed, confirmation, and minimal resistance. As a result, actions may be carried out routinely even when consequences develop over time, propagate through a system, or aIect others indirectly. This tension between procedural eIiciency and consequence invisibility presents a persistent design challenge. Visual interfaces can communicate consequence through progress indicators, branching flows, or warnings. Under pressure, such cues may be overlooked or cognitively bypassed. When routine dominates interaction, awareness of consequence often weakens, particularly in situations where outcomes are delayed or distributed. Against this background, sound has long been used in interface design to signal attention shifts, errors, confirmations, or critical alarms. This role has largely been limited to confirmation and alerting rather than anticipation. Such uses are typically 2 reactive, responding to completed actions or changes in system state. Far less attention has been given to how sound might function before a decision is made, not as an alert but as a prompt for awareness. The anticipatory potential of sound therefore remains underused in interaction design. Existing auditory cues tend to reflect intention or current state, yet they rarely convey systemic risk, ethical weight, or downstream impact. A gap remains for sound that hints at what may follow at the moment when a decision is still pending. Unlike alarms or error tones, such sound would not steer action away from a choice but would gently shape how that choice is understood at the point of commitment. From this perspective, sound can serve a preparatory role in interaction by making the weight of an impending decision perceptible. This approach, referred to here as auditory consequence framing, uses sound to convey extent, permanence, and interpersonal impact before an action is finalised. Rather than interrupting flow, it supports quiet reflection. Subtle shifts in tone, resonance, complexity, or spatial character may indicate how consequential a choice may be. The aim is not to warn, but to inform, nudging attention toward consequence without halting decision-making. A familiar physical analogy helps bring this idea into focus. The red safety cover used to guard critical switches does not prevent action, but it introduces friction. Awareness is altered, and what follows is marked as carrying weight. A carefully designed auditory layer could serve a comparable function. Sound, when shaped with restraint, can introduce a perceptual shift that supports deliberation without interrupting interaction. Auditory consequence framing is presented here as a conceptual and practical starting point. The paper explores how sound might signal whether a decision is minor or farreaching, reversible or irreversible, and whether its eIects extend beyond the individual to others. A scenario drawn from emergency response is used to ground the discussion, alongside candidate auditory strategies, anticipated objections, and relevant prior work. The contribution lies not in a finished framework, but in an invitation to prototype, evaluate, and reconsider how sound might support consequence awareness across domains. 2. Conceptual Framing: The Sonic Red Cover In high-stakes control environments, physical safeguards are deliberately used to interrupt habitual action at the moment it matters most. A red plastic cover over a switch does not prevent activation, yet it changes how the action is approached. The hand must lift or reorient, introducing a brief pause that alters posture as well as attention. Although the action remains available, it no longer feels routine. The interaction now carries a sense of decision rather than habit. This eIect does not rely on instruction or warning. The cover does not explain risk or demand compliance. Instead, it introduces a small amount of friction that reshapes awareness at the point of commitment. Even when the cover is flipped quickly, the interaction feels diIerent. The system continues to function, yet the quality of engagement has shifted. A moment is created in which the person becomes aware that 3 the choice is consequential rather than merely procedural. This shift in awareness does not depend on physical obstruction alone. Sound can create a comparable change without relying on resistance or delay. Rather than slowing movement, auditory consequence framing introduces a perceptual adjustment as interaction approaches a point of commitment. The surrounding sound environment begins to evolve in subtle ways. This change does not confirm an action, nor does it respond to a completed event. It signals the presence of a threshold. Where a physical cover alters posture, sound alters how the moment is sensed. A gradual increase in harmonic density, a widening spatial field, or a deepening resonance can suggest that the choice about to be made will unfold over time, influence others, or limit future options. Such sound does not block action or redirect behaviour. Its role is quieter. It allows a choice to be felt as part of a wider system rather than as an isolated command. Control remains with the decision-maker, yet the interaction now carries a sense of trajectory. What matters is not the sound itself, but the way it reshapes attention just before commitment. Most contemporary interfaces do not oIer this form of perceptual preparation. Interaction sounds are typically designed to mark completion. A click, chime, or tone confirms that input has been registered. These sounds are eIective at signalling closure, yet they remain silent on what an action initiates, delays, or displaces. What is absent is any sense of trajectory at the point of choice. The moment before action is often acoustically neutral, even when the action may have lasting or distributed consequences. This limitation becomes more pronounced in contexts where outcomes unfold gradually or extend beyond the immediate interface. In emergency response systems, healthcare platforms, as well as civic technologies, decisions may alter resource availability, aIect other people, or close oI alternative paths. When interfaces oIer no perceptual cue at the moment of confirmation, action can default to routine even when reflection would be appropriate. The red cover serves as a reminder that small design interventions can support ethical attentiveness without introducing obstruction. It does not imply error or danger. It simply changes how the moment of commitment is experienced. Sound can play an analogous role. A reversible choice might be accompanied by a light, dissolving gesture that fades easily. An irreversible commitment might be marked by a slow tonal build that expands as confirmation approaches. A choice with broader social impact might introduce layered textures that imply presence or spread. These cues are not decorative. They carry informational weight through their form as well as their behaviour. Auditory consequence framing proposes that sound can lend shape to the moment before action, supporting awareness without instruction. When designed with care, such sonic changes can slow thought without slowing movement. Ethical attention can 4 then arise within the interaction itself, supporting responsibility without reliance on prompts, rules, or explicit explanation. 3. Scenario Illustration Concrete scenarios help clarify how auditory consequence framing might operate across diIerent forms of critical interaction. The purpose here is not to specify sounds in technical detail, but to show how particular perceptual qualities can be aligned with diIerent kinds of consequence at the moment a decision becomes diIicult to undo. In an emergency response context, a paramedic is entering an incident classification into a mobile triage system. As interaction approaches a critical intervention option, the surrounding audio environment begins to change in subtle but noticeable ways. Harmonic tension increases, creating a sense of compression rather than urgency, while a slight temporal persistence is introduced into the soundscape. This persistence alters how long the moment seems to last, suggesting that the decision under consideration cannot easily be reversed. The sound does not draw attention to itself, yet it signals that the choice will aIect downstream care pathways as well as the availability of staI and equipment. The classification is selected with heightened focus. The action proceeds, though it is no longer experienced as routine entry. In a healthcare setting, a clinician is reviewing treatment options within a decision support interface. As a medication with limited reversibility comes into focus, the auditory layer becomes denser and more sustained. The sound lacks a clear sense of resolution, favouring continuity over closure. This perceptual quality is intended to convey commitment rather than completion. The clinician senses that the choice will shape future options and narrow what can follow. The sound does not explain these implications, but it frames the moment as one that closes possibilities as well as opening them. In an industrial setting, an operator is supervising a production line through a control interface. A shutdown option is selected in response to an emerging fault. As confirmation approaches, the auditory environment shifts toward a lower and more uniform character. Rhythmic detail reduces, and the sound feels slower and heavier. This change is designed to convey duration and recovery cost rather than danger. It helps make perceptible that triggering the shutdown will halt production for an extended period and require a full restart cycle. The decision is taken with a clear sense of commitment, shaped by a sound that communicates temporal cost in an experiential way. In a civic or infrastructure context, an operator is allocating resources within a system that balances competing public needs. As capacity is redirected away from other areas, the audio field subtly widens. Additional layers appear toward the edges of the soundscape, suggesting spread and distribution. The interaction remains fluid, and no warning is issued. The sound communicates that the decision will be felt beyond the immediate focus of the interface, aIecting people and services that are not directly visible. 5 Across these cases, sound is used to frame consequence rather than to signal correctness, urgency, or error. Each auditory change is aligned with a particular dimension of consequence, such as irreversibility, temporal cost, or social reach, using perceptual qualities rather than explicit messages. Volume and pitch are less important than duration, density, and spatial behaviour. In every case, the person remains in control, yet the decision is experienced as part of a wider system of eIects. These scenarios are illustrative and do not assume that sound alone is suIicient to support judgement in all contexts. Taken together, they point toward a small set of recurring consequence dimensions that can be shaped through sound, including reversibility, temporal extent, accumulation over time, recovery cost, and eIects on others. These dimensions provide a basis for more systematic discussion in the following section. 4. Limitations in Existing Systems Sound is already widely used in interactive systems, particularly in time-sensitive or safety-related contexts. Notifications, confirmation cues, and error tones are common across mobile devices, clinical interfaces, industrial control systems, and public infrastructure tools. In these roles, sound is valued for its ability to attract attention, confirm successful input, or indicate that something has gone wrong. Such cues are often eIective, especially when visual attention is limited or divided. However, these uses of sound are largely retrospective. They acknowledge what has already happened rather than shaping awareness of what is about to happen. A confirmation sound responds to a completed action. An error tone flags a problem once a threshold has been crossed. Even alerts that feel anticipatory are typically triggered by established system states. In most cases, the auditory signal is tied closely to the individual user and the immediate moment, even when the eIects of a decision extend well beyond both. What remains largely absent is a systematic use of sound to communicate anticipated consequence before commitment. Where sound is used at all, it rarely varies in a principled way with the scale, duration, or distribution of a decision’s eIects. Consequences that unfold over time, cascade through interconnected systems, or aIect others indirectly are usually left to be inferred from training or experience rather than being supported perceptually at the point of choice. This emphasis on retrospective sound reflects long-standing assumptions in interface design about predictability, measurability, and accountability. Feedback sounds are comparatively easy to specify, standardise, and validate. They confirm that an action has been registered or that a rule has been violated. Anticipatory sound operates in a more ambiguous space. It shapes perception rather than signalling correctness, which makes it harder to formalise, test, and certify within conventional design processes. In the absence of perceptual support at the point of decision, users are therefore expected to rely on memory, training, policy, and prior experience to anticipate consequences. While these resources are essential, they are unevenly distributed and 6 vulnerable under pressure. Fatigue, time constraints, and divided attention can all undermine a person’s ability to project future outcomes, particularly when consequences are delayed, distributed, or socially mediated. Interfaces that remain acoustically neutral at such moments place a substantial burden on cognition. Auditory consequence framing is proposed in response to this limitation. It does not seek to replace existing notification or alert mechanisms, nor does it assume that sound alone can support complex judgement. Instead, it highlights a missed design opportunity and opens space for treating sound as a material for consequence awareness rather than confirmation alone. Identifying this limitation is a necessary step toward considering how consequence might be framed perceptually before commitment. The following sections build on this diagnosis by outlining how diIerent forms of consequence can be characterised and supported through sound. 5. Design Opportunities and Strategies The limitations identified in existing systems point toward a wide range of design opportunities rather than a single mechanism. Treating sound as a material for framing consequence shifts its role from marking events to shaping how decisions are experienced at the moment of commitment. The techniques described below can be understood as shaping consequence through perceptual structure, time, relation, and stability. They are oIered as lenses for design reasoning rather than fixed mappings, intended to support careful calibration rather than uniform application. One class of strategies concerns spectral structure and harmonic organisation, which shape how contained or interconnected a decision feels. Sounds with sparse spectral content often feel singular and local, while denser harmonic structures suggest multiplicity and interdependence. Gradual increases in harmonic density can therefore indicate that a decision engages more of a system or implicates more people. Spectral thinning can suggest narrowing options or reduced degrees of freedom. Register contributes to this framing. Lower registers may convey grounding or material commitment, while higher registers can suggest abstraction or distance from immediate consequence. These cues work most eIectively when they evolve relative to a familiar baseline rather than appearing abruptly. Closely related are strategies based on timbral evolution, which help distinguish exploratory interaction from consequential commitment. A stable and coherent timbre may accompany reversible adjustment, while increasing roughness, granularity, or inharmonicity can signal that a threshold is being approached. These changes do not need to coincide exactly with the point of action. Gradual timbral drift as commitment increases allows the person to sense transition without interruption, reinforcing the patterns illustrated in the earlier scenarios. Temporal behaviour provides another dimension for framing consequence. Duration, decay, persistence, and onset shape how final a moment feels. Sounds that resolve quickly tend to suggest ease of recovery, while those that linger imply diIiculty of undoing. Delayed onset or extended decay can alter the felt weight of a decision without increasing urgency. Silence and near silence are particularly important here. The 7 withdrawal or thinning of sound can frame consequence through absence, signalling gravity or loss of optionality by reducing perceptual support rather than adding emphasis. These eIects are often felt rather than noticed, which allows them to remain supportive over repeated use. Beyond individual moments, temporal accumulation can be used to represent cascading consequence. Repeated actions that leave residual traces or layers can suggest that eIects are accumulating rather than resetting, echoing the kinds of downstream impact described in the scenario section. This approach is especially relevant where individual decisions appear minor but aggregate eIects are significant, allowing consequence to be perceived as process rather than event. Spatial behaviour allows consequence to be framed relationally. Narrow and centred sounds tend to feel personal and contained, while widening spatial fields suggest distribution and reach. Introducing peripheral or diIuse elements can indicate that a decision aIects others who are not directly represented within the interface, reflecting the social and infrastructural contexts discussed earlier. Spatial movement can also convey directionality of impact, suggesting whether eIects propagate outward, return inward, or remain localised. Another set of techniques concerns dynamic stability and instability. Sounds that fluctuate, resist settling, or exhibit subtle irregularities can convey sensitivity, indicating that a system is near a point where small changes have lasting eIects. Sounds that stabilise into a consistent pattern can suggest that a decision has committed the system to a particular state. These qualities allow consequence to be sensed as system behaviour rather than as warning or instruction. Masking, clarity, and perceptual availability oIer further resources. Allowing certain elements to become partially obscured can suggest that information or options are being lost or deprioritised, while increasing clarity can indicate consolidation or narrowing focus. As noted in the limitations of existing systems, these shifts matter most when they occur before commitment rather than after, shaping awareness at the moment decisions become diIicult to reverse. Consequence can also be framed through deviation from baseline. Small departures from an established sonic norm often carry more meaning than novel sounds, particularly in systems used repeatedly. A slight change in texture, timing, or spatial behaviour can be suIicient to signal that a decision diIers in kind from routine action, helping to manage habituation over time. Coupling and decoupling between action and sound provide additional nuance. Tight synchronisation between gesture and sound tends to feel responsive and reversible. Loosening this coupling through slight delay, softened causality, or partial desynchronisation can make an action feel less trivial or more committed, even when the gesture itself remains simple. 8 In some contexts, rhythmic organisation oIers another avenue. Regular and predictable rhythms can accompany routine operation, while disruptions to rhythm can indicate that a decision interrupts established flow. Stretching or slowing rhythmic patterns can suggest temporal cost or recovery time without relying on explicit timers. Over repeated use, controlled variation within a recognisable rhythmic family can help preserve sensitivity without undermining familiarity. Finally, consequence framing can benefit from cross modal alignment. Sound does not need to operate in isolation. Aligning auditory changes with visual or haptic structure, without duplicating information, can reinforce perception through coherence rather than redundancy. Temporal alignment and shared structural change across modalities help sound remain supportive rather than dominant. These techniques are not intended to operate independently, nor should they be layered indiscriminately. Overuse or excessive combination can flatten distinctions rather than clarify them. Consequence is often multidimensional, but eIective framing depends on selecting which dimensions matter in a given context and allowing others to remain quiet. The central design task lies in aligning perceptual form with the structure of a decision, using restraint as well as variation. By treating sound as a medium for consequence rather than confirmation, designers can support awareness at the point where decisions begin to matter, while leaving judgement and control with the person interacting with the system. 6. Objections and Ethical Considerations Designing for consequence awareness involves ethical judgement. Choices about which consequences are made perceptible, when they are surfaced, and how they are framed reflect values about responsibility, risk, and care. Auditory consequence framing must therefore be examined in terms of its eIects on attention, inclusion, interpretation, and power, rather than treated as a purely technical addition. One concern is that additional sound could distract users, particularly in environments characterised by time pressure, stress, or high cognitive demand. This risk cannot be dismissed. In many systems, speed and fluency carry ethical importance in their own right, and introducing friction where it is not needed may undermine performance or safety. Auditory consequence framing therefore involves a tension between maintaining routine eIiciency and creating space for reflection. The approach described here recognises that reflection is not always desirable, and that routine eIiciency may at times take priority. Any use of auditory consequence framing must therefore remain proportional to the scale and reversibility of the consequences involved, with calibration treated as a central design responsibility rather than a secondary adjustment. It suggests instead that there are moments where habitual action carries suIicient downstream impact that a subtle shift in awareness may be appropriate. Determining when such framing is suitable remains a contextual design judgement rather than a general rule. Accessibility raises further considerations. Auditory consequence framing cannot be assumed to benefit all users equally, particularly those who are D or deaf or hard of 9 hearing. This limitation should not be treated merely as a constraint. Designing consequence awareness across modalities can enrich interaction for a wide range of users. Auditory cues can be paired with haptic, visual, or spatial equivalents that share structural qualities rather than duplicating content. Such alignment supports inclusivity while underscoring that consequence framing operates through perceptual form rather than symbolic explanation. Hearing should not be treated as a prerequisite for engagement with a system. Another concern is the risk that such sound may be interpreted as aesthetic rather than informative. Users may not immediately recognise subtle auditory changes as meaningful, particularly when they fall outside familiar categories such as alerts or confirmations. Beyond the user, designers, engineers, or organisations may discount such approaches as decorative, reflecting inherited assumptions about what counts as functional sound in interfaces. Auditory consequence framing challenges these assumptions by treating sound as a means of shaping awareness rather than marking events. Its legitimacy depends on consistency, careful calibration, and evidence that such cues influence perception rather than merely embellish interaction. Questions of responsibility and potential misuse also arise. Framing consequence involves judgement about which eIects are foregrounded and which remain implicit. Decisions about whose consequences matter, which risks are emphasised, and how uncertainty is represented are not neutral. There is a risk that consequence framing could be applied selectively, amplifying some considerations while obscuring others. Responsible deployment therefore requires transparency about design intent and sensitivity to bias, alongside restraint in how strongly any single dimension of consequence is emphasised. These considerations point toward the need for careful evaluation rather than categorical acceptance or rejection. Auditory consequence framing does not claim universal applicability, nor does it propose to replace other forms of feedback, training, or decision support. Its role is exploratory. Responsible use depends on proportionality, inclusivity, and attentiveness to context, as well as readiness to revise or withdraw such approaches where they prove inappropriate. Taken together, these objections clarify the position of the paper. The aim is not to steer behaviour or enforce compliance, but to support awareness at moments where decisions carry weight beyond their immediate execution. Whether auditory consequence framing achieves this aim remains an open empirical question. Addressing it requires study, iteration, and readiness to revise or withdraw such approaches where needed. 7. Use Cases Across Sectors The scenarios described earlier are not intended as domain specific prescriptions. Their value lies in the patterns of commitment they reveal. Auditory consequence framing becomes relevant wherever actions are easy to execute yet diIicult to undo, or where eIects extend beyond the individual acting. The aim in this section is to trace continuity