[SteamVR] Steam Audio

SolKutTeR · 26. Oktober 2018

Weitere Betaversion 16, mit HRTF und SOFA Files Implementiert.
Damit soll es für Programmierer nun leichter sein, SOFA (Spatially-Oriented Format for Acoustics) Dateien in die VR-/Anwendung einzubinden.

Beta 16: Custom HRTF Support
In the spatial audio community, there is a lot of interesting, ongoing research and experimentation that aims to understand the trade-offs involved in using customized (or personalized) HRTFs. With the latest release of Steam Audio 2.0-beta.16[valvesoftware.github.io], we want to provide developers with an efficient tool that enables them to conduct experiments and research studies. Our hope is that new knowledge in this domain can be created faster, and can be shared with the VR and gaming communities more easily.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Custom HRTFs can be specified to Steam Audio using the SOFA file format. SOFA stands for Spatially-Oriented Format for Acoustics, and is a standard developed by the Audio Engineering Society (AES) and published in 2015. For more information on the SOFA format, see https://www.sofaconventions.org/.

How to obtain a SOFA file, whether by measurement, calibration, or any other process, is beyond the scope of Steam Audio. We just provide an efficient tool for using SOFA files for research and experimentation.

Steam Audio makes a few assumptions about the data provided using SOFA files; for more information refer to the documentation.

To provide a SOFA file to Steam Audio, follow the instructions below.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Unity plugin
Copy SOFA files to the StreamingAssets directory in your Unity project. Then open the Steam Audio tab (Window > Steam Audio) and specify the SOFA files to load under HRTF Settings.

FMOD Studio plugin
SOFA files are specified using your game engine. If using Unity, follow the instructions for the Unity plugin; the FMOD Studio plugin will automatically load and use your SOFA files.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Unreal plugin
SOFA file support will be added to the Unreal plugin in an upcoming update.

C API
SOFA files are loaded when creating a Binaural Renderer using iplCreateBinauralRenderer. The relevant information is passed using the params parameter to this function: set the type member to IPL_HRTFDATABASETYPE_SOFA and the sofaFileName member to the absolute path to the SOFA file you wish to load.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

For more information on using any of the above plugins to load SOFA files, refer to the relevant documentation. Note that SOFA files are not necessary to use Steam Audio; you can continue to use Steam Audio for HRTF-based 3D audio and all of its other features without specifying any SOFA files, just as before.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

SolKutTeR · 2. November 2018

Die neue Steam Audio 2.0-Beta.16 erhält ein vielversprechendes Feature.

(This video contains audio; you may have to unmute it to listen.)

Beta 16: Dynamic Geometry Support
We've just released Steam Audio 2.0-beta.16[valvesoftware.github.io], in which the Unity plugin now provides support for occlusion of sound by dynamic geometry. The support for dynamic geometry is only applicable to occlusion and transmission; reflections and reverb do not support dynamic geometry.

To make this work, Steam Audio uses Unity's built-in ray tracer, which can be enabled by attaching the Steam Audio Custom Settings component to a GameObject, and setting Ray Tracer Option to Unity. When using the Unity ray tracer, you don't need to tag objects with Steam Audio Geometry components; any GameObject with a collider can potentially occlude sound. To configure which colliders can occlude sound, you can move the occluders to appropriate layers, and configure Steam Audio to only use those layers for occlusion. This can be done in the Steam Audio tab (Window > Steam Audio), under Layer Mask. Note that materials are still specified by attaching Steam Audio Material components to the relevant GameObjects.

For more information, refer to the Unity plugin documentation.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

SolKutTeR · 31. Oktober 2019

Neue Beta Version 17 mit Unreal Engine 4.24 Update.

We've recently updated the Steam® Audio Unreal Engine integration with the latest Beta 17 API. This version will be part-and-parcel of UE 4.24 and bolsters Steam® Audio performance with support for multi-threaded environmental effect simulation, Intel® Embree, and AMD Radeon Rays.

Each of these features provide developers with significant performance boosts compared to simulating environmental effects with the built-in Steam® Audio raytracer on a single thread. Radeon Rays, which runs on any OpenCL 1.2 compatible GPU, can provide 50-150X speed-ups. Intel® Embree, which runs on the CPU, can provide speed-ups of around 20X when using recent 4-core CPUs. The built-in raytracer also benefits significantly from the new multi-threading support and its performance scales linearly with the number of threads.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Figure: (Top) Absolute time (in milliseconds) for real-time simulation of environmental effects vs. number of threads. (Bottom) Linear scaling for real-time simulation of environmental effects vs. number of threads. Simulations were performed on Intel Xeon Platinum 8124 CPU @ 3 GHz for 32K rays, 32 bounces, and 16 sources.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Figure: Speedup when baking reverb using Radeon Rays vs. Embree (single-threaded) vs. Steam Audio's built-in ray tracer (single-threaded), for two scenes: Sibenik cathedral (80k triangles) and a Hangar scene from the Unity Asset Store (140k triangles). Speedups are averaged over a range of simulation settings and probe grid densities, and plotted using a logarithmic scale, shown in the graph are relative to Steam Audio's built-in ray tracer.

This is already up in Epic's UE main branch for 4.24, Unreal developers wanting to take early advantage of all these features can simply compile this main branch. If you prefer to grab your engine from the Epic launcher, this release will be available in the upcoming UE 4.24 Preview.

Thanks to Doğa Can Yanıkoğlu and Charles Alexander for their contributions to this Steam® Audio update and with additional features such as support for level transitions and improved geometry tagging.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Full Changelist

Updates Steam® Audio API to Beta 17 (h/t @dyanikoglu).

Adds scene reinit on level transitions (h/t @dyanikoglu).

Improved geometry tagging (h/t @muchcharles).

Add support for RadeonRays and Embree raytracers.

Better settings organization.

Add support for multiple phonon sources.

Ensure scene exports are reloaded between editor sessions.

Ensure Android and 32-bit builds falls back cleanly to Phonon (if project is configured with Embree or Radeon).

Various stability improvements.

If you have any questions and/or feedback on this release, please feel free to post in the discussion forums or open an issue on GitHub.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

SolKutTeR · 22. April 2020

Hier gab es seit längerem wieder ein Update v18, welches recht umfangreich daherkommt.

Beta 18: Expanded Android support, Spatial Blend
We've just released Steam Audio 2.0-beta.18, which includes support for a wider range of CPU architectures on Android, performance and quality improvements, and several bug fixes. Below are some of the highlights.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Expanded Android Support
Previous versions of the Steam Audio SDK have supported Android devices that can run 32-bit ARM (armv7) code only. Starting with 2.0-beta.18, the Steam Audio SDK supports a much wider range of Android devices, by providing binaries for 64-bit ARM (armv8/arm64/aarch64), 32-bit Intel (x86), and 64-bit Intel (x86_64/x64) processors as well.

The Unity plugin now supports Android builds for ARMv7, ARM64, and x86 targets. Building a Unity project for ARM64 requires the IL2CPP scripting backend.

The FMOD Studio plugin also now supports Android builds for ARMv7, ARM64, and x86 targets.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Improved Spatial Blend
Sound designers often want to transition between using highly positional HRTF for sounds that are far enough away from the listener, and un-spatialized stereo audio clips for sounds that are very close to the listener. At Valve, we've used this approach in Counter-Strike: Global Offensive, and Half-Life: Alyx. For example, the same weapon sound could be rendered with HRTF if an enemy is firing the weapon, but as a stereo clip if it's the player firing. To ensure a smooth transition between spatialized and un-spatialized audio as the listener approaches the source, we've added a new spatial blend parameter to the Steam Audio binaural effect. As the value of this parameter is ramped down from 1 to 0, the audio smoothly changes from spatialized to un-spatialized, without phasing artifacts.

This functionality is also available in the Unity plugin. To use it, just adjust the Spatial Blend slider on Unity's built-in Audio Source component. Refer to the documentation for more details.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Steam Audio SDK 2.0-beta.18

Extended Android support to include 64-bit ARM (armv8/arm64/aarch64), 32-bit Intel (x86), and 64-bit Intel (x64/x86_64/amd64) CPUs.

Added support for spatial blend in the binaural effect, which smoothly blends between fully-spatialized point source and unspatialized stereo input audio.

Added support for custom distance attenuation and air absorption curves, which affect both direct and indirect sound.

Enabled the number of volumetric occlusion samples to be specified separately for each source, and to be changed on the fly.

Improved quality of bilinear interpolation when using custom HRTFs from SOFA files.

Reduced unwanted volume boost in reflected sound when source and listener are both close to geometry.

Modified behavior of baked indirect sound to continue using previous impulse response if no baked data is available for the current source/listener position.

Reduced data size of baked indirect sound.

Improved performance of various operations.

Fixed popping artifact in baked reverb when the listener is at the exact same position as a probe.

Fixed bug where impulse responses were not properly updated in some cases when the source or listener position changed.

Fixed bug in Ambisonics rotation where rotations were not properly interpolated from one frame to the next.

Fixed crash when adding or removing instanced meshes while a simulation is running.

Fixed crash due to source directivity information not being initialized correctly.

Fixed crash when trying to initialize Radeon Rays on non-AMD GPUs.

Fixed crash when trying to initialize Radeon Rays or TrueAudio Next when multiple OpenCL drivers are installed (e.g., Intel for CPU and AMD for GPU).

Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Steam Audio Unity Plugin 2.0-beta.18

Updated to use Steam Audio SDK 2.0-beta.18.

Updated to be compatible with Steam Audio FMOD Studio Plugin 2.0-beta.18.

Extended Android support to include 64-bit ARM (armv8/arm64/aarch64) and 32-bit Intel (x86) CPUs.

Updated Steam Audio Spatializer effect to use the Audio Source's Spatial Blend parameter to drive the new spatial blend feature, which smoothly blends between fully-spatialized point source and unspatialized stereo input audio. In addition, Spatial Blend also affects distance attenuation (but not occlusion, indirect sound, etc.).

Enabled custom distance attenuation curves authored in an Audio Source component to affect direct and indirect sound rendered by the spatializer plugin.

Fixed unnecessary GC allocations when using Unity's built-in ray tracer.

Fixed build errors when using the IL2CPP backend.

Fixed bug where static geometry export included disabled GameObjects.

Fixed bug where indirect sound was incorrect if the Audio Listener was scaled. The new behavior allows the Audio Listener to be uniformly scaled (non-uniform scales are currently not supported).

Fixed bug where scaling an Audio Source playing an Ambisonic audio clip would result in volume changes.

Fixed bug where source and listener transforms were not applied correctly when decoding Ambisonic audio clips.

Fixed bug where playing an Ambisonic audio clip with the output format set to 5.1/7.1 would result in crackling.

Fixed bug where spatializing an Audio Source at the same position as the Audio Listener would result in silence.

Fixed bug where spatialized Audio Sources were occasionally initialized incorrectly, causing all audio output to be silent.

Fixed bug where the first few frames of a spatialized Audio Source with a Steam Audio Source attached would play with incorrect occlusion settings.

Fixed bug where occlusion settings were not properly updated when a GameObject containing the Steam Audio Source was enabled and/or disabled.

Fixed crash when trying to initialize Radeon Rays on non-AMD GPUs.

Fixed crash when trying to initialize Radeon Rays or TrueAudio Next when multiple OpenCL drivers are installed (e.g., Intel for CPU and AMD for GPU).

Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Steam Audio FMOD Studio Plugin 2.0-beta.18

Updated to use Steam Audio SDK 2.0-beta.18.

Extended Android support to include 64-bit ARM (armv8/arm64/aarch64) and 32-bit Intel (x86) CPUs.

Fixed bug with FMOD Studio + Unity integration where switching scenes or reloading scenes at runtime would result in silence.

Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Contributor List for Steam Audio 2.0-beta.18

@Schroedingers-Cat

@jonas-johansson

Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

SolKutTeR · 23. Juli 2021

Seit längerem wieder ein recht interessantes 4.0.0 Update.
Das ganze findet ihr wie immer auch auf z.B. Github.

Steam Audio 4.0.0 Release
We've just released Steam Audio 4.0.0, which is a major update to Steam Audio. This release includes new features and an updated API that is more flexible than previous releases. Because this is a major update, the version numbering we used so far was no longer sufficient: we have updated from 2.0-beta.20 (the previous release) to 4.0.0 (the next available integer).

This release includes features that were developed or significantly enhanced during the development of Half-Life: Alyx.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Pathing
Pathing is a new way of baking sound propagation from a moving source to a moving listener. This involves placing probes in the scene, and calculating shortest paths between each pair of probes. At run-time, this baked data is used to calculate how sound propagates from the moving source to the moving listener, and spatialize the sound accordingly. If a baked shortest path is occluded by dynamic geometry (like a door), Steam Audio can recalculate alternate shortest paths on the fly. Steam Audio also applies a diffraction model to paths that bend around corners or through doorways, etc. This feature is useful for modeling how sound emitted by an occluded source reaches the player through doors or windows instead of directly through walls.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Hybrid Reverb
When rendering reflections or reverb, Steam Audio can use convolution reverb (which is defined in terms of an impulse response) or parametric reverb (which is defined in terms of a small set of parameters, like decay time). Convolution reverb results in more accurate reproduction of early reflections and directionality, but requires more CPU. Parametric reverb requires less CPU, but cannot reproduce early reflections as accurately, especially in outdoor spaces. Hybrid reverb is a hybrid of the two: the early reflections are rendered using an impulse response, and the later reverb tail is rendered using parametric reverb. The transition between the two types of reverb is smooth and controllable, as is the length of the reverb tail. This feature is useful for trading off reverb quality and performance.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Unity Plugin: Additive Scenes
The Unity plugin now has full support for additive scenes. Multiple scenes can be opened additively in the editor, and exported separately. Scenes can be additively loaded and unloaded freely at run-time, and Steam Audio will automatically update occlusion, reflections, and pathing simulation to account for the changes.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

C API Redesign
The Steam Audio C API has been significantly redesigned, with the goal of increasing the flexibility available to developers and sound designers. Developers can control when and how often simulations are run, and can perform arbitrary post-processing before using the simulation results for rendering. For example, after simulating reverb, the length of the reverb tail can be increased or decreased based on the game state. Simulation results can also be used outside of spatial audio rendering: for example, the results of pathing simulation can be used to drive enemy AI.

Due to the major changes in the API and plugin design, this release is not backwards-compatible with previous releases. In-place upgrades are not recommended for existing projects, except those in the earliest stages of development.

This release includes updates to the Unity plugin, FMOD Studio plugin, and C API. An update to the Unreal plugin will be released separately.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

Hier noch das gänzliche Changelog:

Steam Audio SDK 4.0.0
This is a major update to the Steam Audio SDK, and is not backwards-compatible with previous releases.

Major New Features
This release of Steam Audio introduces the following major new features:

Pathing. Steam Audio can simulate and bake propagation paths from moving sources to moving listeners. This allows modeling how sound travels along corridors, through doorways, etc., and applying the appropriate filters and spatialization. Baked paths can also be updated in real-time to respond to occlusions by moving geometry.

Hybrid Reverb. Steam Audio can render reflections and reverb using a technique called hybrid reverb. This is a hybrid of convolution reverb and parametric (artificial) reverb, which involves rendering the early reflections using convolution, and the late reverberation tail using parametric reverb. This allows realistic rendering of large, reverberant spaces, as well as detailed early reflections, with reduced CPU usage as compared to pure convolution reverb. Hybrid reverb also allows the reverb tail length to be controlled by designers to override the simulation results.

The Steam Audio API has been significantly updated. One of the main changes is a cleaner separation between simulation and rendering, which provides more opportunities for designers (or custom game code) to intervene and fine-tune the results generated by Steam Audio. It also allows simulation results to be used outside of spatial audio rendering, for example, the loudness of sound propagation paths can be used to drive enemy AI.

The API documentation has been significantly updated.

Improvements

InstancedMesh objects (dynamic geometry) are now supported using the Phonon ray tracer. In particular, this allows dynamic geometry to be supported on Android.

Direct path simulation (i.e., occlusion, transmission, etc.), reflection simulation, and pathing simulation can be run concurrently.

Switched to using FlatBuffers for serialization.

Materials are now stored in StaticMesh objects instead of Scene objects. This allows static meshes to be easily added and removed from a scene.

OpenCL can now be initialized using existing command queues, instead of newly-created command queues in a newly-created context.

Embree and Radeon Rays are now statically linked into Steam Audio.

Upgraded TrueAudio Next to v1.3.1.1.

Fixes

Disabled flushing denormal numbers to zero by default.

Fixed various potential crashes when using Radeon Rays.

Fixed bug in BVH construction when using the Phonon ray tracer.

Fixed bug in convolution reverb on Android.

Steam Audio Unity Plugin 4.0.0
This is a major update to the Steam Audio Unity Plugin, and is not backwards-compatible with previous releases.
Steam Audio Unity Plugin 4.0.0 requires Unity 2017.3 or later.

Major New Features

Updated to use Steam Audio SDK 4.0.0.

Additive scenes are now fully supported. Multiple scenes can be additively opened in the editor, and exported to separate files. At run-time, scenes can be additively loaded (and unloaded), and Steam Audio will automatically add (and remove) the relevant geometry from its internal copy for simulation.

Exported scene data and baked probe data is stored in .asset files, which can be placed anywhere in in your project's Assets directory, and referenced from within scenes or prefabs. This allows generation of self-contained AssetBundles that contain all necessary Steam Audio data referenced by scenes or prefabs in the AssetBundle. #136

Steam Audio settings are now project-wide, instead of specified per-scene.

There is now a single .unitypackage to import, which includes all binaries for all platforms, including Embree, Radeon Rays, and TrueAudio Next integration, as well as FMOD Studio support. (If you're not using FMOD Studio, you can uncheck the FMOD directory when importing the package.)

The plugin UI has been significantly updated, in particular to allow the use of new Steam Audio features like pathing and hybrid reverb.

The documentation has been significantly updated.

Improvements

Occlusion and transmission simulation now run in the main thread.

Distance attenuation, air absorption, and directivity calculations are now run in the audio thread.

The update rate of reflection and pathing simulation can be controlled using the Simulation Update Interval parameter.

The plugin's directory layout has been reorganized. C# scripts, native plugin binaries, and other data files are all placed in Assets/Plugins/SteamAudio.

The project-wide settings are placed in the Assets/Plugins/SteamAudio/Resources/SteamAudioSettings.asset file.

Acoustic materials are now placed in .asset files. The built-in materials are available in Assets/Plugins/SteamAudio/Resources/Materials. You can create your own materials and place them anywhere, and reference them from Steam Audio Geometry components.

Fixes

Fix various unnecessary GC allocations.

Added a workaround for a potential issue in Unity where distant sounds may play with the wrong volume for the first few frames.

phonon_fmod.dll (or libphonon_fmod.so, etc.) is placed in the correct place in the Assets folder, so FMOD Studio can find and load it.

Steam Audio FMOD Studio Plugin 4.0.0
This is a major update to the Steam Audio FMOD Studio plugin, and is not backwards-compatible with previous releases.
Steam Audio FMOD Studio Plugin 4.0.0 requires FMOD Studio 2.0 or later.

Major New Features

The plugin UI has been significantly updated.

The documentation has been significantly updated.

Improvements

Distance attenuation, air absorption, and directivity calculations are now run in the audio thread.

Distance attenuation curves can be edited directly on the Steam Audio Spatializer. This means you no longer need to add an FMOD Spatializer effect just to control the distance attenuation curve.

Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

SolKutTeR · 20. Februar 2024

Das Ganze ist nun übrigens Open Source.

Steam Audio Open Source Release
We are excited to announce that with the latest release of Steam Audio, the complete source code of the Steam Audio SDK is now available as open source. With this release, our goal is to provide more control to developers, which will lead to better experiences for their users, and hopefully valuable contributions back to the wider community of developers using Steam Audio.

This comes after receiving a lot of valuable feedback and contributions from the community to the plugins already available as open source (Unity, Unreal, and FMOD Studio), and we want to bring those same benefits to the core SDK. This will allow developers to tailor the SDK to their needs, and deliver improved experiences to everyone using the technology. We will also continue our ongoing work on Steam Audio, including the release of bug fixes and new features.

The choice of what features we work on is often driven by the needs of internal projects. For instance, during the development of Half-Life: Alyx, we spent a lot of time working on our hybrid reverb and pathing features, which we later released as part of Steam Audio 4.0.0. These priorities might not always align with partner priorities, so we want to remove roadblocks that prevent partners from implementing spatial audio features that require access to the core Steam Audio SDK. As an example, we may be working on fixing a performance issue in Steam Audio affecting an internal project, but a partner may need Steam Audio ported to a console platform. Making the entire SDK available as open source allows partners to manage the port themselves, and optimize it for their needs, while also allowing them to contribute their changes back if desired.

The entire Steam Audio codebase, including both the SDK and all plugins, is now released under the Apache 2.0 license. This allows developers to use Steam Audio in commercial products, and to modify or redistribute it under their own licensing terms without having to include source code. We welcome contributions from developers who would like to fix bugs or add features to Steam Audio; for more details, see the files LICENSE.md and CONTRIBUTING.md in the GitHub repository.
Klicke in dieses Feld, um es in vollständiger Größe anzuzeigen.

[SteamVR] Steam Audio

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

Nützliche Suchen

[SteamVR] Steam Audio

SolKutTeR ADMIN VRF Team

SolKutTeR ADMIN VRF Team

SolKutTeR ADMIN VRF Team

SolKutTeR ADMIN VRF Team

SolKutTeR ADMIN VRF Team

SolKutTeR ADMIN VRF Team

Nützliche Suchen

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team

SolKutTeR

ADMIN
VRF Team