Ambisonics have been known by us to be a solution to binaural head tracked listening to 3D sound tracks for a long time. For me the first i saw about that was from Angelo Farina 2006, but then Head trackers and binaural binaural decoding programs and ambisonic recording was not available to me. See reference segment las in mail, below >>>>>>>>>>>>>>>>>>>>
But today in November 2014 The status is NOT the same. 1 - I do record FOA ambisonics with a Core-sound mic and a DR-680 2 - I have a DIY Head Tracker http://www.rcgroups.com/forums/showthread.php?t=1677559 to use eith windows 3 - We have installed the AmbiX program suite written by Matthias Kronlachner. Playback Ambisonics to Binaural with Head tracking on a Windows PC, download Instructions and program here: http://www.matthiaskronlachner.com/?p=2091 Head tracking for Binaural Ambisonic Playback http://www.matthiaskronlachner.com/?p=2015 ambiX v0.2.2 - Ambisonic plug-in suite - GPL using a DIY head tracker and plugin to convert head direction signals to OSC messages. Using the www.reaper.fm/ DAW as player, converting signal from Head tracker to OSC messages http://opensoundcontrol.org/introduction-osc for direction control of decoding. The above GPL based solution works and have the possibility to be expanded to accept direction data from different head trackers. So what is the problem then? A usual I want more! But the problem with us "sursounders" seems to be, we are all busy searching for the holy grail and do not promote and use what we have! Can we for once try to push something that can be seen as GOOD ENOUGH by outsiders? Taking the example of MP3, starting small like low bitrate MP3 and then taking over the world :-) Do we have any individuals among us that can take an initiative and take contact with the Virtual Reality crowd that concentrates on Video to lobby for them to include 3D sound in their environments and programs? A few of the projects could be suitable to lobby is listed below, to my understanding a few of them are open source, so students could take assignments to assist in integrating FOA ambisonics to them? There is intense activity going on with Picture and Video applications for watching with Direction of view control! - Games - a few use Ambisonics for creation of sound. - Google Streetview - DIY Spherical panoramas - Included in android phones now! - Spherical Video Blogs - VR Viewers - for example Oculus Rift. Is this the "Ambisonic Bucket List"? ############################ - Show How to integrate Ambisonics with headtracked Spherical video or static 3d panoramas like Google street view or VRviewers. - A good enough compression program for FOA .amb tracks, is that Flac, Wavepack, OGG but appearently not MP3? Any other alternative? - A streaming solution for FOA - is that needed? I have not quite understood the issues with that... - Show how to integrate ambisonics in MKV files for bot creation and playback. - Upsampling of FOA for binaural decoding or do we already have that? - sorry Matthias i have not read and understood the internals of your AmbiX suite. Bo-Erik Sandholm Stockholm, Sweden As always, views here have no relationship to my employer. A few starting points for eventual cooperation opportunities and project ideas : -------------------------------------------------------------------------------- We have a SOLUTION how to play head tracked binaural sound, can we get this integrated into applications like the ones below? Problem description and an indication of how to attack Sound for VR video players, but they had not seen our solution when they wrote the blog: http://elevr.com/audio-for-vr-film/ Browser based VR apps - maybe the browser based vr.js ? https://github.com/benvanik/vr.js/blob/master/README.md Can support for the head trackers below be borrowed and added to Matthias head tracker driver to OSC sender converter program or in to ambiexplorer, Or can the ambisonic support from ambiexplorer be ported to this player https://vrplayer.codeplex.com/ For Android. Features Read 2D/3D images and videos Read local files, streams (including youtube), disc, and more! Supported format: mono, over-under, side. 3D audio base on orientation and position. Preset files to auto-configure application settings Available projections: Plane (For regular movies projected on a virtual screen) Cube (Often used in video games) Cylinder (Mainly for panoramic pictures) Dome (For action cameras like the go pro) Full dome (For imax style experiences) Sphere (For 360 videos) Custom geometry imported from Maya or 3D Studio (For experimenting with other typologies) Available trackers for orientation and position mouse Oculus Rift Wiimote with Motion Plus PS Move controller Razer Hydra Microsoft Kinect VRPN client Track IR LEAP motion YEI 3-space. Oculus Reverse engineering Oculus Rift protocols http://yetifrisstlama.blogspot.fr/2014/03/the-foculus-rift-part-2-reverse.html A finding that might relat to other magnetic sensors?: I think glitches actually come from the LSM303 magnetometer sensor. First I thought it is a synchronization issue. But it turned out, the only way to get rid of them was to reduce the output data rate of the sensor from 220 Hz to 75 Hz. https://github.com/yetifrisstlama/Foculus_Rift_Tracker_STM32F3DISCOVERY Firmware for the STM32F3DISCOVERY board to emulate an Oculus Rift compatible USB motion tracker http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6906608 Head Tracking for the Oculus Rift Abstract - We present methods for efficiently maintaining human head orientation using low-cost MEMS sensors. We particularly address gyroscope integration and compensa- tion of dead reckoning errors using gravity and magnetic fields. Although these problems have been well-studied, our performance criteria are particularly tuned to optimize user experience while tracking head movement in the Oculus Rift Development Kit, which is the most widely used virtual reality headset to date. We also present novel predictive tracking methods that dramatically reduce effective latency (time lag), which further improves the user experience. Experimental results are shown, along with ongoing research on positional tracking. Head tracking on DK2 https://www.youtube.com/user/glixylpoussin https://www.youtube.com/watch?v=WC5_ElRnPS4 Published august 5 2014 A viewer requested to see HD textures on the Oculus Rift DK2. The head tracking works, but not the positional tracking. In this video I show what it looks like so far. I am working on a Minecraft mod pack that is Rift optimized. However, only Forge mods that don't change EntityRenderer on the Rift will work with the Minecrift driver in its current state. I am hoping that with the 1.7.10 version that will change and Rift mod packs will be more feature rich. Visit http://glixyl.wordpress.com for my mod pack library and links to my Technic pages. Here is the link to the early-release Minecrift for DK2 if you want to play with it until all the new DK2 features are support on MC1.7.10. http://www.mtbs3d.com/phpbb/viewtopic... NEW: link to Minecrift for Minecraft 1.7.10 (non-Forge) with positional tracking. http://beta.stashbyte.com/u/codewaffle >>>>>>>>>>>>>>>>>>>> SURSOUND REFERENCE extracts: Monday 2006-04-03 16:31 Angelo Farina Re: [Sursound] other than Ambisonics (Enda Bates) Pure binaural head-tracking is a mess, and it requires a lot of computational load. Instead, head-tracking and rotating a B-format signal is trivial, and thereafter a static Ambisonics-to-Binaural renderer can be employed, resulting in faster response to the headtracker, smoother rotation and much lesser computational load. At the point that nowadays any serious head-tracking binaural reproduction system is employing Ambisonics internally.... >>>>>>>>>>>>>>>>>>>> My call for Head tracking improvements and software for windows and Linux. sunday 2014-01-19 21:31 Listening to FOA B-Format with head tracking I was inspired by Hectors android app ambiexplorer that was not compatible with my old android phone. Current status on ANDROID: Android app Ambiexplorer created by Hector Centero http://www.hcenteno.net/software.html demo here V2: https://www.youtube.com/watch?v=gOsfo8or_0E >>>>>>>>>>>>>>>>>>>> Was answered by Matthias Kronlachner on 2014-04-30 18:46 Re: [ Surround sound and better binaural reproduction] He gifted us with plugins and programs for Windows to listen to FOA with a DIY head tracker. _______________________________________________ Sursound mailing list Sursound@music.vt.edu https://mail.music.vt.edu/mailman/listinfo/sursound - unsubscribe here, edit account or options, view archives and so on.
