Microsoft Kinect 2.0 Tools
|Date:||12 Jan, 2017|
- Playback (Kinect2 Tools Microsoft)
Create playback of sensor stream using Kinect for Windows Tools, aplications using Kinect2 will receive content of this playback
*Extract and save the frames from the XEF files containg Kinect stream recording, use StepOnce when real-time saving is not possible. *Prototype kinect interactions without the need to physically interact, prerecord the interaction session and replay it while developing *Experiment with Kinect without the device attached (get DX11 pack sources or compiled release from after 11 Jan 2017) *Workshop scenarios often do not allow everyone to have the device connected. Playback the recorded example session.
- Record (Kinect2 Tools Microsoft) Alpha
Create recording of sensor stream using Kinect Tools. Known issues: *While the recording is in progress, the node does not update it's outputs such as FileSize, Duration and BufferInUseSize.
Kinect 2.0 SDK or runtime, DX11 Pack (optional)
Kinect for Windows Runtime 2.0 https://www.microsoft.com/en-us/download/details.aspx?id=44559
Kinect for Windows SDK 2.0 https://www.microsoft.com/en-us/download/details.aspx?id=44561
DX11 Pack by @vux (compiled) directx11-nodes-alpha
Kinect 2.0 node untethered (if your DX11 pack is released before 11 Jan 2017) http://id144.org/uploads/VVVV.DX11.Nodes.Kinect2.dll
Link to the sample XEF file. 14 seconds, 2GB is in the help patch of the Playback node. Contains dancers Liam Francis and Stephen Quildan from Rambert Dance Company.
Created by Andrej Boleslavský id144 as a research part of the project DUST in artistic collaboration with Mária Júdová, creative producer Carmen Salas, funded by Arts Council England http://vrdust.org.uk
CC BY-SA-NC 4.0 For commercial use please contact me at email@example.com
CommentsComments are no longer accepted.
Please create a new topic in the vvvv beta forum to discuss this contribution.
There is also an alternative version of the tools created by @ravazquez https://discourse.vvvv.org/t/creating-kinect-tools-client-stops-mainloop/14434/8
Sounds awesome, i"ve had need of this before, I had a crazy workflow involving exporting to obj files from brekl, time and space consuming!
This is really great!
Regarding filesize and recording: How long can you record a session without it being a problem to play without framefrops / loading issues?
asking because it seems like something i will end up using on a laptop :)
good questions, we are using this plugins over the course of last three months while creating our VR artwork Dust. http://vrdust.org.uk
We already recorded more than 3TB of xef files, converted into another 3TB of DDS :D. We used laptops with SSD too.
If you do have internal SSD, you should be able to record files without framedrops, there is buffering into ram. set the buffer size accordingly. 10 minutes could give you file that is around 100GB so make sure to have of SSD space ready. Be aware I had a situations during the recording when SSD was writing the files with 20% of declared speed as a result, with 16GB RAM I was able to record for ~80seconds.
There is a limitation, Record node does not indicate the file size and buffer usage, but you can read those values indirectly with other tools (Taskmanager, FileExplorer) or nodes.
USB3 SSD could be an option as long as it sits on a different USB controller than Kinect. Kinect itself will consume significant part of the bandwidth.
There might be a framedrop, but Kinect studio plays the frames according to their timecode. If there is missing frame, Kinect nodes will not deliver new frame. This can become a problem when you store your recording as an indexed DDS sequence. So we store our sequences timecoded, not indexed to prevent desync with audio.
Playback is quite smooth, you may have large files, as long as you are able to read them realtime presumably from SSD, there are no framedrops (when are no framedrops in recording file itself). If you need to export or store the frames and you are not able to read and write realtime, use StepOnce pin of the Playback node.
Thank you for this great tool. The player can read a saved xef file without problem, however, I found that the kinect hardware still have to be connected. It doesn't work without the device attached.
hi @neuston, thanks!
did you try with recent release of dx11? i hope this is not a " ¯_(ツ)_/¯ it works on my machine " situation. :D
directx11-nodes "vvvv-packs-dx11-1.0.1-x64.zip - 08.02.17 <12:23%20UTC> by vux"