VSeeFace & OSC Motion Data

I’m completely new to all things OSC but I’ve been using VSeeFace as a poor man’s motion capture option. VSeeFace can both recieve and send OSC data. I’m able to caputre an OSC stream from VSeeFace onto the TWO Timeline, but when I press play to play back, TWO crashes. Every time. I’d love to explore the potential of TWO and VSeeFace working together, but I’m not sure if it’s even possible. Am I missing something? Any idea why it crashes? The clips definitely seem to be recording data so I’m hopeful there’s a fix. Thanks!

That’s not good at all, but the good news is a crash that consistently reproducible should be easy to fix, I will look right into it!
I’ve never used VSeeFace, didn’t know about it but I should be able to get the hang of it quickly enough.

It’d be helpful if you could tell me what OS you are on, what version of TWO you are running, and what would be most helpful of all is if you could save and send me a .two file with the recorded data - just record and save before pressing play and it should be fine :slight_smile:

Uploading it here should work, otherwise just email it to onar3d at gmail dot com.

Thank you for reporting this!

Thanks so much for the fast response! Please see my specs below. Will have to email the files as new users are not allowed to upload files :slight_smile:

TWO version: 0.9.14

Windows version:
Edition Windows 10 Home
Version 20H2
Installed on ‎9/‎23/‎2021
OS build 19042.1237
Serial number MJ0EZ8HL
Experience Windows Feature Experience Pack 120.2212.3530.0

Device name DESKTOP-MO4PSO8
Processor Intel(R) Core™ i7-10700K CPU @ 3.80GHz 3.79 GHz
Installed RAM 16.0 GB (15.8 GB usable)
System type 64-bit operating system, x64-based processor
Pen and touch No pen or touch input is available for this display

1 Like

Hi,thank you for the files!

I’m not sure about how VSeeFace will respond to having the entirety of the OSC stream it produces transmitted back to it - AFAIK no other software than TWO allows that (but I’d love to stand corrected), and I’m very nearly certain that the developers of VSeeFace have never tested the use-case.

I’ve seen this problem with Resolume for example - if you record everything it produces, and then send the entire stream back, it doesn’t react well, with jumpy/jittery movement, because it just wasn’t made/tested with that in mind!

There are workarounds, for example filtering out / removing certain messages (in the case of Resolume the high-density “position” ones), but with VSeeFace I’m not sure.

I’ve given it a spin with your files and indeed experience instability in TWO, it freezes, probably because of the high density of the data. I will definitely work on fixing that and am grateful for the test files!

Is there perhaps some VSeeFace project I should have too or do I just fire it up?

Last question, when you say it crashes, do you mean it freezes and becomes unresponsive, or a straight-up crash with a “segmentation fault” dialogue?

Best,
Ilias B.

Hello! Regarding the crashing, when I press play on the timeline, there is <second when the playhead starts to advance, then the entire window/UI simply disappears. The software completely shuts down. I don’t get any dialog box or crash report of any kind.

I emailed a generic VSeeFace compatible VRM model directly to you. This is a model I use to set up my system (but not the model I use for actual motion capture). Most of VSeeFace users use Anime style models for VTubing and vitrual interactions, but I’m not using it for that. I have an animated robot mascot for some children’s programming which I’m trying to create customized animations for. Because of this, I realize that my use case for both TWO and VSeeFace are not typical, but I think it still falls within the limits of their capabilities.

There’s no VSeeFace project for you to use, but if you simply activate your webcam, you’ll get motion to the head and shoulders and that should be enough to send on to TWO.

I’m going to spend my weekend diving into TWO’s documentation to explore it’s capabilities. It’s amazing software! Thanks for your help!

1 Like

Hi!

Unfortunately it doesn’t crash on my Windows machine with your test files.

I will do a few more tests to see if I can make it fail though, and if not, I’ll look into if I can send you a special build which writes a log file when crashing.

Meanwhile I see that VSeeFace generates a lot of data, about 60000 messages for 19 seconds - after finding a fix for the crash I’d be curious to see if it doesn’t support features to reduce the message count, to make working with it easier.

One last test which would be useful for diagnosing:
If you have a moment, open the file C:/Program Files/TWO/Examples/AudioVisualBach/AudioVisualBach 0.9.10.two, and press play in the Timelines view - does it crash there too for you, or does it work fine?

Hi!

Since I found I cannot reproduce the crash on my machine, I made a special debug build of TWO which you can download from here:

https://drive.google.com/file/d/1lraLqMjKf0gT-fIDMhQPSkuvbY8LAR6o/view?usp=sharing

It will be much slower than the release so don’t replace your normal install with it - instead you should unpack and run it from a temp folder.

When there’s a crash TWO will create two files in your user folder - mine is: C:\Users\Onar3D\AppData\Local - for your it will be different since your account will not be named Onar3D.

It will be two files, one named TWO_CrashLog_26 Sep 2021 11_34_05.dmp, the other TWO_CrashLog_26 Sep 2021 11_34_05.txt.

zip them up and email them to me!

(TWO will try to email them automatically, but depending on how your computer’s default email handler is set up that may or may not work).

Their content will help me diagnose what happens on your machine.

Thank you!

Ilias B.

Hello,

I was indeed able to playback the example files you suggested. Those seemed to open and play with no problems.

I forgot to mention that I actually installed TWO onto two computers. A Lenovo laptop and Lenovo desktop (the specs I sent you previously were for the desktop. Specs below are for the laptop I’m working on this weekend) Both of them crashed in identical ways, so it’s really interesting that your system didn’t crash.

Regarding the Crashlog install version you sent, unfortunately I got errors and was unable to install. Pics below of the error messages. Please advise.

thanks again,
Dave

Device name LAPTOP
Processor Intel(R) Core™ i9-10980HK CPU @ 2.40GHz 3.10 GHz
Installed RAM 32.0 GB (31.9 GB usable)
System type 64-bit operating system, x64-based processor
Pen and touch No pen or touch input is available for this display
Edition Windows 10 Home
Version 21H1
Installed on ‎9/‎26/‎2021
OS build 19043.1237
Serial number MP1TDP34
Experience Windows Feature Experience Pack 120.2212.3530.0

Screenshot 2021-09-26 191622
Screenshot 2021-09-26 191648
Screenshot 2021-09-26 191740
Screenshot 2021-09-26 191755

Hello. I was wondering if you had seen this post. The log file version of the app won’t install on my system.