Page MenuHome

Motion TrackingProject
ActivePublic

Details

Description

Motion tracking for VFX, based on the libmv a structure from motion library.

Mailing List: bf-vfx

Module Owner: @Sergey Sharybin (sergey)
Developer Members: @Keir Mierle (keir)
User Members: @Sebastian Koenig (sebastian_k) @Sean Kennedy (hype)

Recent Activity

Wed, Dec 5

William Reynish (billreynish) accepted D4020: Clip Editor was using wrong icon.
Wed, Dec 5, 9:21 AM · Motion Tracking

Tue, Dec 4

Sergey Sharybin (sergey) closed T55774: Blender 2.8 crash (motion tracking) as Resolved by committing rBbe91d4ef9576: Fix T55774: Crash when reloading clip during prefetch.
Tue, Dec 4, 4:40 PM · Motion Tracking, BF Blender: 2.8
Philipp Oeser (lichtwerk) updated subscribers of T58671: Crash in Blender 2.80 while using video tracking.

@Sergey Sharybin (sergey) might want to check on this?

Tue, Dec 4, 10:37 AM · Motion Tracking, BF Blender: 2.8
Philipp Oeser (lichtwerk) added a comment to T58671: Crash in Blender 2.80 while using video tracking.

ASAN output is P858

Tue, Dec 4, 10:33 AM · Motion Tracking, BF Blender: 2.8
Philipp Oeser (lichtwerk) triaged T58671: Crash in Blender 2.80 while using video tracking as Confirmed priority.

track->markers is garbled.
Will run through ASAN next

Tue, Dec 4, 10:24 AM · Motion Tracking, BF Blender: 2.8
Michael P. (forest-house) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

Just run a test with the "Default" Color Management. The fps was 11 to 13 fps. So the performance is better, but I don't think this is the main issue here.

Tue, Dec 4, 1:26 AM · Motion Tracking, BF Blender: 2.8

Mon, Dec 3

Sebastian Koenig (sebastian_k) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

This sounds very much like an issue with colormanagement. In 2.80 the default view transform is Filmic. In order to display movie clips correctly the correct mapping has to be applied first. This happens during playback. So once the clip has been played back once, the movie was "converted" internally to the correct view transform. That's why playback is realtime the second time you play it.
You can also set View Transform in Color Management panel from "Filmic" to "Default". That should give you better playback performance right from the first play of the movie.
(Sidenote: "Default" is really not an adequate term anymore, since it isn't even the default setting! :)

Mon, Dec 3, 9:27 PM · Motion Tracking, BF Blender: 2.8
Michael P. (forest-house) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

I have tested this with a cache setting of 1024 MB. It prefetches a video, could not see any GUI freezings and the progress bar updates.
But the frame rate is low: around 4 to 9 fps. (I see this in a 3d view port in the left top corner of a camera view).
If I play the video (play button, not prefetching) the frame rate is also 4 to 9 fps. But the second time I play it, the part that was "played" plays now with 24 fps.

Mon, Dec 3, 7:38 PM · Motion Tracking, BF Blender: 2.8
Jacques Lucke (JacquesLucke) raised the priority of T58613: 'Follow Track' constraint | F-Curve doesn't work from Incomplete to Confirmed.

Just as info for others. To reproduce it in the file, you just have to click "Constraint to F-Curve" in the constraint now.

Mon, Dec 3, 2:36 PM · Motion Tracking, BF Blender
Aitor (iriarte93) added a comment to T58613: 'Follow Track' constraint | F-Curve doesn't work.

Here is it the blend file:

Mon, Dec 3, 2:31 PM · Motion Tracking, BF Blender
Jacques Lucke (JacquesLucke) triaged T58613: 'Follow Track' constraint | F-Curve doesn't work as Incomplete priority.

Please provide some .blend file that allows us to easily reproduce the issue.

Mon, Dec 3, 2:20 PM · Motion Tracking, BF Blender
Aitor (iriarte93) created T58613: 'Follow Track' constraint | F-Curve doesn't work.
Mon, Dec 3, 2:17 PM · Motion Tracking, BF Blender
Sergey Sharybin (sergey) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

@Sebastian Koenig (sebastian_k), did i get it correct:

Mon, Dec 3, 10:06 AM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) updated subscribers of T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

My colleague just tested this on Windows10 with the most recent Blender 2.80 build.
While it does prefetch the footage, it does act a bit weird. The interface seems to freeze until the prefetching is done. Unlike in your case however the footage is in memory after prefetching is finished.
Even though the GUI is a bit unresponsive, we could still press the little X in the prefetching progress bar to cancel it. It works pretty much the same as on my Linux system. Our systems are quite good though (32GB, Hexacore). 4GB of system memory is far from ideal for motion tracking, so poor system performance might play a role in your case. Still, I can't really see a bug here.
However, responsiveness when caching movie files could definitely be improved. When prefetching image sequences the interface stays fully repsonsive here, and the way the progress bar is reporting the prefetching progress is more realtime and repsonive as well.
When 2.8 is more stable and there is a bit more time for polishing this might be something to look at, @Sergey Sharybin (sergey)?

Mon, Dec 3, 9:53 AM · Motion Tracking, BF Blender: 2.8
Sean Kennedy (hype) added a comment to T57912: Tracking Pies.

That would be fine, although I use Detect Features more than I use the Track Setting as Default or Copy Track Settings.

Mon, Dec 3, 7:34 AM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T57912: Tracking Pies.

Ah, good one. Maybe instead of Detect Features? This is not used so often...

Mon, Dec 3, 7:20 AM · Motion Tracking, BF Blender: 2.8
Sean Kennedy (hype) added a comment to T57912: Tracking Pies.

This is very nice, seems to be intuitive.

Mon, Dec 3, 1:01 AM · Motion Tracking, BF Blender: 2.8

Sun, Dec 2

Sebastian Koenig (sebastian_k) created D4020: Clip Editor was using wrong icon.
Sun, Dec 2, 11:16 AM · Motion Tracking

Sat, Dec 1

Sebastian Koenig (sebastian_k) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

Interesting. Would be nice if some other windows user could test this. At the very least I'll have my colleagues in the office test this on monday.

Sat, Dec 1, 9:00 PM · Motion Tracking, BF Blender: 2.8
Michael P. (forest-house) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

Ram 4096 MB. Set the value to 3072 MB (good thinking, btw). But still the same issue.

Sat, Dec 1, 8:38 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

How much RAM do you have, and what's set in your User Preferences, in System>General>Memory Cache Limit? If you prefetch and watch your System's memory consumption, is your RAM filling up or not?

Sat, Dec 1, 6:26 PM · Motion Tracking, BF Blender: 2.8
Michael P. (forest-house) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

As described above I use Windows 7. It freezes for a while, then the GUI is responsive again. But the prefetch of the footage didn't happen at all.

Sat, Dec 1, 4:06 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.

I don't see a bug here. It's true, Blender does become unresponsive for a moment, but that's just due to the prefetching of the movie file. Prefetching image sequences works smoother. At least on my system (Linux64bit) I cannot see a difference in prefetching between 2.80 and 2.79.

Sat, Dec 1, 3:32 PM · Motion Tracking, BF Blender: 2.8
Michael P. (forest-house) renamed T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender from Motion Tracking: pre Blender 2.8 file prefetch freezes Blender to Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.
Sat, Dec 1, 1:12 PM · Motion Tracking, BF Blender: 2.8
Michael P. (forest-house) created T58428: Motion Tracking: pre Blender 2.8 file prefetch footage freezes Blender.
Sat, Dec 1, 1:11 PM · Motion Tracking, BF Blender: 2.8

Thu, Nov 29

Bastien Montagne (mont29) triaged T57912: Tracking Pies as Normal priority.
Thu, Nov 29, 11:27 AM · Motion Tracking, BF Blender: 2.8

Wed, Nov 28

Sean Kennedy (hype) added a comment to T58085: Update Clip Editor for 2.80 Toolsystem.

I agree with you for sure that Blender's accuracy is spectacular. :)

Wed, Nov 28, 4:43 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T58085: Update Clip Editor for 2.80 Toolsystem.

@Sean Kennedy (hype) You have probably tracked in way more programs than me, but at least in the handful of tracking programs I tried none of them had the same approach to super accurate supervised tracking like we have eihter. I think in Blender the single marker plays a more important role by itself than elsewhere, so I think it's fine if UI reflects that.

Wed, Nov 28, 4:10 PM · Motion Tracking, BF Blender: 2.8
Sean Kennedy (hype) added a comment to T58085: Update Clip Editor for 2.80 Toolsystem.

I'm excited to see these tools in the topbar to see how it really feels in action.

Wed, Nov 28, 4:03 PM · Motion Tracking, BF Blender: 2.8
Philipp Oeser (lichtwerk) triaged T58085: Update Clip Editor for 2.80 Toolsystem as Normal priority.
Wed, Nov 28, 2:11 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) updated the task description for T58085: Update Clip Editor for 2.80 Toolsystem.
Wed, Nov 28, 8:43 AM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T58085: Update Clip Editor for 2.80 Toolsystem.

I am not sure about merging the track settings to just one panel. It would be a regression to 2.79, where we have those settings separated.

Wed, Nov 28, 8:42 AM · Motion Tracking, BF Blender: 2.8
Sean Kennedy (hype) added a comment to T58085: Update Clip Editor for 2.80 Toolsystem.

Would it be possible to only have one set of Track Settings? Whatever it is set to when you create a new track, that's what the new track uses. If you have a track selected, those controls then apply to that selected track. It's confusing having two, and this would streamline it quite a bit.

Wed, Nov 28, 7:08 AM · Motion Tracking, BF Blender: 2.8

Tue, Nov 27

William Reynish (billreynish) added a comment to T58085: Update Clip Editor for 2.80 Toolsystem.

This sounds right to me.

Tue, Nov 27, 1:20 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) created T58085: Update Clip Editor for 2.80 Toolsystem.
Tue, Nov 27, 1:12 PM · Motion Tracking, BF Blender: 2.8

Mon, Nov 19

Sergey Sharybin (sergey) closed T57898: Motion tracking 'Display what the algorithm sees in the preview' not working while testing R or G or B options as Resolved.

This got fixed by rB9b8d479e414.

Mon, Nov 19, 1:33 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T57912: Tracking Pies.

I have changed some of the shortcuts.
The Alt key is now being avoided, because on a Mac it is not as comfortable to reach as the shift-key.
So:
Tracking Pie: 'E'
Setup Marker: 'Shift + E'
Setup Display: 'Shift + D'
Setup Tracking Scene: 'Shift + W'
Solve: 'Shift + S'
I find these very comfortable to reach and execute.
Compared to the clip editor hotkeys in 2.79 we would sacrifice Shift+D, which was used for the 'Disable Marker' Hotkey.
However, that operator is in the Tracking Pies at the bottom, very easy to reach.
And the 'Show Disabled Markers' toggle is now at the bottom of the Setup Display Pie, so in the same position, hence very easy to remember.
Following that logic I think we can also remove the hotkey Alt+D, currently used for the "Show Disabled Markers" toggle.
And I would vote for having the tracking pies enabled by default.

Mon, Nov 19, 10:23 AM · Motion Tracking, BF Blender: 2.8

Sun, Nov 18

Sebastian Koenig (sebastian_k) added a comment to T57912: Tracking Pies.

Thanks a lot for the feedback!
I agree about the lacking feedback for a toggle in a pie menu possibly being an issue. However, I would like to keep most of them because it makes the workflow so much faster. And they still can be used in a gesture style interaction, contrary to some other pie menues from the community, where there are multiple entries pre pie-slot, something I consider opposite to the idea behind our pie menu implementation. But I'll have a look again and see if some can be replaced.
About hotkeys, well, the left side is pretty crowded. Q, W, A, S, R, D, X, C are all taken. I find combinations of Shift and E, W, S still very easy and comfortable to execute with the left hand. I was about to say the same about Alt+E as well, but I am typing this reply on my macbook, and there the Alt key is in a less comfy place. So I'll have a look at the keys again. :)

Sun, Nov 18, 8:40 PM · Motion Tracking, BF Blender: 2.8
William Reynish (billreynish) added a comment to T57912: Tracking Pies.

This seems generally ok I think.

Sun, Nov 18, 7:30 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a project to T57912: Tracking Pies: Motion Tracking.
Sun, Nov 18, 5:39 PM · Motion Tracking, BF Blender: 2.8
Christopher Anderssarian (Christopher_Anderssarian) edited projects for T57898: Motion tracking 'Display what the algorithm sees in the preview' not working while testing R or G or B options, added: BF Blender: 2.8, Motion Tracking; removed BF Blender.
Sun, Nov 18, 4:25 PM · Motion Tracking, BF Blender: 2.8

Sep 11 2018

Daniele (madmage) added a comment to T56413: Setup Tracking Scene not working in 2.8.

...in particular, I do not think that an error message is a good solution for a problem. I would better disable that button (or hide it) in case Cycles is not used. What is still missing, I think, is a button that simply put the solver constraint on the camera (without anything else related to adding objects to the scene I mean).

Sep 11 2018, 10:07 AM · Motion Tracking, BF Blender: 2.8

Sep 6 2018

Daniele (madmage) added a comment to T56413: Setup Tracking Scene not working in 2.8.

I do not think it can be considered "resolved": the commit considered as the Fix, as far as I understand, works only with Cycles, and I (and I think a lot of people like me) do not understand how to switch the Motion Tracker to Cycles (switching it in the render tab does not work).

Sep 6 2018, 5:43 PM · Motion Tracking, BF Blender: 2.8

Aug 21 2018

Dalai Felinto (dfelinto) closed T56413: Setup Tracking Scene not working in 2.8 as Resolved by committing rB17c245e29459: Fix T56413: Setup Tracking Scene not working in 2.8.
Aug 21 2018, 4:32 PM · Motion Tracking, BF Blender: 2.8

Aug 19 2018

Sebastian Koenig (sebastian_k) added a comment to T56413: Setup Tracking Scene not working in 2.8.

@Dalai Felinto (dfelinto) I am wondering if it even makes sense to have an EEVEE setup at this point. As far as I can see EEVEE does not have something like a shadow catcher, nor can collections ins view_layers be set to holdout, which is both kind of important for a working setup. So I would first make it use Cycles.

Aug 19 2018, 1:36 PM · Motion Tracking, BF Blender: 2.8

Aug 18 2018

Sebastian Koenig (sebastian_k) added a comment to T56413: Setup Tracking Scene not working in 2.8.

I have managed to make the Setup_Tracking_Scene operator work without errors by disabling the old BI and layer stuff, now I am trying to make the renderlayer setup work again.
However, it seems as if there are some python bindings missing still.
To make the setup work I am planning to have 2 Viewlayers, Background and Foreground (as was already implemented in the new script), with two collections, "background" and "foreground". In the Foreground viewlayer, the background collection will be set to "holdout", in the Background view_layer the foreground collection will be set to indirect only.
I can make the setup work with the outliner View_Layer menu, however I could not find a way to do that via python. Something like bpy.context.scene.view_layers["Background"].collections["foreground"].holdout = True
That or at least something similar does not seem to exist yet.
Or if it does, maybe someone can give me a hint?

Aug 18 2018, 9:42 AM · Motion Tracking, BF Blender: 2.8

Aug 16 2018

Dalai Felinto (dfelinto) updated subscribers of T56413: Setup Tracking Scene not working in 2.8.

I will have a look

Aug 16 2018, 4:24 PM · Motion Tracking, BF Blender: 2.8
Sebastian Koenig (sebastian_k) added a comment to T56413: Setup Tracking Scene not working in 2.8.

I will have a look. Maybe first just kick out all the old stuff so that at least the basic setup of constraints and background images work. Speaking of which, the whole camera background image stuff doesnt seem to work all that great yet. Footage is always drawn in front of objects, no matter the front/back setting in camera background images. Also the colors are completely off in solid mode.

Aug 16 2018, 11:15 AM · Motion Tracking, BF Blender: 2.8
lower case (lowercase) added a comment to T56413: Setup Tracking Scene not working in 2.8.

how about an option to make a simple setup using a shadow catcher plane and just one render layer..? that is often enough to have a working scene

Aug 16 2018, 2:56 AM · Motion Tracking, BF Blender: 2.8
Dalai Felinto (dfelinto) triaged T56413: Setup Tracking Scene not working in 2.8 as Normal priority.

@Sebastian Koenig (sebastian_k) maybe this is something you could help with?

Aug 16 2018, 12:37 AM · Motion Tracking, BF Blender: 2.8