Motion Tracking Keyframe A & B, relative not absolute. #86456

Closed
opened 2021-03-10 13:47:00 +01:00 by Richard Lyons · 12 comments

System Information
Operating system: Darwin-19.6.0-x86_64-i386-64bit 64 Bits
Graphics card: NVIDIA GeForce GT 650M OpenGL Engine NVIDIA Corporation 4.1 NVIDIA-14.0.32 355.11.11.10.10.143

Blender Version
Broken: version: 2.92.0, branch: master, commit date: 2021-02-24 16:25, hash: 02948a2cab
Worked: (newest version of Blender that worked as expected)

Short description of error
Not sure if this is an actual bug or more a design discussion. When setting the values of Keyframe A & B in motion tracking "solve" panel. They seem to be relative to the clip.
When working in a VFX pipeline we almost always start clips from frame 1001.... This allows to work with preroll, or fix effects on frames before the start frame without running into minus frame numbering problems.
However, when one moves the clip to 1001... and then enters for example 1010 & 1070 in Keyframe A & B respectively, I get the "At least 8 common tracks on both keyframes are needed for reconstruction" error, even tho there are 8 tracks. It works fine if I change the frames to 10 & 70 instead.

Exact steps for others to reproduce the error
[Please describe the exact steps needed to reproduce the issue]
[Based on the default startup or an attached .blend file (as simple as possible)]

**System Information** Operating system: Darwin-19.6.0-x86_64-i386-64bit 64 Bits Graphics card: NVIDIA GeForce GT 650M OpenGL Engine NVIDIA Corporation 4.1 NVIDIA-14.0.32 355.11.11.10.10.143 **Blender Version** Broken: version: 2.92.0, branch: master, commit date: 2021-02-24 16:25, hash: `02948a2cab` Worked: (newest version of Blender that worked as expected) **Short description of error** Not sure if this is an actual bug or more a design discussion. When setting the values of Keyframe A & B in motion tracking "solve" panel. They seem to be relative to the clip. When working in a VFX pipeline we almost always start clips from frame 1001.... This allows to work with preroll, or fix effects on frames before the start frame without running into minus frame numbering problems. However, when one moves the clip to 1001... and then enters for example 1010 & 1070 in Keyframe A & B respectively, I get the "At least 8 common tracks on both keyframes are needed for reconstruction" error, even tho there are 8 tracks. It works fine if I change the frames to 10 & 70 instead. **Exact steps for others to reproduce the error** [Please describe the exact steps needed to reproduce the issue] [Based on the default startup or an attached .blend file (as simple as possible)]
Author

Added subscriber: @RichardLyons

Added subscriber: @RichardLyons
Member

Added subscriber: @filedescriptor

Added subscriber: @filedescriptor
Member

I would like to reproduce this, but it would be good to know what your settings are. E.g. the "Start Frame" and "Frame Offset" in the "Footage Settings" and then your start and end frame in the scene. Ideally, you could add a .blend file to the report (with a sample clip packed File>External Data>Pack All Into .blend) to illustrate the problem.

I would like to reproduce this, but it would be good to know what your settings are. E.g. the "Start Frame" and "Frame Offset" in the "Footage Settings" and then your start and end frame in the scene. Ideally, you could add a `.blend` file to the report (with a sample clip packed *File*>*External Data*>*Pack All Into .blend*) to illustrate the problem.

Added subscribers: @Sergey, @sebastian_k

Added subscribers: @Sergey, @sebastian_k

If I understand you correctly, you do not enter an offset in the footage settings, but change the start frame of the clip.
In that case, yes, you are right, this behaves a bit weird.
The little green lines down in the cache area appear in the correct spot, but the numbers in the Keyframe A, Keyframe B fields are off.
During testing I have prepared a file that demonstrates the issue.
tracking_keyframes.blend
There are two issues here:
First: the keyframe numbers do not reflect the "correct" frames, even though they work fine.
Second: Entering the numbers in the keyframe field does not trigger a viewport update, so the little green lines only change when you e.g. change the frame.

I am not quite sure if this really is a bug, but it definitely feels buggy. Maybe @Sergey can have a look?
I never noticed this because neither do I work this way, nor do I enter the numbers manually but always use the solving pie for this: Shift-S brings up the solving pie, and in the upper left and upper right corners are the Set Keyframe Operators.

Btw, I did not find the keyframe opertors in any menu. I'll write a patch for that.

If I understand you correctly, you do not enter an offset in the footage settings, but change the start frame of the clip. In that case, yes, you are right, this behaves a bit weird. The little green lines down in the cache area appear in the correct spot, but the numbers in the Keyframe A, Keyframe B fields are off. During testing I have prepared a file that demonstrates the issue. [tracking_keyframes.blend](https://archive.blender.org/developer/F9883109/tracking_keyframes.blend) There are two issues here: First: the keyframe numbers do not reflect the "correct" frames, even though they work fine. Second: Entering the numbers in the keyframe field does not trigger a viewport update, so the little green lines only change when you e.g. change the frame. I am not quite sure if this really is a bug, but it definitely feels buggy. Maybe @Sergey can have a look? I never noticed this because neither do I work this way, nor do I enter the numbers manually but always use the solving pie for this: Shift-S brings up the solving pie, and in the upper left and upper right corners are the Set Keyframe Operators. Btw, I did not find the keyframe opertors in any menu. I'll write a patch for that.
Author

Hi guys,
Yes, the image sequence I am using is numbered from frame 1001. So I don't use offset in the footage settings, just set the start frame to 1001.
Unfortunately the footage is under NDA, so I cannot send the images. I could upload the blend without, footage if that helps. But I honestly think Sebastian has correctly interpreted the problem/feature :)

Hi guys, Yes, the image sequence I am using is numbered from frame 1001. So I don't use offset in the footage settings, just set the start frame to 1001. Unfortunately the footage is under NDA, so I cannot send the images. I could upload the blend without, footage if that helps. But I honestly think Sebastian has correctly interpreted the problem/feature :)

This issue was referenced by 30ee57be60

This issue was referenced by 30ee57be60b76b75b6bbf4f780aa670e26502659
Member

Added subscriber: @lichtwerk

Added subscriber: @lichtwerk
Member

Changed status from 'Needs Triage' to: 'Needs Developer To Reproduce'

Changed status from 'Needs Triage' to: 'Needs Developer To Reproduce'
Member

First: the keyframe numbers do not reflect the "correct" frames, even though they work fine.
I am not quite sure if this really is a bug, but it definitely feels buggy. Maybe @Sergey Sharybin (sergey) can have a look?

I would not consider this a bug (to me it seems like having this relative to the startframe has both upsides and downsides -- and in code this is handled correctly, both for the UI indicators as well as in the solving process).
But I guess it would be good if @Sergey has a final word here.
If this is not considered a bug, it might be good to document this in https://docs.blender.org/manual/en/dev/movie_clip/tracking/clip/toolbar/solve.html

> First: the keyframe numbers do not reflect the "correct" frames, even though they work fine. > I am not quite sure if this really is a bug, but it definitely feels buggy. Maybe @Sergey Sharybin (sergey) can have a look? I would not consider this a bug (to me it seems like having this relative to the startframe has both upsides and downsides -- and in code this is handled correctly, both for the UI indicators as well as in the solving process). But I guess it would be good if @Sergey has a final word here. If this is not considered a bug, it might be good to document this in https://docs.blender.org/manual/en/dev/movie_clip/tracking/clip/toolbar/solve.html

Changed status from 'Needs Developer To Reproduce' to: 'Resolved'

Changed status from 'Needs Developer To Reproduce' to: 'Resolved'
Sergey Sharybin self-assigned this 2021-05-03 16:16:26 +02:00

The relative behavior of the keyframes is how they were designed to: you can think of it as "this picture A and that picture B is what defines the keyframes". Where exactly they are mapping in time is a bit irrelevant from the solver perspective.

The lack of refresh is supposed to be fixed now after commit from Philipp.

Thanks for the report, but the remaining parts here aren't really a bug.

The relative behavior of the keyframes is how they were designed to: you can think of it as "this picture A and that picture B is what defines the keyframes". Where exactly they are mapping in time is a bit irrelevant from the solver perspective. The lack of refresh is supposed to be fixed now after commit from Philipp. Thanks for the report, but the remaining parts here aren't really a bug.
Sign in to join this conversation.
No Label
Interest
Alembic
Interest
Animation & Rigging
Interest
Asset Browser
Interest
Asset Browser Project Overview
Interest
Audio
Interest
Automated Testing
Interest
Blender Asset Bundle
Interest
BlendFile
Interest
Collada
Interest
Compatibility
Interest
Compositing
Interest
Core
Interest
Cycles
Interest
Dependency Graph
Interest
Development Management
Interest
EEVEE
Interest
EEVEE & Viewport
Interest
Freestyle
Interest
Geometry Nodes
Interest
Grease Pencil
Interest
ID Management
Interest
Images & Movies
Interest
Import Export
Interest
Line Art
Interest
Masking
Interest
Metal
Interest
Modeling
Interest
Modifiers
Interest
Motion Tracking
Interest
Nodes & Physics
Interest
OpenGL
Interest
Overlay
Interest
Overrides
Interest
Performance
Interest
Physics
Interest
Pipeline, Assets & IO
Interest
Platforms, Builds & Tests
Interest
Python API
Interest
Render & Cycles
Interest
Render Pipeline
Interest
Sculpt, Paint & Texture
Interest
Text Editor
Interest
Translations
Interest
Triaging
Interest
Undo
Interest
USD
Interest
User Interface
Interest
UV Editing
Interest
VFX & Video
Interest
Video Sequencer
Interest
Virtual Reality
Interest
Vulkan
Interest
Wayland
Interest
Workbench
Interest: X11
Legacy
Blender 2.8 Project
Legacy
Milestone 1: Basic, Local Asset Browser
Legacy
OpenGL Error
Meta
Good First Issue
Meta
Papercut
Meta
Retrospective
Meta
Security
Module
Animation & Rigging
Module
Core
Module
Development Management
Module
EEVEE & Viewport
Module
Grease Pencil
Module
Modeling
Module
Nodes & Physics
Module
Pipeline, Assets & IO
Module
Platforms, Builds & Tests
Module
Python API
Module
Render & Cycles
Module
Sculpt, Paint & Texture
Module
Triaging
Module
User Interface
Module
VFX & Video
Platform
FreeBSD
Platform
Linux
Platform
macOS
Platform
Windows
Priority
High
Priority
Low
Priority
Normal
Priority
Unbreak Now!
Status
Archived
Status
Confirmed
Status
Duplicate
Status
Needs Info from Developers
Status
Needs Information from User
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Known Issue
Type
Patch
Type
Report
Type
To Do
No Milestone
No project
No Assignees
6 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: blender/blender#86456
No description provided.