Animation Generator using Natural Language #47588

New Issue

Sophie Shen · 2016-02-26T17:36:21+01:00

Sophie Shen commented

2016-02-26 17:36:21 +01:00

Build scene from a description of natural language. Since learning script still takes time for novice or people without much knowledge of programming and modeling, I propose to make an easy animation and modeling generator that generates scene directly from natural language. For example, with an input of "a teapot is jumping on a table", we initialize a simple scene that roughly match the description.

Edit:
The complexity of the sentence will not be limited. I'll simplify user's description to basic sentences and take the simplified ones to generate script code that can build a scene with animations.

Build scene from a description of natural language. Since learning script still takes time for novice or people without much knowledge of programming and modeling, I propose to make an easy animation and modeling generator that generates scene directly from natural language. For example, with an input of "a teapot is jumping on a table", we initialize a simple scene that roughly match the description. Edit: The complexity of the sentence will not be limited. I'll simplify user's description to basic sentences and take the simplified ones to generate script code that can build a scene with animations.

Sophie Shen commented

2016-02-26 17:36:21 +01:00

Changed status to: 'Open'

Sophie Shen self-assigned this 2016-02-26 17:36:21 +01:00

Sophie Shen commented

2016-02-26 17:36:21 +01:00

Added subscriber: @Shen

eroMoD commented

2016-02-26 20:32:54 +01:00

Added subscriber: @eroMoD

eroMoD commented

2016-02-26 20:32:54 +01:00

But the sentence structure would probably need to be a bit more basic , skipping works like "a" or "the" or "is".

Im imagining:

[Object] + [Action] + [object]

So it would sounds like:

Teapot Jump table
and then a popup appears for the jump action
How many jumps/ how fast/etc

Can easily change the object/action:

Mic + Drop + Floor

I like the idea, but sadly, I cant program
Got a D+ in Java :(

But the sentence structure would probably need to be a bit more basic , skipping works like "a" or "the" or "is". Im imagining: [Object] + [Action] + [object] So it would sounds like: Teapot Jump table and then a popup appears for the jump action How many jumps/ how fast/etc Can easily change the object/action: Mic + Drop + Floor I like the idea, but sadly, I cant program Got a D+ in Java :(

Sophie Shen commented

2016-02-26 20:40:46 +01:00

For the sentence structure, I'd like to not restrict the complexity because I want this feature be friendly to babies. I'll take whatever the user says and simplify the description to basic sentences, as you mentioned :)

I'll probably apply natural language processing to simplify user's descriptions.

For the sentence structure, I'd like to not restrict the complexity because I want this feature be friendly to babies. I'll take whatever the user says and simplify the description to basic sentences, as you mentioned :) I'll probably apply natural language processing to simplify user's descriptions.

Bastien Montagne commented

2016-02-27 11:39:07 +01:00

Added subscriber: @mont29

Bastien Montagne commented

2016-02-27 11:39:07 +01:00

Changed status from 'Open' to: 'Archived'

Bastien Montagne closed this issue

2016-02-27 11:39:07 +01:00

Bastien Montagne commented

2016-02-27 11:39:07 +01:00

This looks like nice idea (though I think terribly hard to make it work correctly ;) ), but please do not use the tracker to just present a project. We only accept finished, ready-to-be-reviewed patches here (actually, much better to use our review tool for that. Ideas and projects shall be discussed on ML (like bf-funboard) or forums…

This looks like nice idea (though I think terribly hard to make it work correctly ;) ), but please do not use the tracker to just present a project. We only accept finished, ready-to-be-reviewed patches here (actually, much better to use our [review tool](https://developer.blender.org/differential/diff/create/) for that. Ideas and projects shall be discussed on ML (like bf-funboard) or forums…

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Animation Generator using Natural Language #47588