Page MenuHome

AudioProject
ActivePublic

Details

Description

Sound import, export, editing and playback through the Audaspace library.

Subproject of VFX & Video

Recent Activity

Today

Marcos Perez (pistolario) updated the summary of D14412: Graphical sound equalizer.
Fri, Jul 1, 12:20 PM · Audio, VFX & Video, Video Sequencer
Marcos Perez (pistolario) updated the diff for D14412: Graphical sound equalizer.

Changed the Diff in order to address comments by Nexyon and ISS
Specially:

  • removed EqualizerReader. All from Equalizer to ConvolutionReader
  • constants and the leadership of creation and sizes, taken in the Blender part
  • buffer of communication con Audaspace created in Blender part
  • With a Selector, the user can create 1, 2 or 3 graphical band definitions
  • with Python API, user can delele all the graphical band definitions, and create one by one
  • changes in names of structs and functions suggested by ISS
  • improvements and simplifications commented by ISS
  • limited modifications to +/-30 dB and cut the data from the curve mappings to +/-30 db
Fri, Jul 1, 9:25 AM · Audio, VFX & Video, Video Sequencer

Mon, Jun 27

Richard Antalik (ISS) added a comment to D14412: Graphical sound equalizer.

I am happy with the code functionally as well, left mostly nitpicks and suggestions.

Mon, Jun 27, 9:41 PM · Audio, VFX & Video, Video Sequencer

Thu, Jun 23

Joerg Mueller (nexyon) added a comment to D14412: Graphical sound equalizer.

The audaspace side of the patch starts to look good, mostly there is only minor changes left I would say:

Thu, Jun 23, 10:11 PM · Audio, VFX & Video, Video Sequencer
Joerg Mueller (nexyon) closed T99083: audio bad in command-line video player (blender -a) as Resolved by committing rB41a0411d7938: Fix T99083: audio bad in command-line video player (blender -a).
Thu, Jun 23, 9:32 PM · Audio, VFX & Video, BF Blender

Wed, Jun 22

Pratik Borhade (PratikPB2123) updated subscribers of T99083: audio bad in command-line video player (blender -a).
Wed, Jun 22, 12:20 PM · Audio, VFX & Video, BF Blender
spam (david_d_costa) added a comment to T73977: Animation Nodes -> numpy.core.multiarray -> import aud.
Wed, Jun 22, 10:46 AM · Audio, Python API, BF Blender
Omar Emara (OmarSquircleArt) changed the status of T99083: audio bad in command-line video player (blender -a) from Needs Triage to Confirmed.

Sounds doesn't seem to play at all since 2.93 for me.

Wed, Jun 22, 10:07 AM · Audio, VFX & Video, BF Blender

Tue, Jun 21

Marcos Perez (pistolario) updated the diff for D14412: Graphical sound equalizer.

Fix a typo cleaning the patch

Tue, Jun 21, 11:49 AM · Audio, VFX & Video, Video Sequencer

Mon, Jun 20

Marcos Perez (pistolario) updated the summary of D14412: Graphical sound equalizer.
Mon, Jun 20, 2:00 PM · Audio, VFX & Video, Video Sequencer
Marcos Perez (pistolario) updated the diff for D14412: Graphical sound equalizer.

Changes to include comments by Nexyom and ISS.
Specially:

Mon, Jun 20, 1:59 PM · Audio, VFX & Video, Video Sequencer

May 24 2022

Sergey Sharybin (sergey) added a comment to T97750: Audio scrubbing sounds glitchy.

I am not sure how useful restriction of cache used for only short audio. It is not uncommon to work on a montage of multiple longer videos files: things like reels, tutorials, etc.

May 24 2022, 4:55 PM · VFX & Video, Audio, BF Blender

May 23 2022

Richard Antalik (ISS) added a comment to D14412: Graphical sound equalizer.

I just wanted to mention, that I will accept whatever solution you and @Joerg Mueller (nexyon) will agree on, and sequencer stuff looks mostly reasonable. Only thing that stands out a bit for me is soundeqs field of Sequence. It's not really bad to have this separated from image modifiers, but if there should be more sound modifiers, I think, that these should be wrapped in more generic struct(similar to image modifiers), but this is probably detail compared to actual sound stuff.

May 23 2022, 9:48 PM · Audio, VFX & Video, Video Sequencer

May 22 2022

Joerg Mueller (nexyon) added a comment to D14412: Graphical sound equalizer.

This looks better already.

May 22 2022, 7:45 PM · Audio, VFX & Video, Video Sequencer
Joerg Mueller (nexyon) added a comment to T97750: Audio scrubbing sounds glitchy.

Well, you could add a setting to automatically enable caching, when the audio files are shorter than a specific length. Another option instead of using caching is to use proxies like done for video. I.e., convert the audio streams of the video file to PCM/wav/uncompressed audio for immediate seeking without performance issues.

May 22 2022, 7:22 PM · VFX & Video, Audio, BF Blender

May 19 2022

Richard Antalik (ISS) closed D14565: Display sound specs in VSE.
May 19 2022, 9:09 PM · Audio, VFX & Video, Video Sequencer

May 10 2022

Marcos Perez (pistolario) updated the diff for D14412: Graphical sound equalizer.

I've tried to address most of the suggestions by Nexyon, as long as I have could, so:

  • I've encapsulated all the EQ creation in EqualizerReader
  • Any time there is a change in the sound Strip, it is created a new definition in SequenceEntry, in order to be ready when SequenceHandle detects different status (the same way it is nowadays)
May 10 2022, 4:22 PM · Audio, VFX & Video, Video Sequencer
Sergey Sharybin (sergey) added a comment to T97750: Audio scrubbing sounds glitchy.

@Joerg Mueller (nexyon), Making sure the current state is documented is surely welcome. However, it is a bad design to task an editor to worry about identifying where and when to enable caching. The good design is when an editor is focused on the editing task, and the performance is ensured by the system.

May 10 2022, 10:21 AM · VFX & Video, Audio, BF Blender

May 7 2022

Joerg Mueller (nexyon) added a comment to T97750: Audio scrubbing sounds glitchy.

I disagree: caching consumes way too much memory to enable it by default when scrubbing is enabled. I instead suggest to suggest in the documentation to enable caching for audio strips when necessary for performance.

May 7 2022, 6:55 PM · VFX & Video, Audio, BF Blender
Peter Fog (tintwotin) added a comment to T97750: Audio scrubbing sounds glitchy.

In conclusion: turn on caching if the performance of ffmpeg is not good enough for scrubbing.

May 7 2022, 8:13 AM · VFX & Video, Audio, BF Blender

May 6 2022

Bastien Montagne (mont29) closed T97466: Assert when pack sound in blender DEBUG as Resolved by committing rBacafc7327ec9: Fix T97466: Assert when pack sound in blender DEBUG..
May 6 2022, 3:06 PM · Core, Dependency Graph, Audio, BF Blender
Bastien Montagne (mont29) added a comment to T97466: Assert when pack sound in blender DEBUG.

@Sergey Sharybin (sergey) thanks, will commit fix then

May 6 2022, 2:58 PM · Core, Dependency Graph, Audio, BF Blender
Bastien Montagne (mont29) moved T94627: Speakers cannot be muted or unmuted via the API (bpy.data.speakers.muted is broken) from Backlog to Bugs on the Core board.
May 6 2022, 2:57 PM · Core, Python API, Dependency Graph, Audio, BF Blender
Sergey Sharybin (sergey) added a comment to T97466: Assert when pack sound in blender DEBUG.

@Bastien Montagne (mont29) Using DEG_id_tag_update_ex instead of BKE_sound_load is correct. The only thing is that flag should just be ID_RECALC_AUDIO. Basically you almost never want to use explicit ID_RECALC_COPY_ON_WRITE.

May 6 2022, 2:50 PM · Core, Dependency Graph, Audio, BF Blender
Bastien Montagne (mont29) changed the subtype of T97466: Assert when pack sound in blender DEBUG from "Report" to "Bug".
May 6 2022, 2:42 PM · Core, Dependency Graph, Audio, BF Blender
Bastien Montagne (mont29) updated subscribers of T97466: Assert when pack sound in blender DEBUG.

This call to BKE_sound_load looks horribly old (from 2008! code) and wrong to me in context of new evaluation with depsgraph, I would expect rather something like that here:

May 6 2022, 2:42 PM · Core, Dependency Graph, Audio, BF Blender

May 5 2022

Joerg Mueller (nexyon) closed T97750: Audio scrubbing sounds glitchy as Archived.

Ok, so everything pretty much works as expected.

May 5 2022, 9:57 PM · VFX & Video, Audio, BF Blender

May 4 2022

Germano Cavalcante (mano-wii) added a comment to T97750: Audio scrubbing sounds glitchy.

For bisect I focused specifically on frame 429.

Before rBded68fb10275 and after rBbdbc7e12a02e this frame is muted (which I thought was related to the glitch):But I can confirm that enabling caching apparently improves the situation:Here what the result looks like in a previous version without caching:
May 4 2022, 9:05 PM · VFX & Video, Audio, BF Blender
Joerg Mueller (nexyon) added a comment to T97750: Audio scrubbing sounds glitchy.

To me the video doesn't seem to have an issue for either, to be honest. The Blender 3.0 version just seems to have a little less performance, which could be caused by a variety of factors. I don't see how rBbdbc7e12a02e would cause it though. Could be a different ffmpeg version even or so, but I don't think that would have changed during your bisection @Germano Cavalcante (mano-wii)?

May 4 2022, 7:08 PM · VFX & Video, Audio, BF Blender
Sergey Sharybin (sergey) updated subscribers of T97750: Audio scrubbing sounds glitchy.

Not sure how active Joerg is.
@Sebastian Parborg (zeddb), do you mind giving some help here? :)

May 4 2022, 10:56 AM · VFX & Video, Audio, BF Blender
Germano Cavalcante (mano-wii) updated the task description for T97750: Audio scrubbing sounds glitchy.
May 4 2022, 2:25 AM · VFX & Video, Audio, BF Blender
Germano Cavalcante (mano-wii) updated subscribers of T97750: Audio scrubbing sounds glitchy.

Bisecting, this problem had apparently been resolved in rBded68fb10275: VSE: Fix audaspace not reading ffmpeg files with start offset correctly,
but was reintroduced in rBbdbc7e12a02e: Audaspace: added audio file streams functionality..

May 4 2022, 2:22 AM · VFX & Video, Audio, BF Blender

May 3 2022

Germano Cavalcante (mano-wii) updated the task description for T97750: Audio scrubbing sounds glitchy.
May 3 2022, 7:16 PM · VFX & Video, Audio, BF Blender
Germano Cavalcante (mano-wii) updated the task description for T97750: Audio scrubbing sounds glitchy.
May 3 2022, 7:14 PM · VFX & Video, Audio, BF Blender
Germano Cavalcante (mano-wii) changed the status of T97750: Audio scrubbing sounds glitchy from Needs Triage to Confirmed.

Thanks for the report. I can confirm the problem. Tested on a macOS-12.2-arm64-arm-64bit 64 Bits

May 3 2022, 7:11 PM · VFX & Video, Audio, BF Blender

May 2 2022

zyc17 (zyc17) updated the task description for T97750: Audio scrubbing sounds glitchy.
May 2 2022, 5:39 AM · VFX & Video, Audio, BF Blender

Apr 26 2022

Richard Antalik (ISS) accepted D14565: Display sound specs in VSE.
Apr 26 2022, 2:43 AM · Audio, VFX & Video, Video Sequencer

Apr 22 2022

Marcos Perez (pistolario) updated the diff for D14565: Display sound specs in VSE.

Improved with ideas and suggestions by ISS.

Apr 22 2022, 8:36 AM · Audio, VFX & Video, Video Sequencer

Apr 21 2022

uriel Deveaud (urielDeveaud) added a watcher for Audio: uriel Deveaud (urielDeveaud).
Apr 21 2022, 8:37 PM

Apr 20 2022

Philipp Oeser (lichtwerk) renamed T97466: Assert when pack sound in blender DEBUG from Assert crash when pack sound in blender DEBUG to Assert when pack sound in blender DEBUG.
Apr 20 2022, 4:46 PM · Core, Dependency Graph, Audio, BF Blender
Philipp Oeser (lichtwerk) changed the status of T97466: Assert when pack sound in blender DEBUG from Needs Triage to Confirmed.

Can confirm

Apr 20 2022, 4:46 PM · Core, Dependency Graph, Audio, BF Blender

Apr 19 2022

Richard Antalik (ISS) added a comment to D14565: Display sound specs in VSE.

I have left few more comments, also noticed that in UI it displays string STEREO which could be Stereo instead - nicer formatting basically.

Apr 19 2022, 11:07 PM · Audio, VFX & Video, Video Sequencer
Joerg Mueller (nexyon) added a comment to D14412: Graphical sound equalizer.
  • one of your major concerns is related with the relation between Blender and Audaspace. Now, there is a fixed way of dealing with the sound: mono, pan , pitch always. They cannot be deleted or avoided because blender supposes that they are threre, and the interface Audaspace - Blender suppose that they are there
Apr 19 2022, 10:36 PM · Audio, VFX & Video, Video Sequencer

Apr 18 2022

Marcos Perez (pistolario) updated the diff for D14565: Display sound specs in VSE.

Updated with comments taken into consideration:

  • moved info to bSound
  • updated info when it is changed the source
  • taken info from depsgraph updating of sequence / bSound
Apr 18 2022, 5:17 PM · Audio, VFX & Video, Video Sequencer

Apr 7 2022

Marcos Perez (pistolario) added a comment to D14412: Graphical sound equalizer.

Nexyon,
the biggest difficulty with dealing with Blender-Audaspace integration is the storage of that Integration.

Apr 7 2022, 3:32 PM · Audio, VFX & Video, Video Sequencer
Marcos Perez (pistolario) added a comment to D14565: Display sound specs in VSE.

my first try was to create a function and it would "examine" de audio file any time it is needed. But I thought that that would be too much extra-work.
I was thinking about where to store the information, and as the first simple attempt I chose Sequence because it is accesed in the strip creation, and because in a video strip the FPS are studied only in the creation.

Apr 7 2022, 12:59 PM · Audio, VFX & Video, Video Sequencer

Apr 6 2022

Richard Antalik (ISS) requested changes to D14565: Display sound specs in VSE.

Thanks for patch, I think this is quite useful.

Apr 6 2022, 4:14 PM · Audio, VFX & Video, Video Sequencer
Marcos Perez (pistolario) added projects to D14565: Display sound specs in VSE: Video Sequencer, VFX & Video, Audio.
Apr 6 2022, 3:47 PM · Audio, VFX & Video, Video Sequencer

Apr 5 2022

Marcos Perez (pistolario) added a comment to D14412: Graphical sound equalizer.

Hello,

first of all, thank you for your attention.

I'll try to address your concerns:

  • I've tried to separate, data and relations with Blender in SequenceReader, and media or down level in SequenceHandle. But I understand that the creation of the "filter" would better in a specific "IReader"
  • one of your major concerns is related with the relation between Blender and Audaspace. Now, there is a fixed way of dealing with the sound: mono, pan , pitch always. They cannot be deleted or avoided because blender supposes that they are threre, and the interface Audaspace - Blender suppose that they are there
  • BypassReader has 2 goals: intercept the sound treatment, in order to detect when the system needs a change (enable / disable / change equalizer), and the second goal is to keep a static pipeline of sound treatment, but with the posibility of avoid one step. If there is no REader inside, the overwork is just "one if to check is it is dirty"
  • FFT doesn't need big accuracy. The problem is that I wanted to show something that worked, before trying to ask someone to modify / include de version of FFTW for only "float"
  • boost was used in a phase of the project for debuging. I should have removed it before
Apr 5 2022, 12:37 PM · Audio, VFX & Video, Video Sequencer

Apr 3 2022

Joerg Mueller (nexyon) added a comment to D14412: Graphical sound equalizer.

Hello Marcos!

Apr 3 2022, 3:46 PM · Audio, VFX & Video, Video Sequencer