Lesson Info
6. Port the Audio Analysis Tools to the Video Mixer
Lessons
Lesson Info
Port the Audio Analysis Tools to the Video Mixer
All right, Segment six. The final segment of this been using work final lot during his last two supplements have noticed. So any alliance port the audio analysis tools to the video mixer. Um, what we're gonna do is open up the video mixer from last week's class, and then we're gonna give it audio analysis capabilities and then create a visual effect that integrates a pre recorded video and the live audio data together into one effect. All right, so I'm gonna go back into the finder here, and I'm gonna go look for that video mixer from last week. You can download it if you don't have it already. Hopefully it's in the chat room, or it'll be It's also just available through their rarely website around, um, video mixer dot PTE. We're gonna launch that up on then. Or actually, what I'm gonna do is I'm gonna take, even though we didn't demo it, live in classless time. Take the video mixer advanced and open it up. And the reason we want the video mixer advanced is because it's got the ability...
in it to switch between effects. Uh, which, if you have the tip sheet from the last class. Actually, you know what? I'm leading us down the wrong path here. Never mind. The video makes her advanced is a lot more interesting for this kind of stuff. But let's just keep it simple. We're just going to use the regular video mixer, and then we're going, Teoh, get into, uh, the effects tab of this one later. But first, we need the port over our audio code. So we're going to create a new tab on Just call it audio, and we're gonna go back into our audiovisual laser. Could do you like we did with the project box. Could just take the whole bit on the whole stuff and then copy it. And hot back into the video mixture of which we want to save is a new version. Sorry. I'm just gonna call it audio video mixer, which is a little misleading. Does it makes you think you could mix audio with it, But anyways, um, audio video mixer in inside that audio tab, we're going to paste all of that stuff, and I'm gonna expand that out. Um, over inside audio video mixer. We actually need to, uh, make some calls to stuff that was inside the audiovisual laser set up so set up audio, just like we had in the set up of the audiovisual Isar. We'll put that right below. Say, where Reince Stan she ate Prague box will put set up audio rate below it and then going back again into the audio visual Isar down into its draw. Has that get audio data hot back into this audio video mixer inside draw Right after gets the project box data. We wanted to get the audio data for us to use every for it to be available. Every frame for us. He is Okay, So Okay, well, we're just gonna kind of wing it, um, inside of the effects tab here, there's just one function. And again, if you look at the advanced video mixer, you'll see a way to select between multiple functions, which is really the power of this whole way of setting up these applications. Um, so, you know, study that code in more detail to go farther with this, um, so down inside of the classic mix at the bottom of it right now, it's drawing to the video camera. It's drawing the video camera the screen and we'll just draw the pre recorded videos will just delete that and we're gonna do a translate. So basically, we're gonna take our code that we had used to draw the waves before. So let's say we go back into audiovisual Isar, and we take we look at our effects here and we look at how we ended up drawing, um, this stuff, I'm just going to kind of do the same thing. I take that translate out of there in a drop it in here, Um, when you go back into their again and I'm just gonna grab these two lines, um, are actually not a draw. I'm gonna grab all of these lines, which is the wave here, the wave amplitude and in the frequency wave stuff. And we was gonna put it right below here, and then we're gonna go into, um, this. We're not We're not getting his wave Hugh Here. Um, we're just gonna actually draw a white thing, But we want to change the Alfa. So we're gonna make this wave alfa, or like audio wave Alfa. So what does tell me exactly what the pill is doing? OK, so Phil were about the change that Sorry. We're gonna get rid of these last two numbers, and we're gonna drop that audio wave, Alfa. So what I just did is I changed the name of what was called video camera Alfa and I changed the audio wave Alfa to be a little more explicit about what we're doing on that's going to be the inverse of Videophile Alfa, in other words, were creating across Vader with that first knob between the pre recorded video and the live audio wave forms so that we can cross fade between them just is an example of how to integrate. There's probably a lot more exciting things you could think of doing with Phyllis. Just saying fill it with white at the Alfa. That's determines the audio, right? Yeah. Got it. Aan den again. We're using, uh, I'm just gonna change this. We're going to use the wave amplitude equation that we had used before instead of mapping the third from the left third non from the left and was going to the second knob from left, which is indexed one and a zero based array. And because, um, the way and we're also gonna change frequency wave will just go and will use volume wave. Um okay. And there's actually something that I just skipped here. Another thing that we need to copy over, which is in here. We have all of our video mixer functions left over from last time. We also need to bring over our audio visual visualization tools as well. So I'm just gonna take everything that's below draw inside the audiovisual Isar. I'm gonna select all copy it, hop back over into the audio video mixer and then, like, maybe give myself a little note that says audio tools start here and I'm just gonna paste all those down in below that. So we have them available for us to use over in our effects. And so then now volume waves should be available to us. And classic mix has already implemented over here inside draw. And also, something else to note is because we are stacking on top of that video mixer, the screen recording capabilities, air still in there and all that stuff. So then what we're gonna dio is play that hopefully we get no errors. Okay? Try playing something. Eyes. It's ah, Sounds great, but I think that the the amplitude of that wave needs to be increased by quite a bit. Uh, it was at 10. Left over from when it was being used for frequency. Okay. Warm or time this time with feeling. Yeah. And you noticed, too, that during that I captured a video of that, and I'm playing it back. So is it picking up your voice, is there? Oh, no, that's the reported video. Cross fade back over to That's the life. Got it. OK, right. Very cool. Uh uh uh. Awesome. That is very cool. All right, well, that's the end of the whole thing. What we just did is a ported the audio tools over to do video mixer and combined them into an effect that uses the recorded video with our live audio visualisation. Any questions? Yeah. I wanted you to talk. I saw that you are going to actually use this in a museum. Yes, way. Could you tell us a little bit about that? Yeah. Tonight at the Seattle Art Museum was invited by a local design team called Demise That does a lot of really cool graphic design, work and promotional stuff in marketing and they, in turn, were invited by the Seattle Art Museum to provide visuals on like entertainment and activities. So they're doing like a mask making activity thing where people get to make their own masks. And then we're using the video mixer software or a variation of the video mixer solver from last week with project boxes to to play that people can go and stand in front of a camera, get like 10 seconds of video themselves recorded and then it'll get played back into a mix that's been playing back into the lobby space. And you know the area where everyone will be hanging out. It's very cool. Yeah, yeah, that's actually cool. Yeah, So if you build this stuff, you guys, you can actually use it for things, for things. And it's funny, too, because while is developing the video mix, of course this whole opportunity with Demise and Seattle Art Museum came up, and so has talking the Christian from demise. And wait a second. Why don't I just kill two birds with one stone and all right, a video mixer application that we can use for this and then use that as the example teaching the class. Yeah, that's off, right? And then helpfully, Gabe can use some of this with deuce and cool music videos for trumpet or someone. Sure, if you look up monk Tail Creative Music concern on Vimeo or YouTube. You'll find a list from years Joystick video over free jazz. Oh, yeah, the three. All right. That's right. That were Wow. All kinds of really cool art stuff happening here. Well, we don't have any more questions from the chat room. I think everybody is just soaking and how cool it is. So cool. Well, thank you very much, Joe and Gabe, especially thanks to you, too, for providing the lovely musical input for today. And thanks to everybody in the chat room and watching our live video, we really appreciate your participation and, um, hope to see you online for another classic. And soon And remember, you can participate in the forums would love to see you there if you want to buy the videos for this class the video mixer that we made two weeks ago or the original processing and Arduino class that we did last fall, those air all available through O'Reilly dot com as well as great of life. So go get those if you want to see it again. So all right. Thank you. Thank you.
Ratings and Reviews
Student Work
Related Classes
Mixed Media Art