Hi guys. I just wanted to let you know about my first and only DarkBasic Pro project.
This is a little program I made for progressive rock band "Dream Theater" for their latest tour (I doubt anyone here has heard of them).
The program is basically a 3D character that plays along with whatever you play via MIDI in realtime. It is a wizard character with an octagonal keyboard, and it will attempt to play whatever notes it receives through MIDI as plausibly as possible. The challenge was getting it to sort the notes and figure out which hand and which finger to play which, and perform it as best it can.
The program has already been used for about 12 tour dates up the East coast of the US, then will be used across the rest of the US, then Europe, then across the rest of the world for about 100 shows in total. The program was also demonstrated at this year's NAMM show at the Korg booth.
Here are some screenshots and a video-
Since it's only designed for one specific high end machine, I splashed out on graphics, since it didn't need to be compatible with low end hardware. The video is older and so is without the graphical effects.
The room uses a parallax mapping shader, modified to include specular mapping and light mapping. Everything else in the scene is also lightmapped, and there is a glow shader applied to the screen to add some softness to the scene.
The musical staff shows what notes are being played in realtime, and uses a custom made vertex shader to ripple the staff based on playing speed.
All of the character animation is done in realtime through code with no pre-made animation. I programmed some basic Inverse Kinematics into the arms so I could position the hands in the correct spot on the keyboard. You'll also notice a cel shading effect, although I'm only using the cartoon outline, and not the shading aspect.
I've also used a shadow shader so the fingers cast a shadow onto the keys, and I've cube mapped the keys to make them shiny.
I also have some video of the program being used live, which gets displayed on a 55" plasma screen behind the keyboardist, and also sometimes used on the large projection screen.
The band's keyboardist also does a solo spot where he duels with the 3D character, and then does a duet, but I don't have video of that unfortunately.
Here are some live clips of the program being used-
- at 8:42, it is displayed on the large projection screen. Ignore the dancing girl!
- from 0:55 in, program is displayed for most of the song behind the keyboardist. Also notice that when the keyboardist rotates his keyboard, the 3D character rotates his keyboard too, thanks to a custom made "MIDI Compass" device that translates rotation to a MIDI controller value.
I'd like to give a huge thanks to Rudolpho for making this program possible with his fantastic MIDI plugin for DBP, and for fixing up the problems and making it absolutely bulletproof and able to endure a whole live show of battering.
Also thanks to this forum and the creators of DB Pro for making it possible for me to make this project happen quickly and easily. This forum has been very helpful with all of my problems.
Sorry I can't post any demos, but I'm sure you understand the situation.