🪄 AI Generators, ElevenLabs Sound FX & Smart Melody

Omni DAW features an integrated suite of artificial intelligence and generative algorithms, supporting creators in crafting unique Sound FX, TTS voiceovers, chord progressions, and spectral textures.

1. ElevenLabs Integration: Sound FX & Voice Generation

Omni DAW has a direct connection to the ElevenLabs Sound Generation & Text-to-Speech API:

A. Sound FX Generation

Type a text prompt describing the desired effect (e.g., "Laser blast in deep space", "Dark monster roar", "Tapping on glass transition"), and the ElevenLabs engine will generate a clean, high-quality Sound FX audio file directly into your project!

B. Voice and Voiceover Generation (Text-to-Speech TTS)

• Model and Voice Selection: Access to the latest ElevenLabs vocal models.
• Speech Generation: Transforming text into natural-sounding vocal, voiceover, and narrative lines with emotion and stability adjustments.

C. Application in DAW Modules:

• ScratchDeck Integration: A generated Sound FX sample or vocal can be immediately sent to the ScratchDeck module for live vinyl scratching!
• Convolution Reverb IR Generation: Creating synthetic impulse responses (IRs) for the Conv Reverb effect.
• Sample History: Automatic saving of all generated samples to disk in WAV/MP3 format with the ability for quick reuse.

2. Smart Random Melody Generator (Algorithmic Melodies)

The Piano Roll editor features a Smart Random Melody generator utilizing 12 compositional archetypes:

1. Stepwise Flow: Smooth stepwise motion, arched singing phrasing (Pop / Folk / Singer-Songwriter).
2. Minimal Cell: Short 2–4 note motifs repeated with transposition and inversion (Minimalism / Techno).
3. Classical Arch: Classic phrase architecture with a clear build-up to a climax and decay.
4. Funk Groove: Syncopated rhythm, chromatic neighbor notes, and emphasis on the accented beat (Funk / R&B).
5. Celtic Reel: Very fast stepwise runs and ornaments (Jig / Celtic Reel).
6. Bebop Line: Jazz chromaticism, approach notes, and targeting chord tones.
7. Arpeggio Loop: A looped arpeggio cyclically moving through scale degrees.
8. Synth Arp: A dynamic synthetic line of 8ths and 16ths with a repetitive interval pattern (Synth-Pop / EDM).
9. Sequence Run: Ascending or descending runs of parallel thirds and sixths.
10. Ambient Drift: Wide interval leaps, long sustained notes, and spacious pauses (Ambient / Soundscape).
11. Tension Build: Tension building by raising register and rhythmic density.
12. Modal Motive: Ethnic modal motifs and pentatonic gaps.

3. Smart Progression Generator (Library of 50+ Chord Progressions)

The dedicated Smart Progression engine provides a catalog of 51 factory chord progressions, grouped into 7 categories:

• Categories: Pop & Rock, Jazz, Blues & Funk, Minor & Dark, Classical, Modal & Borrowed, Pedal & Special. Some individual progressions also have descriptive stylistic subtitles (e.g., "I–vi–IV–V (50s / Doo-wop)", "vi–V–IV–V (Epic Film)", "i–V–VI–VII (Metal / Prog)").
• Automatic Voice Leading (Smooth Transitions): Smooth mode automatically selects chord inversions so that chord changes occur with minimal voice movement — alternatively, Root Position mode is available.
• Chord Variations: Expanding chords with sevenths and ninths (Maj7, Min7, Dom9, Add9) and other progression flavors.

4. Integration with LLM AI Models (AI MIDI Create & AI Progression)

For users looking for full generative synthesis, Omni DAW offers direct integration with LLM models. 6 providers are available: Anthropic Claude (default), OpenAI GPT, Google Gemini, DeepSeek, and two local ones — LM Studio and Ollama (no API key required, configured via local address, defaulting to http://localhost:1234/v1 for LM Studio and http://localhost:11434/v1 for Ollama):

• AI Create — Melody Window: Type a text prompt (e.g., "A dark bassline in synthwave style at 120 BPM in D minor") – the engine sends a query to the selected AI provider and inserts the generated notes onto the Piano Roll grid.
• AI Generate — Progression Window: Generating multi-chord harmony from verbal descriptions of the track's vibe.

5. AI Image Generator for the Iris Synthesizer

For the Iris synthesizer (see /docs/alchemical-synth — image-to-sound resynthesis engine), Omni DAW features a built-in AI image generator based on the Google Gemini model (gemini-2.5-flash-image, independent of the text model selected in AI settings):

• Type a visual description (e.g., "Aurora borealis over an arctic ocean"), and AI will generate an image that is automatically baked into the additive spectral table (frames × partials) driving Iris synthesis.