Check out the MOD Assistant Beta to find a guitar tone with AI

Dear Community,

we would like to introduce you to the new MOD Assistant and invite you for Beta testing!

This Assistant will help you replicate a guitar tone from an audio sample using an AI-generated Pedalboard. You can instantly try the suggested pedalboard on your MOD device and tweak the tone to your taste.

To check it out, have your MOD device connected, updated and go to assistant.mod.audio

Unlike with beta testing of new MOD OS versions or plugins, testing the MOD Assistant does not affect the stability of your MOD device at all. The stable 1.12.1 update is needed only to receive the pedalboard, while the magic happens in the cloud.

Currently the MOD Assistant is suggesting a chain of an Amp Sim, Reverb and Cab Sim only, with a limited set of plugins. This will be extended and improved as things progress, and your feedback is very important. Therefore pedalboards are stored anonymously with your rating.

It’s also very much appreciated, if you share your experience here in the forum. This is unknown territory with a lot to learn, for the AI as well as for us humans. Beside the public discussions on practical usage, I would also love to establish an AI experts group with those of you who happen to have a respective background. DM me if you are interested please.

The underlying research and advanced development started in March 2022. We shared and discussed some of the results with you here: AI research at MOD. I’m glad we could continue this very promising project with the reboot and have @itskais now as our AI Engineer collaborating closely with @falkTX and @jesse. Thanks for this awesome first release!

Happy holidays everyone!

32 Likes

Super cool idea! We’ve all dreamt of this, right? I just tried it out with my Dwarf. I recorded myself playing a Gilmour lick into my DAW and processed it with 5 different Amp/Cab/Reverb setups via Amplitube (order of assending gain): Bassman, Fender Twin, Hi-Watt, AC-30, PRS. No effects other than Spring, Hall or Plate reverb. Uploaded each sample, then loaded and played thru the created pedalboard.

I did give the thumbs-up to one: My PRS/4x12-Brit/Hall sample which the assistant matched to their high gain amp with 4x12 greenbacks and a nice plate verb. Another was close: HiWatt w/ plate reverb which matched to a Brit Marshall 2000 cab, good choice, but the amp had almost no grit/overdrive and the reverb chosen was a shimmer verb (I hate that shit). It seemed to choose that whenever I had used a plate reverb.

I uploaded a few other riff snippets too with various levels of overdrive applied. With my playing, it seems to chose between just two amps: Gx Alembic for cleaner tones (with near zero gain/grit), Mutant for gainier (with way too much distortion applied). If I turned down the cranked gain on the Mutant that it gave me, it was sometimes in the ballpark.

Similar story with cabs. Even though they have Bassman, AC-30, Twin cabs, etc., it tended to select the “Tool Pot” cab (named after the band I presume) for tones without much breakup, but seemed to pick better matches, like 4x12 greenback and Marshall 2000, for gainier tones.

I was using the same guitar/pickup to record my upload and auditioning the pedalboard, but if you weren’t, I can’t imagine the results being very reliable. Upload a real sample of Gilmour and you’re using a 335… yeah, how is it gonna know how to bend your tone? If it took a direct guitar sample along with your processed sample, then it knows the real transfer function like a real profiler. At the very least, maybe you could offer selections for type of guitar: Strat, Tele, LesPaul, Semi-hollow, P-Bass, etc. and which pickup(s) you intend to use. Maybe better yet, suggest which pickup you Should use with the pedalboard.

Anyway, this “Profiling as a service” seems like it could eventually be a nice way for nubes or tweak-a-phobics to get good tone. Thanks for creating this and providing another reason to embrace AI instead of fearing the day we become its servants.

13 Likes

My honest point of view is that I believe there are better fields of investments for Mod Audio right now than AI for tone capture/reproduction. There are still quite a few issues to be ironed out in current firmware like midi timing and tempo matching to make all these midi adn synth features really usefull. I’d rather have mod audio invest in making those rock solid before nice to haves like AI. To appeal to the pro market, things must work reliably.

5 Likes

Hey @randreich!
Thank you for taking the time to assess our new Beta feature, and providing us with a detailed feedback on your experience with it.

Let me start with acknowledging the fact that, yes for cleaner tones, tones with just a bit of breakup, the assitant is a bit biased towards using the Gx-Alembic (although it’s mostly a super clean tone with not much gain). That’s mainly due to the fact that training was done with an initial limited number of plugins, not covering a huge range of tone when it comes to gain and drive.
That also affects the cab suggestions when it comes to cleaner tones, since the system wasn’t trained on a lot of clean (slightly gainy) guitar sounds.

Adding a selection of guitar types or pickup types to have more personalized pedalboard suggestions is in fact an idea in the backlog of this profiling project, altho we’re not in a position to implement it yet!

Thanks again for your reply, this will totally be kept in mind when working on the next iteration.
Cheers!

10 Likes

So we’re continuing to work on the next iteration of the MOD Assistant, taking into consideration the feedback that you gave us, both here and through the feedback buttons (thumbs up and down). Soon enough we will announce the second release.
We thank you again for collaborating on it.

One thing to mention, though, when you continue using this tool for now, please don’t upload full song files. The Assistant can only work with sound files that contain solo electric guitar sound, that way it’s able to provide you with the closest pedalboard suggestion.

5 Likes