Hey @StefanD,
I guess you are loading quite heavy plugins all on the same board.
I have a first quick tip for you: replace all the tinyGain plugins with Gain and Gain 2x2, they are less CPU hungry.
The Portal plugins can indeed help you a little bit. Especially for the TimeWrap, LP3 and MrFreeze.
Eventually, something like the ToggleSwitch and a system using CV plugins that turns the right effect (mostly from the same 3 end of the chain plugins) and routes the audio correctly will eventually help you. Alternatively, for the routing purposes, you can try the new osc-Audio Router from @steve