Local training

I was able to run that notebook in a jupyter running within a local docker container environment at my windows machine with RTX 3060 video card. Basically, that’s possible. Collab workbook ran out of capacity? | "usage limits in Colab" - #3 by ignis32

But it took some time to set up all the dependencies. (especially adding wsl2 was a pain). I used dockerfile as below to have necessary python libraries and jupyter.

FROM aidadsp/pytorch

USER root

RUN apt update && \
    apt -y install git
	
RUN mkdir /content && \
    chown aidadsp /content
	
USER aidadsp

RUN pip install jupyter_http_over_ws && \
    jupyter serverextension enable --py jupyter_http_over_ws && \
    pip install librosa plotly 
 
USER aidadsp
#instead of the google drive input
RUN mkdir /content/drive
-



#### adding colab functions. bit of a mess.
USER root
RUN  apt -y install build-essential python3-dev python3-numpy
# fails in pip for unknown reason, going with conda. Also had not installed without root.
RUN  conda install -y -c conda-forge google-colab

USER aidadsp
WORKDIR /content
ENTRYPOINT ["jupyter", "notebook", "--ip='*'", "--port=8888", "--allow-root", "--NotebookApp.allow_origin='https://colab.research.google.com'", "--NotebookApp.port_retries=0"]

Notebook depends on some google stuff which is not available locally, so I had to modify it and also had to put wav files to docker container by hand via Docker desktop interfaces, as soon as file upload does not work that way.

I do not have a good step by step documented approach on that unfortunately, but here are some notes I’d taken for myself in the process, hope it can might help

 build image from Dockerfile with

 docker build -t aidax_win_local_colab .

 STEP 1)
  comment  in code (we will upload in another way)
   #from google.colab import files
   
   
  
  #from google.colab import drive
  #print("Mounting google drive...")
  #drive.mount('/content/drive')
  
 STEP 1.3)
 
	Use Docker Desktop files interface, and put  a folder with input.wav and target.wav into /content/drive/ folder.
	e.g.  /content/drive/:
		
	/content/drive/Elmwood3100-reamp.io
	/content/drive/Elmwood3100-reamp.io/target.wav
	/content/drive/Elmwood3100-reamp.io/input.wav

STEP 3) 

	Evaulation upload does not work yet. Sad face.  




docker run -dp 8888:8888 --rm -it  --gpus all aidax_win_local_colab   

P.S.

However, I have a feeling that my attempt to run that notebook locally was really excessive and not straightforward.
Looks like notebook was based on the Automated-GuitarAmpModelling, and if I had to set up local training environment again, I would instead try to find out how to use this Automated-GuitarAmpModelling code directly, without the notebook and it’s dependency hell. Looks like it was initially created for the local execution of the same procedure, and notebook just provides a GUI and google colab processing power, which are not much of use locally anyway.

2 Likes