Hi Jocko. The advice I'm giving is based on my set up which is a PC running windows XP SP3 and using the free Windows 'Movie Maker' software. Basically you want to combine an MP3 audio file with a jpg image file.The easiest way I found to make videos for YouTube was to take a picture of the record label via the scanner (150 dpi is fine) and save it as a Jpg image file. Open up windows movie maker and start a new project. Add the image and sound file to the project and increase the image time so that it matches the length of the track in question. You end up with something like this:
https://www.youtube.com/watch?v=SaPCgnM2FT4
As your confidence increases you can try multiple images and "pan" effects.
https://www.youtube.com/watch?v=-lCckI_I5iE
There's lots of info on the internet.
Good luck.
Dave