Can I promote a video that just has audio and cover art?

Yes, you absolutely can but please keep in mind that visuals with high quality produced content get the best results and most feedback. However, many artists and labels make it a point to promote just the audio track first to “check the temperature” from the fans before deciding on whether to invest in making an official video for the song.