I guess my concern would depend on the make-up of your target audience. I am stuck with dial-up service. I just waited 5 minutes for my PC to tell me it was loading and had hit the 9% mark, when I stopped the process.
If you know that your people are generally broadband equipped, then you have a good thing going. If many are in the same shape I am, the frustration of slow-load will negate any benefit of the video.