Caldwell says VU's struggles started with fourth-down decision