Jamie Vardy (Getty Images)
The Three Lions were well on their way to the quarter-final in regular time courtesy of a 57th-minute penalty from captain Harry Kane.
Vardy was introduced into the match in the 88th minute for Manchester City paceman Raheem Sterling to secure the lead and see out the match.
However, in the final minute of stoppage time, Colombia defender Yerry Mina equalised to take the match into extra-time.
The match eventually went to penalties and Vardy was expected to take one after Harry Kane, Marcus Rashford, Jordan Henderson and Kieran Trippier.
But it was not to be as Eric Dier stepped up and secured England's place in the quarter-finals.
It was later revealed that Vardy suffered a late groin injury in the second half of extra-time and was not able to take a penalty.
"Dier wasn't supposed to take that decisive fifth penalty," Sky Sports News' Rob Dorsett said, as quoted by the website.
"Vardy, the man who takes penalties regularly for Leicester, was down to take it but he picked up a groin strain towards the very end of extra-time so massive credit to Dier."
England will now face Sweden on Saturday at the Samara Arena.
Kick-off is at 16:00 (SA time).