The moves start earlier than that, from when the cards are being selected through to when they're replaced. Penn's groan at 4:06 is because the move at 4:04 tells him that the up/down cards are already separated and the trick is already finished.