A crook who robbed a vulnerable Wodonga man threatened he would "smash" the victim during the ordeal.