Tran Van Lap, 48, admitted he was carrying them for a Vietnamese-American living in the U.S. He had transited through Singapore, escaping detection there.
He is now in the custody of the city police who have taken over the investigation.
Possession and trading of rhino horns and other wildlife parts is illegal in Vietnam.