Emergency services launched a search for the men at 5.28pm after their boat capsized in front of the entrance to a marina at Wedel west of Hamburg.
Both men, aged 24 and 28, drowned immediately, but it is unclear how the boat capsized.
Police said in a statement that divers and a helicopter were deployed and the bodies were retrieved at around 9pm.
SEE ALSO: House blast kills four people