A man has died after getting into difficulty while swimming off the coast of Devon.