Yes, answers in comments should be immediately deleted, as they are counter to the way the SE system is intended to work. They cannot be downvoted, as can a poor actual answer.
See these meta questions about comments and how the system is intended to work:
Why does commenting require reputation?
Here is a relevant excerpt:
Comments exist so that users can talk about questions and answers without posting new answers that do not actually answer their parent questions. Comments are often used to ask for clarification on, suggest corrections to and provide meta-information about posts.
Comments are intentionally short, having maximum length of 600 characters, and allow only limited markup. URLs in comments automatically become hyperlinks. Each user may post only one comment every 15 seconds.
Comments are disposable: unlike posts, there's no revision history, and they can be deleted without warning by their authors, by moderators, and in response to flags.
In theory this should be the way every stack exchange site should treat comments. However, this also relies heavily on the community to moderate, as it is not feasible to expect a small team of moderators to vet every single comment on every single question/answer.