c# - How to split text into words?

Question

How to split text into words?

Example text:

'Oh, you can't help that,' said the Cat: 'we're all mad here. I'm mad. You're mad.'

The words in that line are:

1. Oh
2. you
3. can't
4. help
5. that
6. said
7. the
8. Cat
9. we're
10. all
11. mad
12. here
13. I'm
14. mad
15. You're
16. mad

Answer 1

Split text on whitespace, then trim punctuation.

var text = "'Oh, you can't help that,' said the Cat: 'we're all mad here. I'm mad. You're mad.'";
var punctuation = text.Where(Char.IsPunctuation).Distinct().ToArray();
var words = text.Split().Select(x => x.Trim(punctuation));

Agrees exactly with example.