TL;DR: There are two things you can do:
1. Change in Language & Region -> Advanced...
2. When converting a text to columns, you can specify the delimiter (Step 3 of 3 -> Advanced...)
Regional settings
The regional settings will affect all applications, not only Excel.
Here