You have more experience that you realize
Someone told me: "I think that my little experience. I'm not as seasoned as you or other people because I have moved to Service Design recently."
I then asked the person: "How old are you?" She said: "32". As there are 365 days in one year, this person has a 11,680 days level of experience. Doesn't sound bad to me.
Changing field is like changing company
People forget, that if you changed jobs within your field, it feels like changing discipline. Sometimes the way a company does UX and how another company does UX is sometimes so different that it feels like changing discipline.
The same will happen when you go from UX to Service Design as when you go from a UX company to another UX company. The level of change is quite similar.