Are you sure, i thought skill were loaded into the main context, unlike (sub)agents. According to Claude they're loaded into the main context.
Do you have link?
Unless claude decides a skill is needed, then it loads the additional details into the main context to use. It's basically lazy loading into main context.