I googled it, there is an option to sync it to your Microsoft account, but I can’t say whether that’s on by default when you turn on clipboard history because I skipped adding a Microsoft account. But if it is, you can turn it off in Settings -> System -> Clipboard.