To remove individual widgets from a stack, touch and hold a stack and choose "Edit Stack" from the menu, swipe to the widget you'd like to remove, hit the minus "-" icon in the widget's top-left ...

It will remove your selected icon from the Taskbar on Windows 11 and 10. If you want to temporarily hide or remove the Chat icon, you can follow any of the first four methods.