Trouble Streaming Game Audio Only

Hey, so I’m trying to stream a game while talking to my friends in a party using the xbox companion game bar on windows 10. However, every time I stream it picks up the party chat no matter what, when all I would like to do is just stream the game audio only. Would anyone know how to somehow separate the audio while still being able to use headphones and a mic on windows 10?