I’ll mention it’s not just Zoom, but Google Meet, Microsoft Teams, and pretty much all other conferencing services all suffer from the same issue.
You’ll typically get a latency (delay) of at least 250ms (1/4 second) which is usually not noticeable for discussion (except when people don’t mute their mics and you get echo, or when people start to talk over each other by accident).
For real-time music collaboration you really need less than 30ms, and even that is quite high.
There are audio setups that you can use for real-time music collaboration which work quite well over relatively long distances (up to a few hundred miles depending on network conditions). Note that these will require you to take steps on your side to minimise local latency, and to prevent echo.
The one I have used the most is Jamulus, which is free.
There are some commercial services around which may be slightly easier to use, but aren’t going to give better latency, regardless of what their marketing seems to claim.
Cheers,
Keith