No, it won't slow your site because it is not using the resources of your server rather it's using the Zoom platform to render the meeting window. The load on your server will be similar to a normal page visit.