Do i need to install an agent on every machine or instance that I need to manage in Ezeelogin?

No, there are no agents that needs to be installed on the remote server or cloud instances that needs to be managed. The only requirement is that you need to have an sshd packages installed and the sshd daemon running on the remote server/instance which is usually available by default with almost most every Linux distributions.