Do I need to install AgendaX directly on the Exchange server?

No, AgendaX can be installed on any IIS server.

An installation on Exchange Server is not required.

Also, no components need to be installed on the Exchange server.