Open the Plug in Speed app. Go to settings (the cog icon in the top right corner). There, wait a couple of seconds and you will see a message to install Plug in Speed in your theme. Follow the instructions and it will be automatically installed.

If you don't see the message, Plug in Speed is successfully installed in your theme.