Yes, Native Ads (Recommendation Ads) can be put into a theme component. No plugin is required.
Showing at the top of a topic page was one file in a directory named javascripts/<plugin-name>/connectors/topic-above-post-stream/<plugin-name>.hbs. Paste the code for the ad into this file.
I’m not sure that the ad-plugin is needed for supporting Amazon Ads.