Should have probably checked this early but it appears viewing all comments IS actually an option thats in the core. You just need to view - yoursite/PageComment/rss. No need for custom code yays!
HAHAHA after all that! Oh well, got there anyways.
Thankfully this was documented on the wiki too, so no digging around the forum: