Never used a fire stick. But I have 2 Chromecast TV's, 1 Apple TV 4K, and a few Roku Ultras. I like the Roku's the best for the ease of use. Their remotes are the best in that you can control what you need to control.
The Chromecast works OK. I got it since I wanted it completely hidden and I liked it over the Roku stick as I could stream video to it from my phone if I wanted. The remote is kinda small for me and the buttons are extremely sensitive which is annoying if you're up and around and want to put it in your pocket. It does freeze on occasion or takes a while to load an app at times.
The Apple is OK. Takes a bit longer to load. We don't use the other Apple products, so maybe that would change opinions to have music and everything on the device. Biggest issue is the Apple remote is straight garbage. I ended up with a Harmony remote on that. I don't know what I'd do now that Logitech discontinued those.
Roku's are solid. Nothing fancy, but they work and never buffer. I have the Ultra's so I could hard wire them. Got the rechargeable remote for TV and volume control along with private listening (a godsend if you have loud kids). Only gripe I can think of is no TV source selection on the remote if you have gaming systems hooked to the TV as well.