They really don’t fit the same niche as the little machines that you could plug into your tv and either load up some simple arcade games or produce your own using Basic.
That's not really a niche, though, any more. It's almost cheaper to just put an LCD on something than to interface with modern TVs.
If you want something more in that spirit regardless of hardware, maybe PICO-8? It's basically a (virtual) minimalist 8-bit computer / gaming console for the modern era.