Why Aren’t There More Mainstream Sensor Manufacturers?

On reading this title, the first question that may have crossed your mind is - why? It's almost like car enthusiasts saying there needs to be more engine manufacturers in the industry. While I'm not saying it's a monopoly, camera sensor manufacturing is mainly done by a handful of companies these days.