'When did get like this' It has always had an element of this, big rooms have always been about common denominator. Wigan, Yate, Cleethorpes, Stafford. At all of these venues you could look at the DJ line up and would know much of what was going to be played if you went regularly. There was never a time when DJ's went on and played one new thing after another. Even Richard in his hayday would play 80 % of his set the same as the week before at Wigan. Also many new things were played in smaller clubs first and then pick up on by other DJ's, so it was and so it always will be.
As for the ego thing often it's reversed, well known DJ's will pick up on a thing and play it and then it's the ego of another DJ that is hurt. 'It's not fair, why is everyone talking about this or that record he palyed, I played it 2-10 years ago'. Stop worring about what other DJ's do and make sure that you do the very best you can, that is play good music and entertain the paying public.
Lastly 'Punters need to set them free..... Never gonna happen, the majority will always feel more comfortable with what they know, it's human nature.
Like Arthur I have been sacked, not asked back to many venues for playing what ever!! and I strongly believe in new things being played. The more records that are played, then the more memories we will have. But it has to be done in balance.