I think Elvis was very apprehensive for good reason-he remembered how in the 50s he had been mauled, scratched, attacked etc.....by loving fans.
Now into the 60s this calmed down some-but Elvis being the creature of habit just more or less stuck with the idea that he could not go out without being mobbed. Cut to 1968 when he and Steve Binder were discussing the 68 special and Binder asked Elvis what would happen it they stepped out onto the street in Burbank-so they stepped out-and Elvis just was not bothered, to the point that according to Binder he began to speak louder to draw attention to himself. So perhaps for a while Elvis was just gunshy......but.......after the 68 special and after the return to live shows once again Elvis had to truely worry about being mobbed and over zealous crowds.
I think the Colonel did worry about Elvis being hurt, I mean Elvis was his meal ticket