Small Town Boy moved from a British city of 7 million to a German town of 48,000.
The adjective "small" refers to the town, rather than to the boy or any part thereof.
It is a relative term, for the town itself is in fact a "Große Kreisstadt".
See also