Scale frame with layers proportionally

I want to scale this frame with all layers proportionally without autolayout etc. I have tried the scale tool (K), but the layers seem to scale weirdly. If anyone has any suggestions, please let me know.