Looks like something is missing in the script, or I missed something myself.
Switch to a display layout that is based on the same TO as the blank layout.
I understand fine that executing the find in an empty layout will execute faster
Actually, not the Find is performed faster, but you avoid the overhead involved in displaying records you're (probably) not interested in when arriving at the layout.
Another possibility to achieve that is to enter Find mode immediately, then switch to the display layout and perform the Find.
But will the objects still need to transfer if you are in find mode when you switch to that layout ?