Layer visibility is a per page setting. You can have any layer turned on for some pages but not others. In the case of page numbers, you can put the auto text tag on a shared layer that is turned off for the first page. Look at the title block templates supplied with LayOut. Many of them demonstrate this. For example:
The cover sheet has the layer visibility set as shown.
It will be displayed on the second and subsequent pages, though. Note on the inside page the Cover Page title block and borders are not shown.
Note that layer name and page name have no impact on this. You can call your layers and your pages whatever you want. The ones shown in the template are just named as they are in hopes of making things clear.