High-cadence rolling surveys, which continuously monitor patches of the sky (e.g., PS1, ZTF, ATLAS), have become standard among extra-galactic transient searches over the last two decades. These surveys have given us large statistical samples of supernovae (SNe) and other transients in the low-z range up to redshifts of 1. With JWST, going deeper and redder, we can now expand transient astronomy into the early, high-redshift universe, which offers us a direct approach for probing both the first stars and the epoch of reionization, as well as insights into rare high energy physics and explosion mechanisms (e.g., Pair-Instability SNe and Superluminous SNe). I will discuss our recent discovery of dozens of SNe up to z~5 with the JADES and COSMOS project, their spectroscopic follow-up, and what we can expect in the future with both JWST and Roman.