The allowance for side loading isn’t inherently less secure, it is the participation in side loading. But then again it would also allow for many FOSS apps, something like an F droid equivalent for iOS, which could actually be more secure alternatives to their proprietary counterparts.